2024-04-26T19:57:24.965 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T19:57:24.965 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145 --owner scheduled_rishabh@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --verbose -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/orig.config.yaml 2024-04-26T19:57:25.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T19:57:25.109 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145 branch: wip-rishabh-testing-20240426.111959 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7675145' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - Replacing daemon mds sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM1U+C9Z6C+EqROyVro6ABMvDrJVyQpiMqkrVKa27Ec8kC2avgB1mvtC4Q6Bz4w1qTFoBabvNIQE9gmCgnkRJZk= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBKdH3lPmUx2lAwwg+DinHuC04huUjnK1mf9EhkSXBJBzvnoM6zuzEsEXX5LEQFs4QtYG5YfrRZ4hza4cw3WHo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T19:57:25.110 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T19:57:25.110 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T19:57:25.111 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T19:57:25.112 INFO:teuthology.task.internal:Checking packages... 2024-04-26T19:57:25.138 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T19:57:25.138 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T19:57:25.139 INFO:teuthology.packaging:ref: None 2024-04-26T19:57:25.139 INFO:teuthology.packaging:tag: None 2024-04-26T19:57:25.139 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T19:57:25.139 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T19:57:25.139 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T19:57:25.286 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T19:57:25.289 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T19:57:25.298 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T19:57:25.298 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T19:57:25.305 INFO:teuthology.task.internal:Saving configuration 2024-04-26T19:57:25.325 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T19:57:25.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T19:57:25.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:54.995703', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGBt13erFGeOED3SSFi9Yww2QiPP49uq6fCEVHdPcgHN'} 2024-04-26T19:57:25.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 19:51:54.994164', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAY5I2S4DzmbW7+JUEEiXAPEwef7h7OvmT/UgLN5jBdl'} 2024-04-26T19:57:25.375 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T19:57:25.381 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T19:57:25.382 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-26T19:57:25.382 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T19:57:25.445 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8b885ab4c0>, signals=[15]) 2024-04-26T19:57:25.446 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T19:57:25.452 INFO:teuthology.task.internal:Opening connections... 2024-04-26T19:57:25.452 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T19:57:25.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T19:57:25.536 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T19:57:25.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T19:57:25.615 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T19:57:25.621 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-26T19:57:25.632 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-26T19:57:25.632 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T19:57:25.679 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T19:57:25.680 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T19:57:25.680 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T19:57:25.680 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2024-04-26T19:57:25.680 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-26T19:57:25.704 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-04-26T19:57:25.709 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-04-26T19:57:25.709 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04" 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T19:57:25.755 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T19:57:25.756 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T19:57:25.756 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T19:57:25.756 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy 2024-04-26T19:57:25.756 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-04-26T19:57:25.779 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T19:57:25.790 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T19:57:25.795 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T19:57:25.795 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-04-26T19:57:25.797 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-04-26T19:57:25.802 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T19:57:25.808 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T19:57:25.808 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-04-26T19:57:25.844 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-04-26T19:57:25.870 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T19:57:25.916 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T19:57:25.930 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T19:57:25.930 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-26T19:57:25.930 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-26T19:57:25.931 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T19:57:25.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T19:57:25.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-26T19:57:26.103 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T19:57:26.103 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T19:57:26.104 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T19:57:26.109 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2024-04-26T19:57:26.109 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T19:57:26.110 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T19:57:26.110 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-26T19:57:26.110 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T19:57:26.166 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T19:57:26.296 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T19:57:26.296 INFO:teuthology.orchestra.run.smithi016.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T19:57:26.296 INFO:teuthology.orchestra.run.smithi016.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T19:57:26.296 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-26T19:57:26.296 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git config --global init.defaultBranch 2024-04-26T19:57:26.296 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-26T19:57:26.297 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T19:57:26.297 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T19:57:26.297 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-26T19:57:26.297 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git branch -m 2024-04-26T19:57:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T19:57:26.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T19:57:26.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T19:57:26.421 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T19:58:56.374 INFO:teuthology.orchestra.run.smithi016.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T19:58:56.375 INFO:teuthology.orchestra.run.smithi016.stderr: * [new branch] main -> origin/main 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T19:58:56.411 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T19:58:56.413 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T19:58:56.414 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T19:58:56.414 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T19:58:56.414 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T19:58:56.414 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T19:58:56.414 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T19:58:56.414 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T19:58:56.414 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T19:58:56.416 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T19:58:56.417 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T19:58:56.418 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T19:58:56.419 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T19:59:00.905 INFO:teuthology.orchestra.run.smithi016.stderr:Updating files: 44% (1512/3390) Updating files: 45% (1526/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 58% (1990/3390) Updating files: 59% (2001/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2342/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 82% (2792/3390) Updating files: 83% (2814/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T19:59:00.910 INFO:teuthology.orchestra.run.smithi016.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T19:59:00.933 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T19:59:00.934 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T19:59:01.153 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T19:59:01.154 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T19:59:01.156 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-26T19:59:03.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26 19:59:02 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T19:59:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:FINISHED --2024-04-26 19:59:02-- 2024-04-26T19:59:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:Total wall clock time: 1.8s 2024-04-26T19:59:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:Downloaded: 1 files, 43M in 1.7s (25.0 MB/s) 2024-04-26T19:59:03.025 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T19:59:03.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T19:59:03.280 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T19:59:05.285 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T19:59:05.289 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T19:59:05.407 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T19:59:09.406 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T19:59:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:31.930 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-26T19:59:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T19:59:31.959 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-26T19:59:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:32.270 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T19:59:32.571 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T19:59:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T19:59:32.640 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T19:59:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T19:59:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T19:59:32.827 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T19:59:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-26T19:59:33.031 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T19:59:33.039 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T19:59:33.039 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T19:59:33.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:33.057 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:33.058 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:33.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T19:59:33.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T19:59:33.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T19:59:33.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T19:59:33.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T19:59:33.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T19:59:33.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T19:59:33.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T19:59:33.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T19:59:33.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T19:59:33.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T19:59:33.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T19:59:33.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T19:59:33.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T19:59:33.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T19:59:33.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T19:59:33.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T19:59:33.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T19:59:33.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T19:59:33.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T19:59:33.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T19:59:33.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T19:59:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T19:59:33.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T19:59:33.108 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T19:59:33.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T19:59:33.154 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T19:59:33.154 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T19:59:33.154 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T19:59:33.155 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T19:59:33.156 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T19:59:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T19:59:33.158 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T19:59:33.159 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T19:59:33.160 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T19:59:33.161 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T19:59:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T19:59:33.163 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T19:59:33.164 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T19:59:33.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T19:59:33.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T19:59:33.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T19:59:33.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T19:59:33.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T19:59:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T19:59:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T19:59:33.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T19:59:33.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T19:59:33.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T19:59:33.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T19:59:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T19:59:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T19:59:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T19:59:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T19:59:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T19:59:33.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T19:59:33.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T19:59:33.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T19:59:33.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T19:59:33.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T19:59:33.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T19:59:33.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T19:59:33.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T19:59:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T19:59:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T19:59:33.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T19:59:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T19:59:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T19:59:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T19:59:33.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T19:59:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T19:59:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T19:59:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T19:59:33.239 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T19:59:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T19:59:33.241 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T19:59:33.242 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T19:59:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T19:59:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T19:59:33.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T19:59:33.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T19:59:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T19:59:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T19:59:33.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T19:59:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T19:59:33.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T19:59:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T19:59:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T19:59:33.254 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T19:59:33.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T19:59:33.256 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T19:59:33.257 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T19:59:33.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T19:59:33.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T19:59:33.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T19:59:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T19:59:33.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T19:59:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T19:59:33.264 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T19:59:33.265 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T19:59:33.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T19:59:33.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T19:59:33.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T19:59:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T19:59:33.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T19:59:33.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T19:59:33.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T19:59:33.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T19:59:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T19:59:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T19:59:33.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T19:59:33.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T19:59:33.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T19:59:33.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T19:59:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T19:59:33.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T19:59:33.318 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T19:59:33.319 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T19:59:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T19:59:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T19:59:33.322 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T19:59:33.323 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T19:59:33.324 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T19:59:33.325 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T19:59:33.326 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T19:59:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T19:59:33.328 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T19:59:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T19:59:33.330 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T19:59:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T19:59:33.332 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T19:59:33.333 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T19:59:33.334 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T19:59:33.335 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T19:59:33.336 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T19:59:33.337 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T19:59:33.338 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T19:59:33.339 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T19:59:33.340 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T19:59:33.341 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T19:59:33.342 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T19:59:33.342 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T19:59:33.342 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T19:59:33.342 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T19:59:33.342 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T19:59:33.342 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T19:59:33.342 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T19:59:33.343 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T19:59:33.344 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T19:59:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T19:59:33.346 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T19:59:33.347 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T19:59:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T19:59:33.349 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T19:59:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T19:59:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T19:59:33.352 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T19:59:33.353 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T19:59:33.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T19:59:33.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T19:59:33.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T19:59:33.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T19:59:33.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T19:59:33.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T19:59:33.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T19:59:33.363 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T19:59:33.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T19:59:33.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T19:59:33.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T19:59:33.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T19:59:33.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T19:59:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T19:59:33.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T19:59:33.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T19:59:33.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T19:59:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T19:59:33.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T19:59:33.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T19:59:33.406 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T19:59:33.406 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T19:59:33.406 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T19:59:33.406 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T19:59:33.406 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T19:59:33.406 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T19:59:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T19:59:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T19:59:33.409 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T19:59:33.410 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T19:59:33.411 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T19:59:33.412 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T19:59:33.413 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T19:59:33.414 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T19:59:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T19:59:33.416 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T19:59:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T19:59:33.418 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T19:59:33.419 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T19:59:33.420 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T19:59:33.421 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T19:59:33.422 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T19:59:33.423 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T19:59:33.424 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T19:59:33.425 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T19:59:33.426 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T19:59:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T19:59:33.428 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T19:59:33.429 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T19:59:33.430 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T19:59:33.431 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T19:59:33.432 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T19:59:33.433 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T19:59:33.434 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T19:59:33.435 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T19:59:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T19:59:33.437 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T19:59:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T19:59:33.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T19:59:33.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T19:59:33.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T19:59:33.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T19:59:33.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T19:59:33.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T19:59:33.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T19:59:33.447 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:33.447 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:33.447 DEBUG:teuthology.orchestra.run.smithi016:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T19:59:33.488 INFO:teuthology.orchestra.run.smithi016.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T19:59:33.488 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T19:59:33.488 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T19:59:33.489 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T19:59:33.489 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:33.489 DEBUG:teuthology.orchestra.run.smithi016:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T19:59:33.532 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-26T19:59:33.925 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-26T19:59:33.926 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T19:59:33.932 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-26T19:59:34.107 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:34.114 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T19:59:34.347 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T19:59:34.353 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T19:59:34.397 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T19:59:34.402 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T19:59:34.663 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T19:59:34.663 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T19:59:34.663 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T19:59:34.679 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-26T20:00:05.799 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-26T20:00:05.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T20:00:05.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:00:24.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-26T20:00:33.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T20:00:33.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:01:33.359 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T20:01:45.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T20:01:45.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:01:45.639 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T20:01:46.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T20:01:46.397 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T20:01:46.397 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T20:01:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T20:01:46.445 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T20:01:46.445 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T20:01:46.446 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T20:01:47.447 DEBUG:teuthology.parallel:result is None 2024-04-26T20:01:47.447 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T20:01:47.457 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T20:01:47.457 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:01:47.460 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T20:01:47.467 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T20:01:47.473 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T20:01:47.479 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T20:01:47.479 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:01:47.513 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T20:01:47.754 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T20:01:47.761 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T20:01:47.762 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T20:01:47.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:01:47.767 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:01:47.771 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T20:01:47.837 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.850 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.858 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.866 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T20:01:47.868 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T20:01:47.875 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T20:01:47.875 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:01:47.878 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T20:01:47.925 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T20:01:47.935 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T20:01:47.936 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:01:47.948 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T20:01:47.972 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.006 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.058 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:01:48.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:01:48.124 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T20:01:48.129 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T20:01:48.176 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:01:48.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T20:01:48.248 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-04-26T20:01:48.251 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-04-26T20:01:48.347 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T20:01:48.356 INFO:teuthology.task.internal:Starting timer... 2024-04-26T20:01:48.356 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T20:01:48.391 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T20:01:48.400 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2024-04-26T20:01:48.400 DEBUG:teuthology.task.selinux:Excluding smithi192: OS 'ubuntu' does not support SELinux 2024-04-26T20:01:48.400 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T20:01:48.400 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T20:01:48.400 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T20:01:48.400 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T20:01:48.409 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T20:01:48.415 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T20:01:48.551 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T20:01:48.568 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T20:01:48.570 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T20:09:59.175 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-04-26T20:09:59.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T20:09:59.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:09:59.388 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T20:09:59.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T20:09:59.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-26T20:09:59.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T20:09:59.598 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-04-26T20:09:59.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-04-26T20:09:59.715 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T20:09:59.733 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T20:09:59.734 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:09:59.734 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:09:59.737 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T20:09:59.737 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:09:59.775 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T20:09:59.775 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Command line: ntpd -gq 2024-04-26T20:09:59.775 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: ---------------------------------------------------- 2024-04-26T20:09:59.775 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T20:09:59.775 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T20:09:59.775 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: corporation. Support and training for ntp-4 are 2024-04-26T20:09:59.775 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: available at https://www.nwtime.org/support 2024-04-26T20:09:59.776 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: ---------------------------------------------------- 2024-04-26T20:09:59.776 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: proto: precision = 0.045 usec (-24) 2024-04-26T20:09:59.777 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: basedate set to 2022-02-04 2024-04-26T20:09:59.777 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: gps base set to 2022-02-06 (week 2196) 2024-04-26T20:09:59.777 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:09:59.777 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:09:59.777 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:09:59.778 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:09:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T20:09:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T20:09:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T20:09:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Listen normally on 3 ens1f0 172.21.15.16:123 2024-04-26T20:09:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Listen normally on 4 lo [::1]:123 2024-04-26T20:09:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2024-04-26T20:09:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:09:59 ntpd[17108]: Listening on routing socket on fd #22 for interface updates 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Command line: ntpd -gq 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: ---------------------------------------------------- 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: corporation. Support and training for ntp-4 are 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: available at https://www.nwtime.org/support 2024-04-26T20:09:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: ---------------------------------------------------- 2024-04-26T20:09:59.787 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: proto: precision = 0.061 usec (-24) 2024-04-26T20:09:59.787 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: basedate set to 2022-02-04 2024-04-26T20:09:59.787 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: gps base set to 2022-02-06 (week 2196) 2024-04-26T20:09:59.787 INFO:teuthology.orchestra.run.smithi192.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:09:59.788 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T20:09:59.788 INFO:teuthology.orchestra.run.smithi192.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Listen normally on 3 enp3s0f1 172.21.15.192:123 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Listen normally on 4 lo [::1]:123 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8049%5]:123 2024-04-26T20:09:59.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:09:59 ntpd[17627]: Listening on routing socket on fd #22 for interface updates 2024-04-26T20:10:00.775 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:00.775 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:00 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:00 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:00 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:00.786 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:00 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:00.786 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:00 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:00.786 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:00 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:00.786 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:00 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:00.787 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:00 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:00.787 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:00 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:01.786 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:01 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:01.786 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:01 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.776 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:02.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:02.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:02.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:02 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:02.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:02 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:04.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:04 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:04.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:04.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:04.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:04.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:04.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:04.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:04 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:06.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.777 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 20:10:06 ntpd[17108]: ntpd: time slew +0.000927 s 2024-04-26T20:10:06.778 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew +0.000927s 2024-04-26T20:10:06.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T20:10:06.779 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 20:10:06 ntpd[17108]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T20:10:06.787 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.787 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.787 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T20:10:06.788 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T20:10:06.789 INFO:teuthology.orchestra.run.smithi192.stdout:26 Apr 20:10:06 ntpd[17627]: ntpd: time slew -0.001820 s 2024-04-26T20:10:06.789 INFO:teuthology.orchestra.run.smithi192.stdout:ntpd: time slew -0.001820s 2024-04-26T20:10:06.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T20:10:06.789 INFO:teuthology.orchestra.run.smithi192.stderr:26 Apr 20:10:06 ntpd[17627]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T20:10:06.868 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:10:06.868 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2024-04-26T20:10:06.868 INFO:teuthology.orchestra.run.smithi192.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.868 INFO:teuthology.orchestra.run.smithi192.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.868 INFO:teuthology.orchestra.run.smithi192.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.868 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.876 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:10:06.877 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-26T20:10:06.877 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.877 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.877 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.877 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T20:10:06.878 INFO:teuthology.run_tasks:Running task install... 2024-04-26T20:10:06.890 DEBUG:teuthology.task.install:project ceph 2024-04-26T20:10:06.890 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T20:10:06.890 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T20:10:06.890 INFO:teuthology.task.install:Using flavor: default 2024-04-26T20:10:06.897 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T20:10:06.897 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T20:10:06.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2024-04-26T20:10:06.898 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-key list | grep Ceph 2024-04-26T20:10:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T20:10:06.998 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T20:10:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T20:10:07.000 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T20:10:07.000 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T20:10:07.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:10:07.029 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T20:10:07.081 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T20:10:07.081 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T20:10:07.082 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T20:10:07.082 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T20:10:07.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:10:07.268 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T20:10:07.268 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:10:07.323 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T20:10:07.324 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:10:07.394 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:10:07.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T20:10:07.408 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2024-04-26T20:10:07.432 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:10:07.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T20:10:07.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-04-26T20:10:07.585 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T20:10:07.628 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T20:10:07.642 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T20:10:07.649 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T20:10:07.652 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T20:10:07.671 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T20:10:07.673 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T20:10:07.692 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T20:10:07.719 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T20:10:07.721 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T20:10:07.745 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T20:10:07.754 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T20:10:07.781 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T20:10:07.800 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T20:10:07.818 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T20:10:07.854 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T20:10:07.893 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T20:10:07.901 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T20:10:08.031 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 29.2 kB in 0s (65.7 kB/s) 2024-04-26T20:10:08.251 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 29.2 kB in 1s (50.7 kB/s) 2024-04-26T20:10:08.944 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2024-04-26T20:10:08.961 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:10:09.023 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2024-04-26T20:10:09.231 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2024-04-26T20:10:09.232 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2024-04-26T20:10:09.281 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T20:10:09.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:10:09.374 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T20:10:09.432 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:10:09.432 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:10:09.432 INFO:teuthology.orchestra.run.smithi192.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:10:09.433 INFO:teuthology.orchestra.run.smithi192.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:10:09.433 INFO:teuthology.orchestra.run.smithi192.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T20:10:09.433 INFO:teuthology.orchestra.run.smithi192.stdout: python2.7-minimal 2024-04-26T20:10:09.433 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:10:09.434 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2024-04-26T20:10:09.434 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T20:10:09.435 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T20:10:09.435 INFO:teuthology.orchestra.run.smithi192.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:10:09.435 INFO:teuthology.orchestra.run.smithi192.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T20:10:09.436 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T20:10:09.437 INFO:teuthology.orchestra.run.smithi192.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T20:10:09.438 INFO:teuthology.orchestra.run.smithi192.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T20:10:09.438 INFO:teuthology.orchestra.run.smithi192.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T20:10:09.438 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2024-04-26T20:10:09.438 INFO:teuthology.orchestra.run.smithi192.stdout: btrfs-tools 2024-04-26T20:10:09.544 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2024-04-26T20:10:09.544 INFO:teuthology.orchestra.run.smithi192.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T20:10:09.544 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T20:10:09.544 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T20:10:09.544 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T20:10:09.544 INFO:teuthology.orchestra.run.smithi192.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:10:09.544 INFO:teuthology.orchestra.run.smithi192.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T20:10:09.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T20:10:09.546 INFO:teuthology.orchestra.run.smithi192.stdout: socat unzip xmlstarlet zip 2024-04-26T20:10:09.551 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-26T20:10:09.551 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-26T20:10:09.610 INFO:teuthology.orchestra.run.smithi192.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T20:10:09.610 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 182 MB of archives. 2024-04-26T20:10:09.610 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T20:10:09.610 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T20:10:09.632 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T20:10:09.644 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T20:10:09.686 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T20:10:09.695 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T20:10:09.721 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T20:10:09.727 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T20:10:09.736 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:10:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:10:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:10:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:10:09.736 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T20:10:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T20:10:09.737 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:10:09.737 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-26T20:10:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T20:10:09.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T20:10:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:10:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T20:10:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T20:10:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T20:10:09.739 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T20:10:09.740 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-04-26T20:10:09.741 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2024-04-26T20:10:09.745 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T20:10:09.804 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T20:10:09.808 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T20:10:09.821 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T20:10:09.825 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T20:10:09.826 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T20:10:09.834 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T20:10:09.837 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T20:10:09.839 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T20:10:09.840 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T20:10:09.841 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T20:10:09.861 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T20:10:09.864 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T20:10:09.866 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T20:10:09.867 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T20:10:09.867 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T20:10:09.885 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T20:10:09.886 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T20:10:09.886 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T20:10:09.887 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T20:10:09.887 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T20:10:09.895 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T20:10:09.896 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-26T20:10:09.896 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T20:10:09.897 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T20:10:09.897 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T20:10:09.899 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T20:10:09.900 INFO:teuthology.orchestra.run.smithi016.stdout: socat unzip xmlstarlet zip 2024-04-26T20:10:09.906 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T20:10:09.907 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T20:10:09.912 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T20:10:09.912 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T20:10:09.913 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T20:10:09.927 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T20:10:09.929 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T20:10:09.929 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T20:10:09.930 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T20:10:09.932 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T20:10:09.948 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T20:10:09.948 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T20:10:09.958 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T20:10:09.958 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T20:10:09.960 INFO:teuthology.orchestra.run.smithi192.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T20:10:09.969 INFO:teuthology.orchestra.run.smithi192.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T20:10:09.971 INFO:teuthology.orchestra.run.smithi192.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T20:10:09.975 INFO:teuthology.orchestra.run.smithi192.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T20:10:09.976 INFO:teuthology.orchestra.run.smithi192.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T20:10:09.977 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T20:10:09.977 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 182 MB of archives. 2024-04-26T20:10:09.978 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T20:10:09.978 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T20:10:09.979 INFO:teuthology.orchestra.run.smithi192.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T20:10:09.990 INFO:teuthology.orchestra.run.smithi192.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T20:10:09.992 INFO:teuthology.orchestra.run.smithi192.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T20:10:09.997 INFO:teuthology.orchestra.run.smithi192.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T20:10:09.997 INFO:teuthology.orchestra.run.smithi192.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T20:10:09.998 INFO:teuthology.orchestra.run.smithi192.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T20:10:10.002 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T20:10:10.002 INFO:teuthology.orchestra.run.smithi192.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T20:10:10.015 INFO:teuthology.orchestra.run.smithi192.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T20:10:10.027 INFO:teuthology.orchestra.run.smithi192.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T20:10:10.028 INFO:teuthology.orchestra.run.smithi192.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T20:10:10.030 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T20:10:10.033 INFO:teuthology.orchestra.run.smithi192.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T20:10:10.036 INFO:teuthology.orchestra.run.smithi192.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T20:10:10.046 INFO:teuthology.orchestra.run.smithi192.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T20:10:10.073 INFO:teuthology.orchestra.run.smithi192.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T20:10:10.074 INFO:teuthology.orchestra.run.smithi192.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T20:10:10.075 INFO:teuthology.orchestra.run.smithi192.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T20:10:10.075 INFO:teuthology.orchestra.run.smithi192.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T20:10:10.076 INFO:teuthology.orchestra.run.smithi192.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T20:10:10.094 INFO:teuthology.orchestra.run.smithi192.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T20:10:10.096 INFO:teuthology.orchestra.run.smithi192.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T20:10:10.096 INFO:teuthology.orchestra.run.smithi192.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T20:10:10.096 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T20:10:10.111 INFO:teuthology.orchestra.run.smithi192.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T20:10:10.111 INFO:teuthology.orchestra.run.smithi192.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T20:10:10.119 INFO:teuthology.orchestra.run.smithi192.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T20:10:10.120 INFO:teuthology.orchestra.run.smithi192.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T20:10:10.120 INFO:teuthology.orchestra.run.smithi192.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T20:10:10.121 INFO:teuthology.orchestra.run.smithi192.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T20:10:10.124 INFO:teuthology.orchestra.run.smithi192.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T20:10:10.125 INFO:teuthology.orchestra.run.smithi192.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T20:10:10.128 INFO:teuthology.orchestra.run.smithi192.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T20:10:10.130 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T20:10:10.132 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T20:10:10.143 INFO:teuthology.orchestra.run.smithi192.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T20:10:10.144 INFO:teuthology.orchestra.run.smithi192.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T20:10:10.145 INFO:teuthology.orchestra.run.smithi192.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T20:10:10.152 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T20:10:10.164 INFO:teuthology.orchestra.run.smithi192.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T20:10:10.167 INFO:teuthology.orchestra.run.smithi192.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T20:10:10.167 INFO:teuthology.orchestra.run.smithi192.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T20:10:10.168 INFO:teuthology.orchestra.run.smithi192.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T20:10:10.168 INFO:teuthology.orchestra.run.smithi192.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T20:10:10.173 INFO:teuthology.orchestra.run.smithi192.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T20:10:10.173 INFO:teuthology.orchestra.run.smithi192.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T20:10:10.186 INFO:teuthology.orchestra.run.smithi192.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T20:10:10.186 INFO:teuthology.orchestra.run.smithi192.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T20:10:10.187 INFO:teuthology.orchestra.run.smithi192.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T20:10:10.207 INFO:teuthology.orchestra.run.smithi192.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T20:10:10.209 INFO:teuthology.orchestra.run.smithi192.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T20:10:10.210 INFO:teuthology.orchestra.run.smithi192.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T20:10:10.211 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T20:10:10.218 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T20:10:10.220 INFO:teuthology.orchestra.run.smithi192.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T20:10:10.220 INFO:teuthology.orchestra.run.smithi192.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T20:10:10.220 INFO:teuthology.orchestra.run.smithi192.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T20:10:10.222 INFO:teuthology.orchestra.run.smithi192.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T20:10:10.231 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T20:10:10.236 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T20:10:10.236 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T20:10:10.242 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T20:10:10.245 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T20:10:10.245 INFO:teuthology.orchestra.run.smithi192.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T20:10:10.246 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T20:10:10.248 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T20:10:10.261 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T20:10:10.270 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T20:10:10.272 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T20:10:10.274 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T20:10:10.274 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T20:10:10.274 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T20:10:10.275 INFO:teuthology.orchestra.run.smithi192.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T20:10:10.275 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T20:10:10.276 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T20:10:10.276 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T20:10:10.277 INFO:teuthology.orchestra.run.smithi192.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T20:10:10.282 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T20:10:10.292 INFO:teuthology.orchestra.run.smithi192.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T20:10:10.297 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T20:10:10.298 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T20:10:10.298 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T20:10:10.300 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T20:10:10.301 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T20:10:10.301 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T20:10:10.302 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T20:10:10.303 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T20:10:10.303 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T20:10:10.322 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T20:10:10.323 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T20:10:10.324 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T20:10:10.325 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T20:10:10.325 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T20:10:10.330 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T20:10:10.344 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T20:10:10.344 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T20:10:10.344 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T20:10:10.346 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T20:10:10.348 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T20:10:10.364 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T20:10:10.365 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T20:10:10.366 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T20:10:10.368 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T20:10:10.369 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T20:10:10.385 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T20:10:10.387 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T20:10:10.449 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T20:10:10.450 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T20:10:10.451 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T20:10:10.451 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T20:10:10.452 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T20:10:10.475 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T20:10:10.477 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T20:10:10.477 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T20:10:10.496 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T20:10:10.497 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T20:10:10.498 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T20:10:10.498 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T20:10:10.499 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T20:10:10.499 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T20:10:10.518 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T20:10:10.518 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T20:10:10.523 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T20:10:10.525 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T20:10:10.527 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T20:10:10.538 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T20:10:10.542 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T20:10:10.545 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T20:10:10.545 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T20:10:10.547 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T20:10:10.559 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T20:10:10.565 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T20:10:10.566 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T20:10:10.570 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T20:10:10.570 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T20:10:10.580 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T20:10:10.580 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T20:10:10.582 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T20:10:10.583 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T20:10:10.591 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T20:10:10.600 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T20:10:10.601 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T20:10:10.603 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T20:10:10.603 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T20:10:11.273 INFO:teuthology.orchestra.run.smithi192.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T20:10:11.351 INFO:teuthology.orchestra.run.smithi192.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T20:10:11.354 INFO:teuthology.orchestra.run.smithi192.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:10:11.355 INFO:teuthology.orchestra.run.smithi192.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T20:10:11.407 INFO:teuthology.orchestra.run.smithi192.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T20:10:11.620 INFO:teuthology.orchestra.run.smithi192.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T20:10:12.521 INFO:teuthology.orchestra.run.smithi192.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T20:10:12.522 INFO:teuthology.orchestra.run.smithi192.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T20:10:12.538 INFO:teuthology.orchestra.run.smithi192.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T20:10:12.580 INFO:teuthology.orchestra.run.smithi192.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T20:10:12.590 INFO:teuthology.orchestra.run.smithi192.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T20:10:12.592 INFO:teuthology.orchestra.run.smithi192.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T20:10:12.626 INFO:teuthology.orchestra.run.smithi192.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T20:10:12.919 INFO:teuthology.orchestra.run.smithi192.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T20:10:12.919 INFO:teuthology.orchestra.run.smithi192.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T20:10:14.016 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T20:10:14.946 INFO:teuthology.orchestra.run.smithi192.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:10:14.949 INFO:teuthology.orchestra.run.smithi192.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T20:10:14.953 INFO:teuthology.orchestra.run.smithi192.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T20:10:14.955 INFO:teuthology.orchestra.run.smithi192.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T20:10:14.955 INFO:teuthology.orchestra.run.smithi192.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T20:10:14.956 INFO:teuthology.orchestra.run.smithi192.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T20:10:15.309 INFO:teuthology.orchestra.run.smithi192.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T20:10:15.791 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T20:10:15.996 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 182 MB in 6s (31.2 MB/s) 2024-04-26T20:10:16.037 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T20:10:16.133 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T20:10:16.144 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T20:10:16.145 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T20:10:16.214 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-04-26T20:10:16.215 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T20:10:16.218 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T20:10:16.218 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T20:10:16.264 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T20:10:16.322 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T20:10:16.534 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T20:10:16.554 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T20:10:16.584 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:10:16.920 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T20:10:16.941 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T20:10:16.979 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T20:10:17.331 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T20:10:17.352 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T20:10:17.431 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:10:17.793 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T20:10:17.813 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T20:10:17.852 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:10:18.107 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T20:10:18.139 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T20:10:18.163 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T20:10:18.183 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T20:10:18.221 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:10:18.249 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T20:10:18.716 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T20:10:18.737 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:10:18.791 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:10:19.278 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T20:10:19.299 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:10:19.345 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:10:19.781 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T20:10:19.802 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:10:19.839 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:10:20.226 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T20:10:20.246 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T20:10:20.292 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:10:20.679 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librados2. 2024-04-26T20:10:20.699 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:20.745 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:21.298 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librbd1. 2024-04-26T20:10:21.319 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:21.364 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:21.825 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T20:10:21.846 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:21.884 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:22.228 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rados. 2024-04-26T20:10:22.249 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:22.295 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:22.366 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T20:10:22.831 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T20:10:22.855 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:10:22.865 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T20:10:22.906 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T20:10:22.926 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:22.972 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:22.998 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T20:10:23.325 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T20:10:23.345 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:23.391 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:23.474 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T20:10:23.719 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T20:10:23.740 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:23.777 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:24.139 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T20:10:24.159 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T20:10:24.206 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T20:10:24.550 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T20:10:24.570 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:24.616 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:24.884 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T20:10:24.884 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T20:10:24.926 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T20:10:25.036 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T20:10:25.057 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T20:10:25.070 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T20:10:25.103 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:10:25.106 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T20:10:25.108 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T20:10:25.223 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T20:10:25.430 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T20:10:25.442 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T20:10:25.480 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:10:25.646 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T20:10:25.646 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T20:10:25.792 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T20:10:25.803 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T20:10:25.841 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:10:26.153 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package lua5.1. 2024-04-26T20:10:26.174 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T20:10:26.211 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:10:26.531 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package lua-any. 2024-04-26T20:10:26.552 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T20:10:26.589 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T20:10:26.842 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package zip. 2024-04-26T20:10:26.853 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T20:10:26.891 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T20:10:27.170 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package unzip. 2024-04-26T20:10:27.191 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T20:10:27.220 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:10:27.796 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package luarocks. 2024-04-26T20:10:27.816 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T20:10:27.957 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:10:28.349 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librgw2. 2024-04-26T20:10:28.369 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:28.407 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:28.976 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T20:10:28.996 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:29.034 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:29.387 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T20:10:29.408 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T20:10:29.445 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:10:29.682 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T20:10:29.683 INFO:teuthology.orchestra.run.smithi016.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T20:10:29.697 INFO:teuthology.orchestra.run.smithi016.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T20:10:29.698 INFO:teuthology.orchestra.run.smithi016.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T20:10:29.698 INFO:teuthology.orchestra.run.smithi016.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T20:10:29.699 INFO:teuthology.orchestra.run.smithi016.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T20:10:29.765 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T20:10:29.786 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:29.823 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:30.276 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-common. 2024-04-26T20:10:30.297 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:30.334 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:31.216 INFO:teuthology.orchestra.run.smithi016.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T20:10:31.831 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-base. 2024-04-26T20:10:31.852 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:31.892 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 182 MB in 21s (8,522 kB/s) 2024-04-26T20:10:31.907 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:32.037 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T20:10:32.107 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T20:10:32.110 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T20:10:32.152 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T20:10:32.414 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T20:10:32.425 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T20:10:32.455 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:10:32.485 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T20:10:32.506 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T20:10:32.544 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:10:32.786 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T20:10:32.799 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T20:10:32.842 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T20:10:32.872 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T20:10:32.892 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T20:10:33.063 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:10:33.194 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T20:10:33.207 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T20:10:33.303 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:10:33.499 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T20:10:33.520 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T20:10:33.558 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:10:33.765 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T20:10:33.779 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T20:10:33.824 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:10:33.869 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T20:10:33.889 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T20:10:33.927 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:10:34.135 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T20:10:34.152 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T20:10:34.185 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:10:34.230 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T20:10:34.251 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T20:10:34.288 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:10:34.591 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T20:10:34.612 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T20:10:34.647 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T20:10:34.649 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T20:10:34.662 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:10:34.714 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:10:34.969 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-portend. 2024-04-26T20:10:34.989 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T20:10:35.027 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T20:10:35.117 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T20:10:35.131 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:10:35.367 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:10:35.397 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T20:10:35.417 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T20:10:35.463 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T20:10:35.687 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T20:10:35.701 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T20:10:35.745 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:10:35.833 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T20:10:35.853 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T20:10:35.899 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:10:36.173 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T20:10:36.188 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T20:10:36.240 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:10:36.295 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T20:10:36.315 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T20:10:36.353 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T20:10:36.560 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2024-04-26T20:10:36.574 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:36.644 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:36.664 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T20:10:36.685 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T20:10:36.722 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T20:10:36.984 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T20:10:37.005 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T20:10:37.021 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2024-04-26T20:10:37.036 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:37.042 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:10:37.071 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:37.370 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-mako. 2024-04-26T20:10:37.391 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T20:10:37.428 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:10:37.566 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T20:10:37.580 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:37.632 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:37.765 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T20:10:37.785 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T20:10:37.823 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:10:37.943 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2024-04-26T20:10:37.958 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:38.010 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:38.126 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T20:10:38.146 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T20:10:38.184 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:10:38.371 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T20:10:38.385 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:38.446 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:38.495 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webob. 2024-04-26T20:10:38.516 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T20:10:38.553 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:10:38.666 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T20:10:38.680 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:38.724 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:38.898 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T20:10:38.919 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T20:10:38.959 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:10:39.018 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T20:10:39.033 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:39.068 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:39.251 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T20:10:39.271 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T20:10:39.309 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:10:39.405 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T20:10:39.420 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T20:10:39.455 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T20:10:39.645 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-paste. 2024-04-26T20:10:39.666 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T20:10:39.703 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:10:39.716 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T20:10:39.730 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:39.774 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:40.023 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T20:10:40.035 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T20:10:40.073 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:10:40.119 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T20:10:40.134 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T20:10:40.177 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:10:40.359 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T20:10:40.380 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T20:10:40.417 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:10:40.496 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T20:10:40.511 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T20:10:40.563 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:10:40.765 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T20:10:40.785 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T20:10:40.822 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T20:10:40.900 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T20:10:40.914 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T20:10:40.958 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:10:41.117 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T20:10:41.138 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T20:10:41.175 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:10:41.245 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2024-04-26T20:10:41.259 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T20:10:41.295 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:10:41.547 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T20:10:41.568 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T20:10:41.605 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T20:10:41.606 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2024-04-26T20:10:41.621 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T20:10:41.681 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T20:10:41.934 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2024-04-26T20:10:41.949 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T20:10:41.967 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-idna. 2024-04-26T20:10:41.987 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T20:10:41.992 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T20:10:42.025 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T20:10:42.279 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2024-04-26T20:10:42.293 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T20:10:42.311 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T20:10:42.323 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T20:10:42.329 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:10:42.352 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:10:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-requests. 2024-04-26T20:10:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T20:10:42.750 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2024-04-26T20:10:42.761 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T20:10:42.800 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:10:43.056 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:10:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2024-04-26T20:10:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:44.102 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T20:10:44.123 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T20:10:44.160 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:10:44.471 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T20:10:44.492 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:44.529 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:44.560 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T20:10:44.572 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:44.602 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:44.918 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T20:10:44.939 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:44.946 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T20:10:44.958 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T20:10:44.985 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:44.997 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:10:45.288 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T20:10:45.309 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T20:10:45.316 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T20:10:45.328 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:45.345 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:10:45.366 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:45.682 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T20:10:45.703 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T20:10:45.732 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T20:10:45.953 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2024-04-26T20:10:45.965 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:45.995 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:46.060 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T20:10:46.081 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:46.118 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:46.522 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T20:10:46.543 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:46.580 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:47.101 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2024-04-26T20:10:47.112 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:47.142 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T20:10:47.159 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:47.163 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:47.200 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:47.763 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T20:10:47.774 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T20:10:47.813 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:10:48.091 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T20:10:48.103 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T20:10:48.133 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:10:48.387 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph. 2024-04-26T20:10:48.408 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:48.445 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:48.511 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T20:10:48.526 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T20:10:48.578 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:10:48.764 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T20:10:48.786 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:48.864 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:48.931 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T20:10:48.947 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T20:10:48.989 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:10:49.218 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T20:10:49.239 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:49.276 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:49.342 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T20:10:49.359 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T20:10:49.409 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:10:49.662 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephadm. 2024-04-26T20:10:49.674 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:49.712 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:49.787 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T20:10:49.802 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T20:10:49.854 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T20:10:50.041 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T20:10:50.062 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T20:10:50.107 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T20:10:50.207 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2024-04-26T20:10:50.221 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T20:10:50.265 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T20:10:50.426 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T20:10:50.438 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:10:50.476 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:10:50.643 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T20:10:50.657 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T20:10:50.709 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T20:10:51.096 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T20:10:51.110 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T20:10:51.162 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:10:51.507 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-babel. 2024-04-26T20:10:51.528 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:10:51.551 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T20:10:51.556 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:10:51.566 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T20:10:51.618 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T20:10:51.851 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T20:10:51.872 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T20:10:51.909 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:10:52.013 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T20:10:52.027 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T20:10:52.079 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T20:10:52.238 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T20:10:52.259 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:52.296 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:52.449 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T20:10:52.463 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T20:10:52.515 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:10:52.641 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T20:10:52.662 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T20:10:52.699 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T20:10:52.885 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2024-04-26T20:10:52.900 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T20:10:52.952 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:10:53.003 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-routes. 2024-04-26T20:10:53.024 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T20:10:53.061 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:10:53.347 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T20:10:53.361 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T20:10:53.404 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:10:53.414 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T20:10:53.436 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:53.473 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T20:10:53.764 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T20:10:53.816 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:10:54.194 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2024-04-26T20:10:54.209 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T20:10:54.260 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:10:54.722 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T20:10:54.736 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T20:10:54.791 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:10:55.020 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T20:10:55.041 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T20:10:55.078 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:10:55.174 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T20:10:55.189 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T20:10:55.241 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:10:55.553 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2024-04-26T20:10:55.567 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T20:10:55.607 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T20:10:55.610 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:10:55.628 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T20:10:55.665 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:10:56.035 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T20:10:56.056 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T20:10:56.120 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T20:10:56.135 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T20:10:56.172 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:10:56.187 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:10:56.457 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T20:10:56.467 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T20:10:56.478 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T20:10:56.481 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T20:10:56.506 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:10:56.525 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:10:56.828 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T20:10:56.843 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T20:10:56.886 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T20:10:57.198 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T20:10:57.212 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T20:10:57.247 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:10:57.257 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T20:10:57.279 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:57.324 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:57.577 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T20:10:57.592 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T20:10:57.627 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T20:10:57.930 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2024-04-26T20:10:57.945 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T20:10:57.988 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T20:10:58.260 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T20:10:58.282 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T20:10:58.341 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T20:10:58.344 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T20:10:58.356 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T20:10:58.399 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:10:58.622 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T20:10:58.643 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T20:10:58.680 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:10:58.728 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2024-04-26T20:10:58.743 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T20:10:58.786 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:10:59.001 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T20:10:59.022 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T20:10:59.067 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:10:59.097 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T20:10:59.112 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T20:10:59.155 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:10:59.362 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T20:10:59.383 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T20:10:59.411 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T20:10:59.451 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T20:10:59.466 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:10:59.534 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:10:59.774 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T20:10:59.795 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T20:10:59.832 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T20:10:59.889 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T20:10:59.903 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:10:59.938 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:00.152 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T20:11:00.173 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T20:11:00.219 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:11:00.249 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T20:11:00.263 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T20:11:00.308 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:11:00.530 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T20:11:00.551 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T20:11:00.588 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T20:11:00.594 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T20:11:00.609 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T20:11:00.652 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T20:11:00.908 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T20:11:00.921 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T20:11:00.958 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:11:01.005 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T20:11:01.020 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:01.055 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:01.375 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T20:11:01.390 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:01.433 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:01.664 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T20:11:01.686 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:01.730 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:02.054 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T20:11:02.069 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:02.083 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T20:11:02.105 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T20:11:02.111 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:02.150 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:11:02.428 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T20:11:02.450 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:11:02.478 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:11:02.731 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package jq. 2024-04-26T20:11:02.752 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:11:02.789 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T20:11:02.940 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2024-04-26T20:11:02.955 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:02.998 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:03.058 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package socat. 2024-04-26T20:11:03.070 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T20:11:03.108 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:11:03.284 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T20:11:03.299 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:03.350 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:03.412 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T20:11:03.433 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T20:11:03.470 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:11:03.721 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T20:11:03.735 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:03.778 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:03.841 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-test. 2024-04-26T20:11:03.863 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:03.908 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:04.273 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2024-04-26T20:11:04.288 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:04.331 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:04.635 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T20:11:04.649 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T20:11:04.684 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T20:11:05.054 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T20:11:05.068 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:11:05.112 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:11:06.108 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2024-04-26T20:11:06.122 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T20:11:06.158 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:11:06.329 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T20:11:06.350 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:06.395 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:06.453 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T20:11:06.467 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T20:11:06.503 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:11:06.781 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T20:11:06.795 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:06.808 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T20:11:06.829 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:06.830 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:06.866 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:07.169 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T20:11:07.176 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T20:11:07.190 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T20:11:07.190 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T20:11:07.226 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T20:11:07.236 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T20:11:07.496 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T20:11:07.509 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:07.520 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2024-04-26T20:11:07.535 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T20:11:07.546 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:07.578 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:11:07.866 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T20:11:07.888 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:07.923 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T20:11:07.924 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:07.938 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:07.981 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:08.161 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T20:11:08.182 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:08.218 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:08.530 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T20:11:08.551 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T20:11:08.596 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:11:08.960 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T20:11:08.981 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T20:11:09.026 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:11:09.312 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T20:11:09.325 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T20:11:09.370 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:11:09.389 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T20:11:09.410 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T20:11:09.447 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:11:09.819 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package pkg-config. 2024-04-26T20:11:09.841 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T20:11:09.857 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T20:11:09.871 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T20:11:09.885 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:11:09.906 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:11:10.205 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T20:11:10.218 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T20:11:10.255 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:11:10.269 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T20:11:10.283 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T20:11:10.421 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:11:10.684 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T20:11:10.705 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T20:11:10.724 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T20:11:10.738 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T20:11:10.750 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T20:11:10.782 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:11:11.053 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T20:11:11.075 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T20:11:11.119 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T20:11:11.457 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T20:11:11.478 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T20:11:11.523 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:11:11.650 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T20:11:11.664 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:11.699 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:11.801 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T20:11:11.820 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T20:11:11.859 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T20:11:12.187 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-py. 2024-04-26T20:11:12.209 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T20:11:12.245 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T20:11:12.557 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T20:11:12.570 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T20:11:12.599 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:11:12.711 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T20:11:12.726 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T20:11:12.761 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T20:11:13.014 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T20:11:13.029 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T20:11:13.070 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T20:11:13.072 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:11:13.092 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T20:11:13.136 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:11:13.400 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T20:11:13.416 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T20:11:13.456 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-toml. 2024-04-26T20:11:13.478 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T20:11:13.492 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:11:13.522 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T20:11:13.828 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T20:11:13.834 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T20:11:13.843 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T20:11:13.855 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T20:11:13.886 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T20:11:13.900 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:11:14.207 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T20:11:14.221 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T20:11:14.254 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T20:11:14.265 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T20:11:14.276 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T20:11:14.320 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:11:14.594 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T20:11:14.598 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T20:11:14.608 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T20:11:14.611 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T20:11:14.652 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:11:14.682 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:11:14.996 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T20:11:15.011 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T20:11:15.055 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T20:11:15.333 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T20:11:15.348 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T20:11:15.383 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:11:15.686 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package radosgw. 2024-04-26T20:11:15.708 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:15.752 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:16.071 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T20:11:16.085 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:16.122 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:16.407 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T20:11:16.421 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T20:11:16.465 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:11:16.556 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T20:11:16.568 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:16.605 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:16.827 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T20:11:16.843 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:11:16.885 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:11:16.917 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T20:11:17.155 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2024-04-26T20:11:17.170 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T20:11:17.194 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:11:17.205 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T20:11:17.304 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:11:17.441 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2024-04-26T20:11:17.456 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T20:11:17.491 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:11:17.551 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T20:11:17.794 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T20:11:17.809 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T20:11:17.852 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:11:17.883 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T20:11:18.198 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2024-04-26T20:11:18.212 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:18.256 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:18.355 INFO:teuthology.orchestra.run.smithi192.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T20:11:18.422 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:19.022 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user cephadm....done 2024-04-26T20:11:19.195 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:11:19.539 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:11:19.815 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:11:19.966 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:11:20.242 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T20:11:20.378 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T20:11:20.393 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:20.436 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:20.510 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:11:20.653 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T20:11:20.815 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T20:11:20.829 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:20.873 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:20.963 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:11:21.192 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T20:11:21.208 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T20:11:21.242 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T20:11:21.349 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T20:11:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T20:11:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:21.608 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T20:11:21.831 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T20:11:21.846 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T20:11:21.884 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T20:11:21.889 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:22.141 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T20:11:22.152 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:11:22.157 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:22.200 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:22.421 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:11:22.494 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T20:11:22.510 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T20:11:22.544 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:11:22.710 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:11:22.874 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T20:11:22.889 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T20:11:22.923 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:11:22.973 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:11:23.209 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:23.302 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T20:11:23.318 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T20:11:23.360 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:11:23.469 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:11:23.603 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:11:23.754 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T20:11:23.774 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2024-04-26T20:11:23.789 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T20:11:23.832 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:11:24.038 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:11:24.152 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T20:11:24.164 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:11:24.167 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T20:11:24.227 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:11:24.416 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:11:24.663 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T20:11:24.678 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T20:11:24.722 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T20:11:24.804 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T20:11:24.838 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T20:11:24.894 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:11:25.024 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T20:11:25.039 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T20:11:25.053 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T20:11:25.082 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T20:11:25.419 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T20:11:25.434 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T20:11:25.454 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:11:25.469 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:11:25.580 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T20:11:25.730 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T20:11:25.745 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T20:11:25.780 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T20:11:25.848 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:11:26.108 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2024-04-26T20:11:26.123 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T20:11:26.124 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:11:26.157 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T20:11:26.443 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T20:11:26.511 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T20:11:26.526 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T20:11:26.568 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:11:26.569 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:11:27.007 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T20:11:27.021 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T20:11:27.065 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:11:27.220 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:11:27.384 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2024-04-26T20:11:27.400 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T20:11:27.442 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T20:11:27.488 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:11:27.639 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:11:27.746 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T20:11:27.761 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T20:11:27.790 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:11:27.795 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:11:28.100 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T20:11:28.107 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T20:11:28.123 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T20:11:28.165 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:11:28.443 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T20:11:28.458 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T20:11:28.493 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T20:11:28.501 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:11:28.777 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:11:29.162 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:11:29.264 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2024-04-26T20:11:29.278 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:29.322 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:29.463 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T20:11:29.940 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:11:29.983 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T20:11:29.999 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T20:11:30.041 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:30.275 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:11:30.398 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T20:11:30.542 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:11:30.668 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:30.699 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T20:11:30.833 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T20:11:30.978 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T20:11:31.101 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T20:11:31.337 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:11:31.525 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T20:11:32.115 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T20:11:32.129 INFO:teuthology.orchestra.run.smithi016.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T20:11:32.193 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:32.543 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:11:32.763 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2024-04-26T20:11:32.795 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:11:32.891 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T20:11:32.929 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T20:11:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T20:11:33.213 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:11:33.364 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:11:33.444 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T20:11:33.515 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:11:33.570 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T20:11:33.825 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:11:33.838 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T20:11:34.085 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T20:11:34.089 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T20:11:34.215 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T20:11:34.394 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:11:34.520 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:11:34.550 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T20:11:34.838 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:11:34.927 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T20:11:35.097 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T20:11:35.220 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T20:11:35.357 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T20:11:35.480 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T20:11:35.625 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:11:35.764 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T20:11:35.876 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T20:11:35.999 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T20:11:36.144 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:11:36.259 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T20:11:36.303 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T20:11:36.535 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T20:11:36.596 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:11:36.747 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:11:36.803 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:37.048 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:11:37.062 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T20:11:37.171 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T20:11:37.280 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T20:11:37.358 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:11:37.548 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T20:11:37.600 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:11:37.657 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T20:11:37.726 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:11:37.877 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:11:37.959 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T20:11:37.985 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T20:11:38.229 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:11:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T20:11:38.355 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:11:38.381 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T20:11:38.437 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T20:11:38.546 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T20:11:38.732 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:11:38.914 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T20:11:38.991 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T20:11:39.040 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T20:11:39.134 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T20:11:39.308 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T20:11:39.402 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:11:39.536 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:11:39.584 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T20:11:39.902 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T20:11:39.904 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:11:40.030 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T20:11:40.213 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:11:40.498 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T20:11:40.734 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T20:11:40.755 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T20:11:41.014 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T20:11:41.023 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T20:11:41.132 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T20:11:41.233 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T20:11:41.576 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T20:11:41.695 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:11:41.979 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:11:41.994 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T20:11:42.373 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T20:11:42.560 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T20:11:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:11:42.980 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T20:11:43.018 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:11:43.144 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:43.270 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:43.289 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T20:11:43.396 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:11:43.615 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T20:11:43.724 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:43.825 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:43.959 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T20:11:43.967 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T20:11:44.252 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T20:11:44.385 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:44.395 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:44.546 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:44.695 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T20:11:44.805 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:11:44.805 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:11:45.030 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T20:11:45.364 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:45.465 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:45.566 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:45.675 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:45.802 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:11:46.311 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T20:11:46.554 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:11:46.672 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T20:11:46.948 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T20:11:47.038 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:47.049 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T20:11:47.158 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T20:11:47.214 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:47.366 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:47.468 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T20:11:47.516 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:47.651 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:47.770 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T20:11:47.777 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:48.028 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:11:48.129 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T20:11:48.352 INFO:teuthology.orchestra.run.smithi192.stdout:Adding group ceph....done 2024-04-26T20:11:48.439 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T20:11:48.699 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T20:11:48.805 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user ceph....done 2024-04-26T20:11:48.958 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T20:11:48.965 INFO:teuthology.orchestra.run.smithi192.stdout:Setting system user ceph properties....done 2024-04-26T20:11:48.978 INFO:teuthology.orchestra.run.smithi192.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T20:11:49.124 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T20:11:49.259 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T20:11:49.497 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T20:11:49.527 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T20:11:49.803 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T20:11:49.903 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T20:11:49.995 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:50.189 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T20:11:50.198 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:11:50.198 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:11:50.381 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T20:11:50.674 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T20:11:50.698 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:50.807 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:50.992 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T20:11:51.258 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:11:51.258 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:11:51.259 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T20:11:51.402 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T20:11:51.511 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T20:11:51.617 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T20:11:51.863 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T20:11:51.873 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T20:11:52.391 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T20:11:52.441 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T20:11:52.658 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T20:11:52.809 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T20:11:53.004 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:53.077 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T20:11:53.203 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T20:11:53.251 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:11:53.251 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:11:53.529 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T20:11:53.773 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:53.822 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T20:11:54.009 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:11:54.009 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:11:54.115 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T20:11:54.335 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T20:11:54.541 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:54.611 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T20:11:54.870 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T20:11:54.889 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:11:54.889 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:11:55.147 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T20:11:55.468 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:55.557 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T20:11:55.593 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:55.745 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:55.858 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T20:11:55.957 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:11:55.957 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:11:56.219 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T20:11:56.320 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:56.421 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:56.498 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:56.572 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T20:11:56.655 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:56.806 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:56.909 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:57.008 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:57.035 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:57.161 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T20:11:57.361 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:11:57.446 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:57.478 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:11:57.547 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:57.631 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:11:57.673 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:57.909 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:11:57.909 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T20:11:58.422 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:11:58.557 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:58.683 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:58.809 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:58.935 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:11:59.078 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T20:11:59.109 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:11:59.112 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T20:11:59.173 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2024-04-26T20:11:59.375 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2024-04-26T20:11:59.376 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2024-04-26T20:11:59.566 INFO:teuthology.orchestra.run.smithi192.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T20:11:59.566 INFO:teuthology.orchestra.run.smithi192.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T20:11:59.567 INFO:teuthology.orchestra.run.smithi192.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T20:11:59.567 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:11:59.567 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:11:59.567 INFO:teuthology.orchestra.run.smithi192.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:11:59.567 INFO:teuthology.orchestra.run.smithi192.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:11:59.567 INFO:teuthology.orchestra.run.smithi192.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T20:11:59.568 INFO:teuthology.orchestra.run.smithi192.stdout: python2.7-minimal 2024-04-26T20:11:59.568 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:11:59.568 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2024-04-26T20:11:59.568 INFO:teuthology.orchestra.run.smithi192.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T20:11:59.568 INFO:teuthology.orchestra.run.smithi192.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T20:11:59.569 INFO:teuthology.orchestra.run.smithi192.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T20:11:59.569 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T20:11:59.569 INFO:teuthology.orchestra.run.smithi192.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:11:59.570 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2024-04-26T20:11:59.570 INFO:teuthology.orchestra.run.smithi192.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T20:11:59.570 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T20:11:59.570 INFO:teuthology.orchestra.run.smithi192.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T20:11:59.610 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2024-04-26T20:11:59.611 INFO:teuthology.orchestra.run.smithi192.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T20:11:59.611 INFO:teuthology.orchestra.run.smithi192.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T20:11:59.612 INFO:teuthology.orchestra.run.smithi192.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T20:11:59.612 INFO:teuthology.orchestra.run.smithi192.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T20:11:59.612 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T20:11:59.612 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T20:11:59.612 INFO:teuthology.orchestra.run.smithi192.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:11:59.613 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2024-04-26T20:11:59.613 INFO:teuthology.orchestra.run.smithi192.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T20:11:59.681 INFO:teuthology.orchestra.run.smithi192.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T20:11:59.681 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 55.7 MB of archives. 2024-04-26T20:11:59.681 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T20:11:59.681 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T20:12:00.009 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T20:12:00.058 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T20:12:00.140 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T20:12:00.142 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T20:12:00.143 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T20:12:00.169 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T20:12:00.171 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T20:12:00.186 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T20:12:00.190 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T20:12:00.191 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T20:12:00.195 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T20:12:00.211 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T20:12:00.316 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T20:12:00.317 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T20:12:00.320 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T20:12:00.432 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:00.558 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:00.684 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:00.810 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:00.936 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:00.938 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T20:12:00.942 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T20:12:00.942 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T20:12:00.947 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T20:12:00.948 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T20:12:00.956 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T20:12:00.959 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T20:12:00.973 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T20:12:00.974 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T20:12:01.008 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T20:12:01.008 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T20:12:01.020 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T20:12:01.040 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T20:12:01.045 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T20:12:01.045 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T20:12:01.046 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T20:12:01.046 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T20:12:01.053 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:01.067 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T20:12:01.070 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T20:12:01.375 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T20:12:01.376 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T20:12:01.419 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T20:12:01.419 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T20:12:01.419 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T20:12:01.419 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T20:12:01.433 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T20:12:01.433 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T20:12:01.573 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2024-04-26T20:12:01.837 INFO:teuthology.orchestra.run.smithi192.stdout:Preconfiguring packages ... 2024-04-26T20:12:01.988 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 55.7 MB in 2s (30.7 MB/s) 2024-04-26T20:12:02.033 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2024-04-26T20:12:02.202 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2024-04-26T20:12:02.219 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T20:12:02.370 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T20:12:02.455 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-26T20:12:02.459 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:12:02.604 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:12:02.805 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T20:12:03.264 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T20:12:03.522 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:03.753 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:12:03.753 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T20:12:04.250 INFO:teuthology.orchestra.run.smithi192.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T20:12:04.398 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:04.484 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package flex. 2024-04-26T20:12:04.524 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:04.563 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-26T20:12:04.567 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T20:12:04.624 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T20:12:05.097 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:12:05.097 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T20:12:05.151 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:12:05.329 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T20:12:05.742 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:05.746 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:12:06.113 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T20:12:06.287 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-26T20:12:06.292 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:12:06.420 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:12:06.803 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:06.822 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:12:06.951 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:12:07.068 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:12:07.068 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T20:12:07.343 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:12:07.752 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:07.761 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package bison. 2024-04-26T20:12:07.848 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-26T20:12:07.853 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T20:12:07.888 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:12:08.331 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T20:12:08.352 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T20:12:08.397 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:12:08.518 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:12:08.519 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T20:12:08.742 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package dump. 2024-04-26T20:12:08.763 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T20:12:08.808 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T20:12:09.071 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package indent. 2024-04-26T20:12:09.083 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:09.112 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:12:09.185 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:09.423 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T20:12:09.435 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T20:12:09.473 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:12:09.519 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:12:09.519 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T20:12:09.793 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T20:12:09.816 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T20:12:09.860 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:12:10.113 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T20:12:10.126 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T20:12:10.153 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:10.154 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:12:10.263 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:10.431 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:10.532 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T20:12:10.555 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T20:12:10.599 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:12:10.655 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:12:10.656 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T20:12:10.854 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T20:12:10.876 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T20:12:10.920 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:12:11.164 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T20:12:11.187 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T20:12:11.222 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T20:12:11.298 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:11.441 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:11.525 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T20:12:11.548 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T20:12:11.592 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:11.592 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:12:11.743 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T20:12:12.121 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:12:12.247 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:12:12.407 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:12:13.132 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:12:14.042 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:12:14.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T20:12:14.097 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T20:12:14.119 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:12:14.123 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T20:12:14.163 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:12:14.308 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-26T20:12:14.308 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-26T20:12:14.399 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T20:12:14.412 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:12:14.449 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:12:14.488 INFO:teuthology.orchestra.run.smithi016.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T20:12:14.488 INFO:teuthology.orchestra.run.smithi016.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T20:12:14.488 INFO:teuthology.orchestra.run.smithi016.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T20:12:14.488 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T20:12:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T20:12:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T20:12:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T20:12:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T20:12:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T20:12:14.489 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T20:12:14.490 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-26T20:12:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T20:12:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T20:12:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T20:12:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T20:12:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:12:14.492 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-26T20:12:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T20:12:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T20:12:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T20:12:14.548 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-26T20:12:14.549 INFO:teuthology.orchestra.run.smithi016.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T20:12:14.549 INFO:teuthology.orchestra.run.smithi016.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T20:12:14.549 INFO:teuthology.orchestra.run.smithi016.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T20:12:14.549 INFO:teuthology.orchestra.run.smithi016.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T20:12:14.549 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T20:12:14.550 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T20:12:14.550 INFO:teuthology.orchestra.run.smithi016.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T20:12:14.550 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2024-04-26T20:12:14.551 INFO:teuthology.orchestra.run.smithi016.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T20:12:14.764 INFO:teuthology.orchestra.run.smithi016.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T20:12:14.764 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 55.7 MB of archives. 2024-04-26T20:12:14.764 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T20:12:14.764 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T20:12:14.777 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T20:12:14.799 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:12:14.843 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:12:15.221 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T20:12:15.244 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T20:12:15.288 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:12:15.446 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T20:12:15.463 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T20:12:15.596 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T20:12:15.599 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T20:12:15.602 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T20:12:15.658 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T20:12:15.658 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T20:12:15.660 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T20:12:15.664 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T20:12:15.667 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T20:12:15.667 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T20:12:15.679 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:12:15.807 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:12:15.835 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T20:12:16.128 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T20:12:16.138 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T20:12:16.142 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T20:12:16.160 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T20:12:16.182 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:16.227 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T20:12:16.227 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:16.613 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T20:12:16.635 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:16.679 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:12:16.991 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T20:12:17.013 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:17.057 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:12:17.276 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T20:12:17.289 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:12:17.326 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:12:17.872 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T20:12:17.894 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T20:12:17.938 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:12:18.266 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package modemmanager. 2024-04-26T20:12:18.288 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:12:18.324 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:12:19.208 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager. 2024-04-26T20:12:19.231 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:12:19.315 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:12:19.973 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ppp. 2024-04-26T20:12:19.995 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T20:12:20.307 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:12:20.619 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T20:12:20.641 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T20:12:20.685 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T20:12:20.980 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T20:12:21.003 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T20:12:21.047 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T20:12:21.350 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T20:12:21.372 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T20:12:21.416 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T20:12:21.720 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T20:12:21.745 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:21.778 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:22.433 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T20:12:22.456 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T20:12:22.517 INFO:teuthology.orchestra.run.smithi192.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T20:12:22.539 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-common (238) ... 2024-04-26T20:12:22.973 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T20:12:22.995 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:23.035 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:24.151 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T20:12:24.158 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T20:12:24.159 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T20:12:24.184 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T20:12:24.185 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T20:12:24.227 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T20:12:24.384 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql. 2024-04-26T20:12:24.397 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T20:12:24.407 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T20:12:24.459 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql (14+238) ... 2024-04-26T20:12:24.703 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T20:12:24.725 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T20:12:24.769 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T20:12:25.013 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T20:12:25.022 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T20:12:25.023 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T20:12:25.026 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T20:12:25.080 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T20:12:25.203 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T20:12:25.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T20:12:25.242 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T20:12:25.305 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T20:12:25.311 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T20:12:25.312 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T20:12:25.313 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T20:12:25.313 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T20:12:25.399 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T20:12:25.421 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T20:12:25.466 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:12:25.518 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T20:12:25.752 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package tcl. 2024-04-26T20:12:25.774 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T20:12:25.822 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T20:12:25.940 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T20:12:26.180 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T20:12:26.202 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T20:12:26.246 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:12:26.617 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T20:12:26.639 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T20:12:26.683 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T20:12:26.693 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T20:12:26.694 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T20:12:26.694 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T20:12:26.694 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T20:12:26.694 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T20:12:26.695 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T20:12:26.727 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T20:12:26.727 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T20:12:27.095 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T20:12:27.117 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T20:12:27.125 INFO:teuthology.orchestra.run.smithi016.stdout:Preconfiguring packages ... 2024-04-26T20:12:27.169 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:12:27.293 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 55.7 MB in 12s (4,580 kB/s) 2024-04-26T20:12:27.455 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T20:12:27.583 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T20:12:27.588 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:12:27.667 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T20:12:27.741 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:12:27.802 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:12:27.978 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:28.129 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:12:28.288 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:12:28.417 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T20:12:28.439 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:28.976 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T20:12:29.103 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:12:29.502 INFO:teuthology.orchestra.run.smithi016.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T20:12:29.556 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:12:29.557 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:12:29.722 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package flex. 2024-04-26T20:12:29.795 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T20:12:29.799 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T20:12:29.837 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T20:12:30.106 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:12:30.274 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:12:30.390 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:12:30.408 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:12:30.534 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T20:12:30.568 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T20:12:30.644 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:12:30.761 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:12:30.896 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:12:30.959 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:12:31.013 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:12:31.540 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T20:12:31.544 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:12:31.692 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:12:31.776 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:12:31.902 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T20:12:31.996 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T20:12:32.055 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T20:12:32.062 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:12:32.181 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:12:32.190 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T20:12:32.290 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T20:12:32.416 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T20:12:32.506 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:12:32.542 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:12:32.665 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T20:12:32.735 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:12:32.860 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:12:32.910 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package bison. 2024-04-26T20:12:32.986 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T20:12:32.990 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T20:12:33.037 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:12:33.045 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:12:33.180 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:12:33.297 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T20:12:33.438 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T20:12:33.440 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T20:12:33.453 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T20:12:33.496 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:12:33.566 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:12:33.849 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package dump. 2024-04-26T20:12:33.865 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T20:12:33.907 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T20:12:34.103 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:12:34.104 INFO:teuthology.orchestra.run.smithi192.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T20:12:34.104 INFO:teuthology.orchestra.run.smithi192.stdout:which means they are currently configured by ifupdown: 2024-04-26T20:12:34.104 INFO:teuthology.orchestra.run.smithi192.stdout:- enp3s0f1 2024-04-26T20:12:34.104 INFO:teuthology.orchestra.run.smithi192.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T20:12:34.104 INFO:teuthology.orchestra.run.smithi192.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T20:12:34.104 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:12:34.220 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package indent. 2024-04-26T20:12:34.221 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T20:12:34.236 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:34.270 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:12:34.522 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T20:12:34.539 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T20:12:34.559 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T20:12:34.580 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:12:34.891 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T20:12:34.910 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T20:12:34.926 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T20:12:34.968 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:12:35.212 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T20:12:35.228 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T20:12:35.279 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:12:35.460 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:12:35.603 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:12:35.699 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T20:12:35.716 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T20:12:35.763 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T20:12:35.766 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:12:35.914 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-common (238) ... 2024-04-26T20:12:36.068 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T20:12:36.085 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T20:12:36.135 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:12:36.438 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T20:12:36.454 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T20:12:36.504 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T20:12:36.875 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T20:12:36.891 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T20:12:36.895 INFO:teuthology.orchestra.run.smithi192.stdout:Adding user postgres to group ssl-cert 2024-04-26T20:12:36.932 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:12:37.107 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:12:37.107 INFO:teuthology.orchestra.run.smithi192.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T20:12:37.318 INFO:teuthology.orchestra.run.smithi192.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T20:12:37.319 INFO:teuthology.orchestra.run.smithi192.stdout:Removing obsolete dictionary files: 2024-04-26T20:12:37.916 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T20:12:38.382 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:38.419 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T20:12:38.436 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:12:38.485 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:12:38.722 INFO:teuthology.orchestra.run.smithi192.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T20:12:38.736 INFO:teuthology.orchestra.run.smithi192.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T20:12:38.773 INFO:teuthology.orchestra.run.smithi192.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout:This user must also own the server process. 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout:The default text search configuration will be set to "english". 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout:Data page checksums are disabled. 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:12:38.774 INFO:teuthology.orchestra.run.smithi192.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T20:12:38.775 INFO:teuthology.orchestra.run.smithi192.stdout:creating subdirectories ... ok 2024-04-26T20:12:38.775 INFO:teuthology.orchestra.run.smithi192.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T20:12:38.790 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default max_connections ... 100 2024-04-26T20:12:38.796 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T20:12:38.810 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default shared_buffers ... 128MB 2024-04-26T20:12:38.813 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T20:12:38.820 INFO:teuthology.orchestra.run.smithi192.stdout:selecting default time zone ... Etc/UTC 2024-04-26T20:12:38.821 INFO:teuthology.orchestra.run.smithi192.stdout:creating configuration files ... ok 2024-04-26T20:12:38.934 INFO:teuthology.orchestra.run.smithi192.stdout:running bootstrap script ... ok 2024-04-26T20:12:39.171 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:12:39.589 INFO:teuthology.orchestra.run.smithi192.stdout:performing post-bootstrap initialization ... ok 2024-04-26T20:12:39.666 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T20:12:39.682 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:12:39.725 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:12:40.070 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T20:12:40.086 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T20:12:40.127 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:12:40.351 INFO:teuthology.orchestra.run.smithi192.stdout:syncing data to disk ... ok 2024-04-26T20:12:40.430 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T20:12:40.446 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:12:40.488 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:12:40.752 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T20:12:40.858 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T20:12:40.875 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:40.916 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:41.261 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T20:12:41.278 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:41.319 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:12:41.572 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T20:12:41.588 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:41.630 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:12:41.916 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T20:12:41.933 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T20:12:41.974 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:12:42.495 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T20:12:42.510 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T20:12:42.553 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:12:42.898 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package modemmanager. 2024-04-26T20:12:42.913 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T20:12:42.956 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:12:43.580 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager. 2024-04-26T20:12:43.596 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T20:12:43.647 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:12:43.705 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:12:43.805 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T20:12:43.932 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up postgresql (14+238) ... 2024-04-26T20:12:44.057 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:12:44.217 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:12:44.476 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:12:44.476 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:12:44.746 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ppp. 2024-04-26T20:12:44.762 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T20:12:45.019 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:12:45.120 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T20:12:45.125 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:12:45.456 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:12:45.534 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T20:12:45.549 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T20:12:45.608 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:12:45.617 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T20:12:45.870 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T20:12:45.885 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T20:12:45.928 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T20:12:46.298 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T20:12:46.313 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T20:12:46.364 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T20:12:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T20:12:46.750 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:46.802 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:47.482 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T20:12:47.497 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T20:12:47.513 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T20:12:47.567 INFO:teuthology.orchestra.run.smithi016.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T20:12:47.597 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-common (238) ... 2024-04-26T20:12:47.619 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:12:48.122 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T20:12:48.137 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T20:12:48.154 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:12:48.160 DEBUG:teuthology.parallel:result is None 2024-04-26T20:12:48.200 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:49.275 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql. 2024-04-26T20:12:49.291 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T20:12:49.334 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql (14+238) ... 2024-04-26T20:12:49.619 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T20:12:49.634 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T20:12:49.677 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T20:12:49.921 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T20:12:49.937 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T20:12:49.980 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T20:12:50.249 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T20:12:50.264 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T20:12:50.298 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:12:50.593 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl. 2024-04-26T20:12:50.609 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T20:12:50.656 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T20:12:51.022 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T20:12:51.037 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T20:12:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:12:51.500 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T20:12:51.517 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T20:12:51.567 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T20:12:51.970 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T20:12:51.986 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T20:12:52.037 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:12:52.340 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T20:12:52.559 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T20:12:52.685 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T20:12:52.811 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:52.937 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T20:12:53.055 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T20:12:53.164 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:12:54.143 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T20:12:54.245 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T20:12:54.638 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:12:54.638 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T20:12:55.356 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T20:12:55.457 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T20:12:55.566 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T20:12:55.692 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T20:12:55.852 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T20:12:55.978 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T20:12:56.104 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T20:12:56.230 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T20:12:56.885 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T20:12:57.036 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T20:12:57.132 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T20:12:57.196 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:12:57.314 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T20:12:57.423 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T20:12:57.549 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T20:12:57.675 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T20:12:57.765 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T20:12:57.835 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T20:12:57.961 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T20:12:58.138 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T20:12:58.281 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:12:58.382 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T20:12:58.550 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T20:12:58.684 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T20:12:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:12:59.276 INFO:teuthology.orchestra.run.smithi016.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T20:12:59.276 INFO:teuthology.orchestra.run.smithi016.stdout:which means they are currently configured by ifupdown: 2024-04-26T20:12:59.276 INFO:teuthology.orchestra.run.smithi016.stdout:- ens1f0 2024-04-26T20:12:59.276 INFO:teuthology.orchestra.run.smithi016.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T20:12:59.276 INFO:teuthology.orchestra.run.smithi016.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T20:12:59.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:12:59.414 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T20:12:59.830 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T20:13:00.260 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T20:13:00.970 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T20:13:01.105 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T20:13:01.206 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T20:13:01.307 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-common (238) ... 2024-04-26T20:13:02.212 INFO:teuthology.orchestra.run.smithi016.stdout:Adding user postgres to group ssl-cert 2024-04-26T20:13:02.445 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:02.445 INFO:teuthology.orchestra.run.smithi016.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T20:13:02.697 INFO:teuthology.orchestra.run.smithi016.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T20:13:02.697 INFO:teuthology.orchestra.run.smithi016.stdout:Removing obsolete dictionary files: 2024-04-26T20:13:03.456 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T20:13:03.925 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T20:13:04.275 INFO:teuthology.orchestra.run.smithi016.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T20:13:04.293 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T20:13:04.351 INFO:teuthology.orchestra.run.smithi016.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T20:13:04.352 INFO:teuthology.orchestra.run.smithi016.stdout:This user must also own the server process. 2024-04-26T20:13:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:04.352 INFO:teuthology.orchestra.run.smithi016.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T20:13:04.352 INFO:teuthology.orchestra.run.smithi016.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T20:13:04.352 INFO:teuthology.orchestra.run.smithi016.stdout:The default text search configuration will be set to "english". 2024-04-26T20:13:04.352 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:04.353 INFO:teuthology.orchestra.run.smithi016.stdout:Data page checksums are disabled. 2024-04-26T20:13:04.353 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:04.353 INFO:teuthology.orchestra.run.smithi016.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T20:13:04.354 INFO:teuthology.orchestra.run.smithi016.stdout:creating subdirectories ... ok 2024-04-26T20:13:04.354 INFO:teuthology.orchestra.run.smithi016.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T20:13:04.377 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default max_connections ... 100 2024-04-26T20:13:04.412 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default shared_buffers ... 128MB 2024-04-26T20:13:04.427 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default time zone ... Etc/UTC 2024-04-26T20:13:04.428 INFO:teuthology.orchestra.run.smithi016.stdout:creating configuration files ... ok 2024-04-26T20:13:04.603 INFO:teuthology.orchestra.run.smithi016.stdout:running bootstrap script ... ok 2024-04-26T20:13:05.230 INFO:teuthology.orchestra.run.smithi016.stdout:performing post-bootstrap initialization ... ok 2024-04-26T20:13:05.840 INFO:teuthology.orchestra.run.smithi016.stdout:syncing data to disk ... ok 2024-04-26T20:13:06.329 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T20:13:09.441 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:13:09.583 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T20:13:09.709 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql (14+238) ... 2024-04-26T20:13:09.836 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T20:13:09.962 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T20:13:10.230 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:13:10.230 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T20:13:10.989 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T20:13:11.073 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T20:13:11.409 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T20:13:11.544 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T20:13:13.230 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T20:13:13.355 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T20:13:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T20:13:13.929 DEBUG:teuthology.parallel:result is None 2024-04-26T20:13:13.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:13:14.308 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2024-04-26T20:13:14.330 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:13:14.331 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:13:14.331 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T20:13:14.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:13:14.631 DEBUG:teuthology.orchestra.run.smithi192:> dpkg-query -W -f '${Version}' ceph 2024-04-26T20:13:14.650 INFO:teuthology.orchestra.run.smithi192.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:13:14.651 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T20:13:14.651 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T20:13:14.653 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T20:13:14.653 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:14.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:13:14.674 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:14.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T20:13:14.707 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T20:13:14.708 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:14.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:13:14.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:13:14.799 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:14.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T20:13:14.812 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T20:13:14.866 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T20:13:14.866 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:14.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:13:14.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:13:14.951 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:14.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T20:13:14.964 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T20:13:15.018 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T20:13:15.018 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:15.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:13:15.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:13:15.107 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:15.107 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T20:13:15.120 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T20:13:15.174 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T20:13:15.263 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T20:13:15.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-04-26T20:13:15.266 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2024-04-26T20:13:15.283 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T20:13:15.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T20:13:15.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T20:13:15.347 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T20:13:15.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T20:13:15.390 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T20:13:15.481 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T20:13:15.481 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T20:13:15.481 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T20:13:15.482 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:15.482 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T20:13:15.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T20:13:15.579 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:15.579 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T20:13:15.585 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T20:13:15.664 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T20:13:15.664 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T20:13:15.665 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7675145', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM1U+C9Z6C+EqROyVro6ABMvDrJVyQpiMqkrVKa27Ec8kC2avgB1mvtC4Q6Bz4w1qTFoBabvNIQE9gmCgnkRJZk=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBKdH3lPmUx2lAwwg+DinHuC04huUjnK1mf9EhkSXBJBzvnoM6zuzEsEXX5LEQFs4QtYG5YfrRZ4hza4cw3WHo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T20:13:15.665 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T20:13:15.668 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T20:13:15.707 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T20:13:15.717 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T20:13:15.763 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:15.763 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:13:15.783 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:13:15.783 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-04-26T20:13:15.831 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:13:15.831 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:15.831 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 903 Links: 1 2024-04-26T20:13:15.831 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:15.831 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 20:05:59.567701506 +0000 2024-04-26T20:13:15.831 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 20:05:59.307703825 +0000 2024-04-26T20:13:15.832 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 20:05:59.307703825 +0000 2024-04-26T20:13:15.832 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 20:05:59.307703825 +0000 2024-04-26T20:13:15.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:13:15.892 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T20:13:15.893 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T20:13:15.893 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000243571 s, 2.1 MB/s 2024-04-26T20:13:15.895 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:13:15.945 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 921 Links: 1 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 20:06:00.147696331 +0000 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 20:05:59.879698721 +0000 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 20:05:59.879698721 +0000 2024-04-26T20:13:15.996 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 20:05:59.879698721 +0000 2024-04-26T20:13:15.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:13:16.057 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T20:13:16.057 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T20:13:16.057 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.00024221 s, 2.1 MB/s 2024-04-26T20:13:16.059 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:13:16.113 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-04-26T20:13:16.163 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:13:16.164 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:16.164 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-04-26T20:13:16.164 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:16.164 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 20:06:00.731691121 +0000 2024-04-26T20:13:16.164 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 20:06:00.439693726 +0000 2024-04-26T20:13:16.164 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 20:06:00.439693726 +0000 2024-04-26T20:13:16.164 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 20:06:00.439693726 +0000 2024-04-26T20:13:16.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:13:16.225 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T20:13:16.226 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T20:13:16.226 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000254438 s, 2.0 MB/s 2024-04-26T20:13:16.228 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:13:16.282 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 953 Links: 1 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 20:06:01.327685804 +0000 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 20:06:01.047688302 +0000 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 20:06:01.047688302 +0000 2024-04-26T20:13:16.332 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 20:06:01.047688302 +0000 2024-04-26T20:13:16.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:13:16.394 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T20:13:16.394 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T20:13:16.394 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000266641 s, 1.9 MB/s 2024-04-26T20:13:16.396 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:13:16.450 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:16.450 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:16.450 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T20:13:16.456 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T20:13:16.456 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-04-26T20:13:16.503 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T20:13:16.503 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:16.503 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-04-26T20:13:16.504 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:16.504 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 20:05:40.398586131 +0000 2024-04-26T20:13:16.504 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 20:05:40.154588309 +0000 2024-04-26T20:13:16.504 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 20:05:40.154588309 +0000 2024-04-26T20:13:16.504 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-04-26T20:13:16.504 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T20:13:16.558 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T20:13:16.558 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T20:13:16.558 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000546542 s, 937 kB/s 2024-04-26T20:13:16.559 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T20:13:16.609 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-04-26T20:13:16.655 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T20:13:16.655 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:16.655 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-04-26T20:13:16.655 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:16.655 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 20:05:40.906581594 +0000 2024-04-26T20:13:16.656 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 20:05:40.638583986 +0000 2024-04-26T20:13:16.656 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 20:05:40.638583986 +0000 2024-04-26T20:13:16.656 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-04-26T20:13:16.656 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T20:13:16.709 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T20:13:16.709 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T20:13:16.710 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000461479 s, 1.1 MB/s 2024-04-26T20:13:16.711 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T20:13:16.760 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 20:05:41.182579128 +0000 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 20:05:41.178579164 +0000 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 20:05:41.178579164 +0000 2024-04-26T20:13:16.807 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-04-26T20:13:16.808 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T20:13:16.863 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T20:13:16.863 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T20:13:16.863 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000524707 s, 976 kB/s 2024-04-26T20:13:16.864 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T20:13:16.912 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-04-26 20:05:41.898572733 +0000 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-04-26 20:05:41.646574984 +0000 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-04-26 20:05:41.646574984 +0000 2024-04-26T20:13:16.959 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-04-26T20:13:16.960 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T20:13:17.013 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-04-26T20:13:17.013 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-04-26T20:13:17.013 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000484691 s, 1.1 MB/s 2024-04-26T20:13:17.014 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T20:13:17.064 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:17.065 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T20:13:17.065 INFO:tasks.ceph:Generating config... 2024-04-26T20:13:17.066 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T20:13:17.066 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-26T20:13:17.066 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T20:13:17.066 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T20:13:17.066 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T20:13:17.066 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T20:13:17.066 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-26T20:13:17.067 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T20:13:17.068 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T20:13:17.069 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-26T20:13:17.069 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-26T20:13:17.070 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-26T20:13:17.070 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-26T20:13:17.070 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T20:13:17.070 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T20:13:17.070 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T20:13:17.070 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T20:13:17.070 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T20:13:17.070 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T20:13:17.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T20:13:17.117 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T20:13:17.136 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T20:13:17.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T20:13:17.248 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2024-04-26T20:13:17.249 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T20:13:17.249 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:17.249 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T20:13:17.299 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:17.390 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid fae48009-e478-45bc-aae9-8a365e3cb2e9 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:fsid fae48009-e478-45bc-aae9-8a365e3cb2e9 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-04-26T20:13:17.393205+0000 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-26T20:13:17.393205+0000 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-04-26T20:13:17.391 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2024-04-26T20:13:17.392 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2024-04-26T20:13:17.392 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T20:13:17.393 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T20:13:17.443 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fae48009-e478-45bc-aae9-8a365e3cb2e9... 2024-04-26T20:13:17.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:13:17.490 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T20:13:17.521 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2024-04-26T20:13:17.521 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2024-04-26T20:13:17.521 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2024-04-26T20:13:17.522 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:13:17.523 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.16,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2024-04-26T20:13:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = fae48009-e478-45bc-aae9-8a365e3cb2e9 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2024-04-26T20:13:17.525 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug trim objects = true 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.526 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore compression mode = aggressive 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2024-04-26T20:13:17.527 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: mon client directed command retry = 5 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject delay max = 1 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject delay probability = 0.005 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject delay type = client mds 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject socket failures = 2500 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: osd blocked scrub grace period = 3600 2024-04-26T20:13:17.528 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: osd max markdown count = 1000 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-04-26T20:13:17.529 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:13:17.530 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: mon down mkfs grace = 300 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-04-26T20:13:17.531 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: client_shutdown_timeout = 120 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2024-04-26T20:13:17.532 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.e] 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.f] 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds balancer = 20 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal fragment size max = 10000 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal merge size = 5 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split bits = 3 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split size = 100 2024-04-26T20:13:17.533 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: mds oft prefetch dirfrags = True 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: mds_dir_prefetch = True 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: mon client directed command retry = 5 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject delay max = 1 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject delay probability = 0.005 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject delay type = client mds osd 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: ms inject socket failures = 2500 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2024-04-26T20:13:17.534 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2024-04-26T20:13:17.535 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-26T20:13:17.535 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-26T20:13:17.535 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T20:13:17.535 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-26T20:13:17.535 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.535 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-26T20:13:17.535 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T20:13:17.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.537 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on skipped message = False 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = fae48009-e478-45bc-aae9-8a365e3cb2e9 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.538 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-26T20:13:17.540 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore compression mode = aggressive 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 20 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 20 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 10 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: mon client directed command retry = 5 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject delay max = 1 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject delay probability = 0.005 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject delay type = client mds 2024-04-26T20:13:17.541 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject socket failures = 2500 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd blocked scrub grace period = 3600 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd max markdown count = 1000 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:13:17.542 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.543 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon down mkfs grace = 300 2024-04-26T20:13:17.544 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: client_shutdown_timeout = 120 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-26T20:13:17.545 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal fragment size max = 10000 2024-04-26T20:13:17.546 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal merge size = 5 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split bits = 3 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split size = 100 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds oft prefetch dirfrags = True 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds_dir_prefetch = True 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: mon client directed command retry = 5 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject delay max = 1 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject delay probability = 0.005 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject delay type = client mds osd 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: ms inject socket failures = 2500 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-26T20:13:17.547 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-26T20:13:17.548 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-26T20:13:17.549 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T20:13:17.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T20:13:17.649 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T20:13:17.649 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:17.649 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T20:13:17.658 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:17.658 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T20:13:17.711 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:13:17.711 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:17.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T20:13:17.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T20:13:17.783 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:17.783 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:17.831 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:13:17.831 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:17.831 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T20:13:17.831 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T20:13:17.854 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:17.854 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:17.900 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T20:13:17.900 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T20:13:17.900 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T20:13:17.955 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T20:13:17.960 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T20:13:18.003 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T20:13:18.015 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T20:13:18.015 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T20:13:18.073 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T20:13:18.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T20:13:18.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T20:13:18.198 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T20:13:18.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T20:13:18.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T20:13:18.321 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T20:13:18.325 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-26T20:13:18.345 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T20:13:18.388 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T20:13:18.391 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T20:13:18.447 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T20:13:18.532 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T20:13:18.535 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T20:13:18.591 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T20:13:18.679 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T20:13:18.683 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-26T20:13:18.739 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T20:13:18.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T20:13:18.782 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T20:13:18.800 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T20:13:18.800 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T20:13:18.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T20:13:18.862 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:18.862 INFO:tasks.ceph:role: osd.0 2024-04-26T20:13:18.862 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:13:18.862 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T20:13:18.925 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:18.926 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:18.954 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T20:13:18.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T20:13:18.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T20:13:19.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T20:13:19.086 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:19.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:19.088 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T20:13:19.149 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:19.150 INFO:tasks.ceph:role: osd.1 2024-04-26T20:13:19.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:13:19.150 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T20:13:19.209 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:19.210 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:19.234 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T20:13:19.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T20:13:19.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T20:13:19.303 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T20:13:19.362 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:19.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:19.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T20:13:19.425 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:19.426 INFO:tasks.ceph:role: osd.2 2024-04-26T20:13:19.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:13:19.426 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T20:13:19.490 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:19.490 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:19.491 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:19.491 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:19.491 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:19.491 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:19.491 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:19.515 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T20:13:19.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T20:13:19.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T20:13:19.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T20:13:19.642 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:19.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:19.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T20:13:19.706 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:19.706 INFO:tasks.ceph:role: osd.3 2024-04-26T20:13:19.706 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:13:19.706 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T20:13:19.769 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:19.769 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:19.770 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:19.794 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T20:13:19.796 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T20:13:19.797 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T20:13:19.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T20:13:19.922 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:19.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:19.924 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:20.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:20.057+0000 7f786e8547c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T20:13:20.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:20.057+0000 7f786e8547c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T20:13:20.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:20.057+0000 7f786e8547c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T20:13:20.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:20.057+0000 7f786e8547c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T20:13:20.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:20.057+0000 7f786e8547c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T20:13:20.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:20.057+0000 7f786e8547c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T20:13:23.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T20:13:23.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:23.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:23.241+0000 7f4a8236e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T20:13:23.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:23.241+0000 7f4a8236e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T20:13:23.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:23.241+0000 7f4a8236e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T20:13:23.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:23.241+0000 7f4a8236e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T20:13:23.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:23.241+0000 7f4a8236e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T20:13:23.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:23.241+0000 7f4a8236e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T20:13:26.281 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T20:13:26.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:26.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:26.397+0000 7f7e929a27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T20:13:26.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:26.397+0000 7f7e929a27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T20:13:26.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:26.397+0000 7f7e929a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T20:13:26.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:26.397+0000 7f7e929a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T20:13:26.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:26.397+0000 7f7e929a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T20:13:26.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:26.397+0000 7f7e929a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T20:13:29.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T20:13:29.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:29.564+0000 7f01ec65e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T20:13:29.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:29.564+0000 7f01ec65e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T20:13:29.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:29.564+0000 7f01ec65e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T20:13:29.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:29.564+0000 7f01ec65e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T20:13:29.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:29.564+0000 7f01ec65e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T20:13:29.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:29.564+0000 7f01ec65e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T20:13:32.590 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T20:13:32.612 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T20:13:32.626 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:32.627 INFO:tasks.ceph:role: osd.4 2024-04-26T20:13:32.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:13:32.627 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T20:13:32.691 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:32.691 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:32.691 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:32.691 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:32.691 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:32.691 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:32.692 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:32.692 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:32.692 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:32.692 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:33.139 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-04-26T20:13:33.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-04-26T20:13:33.142 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T20:13:33.235 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T20:13:33.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:33.245 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:33.245 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T20:13:33.300 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:33.300 INFO:tasks.ceph:role: osd.5 2024-04-26T20:13:33.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:13:33.300 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:33.363 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:33.829 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-04-26T20:13:33.831 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-04-26T20:13:33.831 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T20:13:33.971 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T20:13:33.982 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:33.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:33.983 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T20:13:34.039 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:34.039 INFO:tasks.ceph:role: osd.6 2024-04-26T20:13:34.039 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:13:34.039 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:34.103 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:34.104 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:34.586 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-04-26T20:13:34.588 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-04-26T20:13:34.588 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T20:13:34.747 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T20:13:34.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:34.759 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:34.759 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T20:13:34.816 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T20:13:34.816 INFO:tasks.ceph:role: osd.7 2024-04-26T20:13:34.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:13:34.816 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T20:13:34.879 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T20:13:34.879 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T20:13:34.879 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T20:13:34.879 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T20:13:34.880 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T20:13:34.880 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-04-26T20:13:34.880 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T20:13:34.880 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T20:13:34.880 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T20:13:34.880 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T20:13:35.303 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-04-26T20:13:35.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-04-26T20:13:35.305 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T20:13:35.405 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T20:13:35.415 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T20:13:35.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:13:35.416 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:35.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:35.531+0000 7f524eaa47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T20:13:35.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:35.535+0000 7f524eaa47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T20:13:35.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:35.535+0000 7f524eaa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T20:13:35.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:35.535+0000 7f524eaa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T20:13:35.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:35.535+0000 7f524eaa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T20:13:35.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:35.535+0000 7f524eaa47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T20:13:38.519 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T20:13:38.533 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:38.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:38.610+0000 7f00314437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T20:13:38.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:38.610+0000 7f00314437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T20:13:38.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:38.610+0000 7f00314437c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T20:13:38.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:38.610+0000 7f00314437c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T20:13:38.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:38.610+0000 7f00314437c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T20:13:38.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:38.610+0000 7f00314437c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T20:13:41.600 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T20:13:41.656 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:41.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:41.734+0000 7fb8d8fad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T20:13:41.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:41.734+0000 7fb8d8fad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T20:13:41.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:41.734+0000 7fb8d8fad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T20:13:41.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:41.734+0000 7fb8d8fad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T20:13:41.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:41.734+0000 7fb8d8fad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T20:13:41.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:41.738+0000 7fb8d8fad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T20:13:44.711 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T20:13:44.769 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:44.850+0000 7fe418a257c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T20:13:44.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:44.850+0000 7fe418a257c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T20:13:44.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:44.850+0000 7fe418a257c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T20:13:44.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:44.850+0000 7fe418a257c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T20:13:44.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:44.850+0000 7fe418a257c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T20:13:44.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:44.854+0000 7fe418a257c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T20:13:45.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:13:45.670 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:13:47.854 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T20:13:47.868 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T20:13:47.868 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:47.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T20:13:47.890 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:47.891 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T20:13:47.953 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:47.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T20:13:48.021 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:48.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-26T20:13:48.085 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:48.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T20:13:48.150 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:48.150 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T20:13:48.214 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:48.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T20:13:48.282 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:48.282 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T20:13:48.349 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.349 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T20:13:48.363 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.363 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T20:13:48.419 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.419 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T20:13:48.470 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.471 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-26T20:13:48.524 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T20:13:48.580 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.580 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T20:13:48.634 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T20:13:48.687 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:48.687 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T20:13:48.743 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:48.743 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T20:13:48.752 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T20:13:48.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T20:13:48.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T20:13:48.811 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2024-04-26T20:13:48.811 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDdCixmB1wYORAAnsWtfbccTzsL3atdJsbj/g== 2024-04-26T20:13:48.811 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-04-26T20:13:48.811 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixmCKmJBBAAjqRIp4r52INlfXxDxXO0nw== 2024-04-26T20:13:48.811 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixmTh4ADBAAT1C2wHpUn3MIHYsf2s91jw== 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.e] 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixmBDJNExAAGB9cxtZur3sRb3fEQ6zXwA== 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDgCixmIzF+AxAABk/TQhkACprZz4erwGOB+A== 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDjCixmN2x3DhAAW3RF8WODwJ1KhzhC4dfs3Q== 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDmCixmignHFxAAxCU5/7Zb/jKgzONx+u5srw== 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDpCixmxc7IIRAASXjbJo2cSDy/vm+MnXQ/pg== 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixm07BrABAAxybuKQbjgKWz9rD6csr36w== 2024-04-26T20:13:48.812 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixmN6BjFxAAD2o9PKNtkGIFMRGE7c1oRg== 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixmhgfzHxAA6u9Lv14TQ9kVDlVDAKb9dw== 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.f] 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixmzoi9KBAAN0WuUuaecn3epX7tVCdCzQ== 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDvCixmz1/7HxAAt//vF7jz4NGaqobVw0xbKw== 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDyCixmCzuzJBAAB8u6afDQO6BFPsga53e4QQ== 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQD1CixmZQEyLBAAj+lwr9yIKCeIin0Od8/0mw== 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQD4CixmSNcZMxAAGhGjrjt4hDkTGvQM0dv4VQ== 2024-04-26T20:13:48.813 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2024-04-26T20:13:48.814 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeCixmjDDOLhAA/tb4jhlBQ5paLj+2RG4qyg== 2024-04-26T20:13:48.815 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-04-26T20:13:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDdCixmB1wYORAAnsWtfbccTzsL3atdJsbj/g== 2024-04-26T20:13:48.815 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-26T20:13:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixmCKmJBBAAjqRIp4r52INlfXxDxXO0nw== 2024-04-26T20:13:48.815 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-04-26T20:13:48.815 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixmTh4ADBAAT1C2wHpUn3MIHYsf2s91jw== 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e] 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixmBDJNExAAGB9cxtZur3sRb3fEQ6zXwA== 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDgCixmIzF+AxAABk/TQhkACprZz4erwGOB+A== 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDjCixmN2x3DhAAW3RF8WODwJ1KhzhC4dfs3Q== 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDmCixmignHFxAAxCU5/7Zb/jKgzONx+u5srw== 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDpCixmxc7IIRAASXjbJo2cSDy/vm+MnXQ/pg== 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixm07BrABAAxybuKQbjgKWz9rD6csr36w== 2024-04-26T20:13:48.816 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixmN6BjFxAAD2o9PKNtkGIFMRGE7c1oRg== 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixmhgfzHxAA6u9Lv14TQ9kVDlVDAKb9dw== 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixmzoi9KBAAN0WuUuaecn3epX7tVCdCzQ== 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDvCixmz1/7HxAAt//vF7jz4NGaqobVw0xbKw== 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDyCixmCzuzJBAAB8u6afDQO6BFPsga53e4QQ== 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD1CixmZQEyLBAAj+lwr9yIKCeIin0Od8/0mw== 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD4CixmSNcZMxAAGhGjrjt4hDkTGvQM0dv4VQ== 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-26T20:13:48.817 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDeCixmjDDOLhAA/tb4jhlBQ5paLj+2RG4qyg== 2024-04-26T20:13:48.818 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:13:48.863 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:13:48.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:48.922 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:48.979 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:48.982 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.115 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.360 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.363 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:13:49.451 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T20:13:49.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.535 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.620 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.707 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T20:13:49.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.795 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.883 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.968 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:49.972 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:50.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:50.055 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T20:13:50.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:13:50.136 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T20:13:50.219 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T20:13:50.219 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T20:13:50.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T20:13:50.353 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T20:13:50.373 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T20:13:50.387 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T20:13:50.480 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T20:13:50.491 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T20:13:50.545 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T20:13:50.641 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T20:13:50.651 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:50.654 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T20:13:50.699 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T20:13:50.699 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T20:13:50.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T20:13:50.703 INFO:tasks.ceph.mon.a:Started 2024-04-26T20:13:50.703 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T20:13:50.703 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T20:13:50.749 INFO:tasks.ceph.mon.b:Started 2024-04-26T20:13:50.749 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T20:13:50.749 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T20:13:50.751 INFO:tasks.ceph.mon.c:Started 2024-04-26T20:13:50.751 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T20:13:50.751 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T20:13:50.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T20:13:50.754 INFO:tasks.ceph.mgr.y:Started 2024-04-26T20:13:50.755 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T20:13:50.755 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T20:13:50.757 INFO:tasks.ceph.mgr.x:Started 2024-04-26T20:13:50.757 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T20:13:50.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T20:13:50.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.891+0000 7fe130000640 1 Processor -- start 2024-04-26T20:13:50.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe130000640 1 -- start start 2024-04-26T20:13:50.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe130000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe130000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe130000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe130000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe12815ce20 con 0x7fe1280cd6d0 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe130000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fe12815bfc0 con 0x7fe1280c8d60 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe130000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe12815c2a0 con 0x7fe1280b71d0 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43654/0 (socket says 172.21.15.16:43654) 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 learned_addr learned my addr 172.21.15.16:0/2171043176 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:50.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:13:50.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:50.895+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:13:51.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:51.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.099+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T20:13:51.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:51.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:13:51.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:51.503+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T20:13:52.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:13:52.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12d600640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:13:52.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:13:52.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:13:52.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:52.307+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T20:13:53.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 msgr2=0x7fe1280cd190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:13:53.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1280b71d0 0x7fe1280cd190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:53.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 msgr2=0x7fe1280d1b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:13:53.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.192:3300/0 conn(0x7fe1280c8d60 0x7fe1280d1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:53.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 -- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 msgr2=0x7fe1280d15d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:13:53.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 --2- 172.21.15.16:0/2171043176 >> v2:172.21.15.16:3300/0 conn(0x7fe1280cd6d0 0x7fe1280d15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:53.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 -- 172.21.15.16:0/2171043176 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe12815c580 con 0x7fe1100036c0 2024-04-26T20:13:53.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:53.895+0000 7fe126a00640 1 -- 172.21.15.16:0/2171043176 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe11000c110 con 0x7fe1100073c0 2024-04-26T20:13:56.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.147+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739056492 0 0) 0x7fe12815c580 con 0x7fe1100036c0 2024-04-26T20:13:56.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.147+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe108003530 con 0x7fe1100036c0 2024-04-26T20:13:56.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.147+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1859300106 0 0) 0x7fe108003530 con 0x7fe1100036c0 2024-04-26T20:13:56.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.147+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 >> v1:172.21.15.192:6789/0 conn(0x7fe1100073c0 legacy=0x7fe110009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.147+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11000d410 con 0x7fe1100036c0 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.147+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fe11c00f040 con 0x7fe1100036c0 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.147+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 >> v1:172.21.15.16:6789/0 conn(0x7fe1100036c0 legacy=0x7fe110005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12e000640 1 -- 172.21.15.16:0/2171043176 reap_dead start 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe127e00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108003a40 0x7fe108003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe127e00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108004810 0x7fe108004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe127e00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe10800bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe10800c3a0 con 0x7fe108003a40 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe10800c520 con 0x7fe108004810 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe10800c720 con 0x7fe1080099c0 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108004810 0x7fe108004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12e000640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe10800bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12d600640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108003a40 0x7fe108003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 msgr2=0x7fe10800bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe10800bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108003a40 msgr2=0x7fe108003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108003a40 0x7fe108003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.151+0000 7fe12cc00640 1 -- 172.21.15.16:0/2171043176 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe108003530 con 0x7fe108004810 2024-04-26T20:13:56.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.155+0000 7fe12cc00640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108004810 0x7fe108004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1140129b0 tx=0x7fe11401d270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d52db9da05617e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:56.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1140b3070 con 0x7fe108004810 2024-04-26T20:13:56.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1140ae410 con 0x7fe108004810 2024-04-26T20:13:56.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe127e00640 1 -- 172.21.15.16:0/2171043176 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11400f040 con 0x7fe108004810 2024-04-26T20:13:56.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 -- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108004810 msgr2=0x7fe108004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108004810 0x7fe108004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1140129b0 tx=0x7fe11401d270 comp rx=0 tx=0).stop 2024-04-26T20:13:56.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 -- 172.21.15.16:0/2171043176 shutdown_connections 2024-04-26T20:13:56.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe10800bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108004810 0x7fe108004c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 --2- 172.21.15.16:0/2171043176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108003a40 0x7fe108003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 -- 172.21.15.16:0/2171043176 >> 172.21.15.16:0/2171043176 conn(0x7fe12806d0d0 msgr2=0x7fe12806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:56.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 -- 172.21.15.16:0/2171043176 shutdown_connections 2024-04-26T20:13:56.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.159+0000 7fe130000640 1 -- 172.21.15.16:0/2171043176 wait complete. 2024-04-26T20:13:56.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 Processor -- start 2024-04-26T20:13:56.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 -- start start 2024-04-26T20:13:56.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108003a40 0x7fe1280b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108004810 0x7fe1280b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe1280acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280b4350 con 0x7fe108004810 2024-04-26T20:13:56.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe12815cb40 con 0x7fe108003a40 2024-04-26T20:13:56.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe1280cd190 con 0x7fe1080099c0 2024-04-26T20:13:56.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108004810 0x7fe1280b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108004810 0x7fe1280b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36018/0 (socket says 172.21.15.16:36018) 2024-04-26T20:13:56.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 -- 172.21.15.16:0/4224478933 learned_addr learned my addr 172.21.15.16:0/4224478933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:13:56.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12e000640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe1280acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12d600640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108003a40 0x7fe1280b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 -- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 msgr2=0x7fe1280acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe1280acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 -- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108003a40 msgr2=0x7fe1280b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108003a40 0x7fe1280b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 -- 172.21.15.16:0/4224478933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1280b3990 con 0x7fe108004810 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe12cc00640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108004810 0x7fe1280b51a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1140129b0 tx=0x7fe108005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe125600640 1 -- 172.21.15.16:0/4224478933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1140b3040 con 0x7fe108004810 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe125600640 1 -- 172.21.15.16:0/4224478933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1140b9420 con 0x7fe108004810 2024-04-26T20:13:56.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.163+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1280b3c70 con 0x7fe108004810 2024-04-26T20:13:56.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.167+0000 7fe125600640 1 -- 172.21.15.16:0/4224478933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5e60 con 0x7fe108004810 2024-04-26T20:13:56.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.167+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1281f14f0 con 0x7fe108004810 2024-04-26T20:13:56.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.167+0000 7fe125600640 1 -- 172.21.15.16:0/4224478933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1140b9ba0 con 0x7fe108004810 2024-04-26T20:13:56.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.167+0000 7fe125600640 1 -- 172.21.15.16:0/4224478933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe1140b73f0 con 0x7fe108004810 2024-04-26T20:13:56.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.167+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe128077c20 con 0x7fe108004810 2024-04-26T20:13:56.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.171+0000 7fe125600640 1 -- 172.21.15.16:0/4224478933 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe114016fc0 con 0x7fe108004810 2024-04-26T20:13:56.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.235+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe1280cdab0 con 0x7fe108004810 2024-04-26T20:13:56.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe125600640 1 -- 172.21.15.16:0/4224478933 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe1140059a0 con 0x7fe108004810 2024-04-26T20:13:56.242 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-04-26T20:13:56.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108004810 msgr2=0x7fe1280b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108004810 0x7fe1280b51a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe1140129b0 tx=0x7fe108005840 comp rx=0 tx=0).stop 2024-04-26T20:13:56.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 shutdown_connections 2024-04-26T20:13:56.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080099c0 0x7fe1280acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe108004810 0x7fe1280b51a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 --2- 172.21.15.16:0/4224478933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108003a40 0x7fe1280b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 >> 172.21.15.16:0/4224478933 conn(0x7fe12806d0d0 msgr2=0x7fe1280d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:56.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 shutdown_connections 2024-04-26T20:13:56.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:56.239+0000 7fe130000640 1 -- 172.21.15.16:0/4224478933 wait complete. 2024-04-26T20:13:56.263 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T20:13:56.263 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T20:13:56.264 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:56.264 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T20:13:56.284 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:56.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T20:13:56.344 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:56.339+0000 7f24ca04a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:13:56.348 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:56.348 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T20:13:56.408 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:13:56.408 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T20:13:56.436 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:56.438+0000 7f8cd1256180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T20:13:56.468 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:56.468 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T20:13:56.481 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:56.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T20:13:56.535 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:56.535 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T20:13:56.590 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-04-26T20:13:56.591 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T20:13:56.643 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 507c4fba-bdfd-41df-a4bd-72c9ce75da33 0 2024-04-26T20:13:56.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.810+0000 7f1edec88640 1 Processor -- start 2024-04-26T20:13:56.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.810+0000 7f1edec88640 1 -- start start 2024-04-26T20:13:56.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edec88640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed80c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edec88640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1ed80d01b0 0x7f1ed8153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edec88640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed80cb310 con 0x7f1ed80ccd60 2024-04-26T20:13:56.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edec88640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed80cf610 con 0x7f1ed80d01b0 2024-04-26T20:13:56.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edec88640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80cb5f0 con 0x7f1ed8070290 2024-04-26T20:13:56.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed80c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed80c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:51614/0 (socket says 172.21.15.192:51614) 2024-04-26T20:13:56.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 -- 172.21.15.192:0/1904371506 learned_addr learned my addr 172.21.15.192:0/1904371506 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:56.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edd225640 1 --2- 172.21.15.192:0/1904371506 >> v2:172.21.15.192:3300/0 conn(0x7f1ed80d01b0 0x7f1ed8153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 -- 172.21.15.192:0/1904371506 >> v2:172.21.15.192:3300/0 conn(0x7f1ed80d01b0 msgr2=0x7f1ed8153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:56.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 --2- 172.21.15.192:0/1904371506 >> v2:172.21.15.192:3300/0 conn(0x7f1ed80d01b0 0x7f1ed8153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 -- 172.21.15.192:0/1904371506 >> v1:172.21.15.16:6789/0 conn(0x7f1ed80ccd60 legacy=0x7f1ed80cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 -- 172.21.15.192:0/1904371506 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed80cb8d0 con 0x7f1ed8070290 2024-04-26T20:13:56.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edd225640 1 --2- 172.21.15.192:0/1904371506 >> v2:172.21.15.192:3300/0 conn(0x7f1ed80d01b0 0x7f1ed8153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:56.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1edca24640 1 --2- 172.21.15.192:0/1904371506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed80c45f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5916b3585e578310 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:56.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1ed77fe640 1 -- 172.21.15.192:0/1904371506 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0b5070 con 0x7f1ed8070290 2024-04-26T20:13:56.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1ed77fe640 1 -- 172.21.15.192:0/1904371506 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc0a8a50 con 0x7f1ed8070290 2024-04-26T20:13:56.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.814+0000 7f1ed77fe640 1 -- 172.21.15.192:0/1904371506 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0a8e20 con 0x7f1ed8070290 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 -- 172.21.15.192:0/1904371506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 msgr2=0x7f1ed80c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 --2- 172.21.15.192:0/1904371506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed80c45f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009870 tx=0x7f1ecc01ed50 comp rx=0 tx=0).stop 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 -- 172.21.15.192:0/1904371506 shutdown_connections 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 --2- 172.21.15.192:0/1904371506 >> v2:172.21.15.192:3300/0 conn(0x7f1ed80d01b0 0x7f1ed8153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 --2- 172.21.15.192:0/1904371506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed80c45f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 -- 172.21.15.192:0/1904371506 >> 172.21.15.192:0/1904371506 conn(0x7f1ed8068140 msgr2=0x7f1ed8068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 -- 172.21.15.192:0/1904371506 shutdown_connections 2024-04-26T20:13:56.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 -- 172.21.15.192:0/1904371506 wait complete. 2024-04-26T20:13:56.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 Processor -- start 2024-04-26T20:13:56.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 -- start start 2024-04-26T20:13:56.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.818+0000 7f1edec88640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed81f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ed80ccd60 0x7f1ed8141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ed80d01b0 0x7f1ed813be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80ca410 con 0x7f1ed80ccd60 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80cbe90 con 0x7f1ed80d01b0 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80c4b30 con 0x7f1ed8070290 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edca24640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed81f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edca24640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed81f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:51628/0 (socket says 172.21.15.192:51628) 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edca24640 1 -- 172.21.15.192:0/1844602581 learned_addr learned my addr 172.21.15.192:0/1844602581 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edd225640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ed80d01b0 0x7f1ed813be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1ed7fff640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ed80ccd60 0x7f1ed8141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edd225640 1 -- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 msgr2=0x7f1ed81f1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edd225640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed81f1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edd225640 1 -- 172.21.15.192:0/1844602581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ed80ccd60 msgr2=0x7f1ed8141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edd225640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ed80ccd60 0x7f1ed8141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edd225640 1 -- 172.21.15.192:0/1844602581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed81f4f50 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edca24640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed81f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edd225640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ed80d01b0 0x7f1ed813be00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000ef90 tx=0x7f1ed000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1ed57fa640 1 -- 172.21.15.192:0/1844602581 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0018030 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1ed57fa640 1 -- 172.21.15.192:0/1844602581 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed000cd30 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81f1d80 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1ed57fa640 1 -- 172.21.15.192:0/1844602581 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0003bc0 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81f51f0 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1ed57fa640 1 -- 172.21.15.192:0/1844602581 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ed001b070 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1ed57fa640 1 -- 172.21.15.192:0/1844602581 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1ed001d7e0 con 0x7f1ed80d01b0 2024-04-26T20:13:56.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.822+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed80696e0 con 0x7f1ed80d01b0 2024-04-26T20:13:56.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.826+0000 7f1ed57fa640 1 -- 172.21.15.192:0/1844602581 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1ed0022070 con 0x7f1ed80d01b0 2024-04-26T20:13:56.864 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:56.859+0000 7f24ca04a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:13:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.894+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "507c4fba-bdfd-41df-a4bd-72c9ce75da33", "id": 0} v 0) -- 0x7f1ed80ca6b0 con 0x7f1ed80d01b0 2024-04-26T20:13:56.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1ed57fa640 1 -- 172.21.15.192:0/1844602581 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "507c4fba-bdfd-41df-a4bd-72c9ce75da33", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1ed0010040 con 0x7f1ed80d01b0 2024-04-26T20:13:56.896 INFO:teuthology.orchestra.run.smithi192.stdout:0 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ed80d01b0 msgr2=0x7f1ed813be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ed80d01b0 0x7f1ed813be00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000ef90 tx=0x7f1ed000c490 comp rx=0 tx=0).stop 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 shutdown_connections 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ed80d01b0 0x7f1ed813be00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ed80ccd60 0x7f1ed8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 --2- 172.21.15.192:0/1844602581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ed8070290 0x7f1ed81f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 >> 172.21.15.192:0/1844602581 conn(0x7f1ed8068140 msgr2=0x7f1ed80c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:56.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 shutdown_connections 2024-04-26T20:13:56.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:56.898+0000 7f1edec88640 1 -- 172.21.15.192:0/1844602581 wait complete. 2024-04-26T20:13:56.915 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new acc5407d-e3ad-4ffa-8988-7e6353ba226a 1 2024-04-26T20:13:56.976 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:56.978+0000 7f8cd1256180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T20:13:57.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.030+0000 7fe86c815640 1 Processor -- start 2024-04-26T20:13:57.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.030+0000 7fe86c815640 1 -- start start 2024-04-26T20:13:57.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86c815640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe8680c4ed0 0x7fe868158e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86c815640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8680c5410 con 0x7fe868152e10 2024-04-26T20:13:57.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86c815640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe868073e20 con 0x7fe8680729c0 2024-04-26T20:13:57.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86c815640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe8681531f0 con 0x7fe8680c4ed0 2024-04-26T20:13:57.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe866d9d640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe8680729c0 0x7fe868163310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36482/0 (socket says 172.21.15.192:36482) 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe866d9d640 1 -- 172.21.15.192:0/2632442325 learned_addr learned my addr 172.21.15.192:0/2632442325 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe865d9b640 1 --2- 172.21.15.192:0/2632442325 >> v2:172.21.15.16:3300/0 conn(0x7fe8680c4ed0 0x7fe868158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702802175 0 0) 0x7fe868073e20 con 0x7fe8680729c0 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003530 con 0x7fe8680729c0 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146319233 0 0) 0x7fe850003530 con 0x7fe8680729c0 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 >> v2:172.21.15.16:3300/0 conn(0x7fe8680c4ed0 msgr2=0x7fe868158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 --2- 172.21.15.192:0/2632442325 >> v2:172.21.15.16:3300/0 conn(0x7fe8680c4ed0 0x7fe868158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 >> v1:172.21.15.16:6789/0 conn(0x7fe868152e10 legacy=0x7fe868070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe868074100 con 0x7fe8680729c0 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fe860001a00 con 0x7fe8680729c0 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe865d9b640 1 --2- 172.21.15.192:0/2632442325 >> v2:172.21.15.16:3300/0 conn(0x7fe8680c4ed0 0x7fe868158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 >> v1:172.21.15.192:6789/0 conn(0x7fe8680729c0 legacy=0x7fe868163310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8500039c0 0x7fe850003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850004810 0x7fe850004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8500051d0 0x7fe85000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8681531f0 con 0x7fe850004810 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe85000c070 con 0x7fe8500039c0 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe85000e480 con 0x7fe8500051d0 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86659c640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8500039c0 0x7fe850003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe866d9d640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8500051d0 0x7fe85000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe865d9b640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850004810 0x7fe850004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86659c640 1 -- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8500051d0 msgr2=0x7fe85000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86659c640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8500051d0 0x7fe85000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86659c640 1 -- 172.21.15.192:0/2632442325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850004810 msgr2=0x7fe850004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86659c640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850004810 0x7fe850004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86659c640 1 -- 172.21.15.192:0/2632442325 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe850003530 con 0x7fe8500039c0 2024-04-26T20:13:57.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe866d9d640 1 -- 172.21.15.192:0/2632442325 reap_dead start 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86659c640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8500039c0 0x7fe850003de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe858001780 tx=0x7fe85801c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14972a124e39f79f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.034+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580013a0 con 0x7fe8500039c0 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8580a9070 con 0x7fe8500039c0 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86559a640 1 -- 172.21.15.192:0/2632442325 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858003600 con 0x7fe8500039c0 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8500039c0 msgr2=0x7fe850003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8500039c0 0x7fe850003de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe858001780 tx=0x7fe85801c420 comp rx=0 tx=0).stop 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- 172.21.15.192:0/2632442325 shutdown_connections 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 --2- 172.21.15.192:0/2632442325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8500039c0 0x7fe850003de0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- 172.21.15.192:0/2632442325 >> 172.21.15.192:0/2632442325 conn(0x7fe86806c380 msgr2=0x7fe86806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- 172.21.15.192:0/2632442325 shutdown_connections 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- 172.21.15.192:0/2632442325 wait complete. 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 Processor -- start 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- start start 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8500039c0 0x7fe8681ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe868157cd0 0x7fe86815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe86815c830 0x7fe868149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680cd0e0 con 0x7fe8500039c0 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680746c0 con 0x7fe868157cd0 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe86c815640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe8680cd5a0 con 0x7fe86815c830 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe86815c830 0x7fe868149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe865d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe868157cd0 0x7fe86815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe86815c830 0x7fe868149500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:51650/0 (socket says 172.21.15.192:51650) 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 -- 172.21.15.192:0/4025783245 learned_addr learned my addr 172.21.15.192:0/4025783245 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 -- 172.21.15.192:0/4025783245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe868157cd0 msgr2=0x7fe86815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 --2- 172.21.15.192:0/4025783245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe868157cd0 0x7fe86815a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 -- 172.21.15.192:0/4025783245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8500039c0 msgr2=0x7fe8681ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 --2- 172.21.15.192:0/4025783245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8500039c0 0x7fe8681ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 -- 172.21.15.192:0/4025783245 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe868158550 con 0x7fe86815c830 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe866d9d640 1 --2- 172.21.15.192:0/4025783245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe86815c830 0x7fe868149500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe86806ffe0 tx=0x7fe860007bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe856ffd640 1 -- 172.21.15.192:0/4025783245 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86001c070 con 0x7fe86815c830 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.038+0000 7fe856ffd640 1 -- 172.21.15.192:0/4025783245 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe860011840 con 0x7fe86815c830 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.042+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe868151f80 con 0x7fe86815c830 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.042+0000 7fe856ffd640 1 -- 172.21.15.192:0/4025783245 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860010040 con 0x7fe86815c830 2024-04-26T20:13:57.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.042+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe868150000 con 0x7fe86815c830 2024-04-26T20:13:57.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.042+0000 7fe856ffd640 1 -- 172.21.15.192:0/4025783245 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe860011c30 con 0x7fe86815c830 2024-04-26T20:13:57.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.042+0000 7fe856ffd640 1 -- 172.21.15.192:0/4025783245 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe860016940 con 0x7fe86815c830 2024-04-26T20:13:57.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.042+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8680696e0 con 0x7fe86815c830 2024-04-26T20:13:57.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.042+0000 7fe856ffd640 1 -- 172.21.15.192:0/4025783245 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe860025070 con 0x7fe86815c830 2024-04-26T20:13:57.089 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:57.087+0000 7f24ca04a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:13:57.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.114+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "acc5407d-e3ad-4ffa-8988-7e6353ba226a", "id": 1} v 0) -- 0x7fe8680cd380 con 0x7fe86815c830 2024-04-26T20:13:57.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe856ffd640 1 -- 172.21.15.192:0/4025783245 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "acc5407d-e3ad-4ffa-8988-7e6353ba226a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe860016c60 con 0x7fe86815c830 2024-04-26T20:13:57.116 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-04-26T20:13:57.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe86815c830 msgr2=0x7fe868149500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 --2- 172.21.15.192:0/4025783245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe86815c830 0x7fe868149500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe86806ffe0 tx=0x7fe860007bb0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 shutdown_connections 2024-04-26T20:13:57.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 --2- 172.21.15.192:0/4025783245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe86815c830 0x7fe868149500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 --2- 172.21.15.192:0/4025783245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe868157cd0 0x7fe86815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 --2- 172.21.15.192:0/4025783245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8500039c0 0x7fe8681ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 >> 172.21.15.192:0/4025783245 conn(0x7fe86806c380 msgr2=0x7fe868158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 shutdown_connections 2024-04-26T20:13:57.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.118+0000 7fe86c815640 1 -- 172.21.15.192:0/4025783245 wait complete. 2024-04-26T20:13:57.133 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 94630365-5d5d-4b5c-9946-e403c8604b96 2 2024-04-26T20:13:57.190 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:57.190+0000 7f8cd1256180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T20:13:57.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.246+0000 7fca5fb1b640 1 Processor -- start 2024-04-26T20:13:57.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.246+0000 7fca5fb1b640 1 -- start start 2024-04-26T20:13:57.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5806e3b0 0x7fca5815c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fca580b20f0 0x7fca580cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5806d630 con 0x7fca58156200 2024-04-26T20:13:57.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fca580cd000 con 0x7fca580b20f0 2024-04-26T20:13:57.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fca5806d910 con 0x7fca5806e3b0 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d0b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5806e3b0 0x7fca5815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d8b7640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fca58156200 0x7fca5806dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36498/0 (socket says 172.21.15.192:36498) 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d8b7640 1 -- 172.21.15.192:0/2201436863 learned_addr learned my addr 172.21.15.192:0/2201436863 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5e0b8640 1 --2- 172.21.15.192:0/2201436863 >> v2:172.21.15.16:3300/0 conn(0x7fca580b20f0 0x7fca580cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d0b6640 1 -- 172.21.15.192:0/2201436863 >> v2:172.21.15.16:3300/0 conn(0x7fca580b20f0 msgr2=0x7fca580cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5c8b5640 1 -- 172.21.15.192:0/2201436863 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226625774 0 0) 0x7fca5806d630 con 0x7fca58156200 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d0b6640 1 --2- 172.21.15.192:0/2201436863 >> v2:172.21.15.16:3300/0 conn(0x7fca580b20f0 0x7fca580cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d0b6640 1 -- 172.21.15.192:0/2201436863 >> v1:172.21.15.192:6789/0 conn(0x7fca58156200 legacy=0x7fca5806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d0b6640 1 -- 172.21.15.192:0/2201436863 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5815be50 con 0x7fca5806e3b0 2024-04-26T20:13:57.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5d0b6640 1 --2- 172.21.15.192:0/2201436863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5806e3b0 0x7fca5815c930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca480097c0 tx=0x7fca4801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=385d979c2fa3a5db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5c8b5640 1 -- 172.21.15.192:0/2201436863 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480b1070 con 0x7fca5806e3b0 2024-04-26T20:13:57.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5c8b5640 1 -- 172.21.15.192:0/2201436863 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca480ac410 con 0x7fca5806e3b0 2024-04-26T20:13:57.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5c8b5640 1 -- 172.21.15.192:0/2201436863 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480ac7e0 con 0x7fca5806e3b0 2024-04-26T20:13:57.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2201436863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5806e3b0 msgr2=0x7fca5815c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 --2- 172.21.15.192:0/2201436863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5806e3b0 0x7fca5815c930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca480097c0 tx=0x7fca4801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2201436863 shutdown_connections 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 --2- 172.21.15.192:0/2201436863 >> v2:172.21.15.16:3300/0 conn(0x7fca580b20f0 0x7fca580cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 --2- 172.21.15.192:0/2201436863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5806e3b0 0x7fca5815c930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2201436863 >> 172.21.15.192:0/2201436863 conn(0x7fca58068140 msgr2=0x7fca58068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2201436863 shutdown_connections 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.250+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2201436863 wait complete. 2024-04-26T20:13:57.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 Processor -- start 2024-04-26T20:13:57.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 -- start start 2024-04-26T20:13:57.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca580b20f0 0x7fca5815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca58156200 0x7fca580cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca58154e20 0x7fca58158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fca581691b0 con 0x7fca58154e20 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fca58169030 con 0x7fca580b20f0 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fca58169330 con 0x7fca58156200 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca58156200 0x7fca580cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d8b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca580b20f0 0x7fca5815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca58156200 0x7fca580cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:51670/0 (socket says 172.21.15.192:51670) 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d8b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca580b20f0 0x7fca5815e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38104/0 (socket says 172.21.15.192:38104) 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 -- 172.21.15.192:0/2098912808 learned_addr learned my addr 172.21.15.192:0/2098912808 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5e0b8640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca58154e20 0x7fca58158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 -- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca580b20f0 msgr2=0x7fca5815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca580b20f0 0x7fca5815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 -- 172.21.15.192:0/2098912808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca58154e20 msgr2=0x7fca58158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca58154e20 0x7fca58158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 -- 172.21.15.192:0/2098912808 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca581f4c60 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5e0b8640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca58154e20 0x7fca58158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d8b7640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca580b20f0 0x7fca5815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5d0b6640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca58156200 0x7fca580cd3d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca480097c0 tx=0x7fca48019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca4e7fc640 1 -- 172.21.15.192:0/2098912808 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480bc070 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca4e7fc640 1 -- 172.21.15.192:0/2098912808 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca480ace20 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca581f8c50 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca4e7fc640 1 -- 172.21.15.192:0/2098912808 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480b1040 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca581f51e0 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca4e7fc640 1 -- 172.21.15.192:0/2098912808 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca48004230 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca4e7fc640 1 -- 172.21.15.192:0/2098912808 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fca48003da0 con 0x7fca58156200 2024-04-26T20:13:57.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.254+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca580696e0 con 0x7fca58156200 2024-04-26T20:13:57.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.258+0000 7fca4e7fc640 1 -- 172.21.15.192:0/2098912808 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fca48016090 con 0x7fca58156200 2024-04-26T20:13:57.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.326+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "94630365-5d5d-4b5c-9946-e403c8604b96", "id": 2} v 0) -- 0x7fca580ca6b0 con 0x7fca58156200 2024-04-26T20:13:57.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca4e7fc640 1 -- 172.21.15.192:0/2098912808 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94630365-5d5d-4b5c-9946-e403c8604b96", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fca48003620 con 0x7fca58156200 2024-04-26T20:13:57.329 INFO:teuthology.orchestra.run.smithi192.stdout:2 2024-04-26T20:13:57.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca58156200 msgr2=0x7fca580cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca58156200 0x7fca580cd3d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca480097c0 tx=0x7fca48019240 comp rx=0 tx=0).stop 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 shutdown_connections 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca58154e20 0x7fca58158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca58156200 0x7fca580cd3d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 --2- 172.21.15.192:0/2098912808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca580b20f0 0x7fca5815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 >> 172.21.15.192:0/2098912808 conn(0x7fca58068140 msgr2=0x7fca580b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 shutdown_connections 2024-04-26T20:13:57.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.330+0000 7fca5fb1b640 1 -- 172.21.15.192:0/2098912808 wait complete. 2024-04-26T20:13:57.345 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 7efc6fa8-e3c8-4acb-bd22-74c334fea496 3 2024-04-26T20:13:57.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.462+0000 7f3de8a9e640 1 Processor -- start 2024-04-26T20:13:57.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.462+0000 7f3de8a9e640 1 -- start start 2024-04-26T20:13:57.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3de40cbf20 0x7f3de40cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de41541f0 con 0x7f3de4153e10 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de40cb4a0 con 0x7f3de40c44e0 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f3de415ab00 con 0x7f3de40cbf20 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de2d9d640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3de40cbf20 0x7f3de40cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de2d9d640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3de40cbf20 0x7f3de40cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38106/0 (socket says 172.21.15.192:38106) 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de2d9d640 1 -- 172.21.15.192:0/3610960532 learned_addr learned my addr 172.21.15.192:0/3610960532 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de2d9d640 1 -- 172.21.15.192:0/3610960532 >> v1:172.21.15.192:6789/0 conn(0x7f3de40c44e0 legacy=0x7f3de415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de2d9d640 1 -- 172.21.15.192:0/3610960532 >> v1:172.21.15.16:6789/0 conn(0x7f3de4153e10 legacy=0x7f3de40c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de2d9d640 1 -- 172.21.15.192:0/3610960532 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de40cb780 con 0x7f3de40cbf20 2024-04-26T20:13:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de2d9d640 1 --2- 172.21.15.192:0/3610960532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de40cbf20 0x7f3de40cc300 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009870 tx=0x7f3dd401ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcdc3277457d928d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de159a640 1 -- 172.21.15.192:0/3610960532 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40b5070 con 0x7f3de40cbf20 2024-04-26T20:13:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de159a640 1 -- 172.21.15.192:0/3610960532 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd40a8a50 con 0x7f3de40cbf20 2024-04-26T20:13:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de159a640 1 -- 172.21.15.192:0/3610960532 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40a8e20 con 0x7f3de40cbf20 2024-04-26T20:13:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- 172.21.15.192:0/3610960532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de40cbf20 msgr2=0x7f3de40cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 --2- 172.21.15.192:0/3610960532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de40cbf20 0x7f3de40cc300 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009870 tx=0x7f3dd401ed50 comp rx=0 tx=0).stop 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- 172.21.15.192:0/3610960532 shutdown_connections 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 --2- 172.21.15.192:0/3610960532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de40cbf20 0x7f3de40cc300 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- 172.21.15.192:0/3610960532 >> 172.21.15.192:0/3610960532 conn(0x7f3de4068770 msgr2=0x7f3de4071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- 172.21.15.192:0/3610960532 shutdown_connections 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.466+0000 7f3de8a9e640 1 -- 172.21.15.192:0/3610960532 wait complete. 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 Processor -- start 2024-04-26T20:13:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 -- start start 2024-04-26T20:13:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de40c44e0 0x7f3de40b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3de40cbf20 0x7f3de4152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de4153e10 0x7f3de41f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3de40cbd40 con 0x7f3de40c44e0 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3de40cc840 con 0x7f3de4153e10 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3de4159bf0 con 0x7f3de40cbf20 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de2d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de4153e10 0x7f3de41f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de1d9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3de40cbf20 0x7f3de4152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de2d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de4153e10 0x7f3de41f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38114/0 (socket says 172.21.15.192:38114) 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de2d9d640 1 -- 172.21.15.192:0/1892639108 learned_addr learned my addr 172.21.15.192:0/1892639108 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de259c640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de40c44e0 0x7f3de40b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de1d9b640 1 -- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de4153e10 msgr2=0x7f3de41f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de1d9b640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de4153e10 0x7f3de41f4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de1d9b640 1 -- 172.21.15.192:0/1892639108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de40c44e0 msgr2=0x7f3de40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de1d9b640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de40c44e0 0x7f3de40b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de1d9b640 1 -- 172.21.15.192:0/1892639108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de41f1220 con 0x7f3de40cbf20 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de2d9d640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de4153e10 0x7f3de41f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de259c640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de40c44e0 0x7f3de40b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de1d9b640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3de40cbf20 0x7f3de4152510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8001ec0 tx=0x7f3dd800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3dd2ffd640 1 -- 172.21.15.192:0/1892639108 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8017070 con 0x7f3de40cbf20 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3dd2ffd640 1 -- 172.21.15.192:0/1892639108 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd80052d0 con 0x7f3de40cbf20 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de41530f0 con 0x7f3de40cbf20 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3dd2ffd640 1 -- 172.21.15.192:0/1892639108 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8003840 con 0x7f3de40cbf20 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de406ef60 con 0x7f3de40cbf20 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3dd2ffd640 1 -- 172.21.15.192:0/1892639108 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3dd801a070 con 0x7f3de40cbf20 2024-04-26T20:13:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3dd2ffd640 1 -- 172.21.15.192:0/1892639108 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3dd8011b80 con 0x7f3de40cbf20 2024-04-26T20:13:57.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.470+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de40696e0 con 0x7f3de40cbf20 2024-04-26T20:13:57.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.474+0000 7f3dd2ffd640 1 -- 172.21.15.192:0/1892639108 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3dd8021070 con 0x7f3de40cbf20 2024-04-26T20:13:57.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.542+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7efc6fa8-e3c8-4acb-bd22-74c334fea496", "id": 3} v 0) -- 0x7f3de40ca710 con 0x7f3de40cbf20 2024-04-26T20:13:57.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3dd2ffd640 1 -- 172.21.15.192:0/1892639108 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7efc6fa8-e3c8-4acb-bd22-74c334fea496", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3dd8011590 con 0x7f3de40cbf20 2024-04-26T20:13:57.546 INFO:teuthology.orchestra.run.smithi192.stdout:3 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3de40cbf20 msgr2=0x7f3de4152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3de40cbf20 0x7f3de4152510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8001ec0 tx=0x7f3dd800c890 comp rx=0 tx=0).stop 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 shutdown_connections 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3de4153e10 0x7f3de41f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3de40cbf20 0x7f3de4152510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 --2- 172.21.15.192:0/1892639108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3de40c44e0 0x7f3de40b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 >> 172.21.15.192:0/1892639108 conn(0x7f3de4068770 msgr2=0x7f3de40cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 shutdown_connections 2024-04-26T20:13:57.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.546+0000 7f3de8a9e640 1 -- 172.21.15.192:0/1892639108 wait complete. 2024-04-26T20:13:57.563 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 7a2f16d0-808e-4ae2-ae74-a3c86fb169c3 4 2024-04-26T20:13:57.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.682+0000 7f42487f8640 1 Processor -- start 2024-04-26T20:13:57.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.682+0000 7f42487f8640 1 -- start start 2024-04-26T20:13:57.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42400c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42400c88a0 0x7f4240164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f424015a460 con 0x7f42401504b0 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f42401540f0 con 0x7f42400c88a0 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f424015a700 con 0x7f42400c9380 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245d93640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42400c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4246594640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f42401504b0 0x7f42400c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36518/0 (socket says 172.21.15.192:36518) 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4246594640 1 -- 172.21.15.192:0/2217144392 learned_addr learned my addr 172.21.15.192:0/2217144392 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4246d95640 1 --2- 172.21.15.192:0/2217144392 >> v2:172.21.15.16:3300/0 conn(0x7f42400c88a0 0x7f4240164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245592640 1 -- 172.21.15.192:0/2217144392 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462238265 0 0) 0x7f424015a460 con 0x7f42401504b0 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245592640 1 -- 172.21.15.192:0/2217144392 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f422c003530 con 0x7f42401504b0 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245d93640 1 -- 172.21.15.192:0/2217144392 >> v2:172.21.15.16:3300/0 conn(0x7f42400c88a0 msgr2=0x7f4240164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245d93640 1 --2- 172.21.15.192:0/2217144392 >> v2:172.21.15.16:3300/0 conn(0x7f42400c88a0 0x7f4240164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245d93640 1 -- 172.21.15.192:0/2217144392 >> v1:172.21.15.192:6789/0 conn(0x7f42401504b0 legacy=0x7f42400c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245d93640 1 -- 172.21.15.192:0/2217144392 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424015d170 con 0x7f42400c9380 2024-04-26T20:13:57.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245d93640 1 --2- 172.21.15.192:0/2217144392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42400c8360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f42300097c0 tx=0x7f423001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ec01bfd920de70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245592640 1 -- 172.21.15.192:0/2217144392 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300b0070 con 0x7f42400c9380 2024-04-26T20:13:57.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245592640 1 -- 172.21.15.192:0/2217144392 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300ab600 con 0x7f42400c9380 2024-04-26T20:13:57.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f4245592640 1 -- 172.21.15.192:0/2217144392 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300ab9d0 con 0x7f42400c9380 2024-04-26T20:13:57.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- 172.21.15.192:0/2217144392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 msgr2=0x7f42400c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 --2- 172.21.15.192:0/2217144392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42400c8360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f42300097c0 tx=0x7f423001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- 172.21.15.192:0/2217144392 shutdown_connections 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 --2- 172.21.15.192:0/2217144392 >> v2:172.21.15.16:3300/0 conn(0x7f42400c88a0 0x7f4240164360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 --2- 172.21.15.192:0/2217144392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42400c8360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- 172.21.15.192:0/2217144392 >> 172.21.15.192:0/2217144392 conn(0x7f4240070590 msgr2=0x7f42400709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- 172.21.15.192:0/2217144392 shutdown_connections 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.686+0000 7f42487f8640 1 -- 172.21.15.192:0/2217144392 wait complete. 2024-04-26T20:13:57.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 Processor -- start 2024-04-26T20:13:57.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 -- start start 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42400c88a0 0x7f424014d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42401f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42401504b0 0x7f4240148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42400c4e60 con 0x7f42400c88a0 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4240150890 con 0x7f42401504b0 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f42400c4fe0 con 0x7f42400c9380 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42401f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42401f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:51700/0 (socket says 172.21.15.192:51700) 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 -- 172.21.15.192:0/3885407745 learned_addr learned my addr 172.21.15.192:0/3885407745 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4246d95640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42401504b0 0x7f4240148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4246594640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42400c88a0 0x7f424014d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 -- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42401504b0 msgr2=0x7f4240148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42401504b0 0x7f4240148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 -- 172.21.15.192:0/3885407745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42400c88a0 msgr2=0x7f424014d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42400c88a0 0x7f424014d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 -- 172.21.15.192:0/3885407745 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4240154470 con 0x7f42400c9380 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4246594640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42400c88a0 0x7f424014d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4245d93640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42401f58d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42300ae040 tx=0x7f4230019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4236ffd640 1 -- 172.21.15.192:0/3885407745 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300ba070 con 0x7f42400c9380 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4236ffd640 1 -- 172.21.15.192:0/3885407745 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300b43f0 con 0x7f42400c9380 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4236ffd640 1 -- 172.21.15.192:0/3885407745 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300b0040 con 0x7f42400c9380 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4240154710 con 0x7f42400c9380 2024-04-26T20:13:57.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f424015cd70 con 0x7f42400c9380 2024-04-26T20:13:57.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4236ffd640 1 -- 172.21.15.192:0/3885407745 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f42300bd070 con 0x7f42400c9380 2024-04-26T20:13:57.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4240155ea0 con 0x7f42400c9380 2024-04-26T20:13:57.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.690+0000 7f4236ffd640 1 -- 172.21.15.192:0/3885407745 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f42300be8c0 con 0x7f42400c9380 2024-04-26T20:13:57.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.694+0000 7f4236ffd640 1 -- 172.21.15.192:0/3885407745 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4230016090 con 0x7f42400c9380 2024-04-26T20:13:57.736 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:57.731+0000 7f24ca04a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:57.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.762+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7a2f16d0-808e-4ae2-ae74-a3c86fb169c3", "id": 4} v 0) -- 0x7f42400696e0 con 0x7f42400c9380 2024-04-26T20:13:57.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.766+0000 7f4236ffd640 1 -- 172.21.15.192:0/3885407745 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a2f16d0-808e-4ae2-ae74-a3c86fb169c3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f42300bebf0 con 0x7f42400c9380 2024-04-26T20:13:57.767 INFO:teuthology.orchestra.run.smithi192.stdout:4 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 msgr2=0x7f42401f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42401f58d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42300ae040 tx=0x7f4230019240 comp rx=0 tx=0).stop 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 shutdown_connections 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42401504b0 0x7f4240148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42400c9380 0x7f42401f58d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 --2- 172.21.15.192:0/3885407745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42400c88a0 0x7f424014d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 >> 172.21.15.192:0/3885407745 conn(0x7f4240070590 msgr2=0x7f424014af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 shutdown_connections 2024-04-26T20:13:57.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.770+0000 7f42487f8640 1 -- 172.21.15.192:0/3885407745 wait complete. 2024-04-26T20:13:57.775 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:57.774+0000 7f8cd1256180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:57.785 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 82e4c18e-eab8-4620-a1e8-fd7013ef8581 5 2024-04-26T20:13:57.802 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:57.799+0000 7f24ca04a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:13:57.831 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:57.830+0000 7f8cd1256180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T20:13:57.866 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:57.863+0000 7f24ca04a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:13:57.885 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:57.886+0000 7f8cd1256180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T20:13:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75f450640 1 Processor -- start 2024-04-26T20:13:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75f450640 1 -- start start 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75f450640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff758156200 0x7ff75815c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75f450640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff75806e3b0 0x7ff7580cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75f450640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75806d630 con 0x7ff7580b20f0 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75f450640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff7580cd000 con 0x7ff758156200 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75f450640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff75806d910 con 0x7ff75806e3b0 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d9ed640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff75806e3b0 0x7ff7580cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d9ed640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff75806e3b0 0x7ff7580cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:51712/0 (socket says 172.21.15.192:51712) 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d9ed640 1 -- 172.21.15.192:0/3838812227 learned_addr learned my addr 172.21.15.192:0/3838812227 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d1ec640 1 --2- 172.21.15.192:0/3838812227 >> v2:172.21.15.16:3300/0 conn(0x7ff758156200 0x7ff75815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d9ed640 1 -- 172.21.15.192:0/3838812227 >> v2:172.21.15.16:3300/0 conn(0x7ff758156200 msgr2=0x7ff75815c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d9ed640 1 --2- 172.21.15.192:0/3838812227 >> v2:172.21.15.16:3300/0 conn(0x7ff758156200 0x7ff75815c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d9ed640 1 -- 172.21.15.192:0/3838812227 >> v1:172.21.15.16:6789/0 conn(0x7ff7580b20f0 legacy=0x7ff75806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d9ed640 1 -- 172.21.15.192:0/3838812227 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75815be50 con 0x7ff75806e3b0 2024-04-26T20:13:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.898+0000 7ff75d1ec640 1 --2- 172.21.15.192:0/3838812227 >> v2:172.21.15.16:3300/0 conn(0x7ff758156200 0x7ff75815c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:13:57.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75d9ed640 1 --2- 172.21.15.192:0/3838812227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff75806e3b0 0x7ff7580cf4e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff750009e50 tx=0x7ff75001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6103df5f866e1bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff74ffff640 1 -- 172.21.15.192:0/3838812227 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500a5810 con 0x7ff75806e3b0 2024-04-26T20:13:57.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff74ffff640 1 -- 172.21.15.192:0/3838812227 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7500a59b0 con 0x7ff75806e3b0 2024-04-26T20:13:57.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff74ffff640 1 -- 172.21.15.192:0/3838812227 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500a5d80 con 0x7ff75806e3b0 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 -- 172.21.15.192:0/3838812227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff75806e3b0 msgr2=0x7ff7580cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 --2- 172.21.15.192:0/3838812227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff75806e3b0 0x7ff7580cf4e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff750009e50 tx=0x7ff75001ca30 comp rx=0 tx=0).stop 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 -- 172.21.15.192:0/3838812227 shutdown_connections 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 --2- 172.21.15.192:0/3838812227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff75806e3b0 0x7ff7580cf4e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 --2- 172.21.15.192:0/3838812227 >> v2:172.21.15.16:3300/0 conn(0x7ff758156200 0x7ff75815c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 -- 172.21.15.192:0/3838812227 >> 172.21.15.192:0/3838812227 conn(0x7ff758068140 msgr2=0x7ff758068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 -- 172.21.15.192:0/3838812227 shutdown_connections 2024-04-26T20:13:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.902+0000 7ff75f450640 1 -- 172.21.15.192:0/3838812227 wait complete. 2024-04-26T20:13:57.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 Processor -- start 2024-04-26T20:13:57.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 -- start start 2024-04-26T20:13:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7580b20f0 0x7ff75814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff758156200 0x7ff758156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff758156d60 0x7ff75815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581691b0 con 0x7ff758156d60 2024-04-26T20:13:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff758169030 con 0x7ff7580b20f0 2024-04-26T20:13:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff758169330 con 0x7ff758156200 2024-04-26T20:13:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7580b20f0 0x7ff75814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7580b20f0 0x7ff75814e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38130/0 (socket says 172.21.15.192:38130) 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 -- 172.21.15.192:0/2779892240 learned_addr learned my addr 172.21.15.192:0/2779892240 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75c9eb640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff758156200 0x7ff758156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d9ed640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff758156d60 0x7ff75815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 -- 172.21.15.192:0/2779892240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff758156200 msgr2=0x7ff758156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff758156200 0x7ff758156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 -- 172.21.15.192:0/2779892240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff758156d60 msgr2=0x7ff75815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff758156d60 0x7ff75815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 -- 172.21.15.192:0/2779892240 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7580cedd0 con 0x7ff7580b20f0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d9ed640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff758156d60 0x7ff75815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75d1ec640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7580b20f0 0x7ff75814e630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff75400e810 tx=0x7ff75400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff74dffb640 1 -- 172.21.15.192:0/2779892240 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754017070 con 0x7ff7580b20f0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff74dffb640 1 -- 172.21.15.192:0/2779892240 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75400c8d0 con 0x7ff7580b20f0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff74dffb640 1 -- 172.21.15.192:0/2779892240 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75400f040 con 0x7ff7580b20f0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7580b4a00 con 0x7ff7580b20f0 2024-04-26T20:13:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7580b4ca0 con 0x7ff7580b20f0 2024-04-26T20:13:57.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff74dffb640 1 -- 172.21.15.192:0/2779892240 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff75401a070 con 0x7ff7580b20f0 2024-04-26T20:13:57.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.906+0000 7ff74dffb640 1 -- 172.21.15.192:0/2779892240 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7ff75401ccc0 con 0x7ff7580b20f0 2024-04-26T20:13:57.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.910+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7580696e0 con 0x7ff7580b20f0 2024-04-26T20:13:57.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.910+0000 7ff74dffb640 1 -- 172.21.15.192:0/2779892240 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff75400cca0 con 0x7ff7580b20f0 2024-04-26T20:13:57.959 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:57.955+0000 7f24ca04a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:13:57.965 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:57.966+0000 7f8cd1256180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T20:13:57.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.978+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "82e4c18e-eab8-4620-a1e8-fd7013ef8581", "id": 5} v 0) -- 0x7ff7580ca6b0 con 0x7ff7580b20f0 2024-04-26T20:13:57.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.982+0000 7ff74dffb640 1 -- 172.21.15.192:0/2779892240 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82e4c18e-eab8-4620-a1e8-fd7013ef8581", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7ff75401c450 con 0x7ff7580b20f0 2024-04-26T20:13:57.983 INFO:teuthology.orchestra.run.smithi192.stdout:5 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.982+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7580b20f0 msgr2=0x7ff75814e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.982+0000 7ff75f450640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7580b20f0 0x7ff75814e630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff75400e810 tx=0x7ff75400ecd0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.986+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 shutdown_connections 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.986+0000 7ff75f450640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff758156d60 0x7ff75815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.986+0000 7ff75f450640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff758156200 0x7ff758156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.986+0000 7ff75f450640 1 --2- 172.21.15.192:0/2779892240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7580b20f0 0x7ff75814e630 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.986+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 >> 172.21.15.192:0/2779892240 conn(0x7ff758068140 msgr2=0x7ff7580af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.986+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 shutdown_connections 2024-04-26T20:13:57.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:57.986+0000 7ff75f450640 1 -- 172.21.15.192:0/2779892240 wait complete. 2024-04-26T20:13:57.999 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 435a458a-9da0-44a7-b25b-e9cd45cbf4ea 6 2024-04-26T20:13:58.020 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:58.022+0000 7f8cd1256180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:13:58.023 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:58.019+0000 7f24ca04a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T20:13:58.100 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:58.102+0000 7f8cd1256180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:13:58.116 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:58.111+0000 7f24ca04a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T20:13:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.138+0000 7f792583a640 1 Processor -- start 2024-04-26T20:13:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.138+0000 7f792583a640 1 -- start start 2024-04-26T20:13:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f792583a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f792583a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79200735c0 0x7f7920158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f792583a640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f79200c8ab0 0x7f7920068140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f792583a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7920072bb0 con 0x7f79200735c0 2024-04-26T20:13:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f792583a640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f792015b710 con 0x7f79200c8ab0 2024-04-26T20:13:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f792583a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f792015c6a0 con 0x7f79201525a0 2024-04-26T20:13:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791effd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791f7fe640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f79200c8ab0 0x7f7920068140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791effd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:51728/0 (socket says 172.21.15.192:51728) 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791effd640 1 -- 172.21.15.192:0/1486284031 learned_addr learned my addr 172.21.15.192:0/1486284031 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791e7fc640 1 --2- 172.21.15.192:0/1486284031 >> v2:172.21.15.16:3300/0 conn(0x7f79200735c0 0x7f7920158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791f7fe640 1 -- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 msgr2=0x7f792015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791f7fe640 1 --2- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791f7fe640 1 -- 172.21.15.192:0/1486284031 >> v2:172.21.15.16:3300/0 conn(0x7f79200735c0 msgr2=0x7f7920158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791f7fe640 1 --2- 172.21.15.192:0/1486284031 >> v2:172.21.15.16:3300/0 conn(0x7f79200735c0 0x7f7920158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791f7fe640 1 -- 172.21.15.192:0/1486284031 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79201590e0 con 0x7f79200c8ab0 2024-04-26T20:13:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791effd640 1 --2- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:58.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791f7fe640 1 --2- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f7920068140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f792006ff60 tx=0x7f791801c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97772bc7c410f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:58.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791dffb640 1 -- 172.21.15.192:0/1486284031 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180b2070 con 0x7f79200c8ab0 2024-04-26T20:13:58.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791dffb640 1 -- 172.21.15.192:0/1486284031 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79180a5860 con 0x7f79200c8ab0 2024-04-26T20:13:58.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.142+0000 7f791dffb640 1 -- 172.21.15.192:0/1486284031 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79180a5c30 con 0x7f79200c8ab0 2024-04-26T20:13:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 msgr2=0x7f7920068140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 --2- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f7920068140 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f792006ff60 tx=0x7f791801c7e0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- 172.21.15.192:0/1486284031 shutdown_connections 2024-04-26T20:13:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 --2- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f7920068140 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 --2- 172.21.15.192:0/1486284031 >> v2:172.21.15.16:3300/0 conn(0x7f79200735c0 0x7f7920158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 --2- 172.21.15.192:0/1486284031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- 172.21.15.192:0/1486284031 >> 172.21.15.192:0/1486284031 conn(0x7f7920070590 msgr2=0x7f79200709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:58.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- 172.21.15.192:0/1486284031 shutdown_connections 2024-04-26T20:13:58.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- 172.21.15.192:0/1486284031 wait complete. 2024-04-26T20:13:58.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 Processor -- start 2024-04-26T20:13:58.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- start start 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79200735c0 0x7f792015f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f792015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f792015bc40 con 0x7f79200735c0 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f792015b960 con 0x7f79200c8ab0 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f79200c9300 con 0x7f79201525a0 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f792015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f792015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38150/0 (socket says 172.21.15.192:38150) 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 -- 172.21.15.192:0/3448594844 learned_addr learned my addr 172.21.15.192:0/3448594844 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791f7fe640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791effd640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79200735c0 0x7f792015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 -- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 msgr2=0x7f792015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 -- 172.21.15.192:0/3448594844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79200735c0 msgr2=0x7f792015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79200735c0 0x7f792015f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 -- 172.21.15.192:0/3448594844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79201f5880 con 0x7f79200c8ab0 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791f7fe640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f791e7fc640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f792015cf00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f791400d800 tx=0x7f791400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f7907fff640 1 -- 172.21.15.192:0/3448594844 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914018030 con 0x7f79200c8ab0 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f7907fff640 1 -- 172.21.15.192:0/3448594844 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79140096a0 con 0x7f79200c8ab0 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79201633b0 con 0x7f79200c8ab0 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f7907fff640 1 -- 172.21.15.192:0/3448594844 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914009870 con 0x7f79200c8ab0 2024-04-26T20:13:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.146+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792015fba0 con 0x7f79200c8ab0 2024-04-26T20:13:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.150+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79200696e0 con 0x7f79200c8ab0 2024-04-26T20:13:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.150+0000 7f7907fff640 1 -- 172.21.15.192:0/3448594844 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f791401b070 con 0x7f79200c8ab0 2024-04-26T20:13:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.150+0000 7f7907fff640 1 -- 172.21.15.192:0/3448594844 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f79140059a0 con 0x7f79200c8ab0 2024-04-26T20:13:58.156 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:58.158+0000 7f8cd1256180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:13:58.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.174+0000 7f7907fff640 1 -- 172.21.15.192:0/3448594844 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7914005ba0 con 0x7f79200c8ab0 2024-04-26T20:13:58.183 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:58.179+0000 7f24ca04a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T20:13:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.238+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "435a458a-9da0-44a7-b25b-e9cd45cbf4ea", "id": 6} v 0) -- 0x7f7920150d70 con 0x7f79200c8ab0 2024-04-26T20:13:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.242+0000 7f7907fff640 1 -- 172.21.15.192:0/3448594844 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "435a458a-9da0-44a7-b25b-e9cd45cbf4ea", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7914009a10 con 0x7f79200c8ab0 2024-04-26T20:13:58.243 INFO:teuthology.orchestra.run.smithi192.stdout:6 2024-04-26T20:13:58.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 msgr2=0x7f792015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f792015cf00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f791400d800 tx=0x7f791400dcc0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 shutdown_connections 2024-04-26T20:13:58.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79201525a0 0x7f792015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79200c8ab0 0x7f792015cf00 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f791400d800 tx=0x7f791400dcc0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 --2- 172.21.15.192:0/3448594844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79200735c0 0x7f792015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 >> 172.21.15.192:0/3448594844 conn(0x7f7920070590 msgr2=0x7f7920074020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:58.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 shutdown_connections 2024-04-26T20:13:58.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.246+0000 7f792583a640 1 -- 172.21.15.192:0/3448594844 wait complete. 2024-04-26T20:13:58.259 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new e9a5b919-911c-46c5-a5e5-e5e8bad1de9f 7 2024-04-26T20:13:58.311 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:58.310+0000 7f8cd1256180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:13:58.358 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:58.355+0000 7f24ca04a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T20:13:58.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.366+0000 7f74787a8640 1 Processor -- start 2024-04-26T20:13:58.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.366+0000 7f74787a8640 1 -- start start 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f74787a8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f74700c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f74787a8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74700c5e80 con 0x7f74700c7a40 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f74787a8640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74700c9060 con 0x7f74700715e0 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f74787a8640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7470073f10 con 0x7f74700c7660 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7476544640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f74700c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7476d45640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f74700715e0 0x7f7470152910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36530/0 (socket says 172.21.15.192:36530) 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7476d45640 1 -- 172.21.15.192:0/2367587579 learned_addr learned my addr 172.21.15.192:0/2367587579 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7475542640 1 -- 172.21.15.192:0/2367587579 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854698841 0 0) 0x7f74700c9060 con 0x7f74700715e0 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7476544640 1 -- 172.21.15.192:0/2367587579 >> v1:172.21.15.192:6789/0 conn(0x7f74700715e0 legacy=0x7f7470152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7476544640 1 -- 172.21.15.192:0/2367587579 >> v1:172.21.15.16:6789/0 conn(0x7f74700c7a40 legacy=0x7f74701592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:58.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7476544640 1 -- 172.21.15.192:0/2367587579 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7470074410 con 0x7f74700c7660 2024-04-26T20:13:58.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7476544640 1 --2- 172.21.15.192:0/2367587579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f74700c8b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f746c0097f0 tx=0x7f746c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbf5ce031d7c2581 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:58.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.370+0000 7f7475542640 1 -- 172.21.15.192:0/2367587579 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c0b5070 con 0x7f74700c7660 2024-04-26T20:13:58.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7475542640 1 -- 172.21.15.192:0/2367587579 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c0a8990 con 0x7f74700c7660 2024-04-26T20:13:58.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7475542640 1 -- 172.21.15.192:0/2367587579 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c0a8d60 con 0x7f74700c7660 2024-04-26T20:13:58.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- 172.21.15.192:0/2367587579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 msgr2=0x7f74700c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 --2- 172.21.15.192:0/2367587579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f74700c8b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f746c0097f0 tx=0x7f746c01ec90 comp rx=0 tx=0).stop 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- 172.21.15.192:0/2367587579 shutdown_connections 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 --2- 172.21.15.192:0/2367587579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f74700c8b20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- 172.21.15.192:0/2367587579 >> 172.21.15.192:0/2367587579 conn(0x7f74700ce220 msgr2=0x7f74700ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- 172.21.15.192:0/2367587579 shutdown_connections 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- 172.21.15.192:0/2367587579 wait complete. 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 Processor -- start 2024-04-26T20:13:58.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- start start 2024-04-26T20:13:58.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74700715e0 0x7f74701e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f747014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74700c7a40 0x7f74700ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74700c5ba0 con 0x7f74700715e0 2024-04-26T20:13:58.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7470158e20 con 0x7f74700c7a40 2024-04-26T20:13:58.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f74700740d0 con 0x7f74700c7660 2024-04-26T20:13:58.375 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f8cd1256180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:13:58.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74700c7a40 0x7f74700ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7475d43640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f747014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74700c7a40 0x7f74700ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38154/0 (socket says 172.21.15.192:38154) 2024-04-26T20:13:58.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 -- 172.21.15.192:0/2504001224 learned_addr learned my addr 172.21.15.192:0/2504001224 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-04-26T20:13:58.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476544640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74700715e0 0x7f74701e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 -- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 msgr2=0x7f747014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f747014d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 -- 172.21.15.192:0/2504001224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74700715e0 msgr2=0x7f74701e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74700715e0 0x7f74701e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 -- 172.21.15.192:0/2504001224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7470155f20 con 0x7f74700c7a40 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7475d43640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f747014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7476d45640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74700c7a40 0x7f74700ce600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f746800c6d0 tx=0x7f746800cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7466ffd640 1 -- 172.21.15.192:0/2504001224 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468018070 con 0x7f74700c7a40 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7466ffd640 1 -- 172.21.15.192:0/2504001224 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7468004d70 con 0x7f74700c7a40 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7470157e20 con 0x7f74700c7a40 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f7466ffd640 1 -- 172.21.15.192:0/2504001224 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746800a880 con 0x7f74700c7a40 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.374+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74701f3380 con 0x7f74700c7a40 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.378+0000 7f7466ffd640 1 -- 172.21.15.192:0/2504001224 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f746801b070 con 0x7f74700c7a40 2024-04-26T20:13:58.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.378+0000 7f7466ffd640 1 -- 172.21.15.192:0/2504001224 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f7468007940 con 0x7f74700c7a40 2024-04-26T20:13:58.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.378+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74700696e0 con 0x7f74700c7a40 2024-04-26T20:13:58.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.378+0000 7f7466ffd640 1 -- 172.21.15.192:0/2504001224 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7470157e20 con 0x7f74700c7a40 2024-04-26T20:13:58.432 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:58.427+0000 7f24ca04a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T20:13:58.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.442+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e9a5b919-911c-46c5-a5e5-e5e8bad1de9f", "id": 7} v 0) -- 0x7f7470150cb0 con 0x7f74700c7a40 2024-04-26T20:13:58.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f7466ffd640 1 -- 172.21.15.192:0/2504001224 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9a5b919-911c-46c5-a5e5-e5e8bad1de9f", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f746800ac30 con 0x7f74700c7a40 2024-04-26T20:13:58.448 INFO:teuthology.orchestra.run.smithi192.stdout:7 2024-04-26T20:13:58.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74700c7a40 msgr2=0x7f74700ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74700c7a40 0x7f74700ce600 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f746800c6d0 tx=0x7f746800cb90 comp rx=0 tx=0).stop 2024-04-26T20:13:58.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 shutdown_connections 2024-04-26T20:13:58.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74700c7a40 0x7f74700ce600 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74700c7660 0x7f747014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 --2- 172.21.15.192:0/2504001224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74700715e0 0x7f74701e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 >> 172.21.15.192:0/2504001224 conn(0x7f74700ce220 msgr2=0x7f74701511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:58.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 shutdown_connections 2024-04-26T20:13:58.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-04-26T20:13:58.450+0000 7f74787a8640 1 -- 172.21.15.192:0/2504001224 wait complete. 2024-04-26T20:13:58.464 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T20:13:58.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T20:13:58.467 INFO:tasks.ceph.osd.0:Started 2024-04-26T20:13:58.467 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T20:13:58.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T20:13:58.470 INFO:tasks.ceph.osd.1:Started 2024-04-26T20:13:58.470 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T20:13:58.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T20:13:58.473 INFO:tasks.ceph.osd.2:Started 2024-04-26T20:13:58.473 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T20:13:58.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T20:13:58.477 INFO:tasks.ceph.osd.3:Started 2024-04-26T20:13:58.478 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T20:13:58.478 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T20:13:58.480 INFO:tasks.ceph.osd.4:Started 2024-04-26T20:13:58.480 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T20:13:58.480 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T20:13:58.482 INFO:tasks.ceph.osd.5:Started 2024-04-26T20:13:58.482 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T20:13:58.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T20:13:58.485 INFO:tasks.ceph.osd.6:Started 2024-04-26T20:13:58.485 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T20:13:58.485 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T20:13:58.487 INFO:tasks.ceph.osd.7:Started 2024-04-26T20:13:58.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:13:58.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed45a00640 1 Processor -- start 2024-04-26T20:13:58.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed45a00640 1 -- start start 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed45a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed400c4580 0x7fed400c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed45a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fed400c5810 0x7fed4015d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed45a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed400cf620 con 0x7fed401573a0 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed45a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fed400ca5a0 con 0x7fed400c4580 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed45a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fed400cf900 con 0x7fed400c5810 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed36000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed400c4580 0x7fed400c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed36000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed400c4580 0x7fed400c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36054/0 (socket says 172.21.15.16:36054) 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed36000640 1 -- 172.21.15.16:0/561474117 learned_addr learned my addr 172.21.15.16:0/561474117 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.655+0000 7fed3f400640 1 --2- 172.21.15.16:0/561474117 >> v2:172.21.15.192:3300/0 conn(0x7fed400c5810 0x7fed4015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed36000640 1 -- 172.21.15.16:0/561474117 >> v2:172.21.15.192:3300/0 conn(0x7fed400c5810 msgr2=0x7fed4015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:13:58.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed36000640 1 --2- 172.21.15.16:0/561474117 >> v2:172.21.15.192:3300/0 conn(0x7fed400c5810 0x7fed4015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed36000640 1 -- 172.21.15.16:0/561474117 >> v1:172.21.15.192:6789/0 conn(0x7fed401573a0 legacy=0x7fed400722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed36000640 1 -- 172.21.15.16:0/561474117 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed400cfbe0 con 0x7fed400c4580 2024-04-26T20:13:58.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed36000640 1 --2- 172.21.15.16:0/561474117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed400c9f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed400ca720 tx=0x7fed2801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc74073b7940ebe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:58.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed3e000640 1 -- 172.21.15.16:0/561474117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280b0070 con 0x7fed400c4580 2024-04-26T20:13:58.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed3e000640 1 -- 172.21.15.16:0/561474117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280ab600 con 0x7fed400c4580 2024-04-26T20:13:58.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed3e000640 1 -- 172.21.15.16:0/561474117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280ab9d0 con 0x7fed400c4580 2024-04-26T20:13:58.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 -- 172.21.15.16:0/561474117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 msgr2=0x7fed400c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 --2- 172.21.15.16:0/561474117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed400c9f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed400ca720 tx=0x7fed2801c490 comp rx=0 tx=0).stop 2024-04-26T20:13:58.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 -- 172.21.15.16:0/561474117 shutdown_connections 2024-04-26T20:13:58.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 --2- 172.21.15.16:0/561474117 >> v2:172.21.15.192:3300/0 conn(0x7fed400c5810 0x7fed4015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 --2- 172.21.15.16:0/561474117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed400c9f60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 -- 172.21.15.16:0/561474117 >> 172.21.15.16:0/561474117 conn(0x7fed400704d0 msgr2=0x7fed400708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:58.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 -- 172.21.15.16:0/561474117 shutdown_connections 2024-04-26T20:13:58.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.659+0000 7fed45a00640 1 -- 172.21.15.16:0/561474117 wait complete. 2024-04-26T20:13:58.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 Processor -- start 2024-04-26T20:13:58.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 -- start start 2024-04-26T20:13:58.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed401630e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed400c5810 0x7fed4006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed401573a0 0x7fed4006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:58.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fed400729c0 con 0x7fed400c4580 2024-04-26T20:13:58.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fed4015dce0 con 0x7fed401573a0 2024-04-26T20:13:58.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fed40072b40 con 0x7fed400c5810 2024-04-26T20:13:58.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed36000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed400c5810 0x7fed4006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed401573a0 0x7fed4006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed36000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed400c5810 0x7fed4006d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:52932/0 (socket says 172.21.15.16:52932) 2024-04-26T20:13:58.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed36000640 1 -- 172.21.15.16:0/4286213423 learned_addr learned my addr 172.21.15.16:0/4286213423 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:13:58.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3ea00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed401630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:58.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3ea00640 1 -- 172.21.15.16:0/4286213423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed400c5810 msgr2=0x7fed4006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3ea00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed400c5810 0x7fed4006d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3ea00640 1 -- 172.21.15.16:0/4286213423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed401573a0 msgr2=0x7fed4006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3ea00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed401573a0 0x7fed4006ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3ea00640 1 -- 172.21.15.16:0/4286213423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed401f8360 con 0x7fed400c4580 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed36000640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed400c5810 0x7fed4006d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed3ea00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed401630e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c730 tx=0x7fed3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed37400640 1 -- 172.21.15.16:0/4286213423 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30016020 con 0x7fed400c4580 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed37400640 1 -- 172.21.15.16:0/4286213423 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30006d60 con 0x7fed400c4580 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed37400640 1 -- 172.21.15.16:0/4286213423 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30003bc0 con 0x7fed400c4580 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed401f8640 con 0x7fed400c4580 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed401f8c00 con 0x7fed400c4580 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.663+0000 7fed37400640 1 -- 172.21.15.16:0/4286213423 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed30005460 con 0x7fed400c4580 2024-04-26T20:13:58.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.667+0000 7fed37400640 1 -- 172.21.15.16:0/4286213423 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fed30005750 con 0x7fed400c4580 2024-04-26T20:13:58.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.667+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed40077c20 con 0x7fed400c4580 2024-04-26T20:13:58.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.667+0000 7fed37400640 1 -- 172.21.15.16:0/4286213423 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fed30020020 con 0x7fed400c4580 2024-04-26T20:13:58.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed400cc390 con 0x7fed400c4580 2024-04-26T20:13:58.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed37400640 1 -- 172.21.15.16:0/4286213423 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fed3000a640 con 0x7fed400c4580 2024-04-26T20:13:58.731 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:13:58.731 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:13:58.443900+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 msgr2=0x7fed401630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed401630e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c730 tx=0x7fed3000cbf0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 shutdown_connections 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed401573a0 0x7fed4006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed400c5810 0x7fed4006d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 --2- 172.21.15.16:0/4286213423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed400c4580 0x7fed401630e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 >> 172.21.15.16:0/4286213423 conn(0x7fed400704d0 msgr2=0x7fed400708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 shutdown_connections 2024-04-26T20:13:58.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:13:58.727+0000 7fed45a00640 1 -- 172.21.15.16:0/4286213423 wait complete. 2024-04-26T20:13:58.750 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T20:13:58.750 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T20:13:59.017 INFO:tasks.ceph.mgr.x.smithi192.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T20:13:59.017 INFO:tasks.ceph.mgr.x.smithi192.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T20:13:59.017 INFO:tasks.ceph.mgr.x.smithi192.stderr: from numpy import show_config as show_numpy_config 2024-04-26T20:13:59.068 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:59.070+0000 7f8cd1256180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:13:59.089 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-04-26T20:13:59.090+0000 7fc3c7e917c0 -1 Falling back to public interface 2024-04-26T20:13:59.105 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-04-26T20:13:59.106+0000 7f1ce83ad7c0 -1 Falling back to public interface 2024-04-26T20:13:59.105 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-04-26T20:13:59.106+0000 7f4c4feda7c0 -1 Falling back to public interface 2024-04-26T20:13:59.114 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T20:13:59.111+0000 7f8501c3d7c0 -1 Falling back to public interface 2024-04-26T20:13:59.124 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-04-26T20:13:59.126+0000 7fc2d21057c0 -1 Falling back to public interface 2024-04-26T20:13:59.134 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T20:13:59.131+0000 7ff1d9af57c0 -1 Falling back to public interface 2024-04-26T20:13:59.137 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T20:13:59.135+0000 7f5745a957c0 -1 Falling back to public interface 2024-04-26T20:13:59.144 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T20:13:59.144 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T20:13:59.144 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2024-04-26T20:13:59.162 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T20:13:59.159+0000 7f4db68e87c0 -1 Falling back to public interface 2024-04-26T20:13:59.192 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:59.187+0000 7f24ca04a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T20:13:59.248 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:59.250+0000 7f8cd1256180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:59.348 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:59.343+0000 7f24ca04a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:59.429 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:59.430+0000 7f8cd1256180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:59.494 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:59.494+0000 7f8cd1256180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:13:59.535 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:59.531+0000 7f24ca04a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T20:13:59.554 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T20:13:59.614 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:59.611+0000 7f24ca04a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T20:13:59.626 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:13:59.626+0000 7f8cd1256180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:59.686 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1979c00640 1 Processor -- start 2024-04-26T20:13:59.686 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1979c00640 1 -- start start 2024-04-26T20:13:59.687 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1979c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f1974159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:59.687 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1979c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19740cc280 con 0x7f197415db90 2024-04-26T20:13:59.687 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1979c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1974159ed0 con 0x7f19740c95c0 2024-04-26T20:13:59.687 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1979c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1974153ea0 con 0x7f1974153ac0 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1973400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f197415db90 0x7f1974164310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41506/0 (socket says 172.21.15.16:41506) 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1973400640 1 -- 172.21.15.16:0/4075567705 learned_addr learned my addr 172.21.15.16:0/4075567705 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972a00640 1 --2- 172.21.15.16:0/4075567705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f1974159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525489891 0 0) 0x7f19740cc280 con 0x7f197415db90 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1958003530 con 0x7f197415db90 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391060320 0 0) 0x7f1974159ed0 con 0x7f19740c95c0 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19740cc280 con 0x7f19740c95c0 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972a00640 1 -- 172.21.15.16:0/4075567705 >> v1:172.21.15.192:6789/0 conn(0x7f19740c95c0 legacy=0x7f19740c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972a00640 1 -- 172.21.15.16:0/4075567705 >> v1:172.21.15.16:6789/0 conn(0x7f197415db90 legacy=0x7f1974164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2585922379 0 0) 0x7f1958003530 con 0x7f197415db90 2024-04-26T20:13:59.689 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.683+0000 7f1972a00640 1 -- 172.21.15.16:0/4075567705 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19740cc750 con 0x7f1974153ac0 2024-04-26T20:13:59.691 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1972a00640 1 --2- 172.21.15.16:0/4075567705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f1974159990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f19640097f0 tx=0x7f196401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282e9287f2729fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:59.692 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0070 con 0x7f1974153ac0 2024-04-26T20:13:59.692 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19640ab400 con 0x7f1974153ac0 2024-04-26T20:13:59.692 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1972000640 1 -- 172.21.15.16:0/4075567705 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c001a00 con 0x7f1974153ac0 2024-04-26T20:13:59.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1979c00640 1 -- 172.21.15.16:0/4075567705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 msgr2=0x7f1974159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:59.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1979c00640 1 --2- 172.21.15.16:0/4075567705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f1974159990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f19640097f0 tx=0x7f196401c2e0 comp rx=0 tx=0).stop 2024-04-26T20:13:59.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1979c00640 1 -- 172.21.15.16:0/4075567705 shutdown_connections 2024-04-26T20:13:59.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1979c00640 1 --2- 172.21.15.16:0/4075567705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f1974159990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:59.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1979c00640 1 -- 172.21.15.16:0/4075567705 >> 172.21.15.16:0/4075567705 conn(0x7f1974071620 msgr2=0x7f19740706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:59.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1979c00640 1 -- 172.21.15.16:0/4075567705 shutdown_connections 2024-04-26T20:13:59.693 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.687+0000 7f1979c00640 1 -- 172.21.15.16:0/4075567705 wait complete. 2024-04-26T20:13:59.694 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 Processor -- start 2024-04-26T20:13:59.694 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 -- start start 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19740c95c0 0x7f19740cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f19740cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197415db90 0x7f19741520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f19740c4ce0 con 0x7f19740c95c0 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19740c4b60 con 0x7f197415db90 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1974168250 con 0x7f1974153ac0 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19740c95c0 0x7f19740cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19740c95c0 0x7f19740cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36068/0 (socket says 172.21.15.16:36068) 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 -- 172.21.15.16:0/1759550521 learned_addr learned my addr 172.21.15.16:0/1759550521 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f196be00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f19740cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:59.696 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1973400640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197415db90 0x7f19741520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:13:59.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 -- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 msgr2=0x7f19740cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:59.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f19740cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:59.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 -- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197415db90 msgr2=0x7f19741520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:59.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197415db90 0x7f19741520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:59.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 -- 172.21.15.16:0/1759550521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19740d0110 con 0x7f19740c95c0 2024-04-26T20:13:59.697 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1972a00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19740c95c0 0x7f19740cf140 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19640ae040 tx=0x7f1964019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f196aa00640 1 -- 172.21.15.16:0/1759550521 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b9020 con 0x7f19740c95c0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f196aa00640 1 -- 172.21.15.16:0/1759550521 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1964003820 con 0x7f19740c95c0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f196aa00640 1 -- 172.21.15.16:0/1759550521 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0040 con 0x7f19740c95c0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19741f6640 con 0x7f19740c95c0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.691+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19741f6c00 con 0x7f19740c95c0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.695+0000 7f196aa00640 1 -- 172.21.15.16:0/1759550521 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19640bc020 con 0x7f19740c95c0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.695+0000 7f196aa00640 1 -- 172.21.15.16:0/1759550521 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f19640b5b10 con 0x7f19740c95c0 2024-04-26T20:13:59.698 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.695+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19740506d0 con 0x7f19740c95c0 2024-04-26T20:13:59.715 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.711+0000 7f196aa00640 1 -- 172.21.15.16:0/1759550521 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f19640c3030 con 0x7f19740c95c0 2024-04-26T20:13:59.775 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19740ccc30 con 0x7f19740c95c0 2024-04-26T20:13:59.776 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f196aa00640 1 -- 172.21.15.16:0/1759550521 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1964015ff0 con 0x7f19740c95c0 2024-04-26T20:13:59.776 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T20:13:59.776 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:13:58.443900+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19740c95c0 msgr2=0x7f19740cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f1979c00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19740c95c0 0x7f19740cf140 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19640ae040 tx=0x7f1964019080 comp rx=0 tx=0).stop 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 shutdown_connections 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f1979c00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f197415db90 0x7f19741520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f1979c00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1974153ac0 0x7f19740cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.771+0000 7f1979c00640 1 --2- 172.21.15.16:0/1759550521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19740c95c0 0x7f19740cf140 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.775+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 >> 172.21.15.16:0/1759550521 conn(0x7f1974071620 msgr2=0x7f197415c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:13:59.777 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.775+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 shutdown_connections 2024-04-26T20:13:59.778 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:13:59.775+0000 7f1979c00640 1 -- 172.21.15.16:0/1759550521 wait complete. 2024-04-26T20:13:59.778 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:13:59.775+0000 7f24ca04a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T20:13:59.793 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T20:14:00.237 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:00.238+0000 7f8cd1256180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:14:00.311 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:00.310+0000 7f8cd1256180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:14:00.492 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:00.490+0000 7f8cd1256180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:14:00.529 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:14:00.527+0000 7f24ca04a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T20:14:00.564 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:00.566+0000 7f8cd1256180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:14:00.620 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:14:00.615+0000 7f24ca04a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T20:14:00.837 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:14:00.835+0000 7f24ca04a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T20:14:00.853 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:00.854+0000 7f8cd1256180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:14:00.914 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:00.914+0000 7f8cd1256180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:14:00.926 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:14:00.923+0000 7f24ca04a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T20:14:01.282 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:14:01.279+0000 7f24ca04a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T20:14:01.356 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T20:14:01.351+0000 7f24ca04a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T20:14:01.957 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:01.957+0000 7f8c77ea0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T20:14:01.958 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-04-26T20:14:01.957+0000 7f8c77ea0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T20:14:02.910 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-04-26T20:14:02.909+0000 7fc3c7e917c0 -1 osd.4 0 log_to_monitors true 2024-04-26T20:14:02.923 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-04-26T20:14:02.921+0000 7f4c4feda7c0 -1 osd.5 0 log_to_monitors true 2024-04-26T20:14:02.938 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-04-26T20:14:02.937+0000 7f1ce83ad7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T20:14:03.027 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-04-26T20:14:03.029+0000 7fc2d21057c0 -1 osd.7 0 log_to_monitors true 2024-04-26T20:14:03.074 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T20:14:03.071+0000 7ff1d9af57c0 -1 osd.0 0 log_to_monitors true 2024-04-26T20:14:03.128 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T20:14:03.123+0000 7f8501c3d7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T20:14:03.138 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T20:14:03.135+0000 7f5745a957c0 -1 osd.2 0 log_to_monitors true 2024-04-26T20:14:03.171 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T20:14:03.167+0000 7f4db68e87c0 -1 osd.3 0 log_to_monitors true 2024-04-26T20:14:05.295 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-04-26T20:14:05.293+0000 7f1ce4356640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T20:14:05.316 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-04-26T20:14:05.317+0000 7f4c4c695640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T20:14:05.327 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-04-26T20:14:05.325+0000 7f1cdc18a640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:05.344 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-04-26T20:14:05.345+0000 7f4c43cb7640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:05.385 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T20:14:05.383+0000 7f5741400640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T20:14:05.404 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-04-26T20:14:05.405+0000 7fc2ce0ae640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T20:14:05.410 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-04-26T20:14:05.409+0000 7fc3c3e3a640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T20:14:05.423 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T20:14:05.419+0000 7f5736a00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:05.428 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-04-26T20:14:05.429+0000 7fc2c5ee2640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:05.436 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-04-26T20:14:05.437+0000 7fc3bbc6e640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:05.438 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T20:14:05.435+0000 7f84fca00640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T20:14:05.470 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T20:14:05.467+0000 7f84f2a00640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:05.477 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T20:14:05.475+0000 7ff1d4a00640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T20:14:05.506 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T20:14:05.503+0000 7ff1caa00640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:06.088 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T20:14:06.083+0000 7f4db1800640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T20:14:06.114 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T20:14:06.111+0000 7f4da7800640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T20:14:06.598 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:06.729 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7fe00640 1 Processor -- start 2024-04-26T20:14:06.729 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7fe00640 1 -- start start 2024-04-26T20:14:06.730 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b800c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:06.730 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b8006d510 0x7f1b8006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:06.730 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7fe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b80152ff0 con 0x7f1b80152c10 2024-04-26T20:14:06.730 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7fe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1b800c5410 con 0x7f1b8006d510 2024-04-26T20:14:06.731 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7fe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1b800c69d0 con 0x7f1b800cd390 2024-04-26T20:14:06.731 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b8006d510 0x7f1b8006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:06.732 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b8006d510 0x7f1b8006d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41036/0 (socket says 172.21.15.16:41036) 2024-04-26T20:14:06.732 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7f400640 1 -- 172.21.15.16:0/704015439 learned_addr learned my addr 172.21.15.16:0/704015439 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:06.732 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b77e00640 1 --2- 172.21.15.16:0/704015439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b800c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:06.732 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7f400640 1 -- 172.21.15.16:0/704015439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 msgr2=0x7f1b800c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:06.732 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7f400640 1 --2- 172.21.15.16:0/704015439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b800c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.732 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7f400640 1 -- 172.21.15.16:0/704015439 >> v1:172.21.15.192:6789/0 conn(0x7f1b80152c10 legacy=0x7f1b800c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:06.732 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.727+0000 7f1b7f400640 1 -- 172.21.15.16:0/704015439 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b800ca2e0 con 0x7f1b8006d510 2024-04-26T20:14:06.734 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7f400640 1 --2- 172.21.15.16:0/704015439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b8006d510 0x7f1b8006d9a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800d150 tx=0x7f1b7801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9682a9eedebcd204 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:06.734 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7e000640 1 -- 172.21.15.16:0/704015439 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800b2d0 con 0x7f1b8006d510 2024-04-26T20:14:06.734 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7e000640 1 -- 172.21.15.16:0/704015439 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7800b470 con 0x7f1b8006d510 2024-04-26T20:14:06.734 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7e000640 1 -- 172.21.15.16:0/704015439 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780a7b10 con 0x7f1b8006d510 2024-04-26T20:14:06.735 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 -- 172.21.15.16:0/704015439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b8006d510 msgr2=0x7f1b8006d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:06.735 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/704015439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b8006d510 0x7f1b8006d9a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800d150 tx=0x7f1b7801ec30 comp rx=0 tx=0).stop 2024-04-26T20:14:06.735 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 -- 172.21.15.16:0/704015439 shutdown_connections 2024-04-26T20:14:06.735 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/704015439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b8006d510 0x7f1b8006d9a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.735 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/704015439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b800c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.735 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 -- 172.21.15.16:0/704015439 >> 172.21.15.16:0/704015439 conn(0x7f1b800ca4d0 msgr2=0x7f1b800ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:06.735 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 -- 172.21.15.16:0/704015439 shutdown_connections 2024-04-26T20:14:06.736 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 -- 172.21.15.16:0/704015439 wait complete. 2024-04-26T20:14:06.736 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 Processor -- start 2024-04-26T20:14:06.736 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.731+0000 7f1b7fe00640 1 -- start start 2024-04-26T20:14:06.738 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8006d510 0x7f1b8014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:06.738 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b80150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:06.738 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b80152c10 0x7f1b801f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:06.738 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b800c96b0 con 0x7f1b80152c10 2024-04-26T20:14:06.738 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b800c74c0 con 0x7f1b8006d510 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1b800ccf00 con 0x7f1b800cd390 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b80152c10 0x7f1b801f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b80152c10 0x7f1b801f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41052/0 (socket says 172.21.15.16:41052) 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 -- 172.21.15.16:0/2144860073 learned_addr learned my addr 172.21.15.16:0/2144860073 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b77e00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b80150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7ea00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8006d510 0x7f1b8014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 -- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 msgr2=0x7f1b80150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b80150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 -- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8006d510 msgr2=0x7f1b8014f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8006d510 0x7f1b8014f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 -- 172.21.15.16:0/2144860073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b801f8790 con 0x7f1b80152c10 2024-04-26T20:14:06.739 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7ea00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8006d510 0x7f1b8014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:06.740 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7f400640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b80152c10 0x7f1b801f7d10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b7801c860 tx=0x7f1b7801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:06.740 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b76a00640 1 -- 172.21.15.16:0/2144860073 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800b720 con 0x7f1b80152c10 2024-04-26T20:14:06.740 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b76a00640 1 -- 172.21.15.16:0/2144860073 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b780be070 con 0x7f1b80152c10 2024-04-26T20:14:06.740 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b76a00640 1 -- 172.21.15.16:0/2144860073 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78009a20 con 0x7f1b80152c10 2024-04-26T20:14:06.741 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b80151fb0 con 0x7f1b80152c10 2024-04-26T20:14:06.741 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b801551a0 con 0x7f1b80152c10 2024-04-26T20:14:06.741 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.735+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b80076f20 con 0x7f1b80152c10 2024-04-26T20:14:06.741 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.739+0000 7f1b76a00640 1 -- 172.21.15.16:0/2144860073 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f1b780b6070 con 0x7f1b80152c10 2024-04-26T20:14:06.742 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.739+0000 7f1b76a00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1b5c0682f0 0x7f1b5c06a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:06.742 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.739+0000 7f1b76a00640 1 -- 172.21.15.16:0/2144860073 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7f1b78121210 con 0x7f1b80152c10 2024-04-26T20:14:06.742 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.739+0000 7f1b7ea00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1b5c0682f0 0x7f1b5c06a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:06.743 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.739+0000 7f1b7ea00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1b5c0682f0 0x7f1b5c06a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b70001710 tx=0x7f1b70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:06.747 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.743+0000 7f1b76a00640 1 -- 172.21.15.16:0/2144860073 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1b78018820 con 0x7f1b80152c10 2024-04-26T20:14:06.912 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.907+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b800cd170 con 0x7f1b80152c10 2024-04-26T20:14:06.913 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b76a00640 1 -- 172.21.15.16:0/2144860073 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10921 (secure 0 0 0) 0x7f1b780f1ce0 con 0x7f1b80152c10 2024-04-26T20:14:06.913 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T20:14:06.913 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":14,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:06.320523+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1b5c0682f0 msgr2=0x7f1b5c06a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1b5c0682f0 0x7f1b5c06a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b70001710 tx=0x7f1b70009040 comp rx=0 tx=0).stop 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b80152c10 msgr2=0x7f1b801f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b80152c10 0x7f1b801f7d10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b7801c860 tx=0x7f1b7801b9d0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 shutdown_connections 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1b5c0682f0 0x7f1b5c06a7b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b80152c10 0x7f1b801f7d10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b800cd390 0x7f1b80150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 --2- 172.21.15.16:0/2144860073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b8006d510 0x7f1b8014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 >> 172.21.15.16:0/2144860073 conn(0x7f1b800ca4d0 msgr2=0x7f1b800cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 shutdown_connections 2024-04-26T20:14:06.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T20:14:06.911+0000 7f1b7fe00640 1 -- 172.21.15.16:0/2144860073 wait complete. 2024-04-26T20:14:06.932 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T20:14:06.932 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T20:14:06.932 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T20:14:06.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T20:14:06.936 INFO:tasks.ceph.mds.a:Started 2024-04-26T20:14:06.936 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T20:14:06.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T20:14:06.939 INFO:tasks.ceph.mds.c:Started 2024-04-26T20:14:06.939 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-26T20:14:06.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-26T20:14:06.942 INFO:tasks.ceph.mds.e:Started 2024-04-26T20:14:06.942 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T20:14:06.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T20:14:06.945 INFO:tasks.ceph.mds.b:Started 2024-04-26T20:14:06.945 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T20:14:06.945 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T20:14:06.947 INFO:tasks.ceph.mds.d:Started 2024-04-26T20:14:06.947 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-26T20:14:06.948 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-26T20:14:06.950 INFO:tasks.ceph.mds.f:Started 2024-04-26T20:14:06.950 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T20:14:06.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:07.030 INFO:tasks.ceph.mds.f.smithi192.stdout:starting mds.f at 2024-04-26T20:14:07.031 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-04-26T20:14:07.031 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-04-26T20:14:07.037 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T20:14:07.053 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-04-26T20:14:07.054 INFO:tasks.ceph.mds.e.smithi016.stdout:starting mds.e at 2024-04-26T20:14:07.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.099+0000 7fd5b5000640 1 Processor -- start 2024-04-26T20:14:07.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.099+0000 7fd5b5000640 1 -- start start 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5b5000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0155ee0 0x7fd5b0073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5b5000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5b00c9b30 0x7fd5b0073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5b5000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b00ce4d0 con 0x7fd5b0070c80 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5b5000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b00730a0 con 0x7fd5b00c9b30 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5b5000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b01562c0 con 0x7fd5b0155ee0 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5ae800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd5b0070c80 0x7fd5b006fd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46258/0 (socket says 172.21.15.16:46258) 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5ae800640 1 -- 172.21.15.16:0/1903544694 learned_addr learned my addr 172.21.15.16:0/1903544694 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5a7e00640 1 --2- 172.21.15.16:0/1903544694 >> v2:172.21.15.192:3300/0 conn(0x7fd5b00c9b30 0x7fd5b0073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5ade00640 1 --2- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0155ee0 0x7fd5b0073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5ad400640 1 -- 172.21.15.16:0/1903544694 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631012787 0 0) 0x7fd5b00ce4d0 con 0x7fd5b0070c80 2024-04-26T20:14:07.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5ad400640 1 -- 172.21.15.16:0/1903544694 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd594003530 con 0x7fd5b0070c80 2024-04-26T20:14:07.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5a7e00640 1 -- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0155ee0 msgr2=0x7fd5b0073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:07.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5a7e00640 1 --2- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0155ee0 0x7fd5b0073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5a7e00640 1 -- 172.21.15.16:0/1903544694 >> v1:172.21.15.16:6789/0 conn(0x7fd5b0070c80 legacy=0x7fd5b006fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.103+0000 7fd5a7e00640 1 -- 172.21.15.16:0/1903544694 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b015c740 con 0x7fd5b00c9b30 2024-04-26T20:14:07.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5a7e00640 1 --2- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c9b30 0x7fd5b0073a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5980097c0 tx=0x7fd59801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=454fda0ee5abc162 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:07.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5ad400640 1 -- 172.21.15.16:0/1903544694 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980aa620 con 0x7fd5b00c9b30 2024-04-26T20:14:07.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5ad400640 1 -- 172.21.15.16:0/1903544694 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5980af070 con 0x7fd5b00c9b30 2024-04-26T20:14:07.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5ad400640 1 -- 172.21.15.16:0/1903544694 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980aa9e0 con 0x7fd5b00c9b30 2024-04-26T20:14:07.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 -- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c9b30 msgr2=0x7fd5b0073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c9b30 0x7fd5b0073a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5980097c0 tx=0x7fd59801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 -- 172.21.15.16:0/1903544694 shutdown_connections 2024-04-26T20:14:07.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c9b30 0x7fd5b0073a70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1903544694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0155ee0 0x7fd5b0073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 -- 172.21.15.16:0/1903544694 >> 172.21.15.16:0/1903544694 conn(0x7fd5b00cd5e0 msgr2=0x7fd5b00cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:07.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 -- 172.21.15.16:0/1903544694 shutdown_connections 2024-04-26T20:14:07.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 -- 172.21.15.16:0/1903544694 wait complete. 2024-04-26T20:14:07.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 Processor -- start 2024-04-26T20:14:07.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 -- start start 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.107+0000 7fd5b5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b0070c80 0x7fd5b0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b00c9b30 0x7fd5b00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5b0155ee0 0x7fd5b0151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b00709e0 con 0x7fd5b0155ee0 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0070860 con 0x7fd5b0070c80 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b0168cd0 con 0x7fd5b00c9b30 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5b0155ee0 0x7fd5b0151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5b0155ee0 0x7fd5b0151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41096/0 (socket says 172.21.15.16:41096) 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 -- 172.21.15.16:0/1538391974 learned_addr learned my addr 172.21.15.16:0/1538391974 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:07.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5a7e00640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b00c9b30 0x7fd5b00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ade00640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b0070c80 0x7fd5b0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 -- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b00c9b30 msgr2=0x7fd5b00c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b00c9b30 0x7fd5b00c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 -- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b0070c80 msgr2=0x7fd5b0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b0070c80 0x7fd5b0158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 -- 172.21.15.16:0/1538391974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b0159530 con 0x7fd5b0155ee0 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5a7e00640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b00c9b30 0x7fd5b00c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:07.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5ae800640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5b0155ee0 0x7fd5b0151180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800cb10 tx=0x7fd5a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5a6000640 1 -- 172.21.15.16:0/1538391974 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8017070 con 0x7fd5b0155ee0 2024-04-26T20:14:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5a6000640 1 -- 172.21.15.16:0/1538391974 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a800ac70 con 0x7fd5b0155ee0 2024-04-26T20:14:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5a6000640 1 -- 172.21.15.16:0/1538391974 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800ae60 con 0x7fd5b0155ee0 2024-04-26T20:14:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b0156940 con 0x7fd5b0155ee0 2024-04-26T20:14:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b0158510 con 0x7fd5b0155ee0 2024-04-26T20:14:07.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b0077c20 con 0x7fd5b0155ee0 2024-04-26T20:14:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.111+0000 7fd5a6000640 1 -- 172.21.15.16:0/1538391974 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fd5a801a070 con 0x7fd5b0155ee0 2024-04-26T20:14:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.115+0000 7fd5a6000640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd58c068320 0x7fd58c06a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.115+0000 7fd5a6000640 1 -- 172.21.15.16:0/1538391974 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7fd5a8085f80 con 0x7fd5b0155ee0 2024-04-26T20:14:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.115+0000 7fd5ade00640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd58c068320 0x7fd58c06a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.115+0000 7fd5ade00640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd58c068320 0x7fd58c06a7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009b60 tx=0x7fd5a0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.119+0000 7fd5a6000640 1 -- 172.21.15.16:0/1538391974 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd5a80564a0 con 0x7fd5b0155ee0 2024-04-26T20:14:07.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.291+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5b01598c0 con 0x7fd5b0155ee0 2024-04-26T20:14:07.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.291+0000 7fd5a6000640 1 -- 172.21.15.16:0/1538391974 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10921 (secure 0 0 0) 0x7fd5a805a7a0 con 0x7fd5b0155ee0 2024-04-26T20:14:07.295 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:06.320523+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:07.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd58c068320 msgr2=0x7fd58c06a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd58c068320 0x7fd58c06a7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009b60 tx=0x7fd5a0009190 comp rx=0 tx=0).stop 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5b0155ee0 msgr2=0x7fd5b0151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5b0155ee0 0x7fd5b0151180 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800cb10 tx=0x7fd5a800a060 comp rx=0 tx=0).stop 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 shutdown_connections 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd58c068320 0x7fd58c06a7e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5b0155ee0 0x7fd5b0151180 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b00c9b30 0x7fd5b00c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 --2- 172.21.15.16:0/1538391974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b0070c80 0x7fd5b0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 >> 172.21.15.16:0/1538391974 conn(0x7fd5b00cd5e0 msgr2=0x7fd5b006fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 shutdown_connections 2024-04-26T20:14:07.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.295+0000 7fd5b5000640 1 -- 172.21.15.16:0/1538391974 wait complete. 2024-04-26T20:14:07.316 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-26T20:14:07.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.451+0000 7f2d39c00640 1 Processor -- start 2024-04-26T20:14:07.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d39c00640 1 -- start start 2024-04-26T20:14:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d39c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d3415bc20 0x7f2d340c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d39c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d340c7430 con 0x7f2d340c8390 2024-04-26T20:14:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d39c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d340c7710 con 0x7f2d341529c0 2024-04-26T20:14:07.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d39c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2d340c8840 con 0x7f2d3415bc20 2024-04-26T20:14:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d2be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d3415bc20 0x7f2d340c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d2be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d3415bc20 0x7f2d340c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41104/0 (socket says 172.21.15.16:41104) 2024-04-26T20:14:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d2be00640 1 -- 172.21.15.16:0/3984287184 learned_addr learned my addr 172.21.15.16:0/3984287184 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d2be00640 1 -- 172.21.15.16:0/3984287184 >> v1:172.21.15.192:6789/0 conn(0x7f2d341529c0 legacy=0x7f2d34159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d2be00640 1 -- 172.21.15.16:0/3984287184 >> v1:172.21.15.16:6789/0 conn(0x7f2d340c8390 legacy=0x7f2d340ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.455+0000 7f2d2be00640 1 -- 172.21.15.16:0/3984287184 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d340c79f0 con 0x7f2d3415bc20 2024-04-26T20:14:07.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d2be00640 1 --2- 172.21.15.16:0/3984287184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d340c5830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b62325d2a4fbfe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:07.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d33400640 1 -- 172.21.15.16:0/3984287184 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0b5070 con 0x7f2d3415bc20 2024-04-26T20:14:07.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d33400640 1 -- 172.21.15.16:0/3984287184 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0a8a50 con 0x7f2d3415bc20 2024-04-26T20:14:07.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d33400640 1 -- 172.21.15.16:0/3984287184 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0a8e20 con 0x7f2d3415bc20 2024-04-26T20:14:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 -- 172.21.15.16:0/3984287184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 msgr2=0x7f2d340c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 --2- 172.21.15.16:0/3984287184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d340c5830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009870 tx=0x7f2d1c01ed50 comp rx=0 tx=0).stop 2024-04-26T20:14:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 -- 172.21.15.16:0/3984287184 shutdown_connections 2024-04-26T20:14:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 --2- 172.21.15.16:0/3984287184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d340c5830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 -- 172.21.15.16:0/3984287184 >> 172.21.15.16:0/3984287184 conn(0x7f2d34070d40 msgr2=0x7f2d34071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 -- 172.21.15.16:0/3984287184 shutdown_connections 2024-04-26T20:14:07.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 -- 172.21.15.16:0/3984287184 wait complete. 2024-04-26T20:14:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 Processor -- start 2024-04-26T20:14:07.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.459+0000 7f2d39c00640 1 -- start start 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d340c8390 0x7f2d34167a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d341529c0 0x7f2d34157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d34146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34152da0 con 0x7f2d3415bc20 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34158bf0 con 0x7f2d341529c0 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2d34070580 con 0x7f2d340c8390 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d34146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d34146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41120/0 (socket says 172.21.15.16:41120) 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 -- 172.21.15.16:0/2350687959 learned_addr learned my addr 172.21.15.16:0/2350687959 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d33e00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d340c8390 0x7f2d34167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d2be00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d341529c0 0x7f2d34157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 -- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d340c8390 msgr2=0x7f2d34167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d340c8390 0x7f2d34167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 -- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d341529c0 msgr2=0x7f2d34157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d341529c0 0x7f2d34157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 -- 172.21.15.16:0/2350687959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d340ce9c0 con 0x7f2d3415bc20 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d33e00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d340c8390 0x7f2d34167a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d2be00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d341529c0 0x7f2d34157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39200640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d34146590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c760 tx=0x7f2d2c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d30c00640 1 -- 172.21.15.16:0/2350687959 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c003b80 con 0x7f2d3415bc20 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d30c00640 1 -- 172.21.15.16:0/2350687959 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c003d20 con 0x7f2d3415bc20 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d30c00640 1 -- 172.21.15.16:0/2350687959 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00aa30 con 0x7f2d3415bc20 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d34167fd0 con 0x7f2d3415bc20 2024-04-26T20:14:07.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d34166cd0 con 0x7f2d3415bc20 2024-04-26T20:14:07.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.463+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d341415a0 con 0x7f2d3415bc20 2024-04-26T20:14:07.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.467+0000 7f2d30c00640 1 -- 172.21.15.16:0/2350687959 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f2d2c00abd0 con 0x7f2d3415bc20 2024-04-26T20:14:07.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.467+0000 7f2d30c00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d100682f0 0x7f2d1006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:07.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.467+0000 7f2d30c00640 1 -- 172.21.15.16:0/2350687959 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f2d2c086450 con 0x7f2d3415bc20 2024-04-26T20:14:07.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.467+0000 7f2d33e00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d100682f0 0x7f2d1006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:07.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.467+0000 7f2d33e00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d100682f0 0x7f2d1006a7b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d24001710 tx=0x7f2d24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:07.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.471+0000 7f2d30c00640 1 -- 172.21.15.16:0/2350687959 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2d2c056db0 con 0x7f2d3415bc20 2024-04-26T20:14:07.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.671+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d340506d0 con 0x7f2d3415bc20 2024-04-26T20:14:07.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.671+0000 7f2d30c00640 1 -- 172.21.15.16:0/2350687959 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f2d2c0566b0 con 0x7f2d3415bc20 2024-04-26T20:14:07.677 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:07.677 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T20:14:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-04-26T20:14:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d100682f0 msgr2=0x7f2d1006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d100682f0 0x7f2d1006a7b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d24001710 tx=0x7f2d24009040 comp rx=0 tx=0).stop 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 msgr2=0x7f2d34146590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d34146590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c760 tx=0x7f2d2c00cc20 comp rx=0 tx=0).stop 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 shutdown_connections 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d100682f0 0x7f2d1006a7b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d3415bc20 0x7f2d34146590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d341529c0 0x7f2d34157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 --2- 172.21.15.16:0/2350687959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d340c8390 0x7f2d34167a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 >> 172.21.15.16:0/2350687959 conn(0x7f2d34070d40 msgr2=0x7f2d34075aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 shutdown_connections 2024-04-26T20:14:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:07.675+0000 7f2d39c00640 1 -- 172.21.15.16:0/2350687959 wait complete. 2024-04-26T20:14:09.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:09.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38fd800640 1 Processor -- start 2024-04-26T20:14:09.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38fd800640 1 -- start start 2024-04-26T20:14:09.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38fd800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f38f8152bc0 0x7f38f80c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38fd800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38f8152fa0 con 0x7f38f8073480 2024-04-26T20:14:09.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38fd800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38f8159790 con 0x7f38f80c9340 2024-04-26T20:14:09.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38fd800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f38f8158930 con 0x7f38f8152bc0 2024-04-26T20:14:09.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f7400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f38f8073480 0x7f38f80c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46282/0 (socket says 172.21.15.16:46282) 2024-04-26T20:14:09.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f7400640 1 -- 172.21.15.16:0/3784625266 learned_addr learned my addr 172.21.15.16:0/3784625266 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:09.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6a00640 1 --2- 172.21.15.16:0/3784625266 >> v2:172.21.15.192:3300/0 conn(0x7f38f8152bc0 0x7f38f80c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481263149 0 0) 0x7f38f8152fa0 con 0x7f38f8073480 2024-04-26T20:14:09.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38dc003530 con 0x7f38f8073480 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830362775 0 0) 0x7f38dc003530 con 0x7f38f8073480 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 >> v2:172.21.15.192:3300/0 conn(0x7f38f8152bc0 msgr2=0x7f38f80c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 --2- 172.21.15.16:0/3784625266 >> v2:172.21.15.192:3300/0 conn(0x7f38f8152bc0 0x7f38f80c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 >> v1:172.21.15.192:6789/0 conn(0x7f38f80c9340 legacy=0x7f38f8072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f8158c10 con 0x7f38f8073480 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f38f0001a00 con 0x7f38f8073480 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 >> v1:172.21.15.16:6789/0 conn(0x7f38f8073480 legacy=0x7f38f80c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38dc0039c0 0x7f38dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc004810 0x7f38dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38dc0051d0 0x7f38dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8158930 con 0x7f38dc0039c0 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc00c080 con 0x7f38dc0051d0 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc00c280 con 0x7f38dc004810 2024-04-26T20:14:09.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.835+0000 7f38f6a00640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38dc0039c0 0x7f38dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38ee000640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc004810 0x7f38dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f7400640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38dc0051d0 0x7f38dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6a00640 1 -- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc004810 msgr2=0x7f38dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6a00640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc004810 0x7f38dc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6a00640 1 -- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38dc0051d0 msgr2=0x7f38dc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6a00640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38dc0051d0 0x7f38dc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6a00640 1 -- 172.21.15.16:0/3784625266 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc003530 con 0x7f38dc0039c0 2024-04-26T20:14:09.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f7400640 1 -- 172.21.15.16:0/3784625266 reap_dead start 2024-04-26T20:14:09.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6a00640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38dc0039c0 0x7f38dc003de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009ae0 tx=0x7f38e801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1f5cbced9c961 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:09.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e80b2070 con 0x7f38dc0039c0 2024-04-26T20:14:09.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e80a5550 con 0x7f38dc0039c0 2024-04-26T20:14:09.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38f6000640 1 -- 172.21.15.16:0/3784625266 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e80096b0 con 0x7f38dc0039c0 2024-04-26T20:14:09.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38fd800640 1 -- 172.21.15.16:0/3784625266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38dc0039c0 msgr2=0x7f38dc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:09.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38fd800640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38dc0039c0 0x7f38dc003de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009ae0 tx=0x7f38e801ca70 comp rx=0 tx=0).stop 2024-04-26T20:14:09.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38fd800640 1 -- 172.21.15.16:0/3784625266 shutdown_connections 2024-04-26T20:14:09.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38fd800640 1 --2- 172.21.15.16:0/3784625266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38dc0039c0 0x7f38dc003de0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:09.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.839+0000 7f38fd800640 1 -- 172.21.15.16:0/3784625266 >> 172.21.15.16:0/3784625266 conn(0x7f38f806c380 msgr2=0x7f38f806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:09.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- 172.21.15.16:0/3784625266 shutdown_connections 2024-04-26T20:14:09.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- 172.21.15.16:0/3784625266 wait complete. 2024-04-26T20:14:09.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 Processor -- start 2024-04-26T20:14:09.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- start start 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc0039c0 0x7f38f81f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38f8155eb0 0x7f38f81e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f80cbd50 0x7f38f80c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81594b0 con 0x7f38f8155eb0 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81591d0 con 0x7f38f80cbd50 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f38f80c47d0 con 0x7f38dc0039c0 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38f8155eb0 0x7f38f81e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38f8155eb0 0x7f38f81e5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41144/0 (socket says 172.21.15.16:41144) 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 -- 172.21.15.16:0/984730252 learned_addr learned my addr 172.21.15.16:0/984730252 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38f6a00640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc0039c0 0x7f38f81f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38f7400640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f80cbd50 0x7f38f80c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 -- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc0039c0 msgr2=0x7f38f81f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc0039c0 0x7f38f81f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 -- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f80cbd50 msgr2=0x7f38f80c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f80cbd50 0x7f38f80c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 -- 172.21.15.16:0/984730252 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f8153570 con 0x7f38f8155eb0 2024-04-26T20:14:09.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ee000640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38f8155eb0 0x7f38f81e5d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38e000e410 tx=0x7f38e000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:09.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ef400640 1 -- 172.21.15.16:0/984730252 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0019070 con 0x7f38f8155eb0 2024-04-26T20:14:09.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ef400640 1 -- 172.21.15.16:0/984730252 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e00052e0 con 0x7f38f8155eb0 2024-04-26T20:14:09.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38ef400640 1 -- 172.21.15.16:0/984730252 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e0003820 con 0x7f38f8155eb0 2024-04-26T20:14:09.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f8153850 con 0x7f38f8155eb0 2024-04-26T20:14:09.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.843+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f81efea0 con 0x7f38f8155eb0 2024-04-26T20:14:09.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.847+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38f8077c20 con 0x7f38f8155eb0 2024-04-26T20:14:09.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.847+0000 7f38ef400640 1 -- 172.21.15.16:0/984730252 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f38e001c070 con 0x7f38f8155eb0 2024-04-26T20:14:09.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.847+0000 7f38ef400640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f38d4068380 0x7f38d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:09.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.847+0000 7f38ef400640 1 -- 172.21.15.16:0/984730252 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f38e0085cc0 con 0x7f38f8155eb0 2024-04-26T20:14:09.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.847+0000 7f38f6a00640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f38d4068380 0x7f38d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:09.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.851+0000 7f38f6a00640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f38d4068380 0x7f38d406a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f38e80af000 tx=0x7f38e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:09.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:09.851+0000 7f38ef400640 1 -- 172.21.15.16:0/984730252 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f38e008c080 con 0x7f38f8155eb0 2024-04-26T20:14:10.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.051+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38f80ca100 con 0x7f38f8155eb0 2024-04-26T20:14:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.051+0000 7f38ef400640 1 -- 172.21.15.16:0/984730252 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5521 (secure 0 0 0) 0x7f38e0055ee0 con 0x7f38f8155eb0 2024-04-26T20:14:10.055 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:10.055 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T20:14:10.056 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2024-04-26T20:14:10.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f38d4068380 msgr2=0x7f38d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f38d4068380 0x7f38d406a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f38e80af000 tx=0x7f38e8008040 comp rx=0 tx=0).stop 2024-04-26T20:14:10.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38f8155eb0 msgr2=0x7f38f81e5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38f8155eb0 0x7f38f81e5d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38e000e410 tx=0x7f38e000e8d0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 shutdown_connections 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f38d4068380 0x7f38d406a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38f80cbd50 0x7f38f80c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38f8155eb0 0x7f38f81e5d80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 --2- 172.21.15.16:0/984730252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38dc0039c0 0x7f38f81f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 >> 172.21.15.16:0/984730252 conn(0x7f38f806c380 msgr2=0x7f38f8073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 shutdown_connections 2024-04-26T20:14:10.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.055+0000 7f38fd800640 1 -- 172.21.15.16:0/984730252 wait complete. 2024-04-26T20:14:10.076 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:10.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 Processor -- start 2024-04-26T20:14:10.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 -- start start 2024-04-26T20:14:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8ba4153c50 0x7f8ba40c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cb530 0x7f8ba40cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ba415d090 0x7f8ba415d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba406c9d0 con 0x7f8ba415d090 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba40c7bb0 con 0x7f8ba4153c50 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba9200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba40c7e50 con 0x7f8ba40cb530 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ba415d090 0x7f8ba415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ba415d090 0x7f8ba415d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41150/0 (socket says 172.21.15.16:41150) 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 -- 172.21.15.16:0/1141393347 learned_addr learned my addr 172.21.15.16:0/1141393347 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba1e00640 1 --2- 172.21.15.16:0/1141393347 >> v2:172.21.15.192:3300/0 conn(0x7f8ba4153c50 0x7f8ba40c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8b9be00640 1 --2- 172.21.15.16:0/1141393347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cb530 0x7f8ba40cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 -- 172.21.15.16:0/1141393347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cb530 msgr2=0x7f8ba40cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 --2- 172.21.15.16:0/1141393347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cb530 0x7f8ba40cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 -- 172.21.15.16:0/1141393347 >> v2:172.21.15.192:3300/0 conn(0x7f8ba4153c50 msgr2=0x7f8ba40c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:10.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 --2- 172.21.15.16:0/1141393347 >> v2:172.21.15.192:3300/0 conn(0x7f8ba4153c50 0x7f8ba40c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.215+0000 7f8ba2800640 1 -- 172.21.15.16:0/1141393347 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba40c8130 con 0x7f8ba415d090 2024-04-26T20:14:10.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba2800640 1 --2- 172.21.15.16:0/1141393347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba415d090 0x7f8ba415d520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40cb4c0 tx=0x7f8b9c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5a703ad995c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba1400640 1 -- 172.21.15.16:0/1141393347 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0b4070 con 0x7f8ba415d090 2024-04-26T20:14:10.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba1400640 1 -- 172.21.15.16:0/1141393347 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c0af400 con 0x7f8ba415d090 2024-04-26T20:14:10.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba1400640 1 -- 172.21.15.16:0/1141393347 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0af7d0 con 0x7f8ba415d090 2024-04-26T20:14:10.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 -- 172.21.15.16:0/1141393347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba415d090 msgr2=0x7f8ba415d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 --2- 172.21.15.16:0/1141393347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba415d090 0x7f8ba415d520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40cb4c0 tx=0x7f8b9c01f1e0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 -- 172.21.15.16:0/1141393347 shutdown_connections 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 --2- 172.21.15.16:0/1141393347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba415d090 0x7f8ba415d520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 --2- 172.21.15.16:0/1141393347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba40cb530 0x7f8ba40cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 --2- 172.21.15.16:0/1141393347 >> v2:172.21.15.192:3300/0 conn(0x7f8ba4153c50 0x7f8ba40c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 -- 172.21.15.16:0/1141393347 >> 172.21.15.16:0/1141393347 conn(0x7f8ba406d490 msgr2=0x7f8ba406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 -- 172.21.15.16:0/1141393347 shutdown_connections 2024-04-26T20:14:10.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 -- 172.21.15.16:0/1141393347 wait complete. 2024-04-26T20:14:10.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.219+0000 7f8ba9200640 1 Processor -- start 2024-04-26T20:14:10.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 -- start start 2024-04-26T20:14:10.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba40cb530 0x7f8ba40c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4153c50 0x7f8ba41e6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba415d090 0x7f8ba41f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba406c660 con 0x7f8ba40cb530 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba406c380 con 0x7f8ba415d090 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba40c93e0 con 0x7f8ba4153c50 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba40cb530 0x7f8ba40c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba40cb530 0x7f8ba40c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41156/0 (socket says 172.21.15.16:41156) 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 -- 172.21.15.16:0/2432514544 learned_addr learned my addr 172.21.15.16:0/2432514544 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8b9be00640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4153c50 0x7f8ba41e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba2800640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba415d090 0x7f8ba41f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 -- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4153c50 msgr2=0x7f8ba41e6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4153c50 0x7f8ba41e6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 -- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba415d090 msgr2=0x7f8ba41f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba415d090 0x7f8ba41f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 -- 172.21.15.16:0/2432514544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba40c5a40 con 0x7f8ba40cb530 2024-04-26T20:14:10.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba2800640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba415d090 0x7f8ba41f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:10.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba1e00640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba40cb530 0x7f8ba40c64e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400d800 tx=0x7f8b9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8b9a000640 1 -- 172.21.15.16:0/2432514544 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400b6c0 con 0x7f8ba40cb530 2024-04-26T20:14:10.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8b9a000640 1 -- 172.21.15.16:0/2432514544 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b94019070 con 0x7f8ba40cb530 2024-04-26T20:14:10.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba41f2690 con 0x7f8ba40cb530 2024-04-26T20:14:10.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8b9a000640 1 -- 172.21.15.16:0/2432514544 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400ba60 con 0x7f8ba40cb530 2024-04-26T20:14:10.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba40c5ce0 con 0x7f8ba40cb530 2024-04-26T20:14:10.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.223+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba4077c20 con 0x7f8ba40cb530 2024-04-26T20:14:10.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.227+0000 7f8b9a000640 1 -- 172.21.15.16:0/2432514544 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b9400bc00 con 0x7f8ba40cb530 2024-04-26T20:14:10.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.227+0000 7f8b9a000640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8b80068380 0x7f8b8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.227+0000 7f8b9a000640 1 -- 172.21.15.16:0/2432514544 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8b94086a60 con 0x7f8ba40cb530 2024-04-26T20:14:10.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.227+0000 7f8b9be00640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8b80068380 0x7f8b8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.227+0000 7f8b9be00640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8b80068380 0x7f8b8006a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ba41e7200 tx=0x7f8b8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.231+0000 7f8b9a000640 1 -- 172.21.15.16:0/2432514544 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8b94057360 con 0x7f8ba40cb530 2024-04-26T20:14:10.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.395+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ba414a950 con 0x7f8ba40cb530 2024-04-26T20:14:10.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.395+0000 7f8b9a000640 1 -- 172.21.15.16:0/2432514544 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7f8b94056c60 con 0x7f8ba40cb530 2024-04-26T20:14:10.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:10.401 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:09.328143+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8b80068380 msgr2=0x7f8b8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8b80068380 0x7f8b8006a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ba41e7200 tx=0x7f8b8c008040 comp rx=0 tx=0).stop 2024-04-26T20:14:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba40cb530 msgr2=0x7f8ba40c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba40cb530 0x7f8ba40c64e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400d800 tx=0x7f8b9400dcc0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 shutdown_connections 2024-04-26T20:14:10.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8b80068380 0x7f8b8006a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba415d090 0x7f8ba41f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4153c50 0x7f8ba41e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 --2- 172.21.15.16:0/2432514544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba40cb530 0x7f8ba40c64e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 >> 172.21.15.16:0/2432514544 conn(0x7f8ba406d490 msgr2=0x7f8ba4071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 shutdown_connections 2024-04-26T20:14:10.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.399+0000 7f8ba9200640 1 -- 172.21.15.16:0/2432514544 wait complete. 2024-04-26T20:14:10.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T20:14:10.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:14:10.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b8400640 1 Processor -- start 2024-04-26T20:14:10.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b8400640 1 -- start start 2024-04-26T20:14:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b8400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b8400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b00ca4d0 con 0x7fc5b00ca040 2024-04-26T20:14:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b8400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b00733c0 con 0x7fc5b00c8e30 2024-04-26T20:14:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b8400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b00736a0 con 0x7fc5b0155ed0 2024-04-26T20:14:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b5000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc5b00c8e30 0x7fc5b006c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:52842/0 (socket says 172.21.15.16:52842) 2024-04-26T20:14:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b5000640 1 -- 172.21.15.16:0/124408739 learned_addr learned my addr 172.21.15.16:0/124408739 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b5a00640 1 --2- 172.21.15.16:0/124408739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5afe00640 1 -- 172.21.15.16:0/124408739 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 623169069 0 0) 0x7fc5b00733c0 con 0x7fc5b00c8e30 2024-04-26T20:14:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b5a00640 1 -- 172.21.15.16:0/124408739 >> v1:172.21.15.192:6789/0 conn(0x7fc5b00c8e30 legacy=0x7fc5b006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b5a00640 1 -- 172.21.15.16:0/124408739 >> v1:172.21.15.16:6789/0 conn(0x7fc5b00ca040 legacy=0x7fc5b0073f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.563+0000 7fc5b5a00640 1 -- 172.21.15.16:0/124408739 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b0073980 con 0x7fc5b0155ed0 2024-04-26T20:14:10.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b5a00640 1 --2- 172.21.15.16:0/124408739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b015bc20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097f0 tx=0x7fc5a401eab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c207792fe94910f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5afe00640 1 -- 172.21.15.16:0/124408739 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40b5070 con 0x7fc5b0155ed0 2024-04-26T20:14:10.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5afe00640 1 -- 172.21.15.16:0/124408739 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a40a87b0 con 0x7fc5b0155ed0 2024-04-26T20:14:10.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5afe00640 1 -- 172.21.15.16:0/124408739 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40a8b80 con 0x7fc5b0155ed0 2024-04-26T20:14:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b8400640 1 -- 172.21.15.16:0/124408739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 msgr2=0x7fc5b015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b8400640 1 --2- 172.21.15.16:0/124408739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b015bc20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097f0 tx=0x7fc5a401eab0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b8400640 1 -- 172.21.15.16:0/124408739 shutdown_connections 2024-04-26T20:14:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b8400640 1 --2- 172.21.15.16:0/124408739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b015bc20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b8400640 1 -- 172.21.15.16:0/124408739 >> 172.21.15.16:0/124408739 conn(0x7fc5b006d490 msgr2=0x7fc5b006d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b8400640 1 -- 172.21.15.16:0/124408739 shutdown_connections 2024-04-26T20:14:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.567+0000 7fc5b8400640 1 -- 172.21.15.16:0/124408739 wait complete. 2024-04-26T20:14:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 Processor -- start 2024-04-26T20:14:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 -- start start 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b00c8e30 0x7fc5b0153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5b00ca040 0x7fc5b01e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0073c60 con 0x7fc5b00ca040 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b00c9b20 con 0x7fc5b00c8e30 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b01562b0 con 0x7fc5b0155ed0 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5b00ca040 0x7fc5b01e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b00c8e30 0x7fc5b0153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b00c8e30 0x7fc5b0153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:57778/0 (socket says 172.21.15.16:57778) 2024-04-26T20:14:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 -- 172.21.15.16:0/3875697210 learned_addr learned my addr 172.21.15.16:0/3875697210 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:10.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b6400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 -- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 msgr2=0x7fc5b0153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b0153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 -- 172.21.15.16:0/3875697210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5b00ca040 msgr2=0x7fc5b01e5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5b00ca040 0x7fc5b01e5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 -- 172.21.15.16:0/3875697210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b0152a90 con 0x7fc5b00c8e30 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b6400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b0153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b5a00640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b00c8e30 0x7fc5b0153220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097f0 tx=0x7fc5a401b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5ad600640 1 -- 172.21.15.16:0/3875697210 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40b5040 con 0x7fc5b00c8e30 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5ad600640 1 -- 172.21.15.16:0/3875697210 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a4004220 con 0x7fc5b00c8e30 2024-04-26T20:14:10.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5ad600640 1 -- 172.21.15.16:0/3875697210 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4003620 con 0x7fc5b00c8e30 2024-04-26T20:14:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b015b880 con 0x7fc5b00c8e30 2024-04-26T20:14:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.571+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b014c850 con 0x7fc5b00c8e30 2024-04-26T20:14:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.575+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b00696e0 con 0x7fc5b00c8e30 2024-04-26T20:14:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.575+0000 7fc5ad600640 1 -- 172.21.15.16:0/3875697210 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5a40c2060 con 0x7fc5b00c8e30 2024-04-26T20:14:10.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.575+0000 7fc5ad600640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc590068380 0x7fc59006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.575+0000 7fc5ad600640 1 -- 172.21.15.16:0/3875697210 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc5a4122d00 con 0x7fc5b00c8e30 2024-04-26T20:14:10.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.575+0000 7fc5b5000640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc590068380 0x7fc59006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.575+0000 7fc5b5000640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc590068380 0x7fc59006a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5b01e6110 tx=0x7fc59c007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.583+0000 7fc5ad600640 1 -- 172.21.15.16:0/3875697210 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc5b00ca4d0 con 0x7fc5b00c8e30 2024-04-26T20:14:10.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.751+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc5b00c5990 con 0x7fc5b00c8e30 2024-04-26T20:14:10.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.751+0000 7fc5ad600640 1 -- 172.21.15.16:0/3875697210 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fc5a40f35f0 con 0x7fc5b00c8e30 2024-04-26T20:14:10.756 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc590068380 msgr2=0x7fc59006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc590068380 0x7fc59006a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5b01e6110 tx=0x7fc59c007d60 comp rx=0 tx=0).stop 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b00c8e30 msgr2=0x7fc5b0153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b00c8e30 0x7fc5b0153220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097f0 tx=0x7fc5a401b850 comp rx=0 tx=0).stop 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 shutdown_connections 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc590068380 0x7fc59006a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5b0155ed0 0x7fc5b0153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5b00ca040 0x7fc5b01e5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 --2- 172.21.15.16:0/3875697210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b00c8e30 0x7fc5b0153220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 >> 172.21.15.16:0/3875697210 conn(0x7fc5b006d490 msgr2=0x7fc5b006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 shutdown_connections 2024-04-26T20:14:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.755+0000 7fc5b8400640 1 -- 172.21.15.16:0/3875697210 wait complete. 2024-04-26T20:14:10.778 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T20:14:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6516e00640 1 Processor -- start 2024-04-26T20:14:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6516e00640 1 -- start start 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6516e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6510155c00 0x7f65100ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6516e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f651006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6516e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f651006f9f0 con 0x7f65100703e0 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6516e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f65100c8fd0 con 0x7f6510155c00 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6516e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f651015bd70 con 0x7f65100ce800 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6510155c00 0x7f65100ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6510155c00 0x7f65100ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41176/0 (socket says 172.21.15.16:41176) 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515a00640 1 -- 172.21.15.16:0/4241380307 learned_addr learned my addr 172.21.15.16:0/4241380307 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515000640 1 --2- 172.21.15.16:0/4241380307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f651006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515a00640 1 -- 172.21.15.16:0/4241380307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 msgr2=0x7f651006fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:10.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515a00640 1 --2- 172.21.15.16:0/4241380307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f651006fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515a00640 1 -- 172.21.15.16:0/4241380307 >> v1:172.21.15.192:6789/0 conn(0x7f65100703e0 legacy=0x7f651006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.915+0000 7f6515a00640 1 -- 172.21.15.16:0/4241380307 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6510070870 con 0x7f6510155c00 2024-04-26T20:14:10.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6515a00640 1 --2- 172.21.15.16:0/4241380307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f65100ce2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6504009870 tx=0x7f650401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ae623a36aeb877 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f650fe00640 1 -- 172.21.15.16:0/4241380307 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65040b5070 con 0x7f6510155c00 2024-04-26T20:14:10.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f650fe00640 1 -- 172.21.15.16:0/4241380307 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65040a8a50 con 0x7f6510155c00 2024-04-26T20:14:10.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f650fe00640 1 -- 172.21.15.16:0/4241380307 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65040a8e20 con 0x7f6510155c00 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 -- 172.21.15.16:0/4241380307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 msgr2=0x7f65100ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 --2- 172.21.15.16:0/4241380307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f65100ce2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6504009870 tx=0x7f650401ed50 comp rx=0 tx=0).stop 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 -- 172.21.15.16:0/4241380307 shutdown_connections 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 --2- 172.21.15.16:0/4241380307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f651006fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 --2- 172.21.15.16:0/4241380307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f65100ce2c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 -- 172.21.15.16:0/4241380307 >> 172.21.15.16:0/4241380307 conn(0x7f6510070d40 msgr2=0x7f6510071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 -- 172.21.15.16:0/4241380307 shutdown_connections 2024-04-26T20:14:10.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.919+0000 7f6516e00640 1 -- 172.21.15.16:0/4241380307 wait complete. 2024-04-26T20:14:10.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 Processor -- start 2024-04-26T20:14:10.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 -- start start 2024-04-26T20:14:10.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65100703e0 0x7f65100cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f6510149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f6510149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f651015c610 con 0x7f6510155c00 2024-04-26T20:14:10.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f651015c330 con 0x7f65100703e0 2024-04-26T20:14:10.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f651015ba40 con 0x7f65100ce800 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f6510149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f6510149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41190/0 (socket says 172.21.15.16:41190) 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 -- 172.21.15.16:0/2393002368 learned_addr learned my addr 172.21.15.16:0/2393002368 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6515000640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f6510149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6515a00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65100703e0 0x7f65100cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 -- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 msgr2=0x7f6510149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f6510149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 -- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65100703e0 msgr2=0x7f65100cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65100703e0 0x7f65100cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 -- 172.21.15.16:0/2393002368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65100cdf70 con 0x7f6510155c00 2024-04-26T20:14:10.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516400640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f6510149b40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f650800c760 tx=0x7f650800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f650d600640 1 -- 172.21.15.16:0/2393002368 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508003b80 con 0x7f6510155c00 2024-04-26T20:14:10.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f650d600640 1 -- 172.21.15.16:0/2393002368 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6508003d20 con 0x7f6510155c00 2024-04-26T20:14:10.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f650d600640 1 -- 172.21.15.16:0/2393002368 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800aa30 con 0x7f6510155c00 2024-04-26T20:14:10.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6510158750 con 0x7f6510155c00 2024-04-26T20:14:10.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.923+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65100c77f0 con 0x7f6510155c00 2024-04-26T20:14:10.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.927+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65100506d0 con 0x7f6510155c00 2024-04-26T20:14:10.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.927+0000 7f650d600640 1 -- 172.21.15.16:0/2393002368 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f650800abd0 con 0x7f6510155c00 2024-04-26T20:14:10.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.927+0000 7f650d600640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f64f0068380 0x7f64f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:10.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.927+0000 7f650d600640 1 -- 172.21.15.16:0/2393002368 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6508086ef0 con 0x7f6510155c00 2024-04-26T20:14:10.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.927+0000 7f6515a00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f64f0068380 0x7f64f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:10.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.927+0000 7f6515a00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f64f0068380 0x7f64f006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65040b2000 tx=0x7f6504009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:10.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:10.931+0000 7f650d600640 1 -- 172.21.15.16:0/2393002368 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6508057190 con 0x7f6510155c00 2024-04-26T20:14:11.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.099+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f65100c5540 con 0x7f6510155c00 2024-04-26T20:14:11.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f650d600640 1 -- 172.21.15.16:0/2393002368 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f650805b490 con 0x7f6510155c00 2024-04-26T20:14:11.105 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:11.105 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-04-26T20:14:11.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T20:14:11.106 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-04-26T20:14:11.106 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-04-26T20:14:11.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T20:14:11.106 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-04-26T20:14:11.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f64f0068380 msgr2=0x7f64f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:11.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f64f0068380 0x7f64f006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65040b2000 tx=0x7f6504009040 comp rx=0 tx=0).stop 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 msgr2=0x7f6510149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f6510149b40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f650800c760 tx=0x7f650800cc20 comp rx=0 tx=0).stop 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 shutdown_connections 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f64f0068380 0x7f64f006a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6510155c00 0x7f6510149b40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65100ce800 0x7f6510149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 --2- 172.21.15.16:0/2393002368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65100703e0 0x7f65100cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 >> 172.21.15.16:0/2393002368 conn(0x7f6510070d40 msgr2=0x7f65101598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 shutdown_connections 2024-04-26T20:14:11.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.103+0000 7f6516e00640 1 -- 172.21.15.16:0/2393002368 wait complete. 2024-04-26T20:14:11.126 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T20:14:11.126 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T20:14:11.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff295600640 1 Processor -- start 2024-04-26T20:14:11.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff295600640 1 -- start start 2024-04-26T20:14:11.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff295600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff290153df0 0x7ff2900c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff295600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29015a820 con 0x7ff2901541d0 2024-04-26T20:14:11.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff295600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2900c7c90 con 0x7ff2900c5120 2024-04-26T20:14:11.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff295600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7ff29015aac0 con 0x7ff290153df0 2024-04-26T20:14:11.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff287e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff2901541d0 0x7ff2900c8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46312/0 (socket says 172.21.15.16:46312) 2024-04-26T20:14:11.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff287e00640 1 -- 172.21.15.16:0/23478822 learned_addr learned my addr 172.21.15.16:0/23478822 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.267+0000 7ff28ea00640 1 --2- 172.21.15.16:0/23478822 >> v2:172.21.15.192:3300/0 conn(0x7ff290153df0 0x7ff2900c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937041978 0 0) 0x7ff29015a820 con 0x7ff2901541d0 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff274003530 con 0x7ff2901541d0 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3294359261 0 0) 0x7ff274003530 con 0x7ff2901541d0 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 >> v2:172.21.15.192:3300/0 conn(0x7ff290153df0 msgr2=0x7ff2900c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 --2- 172.21.15.16:0/23478822 >> v2:172.21.15.192:3300/0 conn(0x7ff290153df0 0x7ff2900c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 >> v1:172.21.15.192:6789/0 conn(0x7ff2900c5120 legacy=0x7ff2900c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900c7f50 con 0x7ff2901541d0 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7ff278001680 con 0x7ff2901541d0 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 >> v1:172.21.15.16:6789/0 conn(0x7ff2901541d0 legacy=0x7ff2900c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff274003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff274004810 0x7ff274004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2740051d0 0x7ff27400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff29015aac0 con 0x7ff2740039c0 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff27400c170 con 0x7ff2740051d0 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff27400c370 con 0x7ff274004810 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28ea00640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff274003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28f400640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2740051d0 0x7ff27400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff287e00640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff274004810 0x7ff274004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28ea00640 1 -- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff274004810 msgr2=0x7ff274004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28ea00640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff274004810 0x7ff274004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28ea00640 1 -- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2740051d0 msgr2=0x7ff27400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28ea00640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2740051d0 0x7ff27400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28ea00640 1 -- 172.21.15.16:0/23478822 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff274003530 con 0x7ff2740039c0 2024-04-26T20:14:11.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.271+0000 7ff28f400640 1 -- 172.21.15.16:0/23478822 reap_dead start 2024-04-26T20:14:11.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff28ea00640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff274003de0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff280009ae0 tx=0x7ff28001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a472810621d9b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:11.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800b2070 con 0x7ff2740039c0 2024-04-26T20:14:11.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2800a5660 con 0x7ff2740039c0 2024-04-26T20:14:11.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff28e000640 1 -- 172.21.15.16:0/23478822 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800096b0 con 0x7ff2740039c0 2024-04-26T20:14:11.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 -- 172.21.15.16:0/23478822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 msgr2=0x7ff274003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:11.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff274003de0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff280009ae0 tx=0x7ff28001ca70 comp rx=0 tx=0).stop 2024-04-26T20:14:11.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 -- 172.21.15.16:0/23478822 shutdown_connections 2024-04-26T20:14:11.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 --2- 172.21.15.16:0/23478822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff274003de0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 -- 172.21.15.16:0/23478822 >> 172.21.15.16:0/23478822 conn(0x7ff2900c9d10 msgr2=0x7ff2900ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:11.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 -- 172.21.15.16:0/23478822 shutdown_connections 2024-04-26T20:14:11.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 -- 172.21.15.16:0/23478822 wait complete. 2024-04-26T20:14:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 Processor -- start 2024-04-26T20:14:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.275+0000 7ff295600640 1 -- start start 2024-04-26T20:14:11.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff2901f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2901566a0 0x7ff29006f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2901f3520 0x7ff2901f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900c5680 con 0x7ff2740039c0 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900c5500 con 0x7ff2901f3520 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff2900c5800 con 0x7ff2901566a0 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff2901f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff2901f7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41218/0 (socket says 172.21.15.16:41218) 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 -- 172.21.15.16:0/2900948035 learned_addr learned my addr 172.21.15.16:0/2900948035 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff287e00640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2901566a0 0x7ff29006f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28f400640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2901f3520 0x7ff2901f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 -- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2901566a0 msgr2=0x7ff29006f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2901566a0 0x7ff29006f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 -- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2901f3520 msgr2=0x7ff2901f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2901f3520 0x7ff2901f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 -- 172.21.15.16:0/2900948035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2901f3ee0 con 0x7ff2740039c0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff28ea00640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff2901f7070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2800b0040 tx=0x7ff280019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff286a00640 1 -- 172.21.15.16:0/2900948035 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800ba020 con 0x7ff2740039c0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff286a00640 1 -- 172.21.15.16:0/2900948035 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff280004020 con 0x7ff2740039c0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff286a00640 1 -- 172.21.15.16:0/2900948035 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800b2040 con 0x7ff2740039c0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff290156ea0 con 0x7ff2740039c0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2901573e0 con 0x7ff2740039c0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff290077c20 con 0x7ff2740039c0 2024-04-26T20:14:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.279+0000 7ff286a00640 1 -- 172.21.15.16:0/2900948035 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff2800059a0 con 0x7ff2740039c0 2024-04-26T20:14:11.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.283+0000 7ff286a00640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff26c068380 0x7ff26c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:11.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.283+0000 7ff286a00640 1 -- 172.21.15.16:0/2900948035 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff280120110 con 0x7ff2740039c0 2024-04-26T20:14:11.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.283+0000 7ff287e00640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff26c068380 0x7ff26c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:11.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.283+0000 7ff287e00640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff26c068380 0x7ff26c06a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff278001060 tx=0x7ff278009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:11.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.287+0000 7ff286a00640 1 -- 172.21.15.16:0/2900948035 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff2800c4020 con 0x7ff2740039c0 2024-04-26T20:14:11.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:11.451+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff290157720 con 0x7ff2740039c0 2024-04-26T20:14:12.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.423+0000 7ff286a00640 1 -- 172.21.15.16:0/2900948035 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7ff2901f3ee0 con 0x7ff2740039c0 2024-04-26T20:14:12.427 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-04-26T20:14:12.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff26c068380 msgr2=0x7ff26c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:12.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff26c068380 0x7ff26c06a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff278001060 tx=0x7ff278009040 comp rx=0 tx=0).stop 2024-04-26T20:14:12.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 msgr2=0x7ff2901f7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:12.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff2901f7070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2800b0040 tx=0x7ff280019810 comp rx=0 tx=0).stop 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 shutdown_connections 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff26c068380 0x7ff26c06a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2901f3520 0x7ff2901f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2901566a0 0x7ff29006f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 --2- 172.21.15.16:0/2900948035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2740039c0 0x7ff2901f7070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 >> 172.21.15.16:0/2900948035 conn(0x7ff2900c9d10 msgr2=0x7ff290157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 shutdown_connections 2024-04-26T20:14:12.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.427+0000 7ff295600640 1 -- 172.21.15.16:0/2900948035 wait complete. 2024-04-26T20:14:12.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T20:14:12.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.607+0000 7f5e8ae00640 1 Processor -- start 2024-04-26T20:14:12.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.607+0000 7f5e8ae00640 1 -- start start 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.607+0000 7f5e8ae00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5e84152d00 0x7f5e840c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.607+0000 7f5e8ae00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5e8415c070 0x7f5e8415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.607+0000 7f5e8ae00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e840c4b30 con 0x7f5e84073230 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.607+0000 7f5e8ae00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5e840c6f60 con 0x7f5e84152d00 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.607+0000 7f5e8ae00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f5e840c7240 con 0x7f5e8415c070 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5e84152d00 0x7f5e840c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5e84152d00 0x7f5e840c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41224/0 (socket says 172.21.15.16:41224) 2024-04-26T20:14:12.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 -- 172.21.15.16:0/875725160 learned_addr learned my addr 172.21.15.16:0/875725160 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:12.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e88e00640 1 --2- 172.21.15.16:0/875725160 >> v2:172.21.15.192:3300/0 conn(0x7f5e8415c070 0x7f5e8415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:12.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 -- 172.21.15.16:0/875725160 >> v2:172.21.15.192:3300/0 conn(0x7f5e8415c070 msgr2=0x7f5e8415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:12.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 --2- 172.21.15.16:0/875725160 >> v2:172.21.15.192:3300/0 conn(0x7f5e8415c070 0x7f5e8415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 -- 172.21.15.16:0/875725160 >> v1:172.21.15.192:6789/0 conn(0x7f5e84073230 legacy=0x7f5e840736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:12.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 -- 172.21.15.16:0/875725160 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840c7520 con 0x7f5e84152d00 2024-04-26T20:14:12.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83e00640 1 --2- 172.21.15.16:0/875725160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84152d00 0x7f5e840c97d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e840747d0 tx=0x7f5e7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9b2ade49d0256 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:12.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83400640 1 -- 172.21.15.16:0/875725160 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740ab680 con 0x7f5e84152d00 2024-04-26T20:14:12.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83400640 1 -- 172.21.15.16:0/875725160 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e740b0070 con 0x7f5e84152d00 2024-04-26T20:14:12.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.611+0000 7f5e83400640 1 -- 172.21.15.16:0/875725160 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740aba40 con 0x7f5e84152d00 2024-04-26T20:14:12.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- 172.21.15.16:0/875725160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84152d00 msgr2=0x7f5e840c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:12.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/875725160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84152d00 0x7f5e840c97d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e840747d0 tx=0x7f5e7401c4e0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- 172.21.15.16:0/875725160 shutdown_connections 2024-04-26T20:14:12.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/875725160 >> v2:172.21.15.192:3300/0 conn(0x7f5e8415c070 0x7f5e8415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/875725160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84152d00 0x7f5e840c97d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- 172.21.15.16:0/875725160 >> 172.21.15.16:0/875725160 conn(0x7f5e840c9d10 msgr2=0x7f5e840ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:12.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- 172.21.15.16:0/875725160 shutdown_connections 2024-04-26T20:14:12.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- 172.21.15.16:0/875725160 wait complete. 2024-04-26T20:14:12.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 Processor -- start 2024-04-26T20:14:12.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- start start 2024-04-26T20:14:12.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e84073230 0x7f5e8415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:12.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e84152d00 0x7f5e8414c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:12.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8415c070 0x7f5e84150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:12.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8415cf70 con 0x7f5e8415c070 2024-04-26T20:14:12.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8415cdf0 con 0x7f5e84152d00 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e8ae00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5e84165c20 con 0x7f5e84073230 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8415c070 0x7f5e84150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8415c070 0x7f5e84150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41226/0 (socket says 172.21.15.16:41226) 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 -- 172.21.15.16:0/4124224540 learned_addr learned my addr 172.21.15.16:0/4124224540 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e83e00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e84073230 0x7f5e8415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e7b400640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e84152d00 0x7f5e8414c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 -- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e84073230 msgr2=0x7f5e8415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e84073230 0x7f5e8415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 -- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e84152d00 msgr2=0x7f5e8414c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e84152d00 0x7f5e8414c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 -- 172.21.15.16:0/4124224540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e841631c0 con 0x7f5e8415c070 2024-04-26T20:14:12.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e7b400640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e84152d00 0x7f5e8414c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:12.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.615+0000 7f5e88e00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8415c070 0x7f5e84150ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c007e90 tx=0x7f5e7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:12.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e80c00640 1 -- 172.21.15.16:0/4124224540 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c014420 con 0x7f5e8415c070 2024-04-26T20:14:12.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e80c00640 1 -- 172.21.15.16:0/4124224540 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7c019070 con 0x7f5e8415c070 2024-04-26T20:14:12.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e80c00640 1 -- 172.21.15.16:0/4124224540 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c014800 con 0x7f5e8415c070 2024-04-26T20:14:12.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e84159a80 con 0x7f5e8415c070 2024-04-26T20:14:12.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e8415aea0 con 0x7f5e8415c070 2024-04-26T20:14:12.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e84077c20 con 0x7f5e8415c070 2024-04-26T20:14:12.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e80c00640 1 -- 172.21.15.16:0/4124224540 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e7c0149a0 con 0x7f5e8415c070 2024-04-26T20:14:12.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e80c00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5e600683b0 0x7f5e6006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:12.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e80c00640 1 -- 172.21.15.16:0/4124224540 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f5e7c087090 con 0x7f5e8415c070 2024-04-26T20:14:12.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.619+0000 7f5e83e00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5e600683b0 0x7f5e6006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:12.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.623+0000 7f5e83e00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5e600683b0 0x7f5e6006a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e740af000 tx=0x7f5e740a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:12.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.623+0000 7f5e80c00640 1 -- 172.21.15.16:0/4124224540 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5e7c057790 con 0x7f5e8415c070 2024-04-26T20:14:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:12.787+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f5e840c6d40 con 0x7f5e8415c070 2024-04-26T20:14:13.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.431+0000 7f5e80c00640 1 -- 172.21.15.16:0/4124224540 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f5e7c057090 con 0x7f5e8415c070 2024-04-26T20:14:13.435 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-04-26T20:14:13.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5e600683b0 msgr2=0x7f5e6006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:13.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5e600683b0 0x7f5e6006a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e740af000 tx=0x7f5e740a7000 comp rx=0 tx=0).stop 2024-04-26T20:14:13.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8415c070 msgr2=0x7f5e84150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:13.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8415c070 0x7f5e84150ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c007e90 tx=0x7f5e7c00e4b0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 shutdown_connections 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5e600683b0 0x7f5e6006a870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e8415c070 0x7f5e84150ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e84152d00 0x7f5e8414c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 --2- 172.21.15.16:0/4124224540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e84073230 0x7f5e8415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 >> 172.21.15.16:0/4124224540 conn(0x7f5e840c9d10 msgr2=0x7f5e840cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 shutdown_connections 2024-04-26T20:14:13.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.435+0000 7f5e8ae00640 1 -- 172.21.15.16:0/4124224540 wait complete. 2024-04-26T20:14:13.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T20:14:13.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.627+0000 7fcf2dc00640 1 Processor -- start 2024-04-26T20:14:13.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.627+0000 7fcf2dc00640 1 -- start start 2024-04-26T20:14:13.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.627+0000 7fcf2dc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.627+0000 7fcf2dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcf280c7b10 0x7fcf2815c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.627+0000 7fcf2dc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf2815cd90 con 0x7fcf28073760 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.627+0000 7fcf2dc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fcf28070c80 con 0x7fcf280c7b10 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.627+0000 7fcf2dc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcf280706c0 con 0x7fcf28156040 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf27400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcf28073760 0x7fcf2806f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46314/0 (socket says 172.21.15.16:46314) 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf27400640 1 -- 172.21.15.16:0/3462002951 learned_addr learned my addr 172.21.15.16:0/3462002951 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26a00640 1 --2- 172.21.15.16:0/3462002951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf1fe00640 1 --2- 172.21.15.16:0/3462002951 >> v2:172.21.15.192:3300/0 conn(0x7fcf280c7b10 0x7fcf2815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26000640 1 -- 172.21.15.16:0/3462002951 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768918852 0 0) 0x7fcf2815cd90 con 0x7fcf28073760 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26000640 1 -- 172.21.15.16:0/3462002951 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf0c003530 con 0x7fcf28073760 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26a00640 1 -- 172.21.15.16:0/3462002951 >> v2:172.21.15.192:3300/0 conn(0x7fcf280c7b10 msgr2=0x7fcf2815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:13.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26a00640 1 --2- 172.21.15.16:0/3462002951 >> v2:172.21.15.192:3300/0 conn(0x7fcf280c7b10 0x7fcf2815c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26a00640 1 -- 172.21.15.16:0/3462002951 >> v1:172.21.15.16:6789/0 conn(0x7fcf28073760 legacy=0x7fcf2806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:13.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26000640 1 -- 172.21.15.16:0/3462002951 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3552219234 0 0) 0x7fcf0c003530 con 0x7fcf28073760 2024-04-26T20:14:13.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26a00640 1 -- 172.21.15.16:0/3462002951 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf280709a0 con 0x7fcf28156040 2024-04-26T20:14:13.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.631+0000 7fcf26a00640 1 --2- 172.21.15.16:0/3462002951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28070010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf180097c0 tx=0x7fcf1801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf3aab24cc8c390a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:13.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf26000640 1 -- 172.21.15.16:0/3462002951 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf180a7070 con 0x7fcf28156040 2024-04-26T20:14:13.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf26000640 1 -- 172.21.15.16:0/3462002951 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf180b0070 con 0x7fcf28156040 2024-04-26T20:14:13.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf26000640 1 -- 172.21.15.16:0/3462002951 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf180ab870 con 0x7fcf28156040 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- 172.21.15.16:0/3462002951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 msgr2=0x7fcf28070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/3462002951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28070010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcf180097c0 tx=0x7fcf1801c470 comp rx=0 tx=0).stop 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- 172.21.15.16:0/3462002951 shutdown_connections 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/3462002951 >> v2:172.21.15.192:3300/0 conn(0x7fcf280c7b10 0x7fcf2815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/3462002951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28070010 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- 172.21.15.16:0/3462002951 >> 172.21.15.16:0/3462002951 conn(0x7fcf280c9d10 msgr2=0x7fcf280ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- 172.21.15.16:0/3462002951 shutdown_connections 2024-04-26T20:14:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- 172.21.15.16:0/3462002951 wait complete. 2024-04-26T20:14:13.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 Processor -- start 2024-04-26T20:14:13.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- start start 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf28073760 0x7fcf28151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf280c7b10 0x7fcf28152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf280c9330 con 0x7fcf28073760 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf28156420 con 0x7fcf280c7b10 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf2dc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcf280c94b0 con 0x7fcf28156040 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf26a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf28073760 0x7fcf28151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf26a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf28073760 0x7fcf28151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41234/0 (socket says 172.21.15.16:41234) 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf26a00640 1 -- 172.21.15.16:0/4168853268 learned_addr learned my addr 172.21.15.16:0/4168853268 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf27400640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.635+0000 7fcf1fe00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf280c7b10 0x7fcf28152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:13.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf26a00640 1 -- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 msgr2=0x7fcf28145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:13.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf26a00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf26a00640 1 -- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf280c7b10 msgr2=0x7fcf28152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf26a00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf280c7b10 0x7fcf28152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf26a00640 1 -- 172.21.15.16:0/4168853268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf28153070 con 0x7fcf28073760 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf26a00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf28073760 0x7fcf28151350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801ab20 tx=0x7fcf18019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf1ea00640 1 -- 172.21.15.16:0/4168853268 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18003a30 con 0x7fcf28073760 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf1ea00640 1 -- 172.21.15.16:0/4168853268 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf18003bd0 con 0x7fcf28073760 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf1ea00640 1 -- 172.21.15.16:0/4168853268 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf180c0480 con 0x7fcf28073760 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf28153350 con 0x7fcf28073760 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf280c72d0 con 0x7fcf28073760 2024-04-26T20:14:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf28077c20 con 0x7fcf28073760 2024-04-26T20:14:13.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf1ea00640 1 -- 172.21.15.16:0/4168853268 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcf180ab470 con 0x7fcf28073760 2024-04-26T20:14:13.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.639+0000 7fcf1ea00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf040683b0 0x7fcf0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:13.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.643+0000 7fcf1ea00640 1 -- 172.21.15.16:0/4168853268 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fcf181212c0 con 0x7fcf28073760 2024-04-26T20:14:13.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.643+0000 7fcf1fe00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf040683b0 0x7fcf0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:13.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.643+0000 7fcf1fe00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf040683b0 0x7fcf0406a870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf28150770 tx=0x7fcf10009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:13.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.647+0000 7fcf1ea00640 1 -- 172.21.15.16:0/4168853268 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcf180c7030 con 0x7fcf28073760 2024-04-26T20:14:13.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:13.847+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcf28072720 con 0x7fcf28073760 2024-04-26T20:14:14.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.435+0000 7fcf1ea00640 1 -- 172.21.15.16:0/4168853268 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fcf18016090 con 0x7fcf28073760 2024-04-26T20:14:14.438 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T20:14:14.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.435+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf040683b0 msgr2=0x7fcf0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:14.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.435+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf040683b0 0x7fcf0406a870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf28150770 tx=0x7fcf10009190 comp rx=0 tx=0).stop 2024-04-26T20:14:14.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.435+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf28073760 msgr2=0x7fcf28151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:14.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.435+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf28073760 0x7fcf28151350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf1801ab20 tx=0x7fcf18019210 comp rx=0 tx=0).stop 2024-04-26T20:14:14.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 shutdown_connections 2024-04-26T20:14:14.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf040683b0 0x7fcf0406a870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf28156040 0x7fcf28145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf280c7b10 0x7fcf28152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 --2- 172.21.15.16:0/4168853268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf28073760 0x7fcf28151350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 >> 172.21.15.16:0/4168853268 conn(0x7fcf280c9d10 msgr2=0x7fcf281544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 shutdown_connections 2024-04-26T20:14:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.439+0000 7fcf2dc00640 1 -- 172.21.15.16:0/4168853268 wait complete. 2024-04-26T20:14:14.487 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T20:14:14.488 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T20:14:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dc2200640 1 Processor -- start 2024-04-26T20:14:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dc2200640 1 -- start start 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dc2200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7dbc0c9760 0x7f7dbc152880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dc2200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc06f810 0x7f7dbc152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dc2200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc15ce80 con 0x7f7dbc15c0e0 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dc2200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc15cbd0 con 0x7f7dbc0c9760 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dc2200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc0c6f80 con 0x7f7dbc06f810 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc06f810 0x7f7dbc152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7db2a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7dbc0c9760 0x7f7dbc152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc06f810 0x7f7dbc152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:44036/0 (socket says 172.21.15.16:44036) 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbbe00640 1 -- 172.21.15.16:0/1218562819 learned_addr learned my addr 172.21.15.16:0/1218562819 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbb400640 1 --1- 172.21.15.16:0/1218562819 >> v1:172.21.15.192:6789/0 conn(0x7f7dbc15c0e0 0x7f7dbc15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:52882/0 (socket says 172.21.15.16:52882) 2024-04-26T20:14:14.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbbe00640 1 -- 172.21.15.16:0/1218562819 >> v2:172.21.15.192:3300/0 conn(0x7f7dbc0c9760 msgr2=0x7f7dbc152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:14.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbbe00640 1 --2- 172.21.15.16:0/1218562819 >> v2:172.21.15.192:3300/0 conn(0x7f7dbc0c9760 0x7f7dbc152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbbe00640 1 -- 172.21.15.16:0/1218562819 >> v1:172.21.15.192:6789/0 conn(0x7f7dbc15c0e0 legacy=0x7f7dbc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:14.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.635+0000 7f7dbbe00640 1 -- 172.21.15.16:0/1218562819 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0c7520 con 0x7f7dbc06f810 2024-04-26T20:14:14.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dbbe00640 1 --2- 172.21.15.16:0/1218562819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc06f810 0x7f7dbc152dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009870 tx=0x7f7db401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a3d1596b7cbe33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dbaa00640 1 -- 172.21.15.16:0/1218562819 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db40b5070 con 0x7f7dbc06f810 2024-04-26T20:14:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dbaa00640 1 -- 172.21.15.16:0/1218562819 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40a8a50 con 0x7f7dbc06f810 2024-04-26T20:14:14.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dbaa00640 1 -- 172.21.15.16:0/1218562819 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db40a8e20 con 0x7f7dbc06f810 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dc2200640 1 -- 172.21.15.16:0/1218562819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc06f810 msgr2=0x7f7dbc152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dc2200640 1 --2- 172.21.15.16:0/1218562819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc06f810 0x7f7dbc152dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009870 tx=0x7f7db401ed50 comp rx=0 tx=0).stop 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dc2200640 1 -- 172.21.15.16:0/1218562819 shutdown_connections 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dc2200640 1 --2- 172.21.15.16:0/1218562819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc06f810 0x7f7dbc152dc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dc2200640 1 --2- 172.21.15.16:0/1218562819 >> v2:172.21.15.192:3300/0 conn(0x7f7dbc0c9760 0x7f7dbc152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.639+0000 7f7dc2200640 1 -- 172.21.15.16:0/1218562819 >> 172.21.15.16:0/1218562819 conn(0x7f7dbc0c9d10 msgr2=0x7f7dbc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 -- 172.21.15.16:0/1218562819 shutdown_connections 2024-04-26T20:14:14.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 -- 172.21.15.16:0/1218562819 wait complete. 2024-04-26T20:14:14.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 Processor -- start 2024-04-26T20:14:14.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 -- start start 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dbc06f810 0x7f7dbc145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dbc0c9760 0x7f7dbc15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc15c0e0 0x7f7dbc141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc0c4a90 con 0x7f7dbc0c9760 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc0c47b0 con 0x7f7dbc06f810 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc0c4d70 con 0x7f7dbc15c0e0 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dbc0c9760 0x7f7dbc15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dbc0c9760 0x7f7dbc15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41242/0 (socket says 172.21.15.16:41242) 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 -- 172.21.15.16:0/2525753668 learned_addr learned my addr 172.21.15.16:0/2525753668 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dbb400640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dbc06f810 0x7f7dbc145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:14.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dbbe00640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc15c0e0 0x7f7dbc141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:14.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 -- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc15c0e0 msgr2=0x7f7dbc141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:14.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc15c0e0 0x7f7dbc141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 -- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dbc06f810 msgr2=0x7f7dbc145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dbc06f810 0x7f7dbc145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 -- 172.21.15.16:0/2525753668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc13ee80 con 0x7f7dbc0c9760 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db2a00640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dbc0c9760 0x7f7dbc15a4b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009db0 tx=0x7f7da400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db3e00640 1 -- 172.21.15.16:0/2525753668 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4018020 con 0x7f7dbc0c9760 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db3e00640 1 -- 172.21.15.16:0/2525753668 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da4014480 con 0x7f7dbc0c9760 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7db3e00640 1 -- 172.21.15.16:0/2525753668 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4014850 con 0x7f7dbc0c9760 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.643+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc13f160 con 0x7f7dbc0c9760 2024-04-26T20:14:14.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.647+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc159cb0 con 0x7f7dbc0c9760 2024-04-26T20:14:14.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.647+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc077c20 con 0x7f7dbc0c9760 2024-04-26T20:14:14.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.647+0000 7f7db3e00640 1 -- 172.21.15.16:0/2525753668 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7da401b020 con 0x7f7dbc0c9760 2024-04-26T20:14:14.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.647+0000 7f7db3e00640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7d98068380 0x7f7d9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:14.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.647+0000 7f7db3e00640 1 -- 172.21.15.16:0/2525753668 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7da40873b0 con 0x7f7dbc0c9760 2024-04-26T20:14:14.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.647+0000 7f7dbb400640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7d98068380 0x7f7d9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:14.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.651+0000 7f7dbb400640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7d98068380 0x7f7d9806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7dac000f70 tx=0x7f7dac007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:14.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.651+0000 7f7db3e00640 1 -- 172.21.15.16:0/2525753668 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7da4022070 con 0x7f7dbc0c9760 2024-04-26T20:14:14.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:14.827+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7dbc072990 con 0x7f7dbc0c9760 2024-04-26T20:14:15.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.435+0000 7f7db3e00640 1 -- 172.21.15.16:0/2525753668 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f7da4010040 con 0x7f7dbc0c9760 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7d98068380 msgr2=0x7f7d9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7d98068380 0x7f7d9806a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7dac000f70 tx=0x7f7dac007e90 comp rx=0 tx=0).stop 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dbc0c9760 msgr2=0x7f7dbc15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dbc0c9760 0x7f7dbc15a4b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009db0 tx=0x7f7da400c490 comp rx=0 tx=0).stop 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 shutdown_connections 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7d98068380 0x7f7d9806a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7dbc15c0e0 0x7f7dbc141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dbc0c9760 0x7f7dbc15a4b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 --2- 172.21.15.16:0/2525753668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dbc06f810 0x7f7dbc145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 >> 172.21.15.16:0/2525753668 conn(0x7f7dbc0c9d10 msgr2=0x7f7dbc0ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 shutdown_connections 2024-04-26T20:14:15.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.439+0000 7f7dc2200640 1 -- 172.21.15.16:0/2525753668 wait complete. 2024-04-26T20:14:15.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T20:14:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.615+0000 7f1f82e00640 1 Processor -- start 2024-04-26T20:14:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.615+0000 7f1f82e00640 1 -- start start 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f82e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1f7c0c8ce0 0x7f1f7c1642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f82e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f7c0c4850 con 0x7f1f7c152d80 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f82e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f7c0c94e0 con 0x7f1f7c0c7cb0 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f82e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f1f7c0c4e60 con 0x7f1f7c0c8ce0 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1f7c152d80 0x7f1f7c06c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42808/0 (socket says 172.21.15.16:42808) 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7be00640 1 -- 172.21.15.16:0/3830363065 learned_addr learned my addr 172.21.15.16:0/3830363065 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f80e00640 1 --2- 172.21.15.16:0/3830363065 >> v2:172.21.15.192:3300/0 conn(0x7f1f7c0c8ce0 0x7f1f7c1642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820131527 0 0) 0x7f1f7c0c4850 con 0x7f1f7c152d80 2024-04-26T20:14:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f60003530 con 0x7f1f7c152d80 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1545606594 0 0) 0x7f1f60003530 con 0x7f1f7c152d80 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 >> v2:172.21.15.192:3300/0 conn(0x7f1f7c0c8ce0 msgr2=0x7f1f7c1642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 --2- 172.21.15.16:0/3830363065 >> v2:172.21.15.192:3300/0 conn(0x7f1f7c0c8ce0 0x7f1f7c1642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 >> v1:172.21.15.192:6789/0 conn(0x7f1f7c0c7cb0 legacy=0x7f1f7c0c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c0c97c0 con 0x7f1f7c152d80 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f1f6c001680 con 0x7f1f7c152d80 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 >> v1:172.21.15.16:6789/0 conn(0x7f1f7c152d80 legacy=0x7f1f7c06c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f600039c0 0x7f1f60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f60004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f600051d0 0x7f1f6000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c0c4e60 con 0x7f1f60004810 2024-04-26T20:14:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6000c0a0 con 0x7f1f600051d0 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6000c2a0 con 0x7f1f600039c0 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f73e00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f60004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f80e00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f600051d0 0x7f1f6000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f7be00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f600039c0 0x7f1f60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f73e00640 1 -- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f600039c0 msgr2=0x7f1f60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f73e00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f600039c0 0x7f1f60003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f73e00640 1 -- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f600051d0 msgr2=0x7f1f6000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f73e00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f600051d0 0x7f1f6000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f80e00640 1 -- 172.21.15.16:0/3830363065 reap_dead start 2024-04-26T20:14:15.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.619+0000 7f1f73e00640 1 -- 172.21.15.16:0/3830363065 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f60003530 con 0x7f1f60004810 2024-04-26T20:14:15.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f73e00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f60004c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f64001780 tx=0x7f1f6401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b278dbaf729c33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:15.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f640013a0 con 0x7f1f60004810 2024-04-26T20:14:15.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f640052f0 con 0x7f1f60004810 2024-04-26T20:14:15.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f7b400640 1 -- 172.21.15.16:0/3830363065 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64003840 con 0x7f1f60004810 2024-04-26T20:14:15.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 -- 172.21.15.16:0/3830363065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 msgr2=0x7f1f60004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:15.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f60004c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f64001780 tx=0x7f1f6401c400 comp rx=0 tx=0).stop 2024-04-26T20:14:15.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 -- 172.21.15.16:0/3830363065 shutdown_connections 2024-04-26T20:14:15.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3830363065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f60004c90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 -- 172.21.15.16:0/3830363065 >> 172.21.15.16:0/3830363065 conn(0x7f1f7c0cd2b0 msgr2=0x7f1f7c0cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:15.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 -- 172.21.15.16:0/3830363065 shutdown_connections 2024-04-26T20:14:15.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 -- 172.21.15.16:0/3830363065 wait complete. 2024-04-26T20:14:15.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 Processor -- start 2024-04-26T20:14:15.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.623+0000 7f1f82e00640 1 -- start start 2024-04-26T20:14:15.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f7c1f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f7c153280 0x7f1f7c155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f7c1e3080 0x7f1f7c13fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c0c9aa0 con 0x7f1f60004810 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c073600 con 0x7f1f7c153280 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7c073ae0 con 0x7f1f7c1e3080 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f7c1f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f7c1f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51010/0 (socket says 172.21.15.16:51010) 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 -- 172.21.15.16:0/3262457518 learned_addr learned my addr 172.21.15.16:0/3262457518 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f73e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f7c153280 0x7f1f7c155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f80e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f7c1e3080 0x7f1f7c13fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 -- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f7c1e3080 msgr2=0x7f1f7c13fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f7c1e3080 0x7f1f7c13fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 -- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f7c153280 msgr2=0x7f1f7c155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:15.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f7c153280 0x7f1f7c155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:15.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 -- 172.21.15.16:0/3262457518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c142f90 con 0x7f1f60004810 2024-04-26T20:14:15.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f80e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f7c1e3080 0x7f1f7c13fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:15.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f7be00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f7c1f5dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c011840 tx=0x7f1f6c011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:15.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f78c00640 1 -- 172.21.15.16:0/3262457518 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c010040 con 0x7f1f60004810 2024-04-26T20:14:15.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f78c00640 1 -- 172.21.15.16:0/3262457518 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c01a070 con 0x7f1f60004810 2024-04-26T20:14:15.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c1536e0 con 0x7f1f60004810 2024-04-26T20:14:15.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f78c00640 1 -- 172.21.15.16:0/3262457518 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00fd60 con 0x7f1f60004810 2024-04-26T20:14:15.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c143510 con 0x7f1f60004810 2024-04-26T20:14:15.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.627+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7c077c20 con 0x7f1f60004810 2024-04-26T20:14:15.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.631+0000 7f1f78c00640 1 -- 172.21.15.16:0/3262457518 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1f6c01f460 con 0x7f1f60004810 2024-04-26T20:14:15.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.631+0000 7f1f78c00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1f58068380 0x7f1f5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:15.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.631+0000 7f1f78c00640 1 -- 172.21.15.16:0/3262457518 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f1f6c089bd0 con 0x7f1f60004810 2024-04-26T20:14:15.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.631+0000 7f1f73e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1f58068380 0x7f1f5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:15.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.631+0000 7f1f73e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1f58068380 0x7f1f5806a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f640ac000 tx=0x7f1f640011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:15.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.635+0000 7f1f78c00640 1 -- 172.21.15.16:0/3262457518 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1f6c05a050 con 0x7f1f60004810 2024-04-26T20:14:15.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:14:15.777 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:14:15.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:15.799+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1f7c0c51f0 con 0x7f1f60004810 2024-04-26T20:14:17.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.479+0000 7f1f78c00640 1 -- 172.21.15.16:0/3262457518 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f1f6c059950 con 0x7f1f60004810 2024-04-26T20:14:17.484 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data_ec' created 2024-04-26T20:14:17.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1f58068380 msgr2=0x7f1f5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:17.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1f58068380 0x7f1f5806a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f640ac000 tx=0x7f1f640011a0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 msgr2=0x7f1f7c1f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f7c1f5dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c011840 tx=0x7f1f6c011d00 comp rx=0 tx=0).stop 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 shutdown_connections 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1f58068380 0x7f1f5806a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f7c1e3080 0x7f1f7c13fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f7c153280 0x7f1f7c155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 --2- 172.21.15.16:0/3262457518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f60004810 0x7f1f7c1f5dd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 >> 172.21.15.16:0/3262457518 conn(0x7f1f7c0cd2b0 msgr2=0x7f1f7c150380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 shutdown_connections 2024-04-26T20:14:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.483+0000 7f1f82e00640 1 -- 172.21.15.16:0/3262457518 wait complete. 2024-04-26T20:14:17.521 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T20:14:17.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9284800640 1 Processor -- start 2024-04-26T20:14:17.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9284800640 1 -- start start 2024-04-26T20:14:17.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9284800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f927c155ee0 0x7f927c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:17.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9284800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c15fbb0 0x7f927c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:17.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9284800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c070380 con 0x7f927c06e270 2024-04-26T20:14:17.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9284800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f927c070660 con 0x7f927c155ee0 2024-04-26T20:14:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9284800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f927c070940 con 0x7f927c15fbb0 2024-04-26T20:14:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9282800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f927c06e270 0x7f927c0c4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42820/0 (socket says 172.21.15.16:42820) 2024-04-26T20:14:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9282800640 1 -- 172.21.15.16:0/331357079 learned_addr learned my addr 172.21.15.16:0/331357079 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9281400640 1 --2- 172.21.15.16:0/331357079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c15fbb0 0x7f927c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:17.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9281e00640 1 --2- 172.21.15.16:0/331357079 >> v2:172.21.15.192:3300/0 conn(0x7f927c155ee0 0x7f927c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:17.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9280a00640 1 -- 172.21.15.16:0/331357079 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848168845 0 0) 0x7f927c070380 con 0x7f927c06e270 2024-04-26T20:14:17.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9280a00640 1 -- 172.21.15.16:0/331357079 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9264003530 con 0x7f927c06e270 2024-04-26T20:14:17.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9281400640 1 -- 172.21.15.16:0/331357079 >> v2:172.21.15.192:3300/0 conn(0x7f927c155ee0 msgr2=0x7f927c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:17.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9281400640 1 --2- 172.21.15.16:0/331357079 >> v2:172.21.15.192:3300/0 conn(0x7f927c155ee0 0x7f927c06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9280a00640 1 -- 172.21.15.16:0/331357079 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2994373428 0 0) 0x7f9264003530 con 0x7f927c06e270 2024-04-26T20:14:17.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9281400640 1 -- 172.21.15.16:0/331357079 >> v1:172.21.15.16:6789/0 conn(0x7f927c06e270 legacy=0x7f927c0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:17.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.667+0000 7f9281400640 1 -- 172.21.15.16:0/331357079 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c070c20 con 0x7f927c15fbb0 2024-04-26T20:14:17.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9281400640 1 --2- 172.21.15.16:0/331357079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c15fbb0 0x7f927c06dd30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f926c0097c0 tx=0x7f926c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2849c5f1659e78ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:17.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9280a00640 1 -- 172.21.15.16:0/331357079 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0b0070 con 0x7f927c15fbb0 2024-04-26T20:14:17.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9280a00640 1 -- 172.21.15.16:0/331357079 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0ab400 con 0x7f927c15fbb0 2024-04-26T20:14:17.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9280a00640 1 -- 172.21.15.16:0/331357079 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278001a00 con 0x7f927c15fbb0 2024-04-26T20:14:17.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 -- 172.21.15.16:0/331357079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c15fbb0 msgr2=0x7f927c06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:17.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 --2- 172.21.15.16:0/331357079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c15fbb0 0x7f927c06dd30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f926c0097c0 tx=0x7f926c01c3c0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 -- 172.21.15.16:0/331357079 shutdown_connections 2024-04-26T20:14:17.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 --2- 172.21.15.16:0/331357079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c15fbb0 0x7f927c06dd30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 --2- 172.21.15.16:0/331357079 >> v2:172.21.15.192:3300/0 conn(0x7f927c155ee0 0x7f927c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 -- 172.21.15.16:0/331357079 >> 172.21.15.16:0/331357079 conn(0x7f927c071f60 msgr2=0x7f927c072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:17.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 -- 172.21.15.16:0/331357079 shutdown_connections 2024-04-26T20:14:17.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.671+0000 7f9284800640 1 -- 172.21.15.16:0/331357079 wait complete. 2024-04-26T20:14:17.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 Processor -- start 2024-04-26T20:14:17.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 -- start start 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c06e270 0x7f927c14bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f927c155ee0 0x7f927c142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927c15fbb0 0x7f927c1430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f927c0ca160 con 0x7f927c15fbb0 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f927c0c9fe0 con 0x7f927c155ee0 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f927c0c61b0 con 0x7f927c06e270 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927c15fbb0 0x7f927c1430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9281400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f927c155ee0 0x7f927c142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9281e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c06e270 0x7f927c14bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9281400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f927c155ee0 0x7f927c142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:46346/0 (socket says 172.21.15.16:46346) 2024-04-26T20:14:17.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9281400640 1 -- 172.21.15.16:0/1896972940 learned_addr learned my addr 172.21.15.16:0/1896972940 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:17.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927c15fbb0 0x7f927c1430e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51012/0 (socket says 172.21.15.16:51012) 2024-04-26T20:14:17.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 -- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c06e270 msgr2=0x7f927c14bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:17.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c06e270 0x7f927c14bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 -- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f927c155ee0 msgr2=0x7f927c142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:17.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f927c155ee0 0x7f927c142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:17.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 -- 172.21.15.16:0/1896972940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c148610 con 0x7f927c15fbb0 2024-04-26T20:14:17.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9282800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927c15fbb0 0x7f927c1430e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f927800cbe0 tx=0x7f927800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:17.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9276000640 1 -- 172.21.15.16:0/1896972940 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927800ace0 con 0x7f927c15fbb0 2024-04-26T20:14:17.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9276000640 1 -- 172.21.15.16:0/1896972940 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9278012400 con 0x7f927c15fbb0 2024-04-26T20:14:17.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9276000640 1 -- 172.21.15.16:0/1896972940 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92780127f0 con 0x7f927c15fbb0 2024-04-26T20:14:17.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c1488d0 con 0x7f927c15fbb0 2024-04-26T20:14:17.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.675+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c14a5c0 con 0x7f927c15fbb0 2024-04-26T20:14:17.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.679+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927c077c20 con 0x7f927c15fbb0 2024-04-26T20:14:17.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.679+0000 7f9276000640 1 -- 172.21.15.16:0/1896972940 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9278012990 con 0x7f927c15fbb0 2024-04-26T20:14:17.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.679+0000 7f9276000640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f92600683b0 0x7f926006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:17.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.679+0000 7f9276000640 1 -- 172.21.15.16:0/1896972940 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f92780872e0 con 0x7f927c15fbb0 2024-04-26T20:14:17.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.679+0000 7f9281e00640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f92600683b0 0x7f926006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:17.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.679+0000 7f9281e00640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f92600683b0 0x7f926006a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9270009b60 tx=0x7f9270009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:17.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.683+0000 7f9276000640 1 -- 172.21.15.16:0/1896972940 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9278056e90 con 0x7f927c15fbb0 2024-04-26T20:14:17.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:17.851+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f927c0caa80 con 0x7f927c15fbb0 2024-04-26T20:14:18.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.487+0000 7f9276000640 1 -- 172.21.15.16:0/1896972940 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f927805b190 con 0x7f927c15fbb0 2024-04-26T20:14:18.492 INFO:teuthology.orchestra.run.smithi016.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f92600683b0 msgr2=0x7f926006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f92600683b0 0x7f926006a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9270009b60 tx=0x7f9270009190 comp rx=0 tx=0).stop 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927c15fbb0 msgr2=0x7f927c1430e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927c15fbb0 0x7f927c1430e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f927800cbe0 tx=0x7f927800a430 comp rx=0 tx=0).stop 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 shutdown_connections 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f92600683b0 0x7f926006a870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927c15fbb0 0x7f927c1430e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f927c155ee0 0x7f927c142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 --2- 172.21.15.16:0/1896972940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f927c06e270 0x7f927c14bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.491+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 >> 172.21.15.16:0/1896972940 conn(0x7f927c071f60 msgr2=0x7f927c0c4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:18.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.495+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 shutdown_connections 2024-04-26T20:14:18.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.499+0000 7f9284800640 1 -- 172.21.15.16:0/1896972940 wait complete. 2024-04-26T20:14:18.542 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T20:14:18.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2869000640 1 Processor -- start 2024-04-26T20:14:18.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2869000640 1 -- start start 2024-04-26T20:14:18.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2869000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2864153eb0 0x7f286415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2869000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28640c96a0 con 0x7f286406f460 2024-04-26T20:14:18.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2869000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28640c9980 con 0x7f286406ff50 2024-04-26T20:14:18.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2869000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f286415ac00 con 0x7f2864153eb0 2024-04-26T20:14:18.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f286406f460 0x7f286406f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42822/0 (socket says 172.21.15.16:42822) 2024-04-26T20:14:18.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861e00640 1 -- 172.21.15.16:0/174594463 learned_addr learned my addr 172.21.15.16:0/174594463 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:18.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2859400640 1 --2- 172.21.15.16:0/174594463 >> v2:172.21.15.192:3300/0 conn(0x7f2864153eb0 0x7f286415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838170502 0 0) 0x7f28640c96a0 con 0x7f286406f460 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2848003530 con 0x7f286406f460 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2680264983 0 0) 0x7f2848003530 con 0x7f286406f460 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 >> v2:172.21.15.192:3300/0 conn(0x7f2864153eb0 msgr2=0x7f286415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 --2- 172.21.15.16:0/174594463 >> v2:172.21.15.192:3300/0 conn(0x7f2864153eb0 0x7f286415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 >> v1:172.21.15.192:6789/0 conn(0x7f286406ff50 legacy=0x7f28640c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2864070610 con 0x7f286406f460 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f2854001680 con 0x7f286406f460 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 >> v1:172.21.15.16:6789/0 conn(0x7f286406f460 legacy=0x7f286406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480039c0 0x7f2848003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2848004810 0x7f2848004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28480051d0 0x7f284800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f286415ac00 con 0x7f28480051d0 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f284800c080 con 0x7f2848004810 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f284800c280 con 0x7f28480039c0 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2862800640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28480051d0 0x7f284800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2861e00640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480039c0 0x7f2848003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2859400640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2848004810 0x7f2848004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2862800640 1 -- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480039c0 msgr2=0x7f2848003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2862800640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480039c0 0x7f2848003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2862800640 1 -- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2848004810 msgr2=0x7f2848004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2862800640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2848004810 0x7f2848004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.687+0000 7f2862800640 1 -- 172.21.15.16:0/174594463 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2848003530 con 0x7f28480051d0 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2862800640 1 -- 172.21.15.16:0/174594463 reap_dead start 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2862800640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28480051d0 0x7f284800b9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f285c001e40 tx=0x7f285c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2b2ceaf279a7a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c001a90 con 0x7f28480051d0 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c003b80 con 0x7f28480051d0 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2861400640 1 -- 172.21.15.16:0/174594463 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c005020 con 0x7f28480051d0 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2869000640 1 -- 172.21.15.16:0/174594463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28480051d0 msgr2=0x7f284800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2869000640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28480051d0 0x7f284800b9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f285c001e40 tx=0x7f285c01c760 comp rx=0 tx=0).stop 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2869000640 1 -- 172.21.15.16:0/174594463 shutdown_connections 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2869000640 1 --2- 172.21.15.16:0/174594463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28480051d0 0x7f284800b9d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2869000640 1 -- 172.21.15.16:0/174594463 >> 172.21.15.16:0/174594463 conn(0x7f28640c9d10 msgr2=0x7f28640ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2869000640 1 -- 172.21.15.16:0/174594463 shutdown_connections 2024-04-26T20:14:18.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.691+0000 7f2869000640 1 -- 172.21.15.16:0/174594463 wait complete. 2024-04-26T20:14:18.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 Processor -- start 2024-04-26T20:14:18.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 -- start start 2024-04-26T20:14:18.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480051d0 0x7f28641485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28641f5600 0x7f2864158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2864148e20 0x7f2864158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28640c5120 con 0x7f28641f5600 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f28640c9500 con 0x7f2864148e20 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f28640c4d70 con 0x7f28480051d0 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28641f5600 0x7f2864158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28641f5600 0x7f2864158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51028/0 (socket says 172.21.15.16:51028) 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 -- 172.21.15.16:0/4134047882 learned_addr learned my addr 172.21.15.16:0/4134047882 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2861e00640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480051d0 0x7f28641485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2862800640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2864148e20 0x7f2864158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 -- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480051d0 msgr2=0x7f28641485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480051d0 0x7f28641485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 -- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2864148e20 msgr2=0x7f2864158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2864148e20 0x7f2864158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 -- 172.21.15.16:0/4134047882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28641597e0 con 0x7f28641f5600 2024-04-26T20:14:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2861e00640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480051d0 0x7f28641485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2859400640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28641f5600 0x7f2864158970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f284c011990 tx=0x7f284c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f285aa00640 1 -- 172.21.15.16:0/4134047882 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c00fad0 con 0x7f28641f5600 2024-04-26T20:14:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f285aa00640 1 -- 172.21.15.16:0/4134047882 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c00fc70 con 0x7f28641f5600 2024-04-26T20:14:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f285aa00640 1 -- 172.21.15.16:0/4134047882 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c014440 con 0x7f28641f5600 2024-04-26T20:14:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2864159ac0 con 0x7f28641f5600 2024-04-26T20:14:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.695+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2864072720 con 0x7f28641f5600 2024-04-26T20:14:18.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.699+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2864072260 con 0x7f28641f5600 2024-04-26T20:14:18.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.699+0000 7f285aa00640 1 -- 172.21.15.16:0/4134047882 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f284c012040 con 0x7f28641f5600 2024-04-26T20:14:18.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.699+0000 7f285aa00640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2840068380 0x7f284006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:18.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.699+0000 7f285aa00640 1 -- 172.21.15.16:0/4134047882 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f284c087290 con 0x7f28641f5600 2024-04-26T20:14:18.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.699+0000 7f2861e00640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2840068380 0x7f284006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:18.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.699+0000 7f2861e00640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2840068380 0x7f284006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2854001ec0 tx=0x7f2854009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:18.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.703+0000 7f285aa00640 1 -- 172.21.15.16:0/4134047882 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2864072260 con 0x7f28641f5600 2024-04-26T20:14:18.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:18.907+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f2864077c20 con 0x7f28641f5600 2024-04-26T20:14:19.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.503+0000 7f285aa00640 1 -- 172.21.15.16:0/4134047882 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f284c019030 con 0x7f28641f5600 2024-04-26T20:14:19.508 INFO:teuthology.orchestra.run.smithi016.stderr:added data pool 4 to fsmap 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2840068380 msgr2=0x7f284006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2840068380 0x7f284006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2854001ec0 tx=0x7f2854009040 comp rx=0 tx=0).stop 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28641f5600 msgr2=0x7f2864158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28641f5600 0x7f2864158970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f284c011990 tx=0x7f284c011e50 comp rx=0 tx=0).stop 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 shutdown_connections 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2840068380 0x7f284006a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2864148e20 0x7f2864158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28641f5600 0x7f2864158970 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 --2- 172.21.15.16:0/4134047882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28480051d0 0x7f28641485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 >> 172.21.15.16:0/4134047882 conn(0x7f28640c9d10 msgr2=0x7f28641516e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:19.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 shutdown_connections 2024-04-26T20:14:19.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.507+0000 7f2869000640 1 -- 172.21.15.16:0/4134047882 wait complete. 2024-04-26T20:14:19.533 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:19.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe765000640 1 Processor -- start 2024-04-26T20:14:19.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe765000640 1 -- start start 2024-04-26T20:14:19.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe765000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe7601570f0 0x7fe76015a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:19.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe765000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe760071680 0x7fe7600c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe765000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7600ca650 con 0x7fe7600c6120 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe765000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe7600c9d40 con 0x7fe7601570f0 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe765000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe760070bc0 con 0x7fe760071680 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe7601570f0 0x7fe76015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe7601570f0 0x7fe76015a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51032/0 (socket says 172.21.15.16:51032) 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75f400640 1 -- 172.21.15.16:0/3338970375 learned_addr learned my addr 172.21.15.16:0/3338970375 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe756a00640 1 --2- 172.21.15.16:0/3338970375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe760071680 0x7fe7600c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75f400640 1 -- 172.21.15.16:0/3338970375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe760071680 msgr2=0x7fe7600c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75f400640 1 --2- 172.21.15.16:0/3338970375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe760071680 0x7fe7600c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75f400640 1 -- 172.21.15.16:0/3338970375 >> v1:172.21.15.16:6789/0 conn(0x7fe7600c6120 legacy=0x7fe7600cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75f400640 1 -- 172.21.15.16:0/3338970375 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7600c9f90 con 0x7fe7601570f0 2024-04-26T20:14:19.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.671+0000 7fe75ea00640 1 -- 172.21.15.16:0/3338970375 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129457843 0 0) 0x7fe758001120 con 0x7fe7600c6120 2024-04-26T20:14:19.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe75f400640 1 --2- 172.21.15.16:0/3338970375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe76015a560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52965a764fc22511 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:19.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe75ea00640 1 -- 172.21.15.16:0/3338970375 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a5750 con 0x7fe7601570f0 2024-04-26T20:14:19.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe75ea00640 1 -- 172.21.15.16:0/3338970375 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7500a58f0 con 0x7fe7601570f0 2024-04-26T20:14:19.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe75ea00640 1 -- 172.21.15.16:0/3338970375 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a5cc0 con 0x7fe7601570f0 2024-04-26T20:14:19.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 -- 172.21.15.16:0/3338970375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 msgr2=0x7fe76015a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 --2- 172.21.15.16:0/3338970375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe76015a560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001ca30 comp rx=0 tx=0).stop 2024-04-26T20:14:19.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 -- 172.21.15.16:0/3338970375 shutdown_connections 2024-04-26T20:14:19.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 --2- 172.21.15.16:0/3338970375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe760071680 0x7fe7600c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 --2- 172.21.15.16:0/3338970375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe76015a560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 -- 172.21.15.16:0/3338970375 >> 172.21.15.16:0/3338970375 conn(0x7fe76006c7b0 msgr2=0x7fe760068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:19.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 -- 172.21.15.16:0/3338970375 shutdown_connections 2024-04-26T20:14:19.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.675+0000 7fe765000640 1 -- 172.21.15.16:0/3338970375 wait complete. 2024-04-26T20:14:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 Processor -- start 2024-04-26T20:14:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 -- start start 2024-04-26T20:14:19.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe760071680 0x7fe7601579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:19.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7600c6120 0x7fe7601f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:19.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe7600ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:19.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe7600c4c20 con 0x7fe7601570f0 2024-04-26T20:14:19.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe7600c4aa0 con 0x7fe760071680 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe7600cb150 con 0x7fe7600c6120 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe7600ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe7600ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51036/0 (socket says 172.21.15.16:51036) 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 -- 172.21.15.16:0/3677154858 learned_addr learned my addr 172.21.15.16:0/3677154858 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe756a00640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7600c6120 0x7fe7601f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75f400640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe760071680 0x7fe7601579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 -- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7600c6120 msgr2=0x7fe7601f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7600c6120 0x7fe7601f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 -- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe760071680 msgr2=0x7fe7601579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe760071680 0x7fe7601579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 -- 172.21.15.16:0/3677154858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7600c6a60 con 0x7fe7601570f0 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75f400640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe760071680 0x7fe7601579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe75fe00640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe7600ce4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c780 tx=0x7fe75800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe757e00640 1 -- 172.21.15.16:0/3677154858 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758005070 con 0x7fe7601570f0 2024-04-26T20:14:19.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe757e00640 1 -- 172.21.15.16:0/3677154858 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe758005230 con 0x7fe7601570f0 2024-04-26T20:14:19.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7601596d0 con 0x7fe7601570f0 2024-04-26T20:14:19.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe757e00640 1 -- 172.21.15.16:0/3677154858 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75800a640 con 0x7fe7601570f0 2024-04-26T20:14:19.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.679+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7601eb8b0 con 0x7fe7601570f0 2024-04-26T20:14:19.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.683+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7600506d0 con 0x7fe7601570f0 2024-04-26T20:14:19.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.683+0000 7fe757e00640 1 -- 172.21.15.16:0/3677154858 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe75800a7e0 con 0x7fe7601570f0 2024-04-26T20:14:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.683+0000 7fe757e00640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe73c068380 0x7fe73c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.683+0000 7fe757e00640 1 -- 172.21.15.16:0/3677154858 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe758086960 con 0x7fe7601570f0 2024-04-26T20:14:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.683+0000 7fe75f400640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe73c068380 0x7fe73c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:19.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.683+0000 7fe75f400640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe73c068380 0x7fe73c06a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe7500ae000 tx=0x7fe7500a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:19.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.687+0000 7fe757e00640 1 -- 172.21.15.16:0/3677154858 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7600c6a60 con 0x7fe7601570f0 2024-04-26T20:14:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.891+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7601ec300 con 0x7fe7601570f0 2024-04-26T20:14:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.891+0000 7fe757e00640 1 -- 172.21.15.16:0/3677154858 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6834 (secure 0 0 0) 0x7fe7600ca650 con 0x7fe7601570f0 2024-04-26T20:14:19.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:19.896 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:19.492982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-26T20:14:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 6 2024-04-26T20:14:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe73c068380 msgr2=0x7fe73c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe73c068380 0x7fe73c06a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe7500ae000 tx=0x7fe7500a7070 comp rx=0 tx=0).stop 2024-04-26T20:14:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 msgr2=0x7fe7600ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe7600ce4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c780 tx=0x7fe75800cc40 comp rx=0 tx=0).stop 2024-04-26T20:14:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 shutdown_connections 2024-04-26T20:14:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe73c068380 0x7fe73c06a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7601570f0 0x7fe7600ce4f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7600c6120 0x7fe7601f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 --2- 172.21.15.16:0/3677154858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe760071680 0x7fe7601579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 >> 172.21.15.16:0/3677154858 conn(0x7fe76006c7b0 msgr2=0x7fe7600c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 shutdown_connections 2024-04-26T20:14:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:19.895+0000 7fe765000640 1 -- 172.21.15.16:0/3677154858 wait complete. 2024-04-26T20:14:19.918 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:20.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0fe00640 1 Processor -- start 2024-04-26T20:14:20.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0fe00640 1 -- start start 2024-04-26T20:14:20.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc080b47e0 0x7fcc0806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0fe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc080cb7f0 con 0x7fcc080c63f0 2024-04-26T20:14:20.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0fe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc080ca0d0 con 0x7fcc081574b0 2024-04-26T20:14:20.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0fe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcc080ccd80 con 0x7fcc080b47e0 2024-04-26T20:14:20.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0de00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcc080c63f0 0x7fcc08164520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42828/0 (socket says 172.21.15.16:42828) 2024-04-26T20:14:20.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0de00640 1 -- 172.21.15.16:0/3763191787 learned_addr learned my addr 172.21.15.16:0/3763191787 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:20.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0ca00640 1 --2- 172.21.15.16:0/3763191787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc080b47e0 0x7fcc0806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513027055 0 0) 0x7fcc080cb7f0 con 0x7fcc080c63f0 2024-04-26T20:14:20.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbf0003530 con 0x7fcc080c63f0 2024-04-26T20:14:20.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415945001 0 0) 0x7fcc080ca0d0 con 0x7fcc081574b0 2024-04-26T20:14:20.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc080cb7f0 con 0x7fcc081574b0 2024-04-26T20:14:20.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4068999647 0 0) 0x7fcbf0003530 con 0x7fcc080c63f0 2024-04-26T20:14:20.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0ca00640 1 -- 172.21.15.16:0/3763191787 >> v1:172.21.15.192:6789/0 conn(0x7fcc081574b0 legacy=0x7fcc080ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0ca00640 1 -- 172.21.15.16:0/3763191787 >> v1:172.21.15.16:6789/0 conn(0x7fcc080c63f0 legacy=0x7fcc08164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.055+0000 7fcc0ca00640 1 -- 172.21.15.16:0/3763191787 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc080cba90 con 0x7fcc080b47e0 2024-04-26T20:14:20.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0ca00640 1 --2- 172.21.15.16:0/3763191787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc080b47e0 0x7fcc0806feb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40097f0 tx=0x7fcbf401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc047c1da4d208b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40b0070 con 0x7fcc080b47e0 2024-04-26T20:14:20.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf40ab400 con 0x7fcc080b47e0 2024-04-26T20:14:20.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc07e00640 1 -- 172.21.15.16:0/3763191787 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00001680 con 0x7fcc080b47e0 2024-04-26T20:14:20.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0fe00640 1 -- 172.21.15.16:0/3763191787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc080b47e0 msgr2=0x7fcc0806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/3763191787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc080b47e0 0x7fcc0806feb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40097f0 tx=0x7fcbf401c400 comp rx=0 tx=0).stop 2024-04-26T20:14:20.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0fe00640 1 -- 172.21.15.16:0/3763191787 shutdown_connections 2024-04-26T20:14:20.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/3763191787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc080b47e0 0x7fcc0806feb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0fe00640 1 -- 172.21.15.16:0/3763191787 >> 172.21.15.16:0/3763191787 conn(0x7fcc08071160 msgr2=0x7fcc08068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:20.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0fe00640 1 -- 172.21.15.16:0/3763191787 shutdown_connections 2024-04-26T20:14:20.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.059+0000 7fcc0fe00640 1 -- 172.21.15.16:0/3763191787 wait complete. 2024-04-26T20:14:20.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 Processor -- start 2024-04-26T20:14:20.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 -- start start 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc080b47e0 0x7fcc08153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc080c63f0 0x7fcc08140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc081574b0 0x7fcc081406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc080707c0 con 0x7fcc080c63f0 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcc08070640 con 0x7fcc080b47e0 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcc08168460 con 0x7fcc081574b0 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc080c63f0 0x7fcc08140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc080b47e0 0x7fcc08153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc080c63f0 0x7fcc08140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51038/0 (socket says 172.21.15.16:51038) 2024-04-26T20:14:20.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 -- 172.21.15.16:0/2548262539 learned_addr learned my addr 172.21.15.16:0/2548262539 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0de00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc081574b0 0x7fcc081406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 -- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc081574b0 msgr2=0x7fcc081406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc081574b0 0x7fcc081406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 -- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc080b47e0 msgr2=0x7fcc08153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc080b47e0 0x7fcc08153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 -- 172.21.15.16:0/2548262539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0806efb0 con 0x7fcc080c63f0 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0ca00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc080c63f0 0x7fcc08140170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4000c10 tx=0x7fcbf40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc05600640 1 -- 172.21.15.16:0/2548262539 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40b0040 con 0x7fcc080c63f0 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc05600640 1 -- 172.21.15.16:0/2548262539 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf40b4430 con 0x7fcc080c63f0 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0806f290 con 0x7fcc080c63f0 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc05600640 1 -- 172.21.15.16:0/2548262539 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40b47e0 con 0x7fcc080c63f0 2024-04-26T20:14:20.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc080cd7f0 con 0x7fcc080c63f0 2024-04-26T20:14:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.063+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc08140d60 con 0x7fcc080c63f0 2024-04-26T20:14:20.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.067+0000 7fcc05600640 1 -- 172.21.15.16:0/2548262539 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcbf40bb020 con 0x7fcc080c63f0 2024-04-26T20:14:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.067+0000 7fcc05600640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcbe8068380 0x7fcbe806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.067+0000 7fcc05600640 1 -- 172.21.15.16:0/2548262539 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcbf4120510 con 0x7fcc080c63f0 2024-04-26T20:14:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.067+0000 7fcc0d400640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcbe8068380 0x7fcbe806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.067+0000 7fcc0d400640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcbe8068380 0x7fcbe806a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc001570 tx=0x7fcbfc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.071+0000 7fcc05600640 1 -- 172.21.15.16:0/2548262539 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcbf4015ff0 con 0x7fcc080c63f0 2024-04-26T20:14:20.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.235+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc08077c20 con 0x7fcc080c63f0 2024-04-26T20:14:20.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc05600640 1 -- 172.21.15.16:0/2548262539 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fcbf40f06f0 con 0x7fcc080c63f0 2024-04-26T20:14:20.242 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:20.242 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcbe8068380 msgr2=0x7fcbe806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcbe8068380 0x7fcbe806a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc001570 tx=0x7fcbfc009040 comp rx=0 tx=0).stop 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc080c63f0 msgr2=0x7fcc08140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc080c63f0 0x7fcc08140170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4000c10 tx=0x7fcbf40191a0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 shutdown_connections 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcbe8068380 0x7fcbe806a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc081574b0 0x7fcc081406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc080c63f0 0x7fcc08140170 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 --2- 172.21.15.16:0/2548262539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc080b47e0 0x7fcc08153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 >> 172.21.15.16:0/2548262539 conn(0x7fcc08071160 msgr2=0x7fcc0814ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 shutdown_connections 2024-04-26T20:14:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.239+0000 7fcc0fe00640 1 -- 172.21.15.16:0/2548262539 wait complete. 2024-04-26T20:14:20.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:20.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe491600640 1 Processor -- start 2024-04-26T20:14:20.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe491600640 1 -- start start 2024-04-26T20:14:20.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe491600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe48c155f20 0x7fe48c0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe491600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 0x7fe48c073550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe491600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48c0c7e40 con 0x7fe48c06fb60 2024-04-26T20:14:20.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe491600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c156300 con 0x7fe48c155f20 2024-04-26T20:14:20.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe491600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c0c8120 con 0x7fe48c15c590 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe48b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe48c06fb60 0x7fe48c15f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42834/0 (socket says 172.21.15.16:42834) 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.399+0000 7fe48b400640 1 -- 172.21.15.16:0/4254057295 learned_addr learned my addr 172.21.15.16:0/4254057295 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48aa00640 1 --2- 172.21.15.16:0/4254057295 >> v2:172.21.15.192:3300/0 conn(0x7fe48c155f20 0x7fe48c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe483e00640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 0x7fe48c073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483177727 0 0) 0x7fe48c0c7e40 con 0x7fe48c06fb60 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe470003530 con 0x7fe48c06fb60 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 16121205 0 0) 0x7fe470003530 con 0x7fe48c06fb60 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 msgr2=0x7fe48c073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:20.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 0x7fe48c073550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 >> v2:172.21.15.192:3300/0 conn(0x7fe48c155f20 msgr2=0x7fe48c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 --2- 172.21.15.16:0/4254057295 >> v2:172.21.15.192:3300/0 conn(0x7fe48c155f20 0x7fe48c0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c072d50 con 0x7fe48c06fb60 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fe484001a00 con 0x7fe48c06fb60 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48aa00640 1 --2- 172.21.15.16:0/4254057295 >> v2:172.21.15.192:3300/0 conn(0x7fe48c155f20 0x7fe48c0722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 >> v1:172.21.15.16:6789/0 conn(0x7fe48c06fb60 legacy=0x7fe48c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 0x7fe4700039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe470003f40 0x7fe470004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe4700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0c8120 con 0x7fe470004d50 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe47000b9d0 con 0x7fe470003f40 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe47000bb80 con 0x7fe48c15c590 2024-04-26T20:14:20.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48b400640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe4700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48aa00640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 0x7fe4700039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe483e00640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe470003f40 0x7fe470004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48b400640 1 -- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 msgr2=0x7fe4700039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:20.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48b400640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c15c590 0x7fe4700039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48b400640 1 -- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe470003f40 msgr2=0x7fe470004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:20.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48b400640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe470003f40 0x7fe470004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.403+0000 7fe48b400640 1 -- 172.21.15.16:0/4254057295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe470003530 con 0x7fe470004d50 2024-04-26T20:14:20.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe48b400640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe4700051d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe48400a870 tx=0x7fe48401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1b74c06ab1a613 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48400a4c0 con 0x7fe470004d50 2024-04-26T20:14:20.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4840072d0 con 0x7fe470004d50 2024-04-26T20:14:20.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe48a000640 1 -- 172.21.15.16:0/4254057295 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840076c0 con 0x7fe470004d50 2024-04-26T20:14:20.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 -- 172.21.15.16:0/4254057295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 msgr2=0x7fe4700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 --2- 172.21.15.16:0/4254057295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe4700051d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe48400a870 tx=0x7fe48401d3a0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe48b400640 1 -- 172.21.15.16:0/4254057295 reap_dead start 2024-04-26T20:14:20.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 -- 172.21.15.16:0/4254057295 shutdown_connections 2024-04-26T20:14:20.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 -- 172.21.15.16:0/4254057295 >> 172.21.15.16:0/4254057295 conn(0x7fe48c06c380 msgr2=0x7fe48c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:20.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 -- 172.21.15.16:0/4254057295 shutdown_connections 2024-04-26T20:14:20.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 -- 172.21.15.16:0/4254057295 wait complete. 2024-04-26T20:14:20.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 Processor -- start 2024-04-26T20:14:20.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.407+0000 7fe491600640 1 -- start start 2024-04-26T20:14:20.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe48c0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c156cf0 0x7fe48c145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0cced0 0x7fe48c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0c5360 con 0x7fe470004d50 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0c51e0 con 0x7fe48c0cced0 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c15c9b0 con 0x7fe48c156cf0 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe48c0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe48c0cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51054/0 (socket says 172.21.15.16:51054) 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 -- 172.21.15.16:0/4203361332 learned_addr learned my addr 172.21.15.16:0/4203361332 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe483e00640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c156cf0 0x7fe48c145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48b400640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0cced0 0x7fe48c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 -- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c156cf0 msgr2=0x7fe48c145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c156cf0 0x7fe48c145f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 -- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0cced0 msgr2=0x7fe48c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0cced0 0x7fe48c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 -- 172.21.15.16:0/4203361332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c1590b0 con 0x7fe470004d50 2024-04-26T20:14:20.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe48aa00640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe48c0cc5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe47c011d00 tx=0x7fe47c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe482a00640 1 -- 172.21.15.16:0/4203361332 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c004020 con 0x7fe470004d50 2024-04-26T20:14:20.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe482a00640 1 -- 172.21.15.16:0/4203361332 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47c0041c0 con 0x7fe470004d50 2024-04-26T20:14:20.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe482a00640 1 -- 172.21.15.16:0/4203361332 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c003620 con 0x7fe470004d50 2024-04-26T20:14:20.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c0ccae0 con 0x7fe470004d50 2024-04-26T20:14:20.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c156a10 con 0x7fe470004d50 2024-04-26T20:14:20.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48c077c20 con 0x7fe470004d50 2024-04-26T20:14:20.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe482a00640 1 -- 172.21.15.16:0/4203361332 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe47c012040 con 0x7fe470004d50 2024-04-26T20:14:20.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.411+0000 7fe482a00640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4680683b0 0x7fe46806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.415+0000 7fe482a00640 1 -- 172.21.15.16:0/4203361332 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe47c087390 con 0x7fe470004d50 2024-04-26T20:14:20.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.415+0000 7fe483e00640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4680683b0 0x7fe46806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.415+0000 7fe483e00640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4680683b0 0x7fe46806a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe48c158920 tx=0x7fe474008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.419+0000 7fe482a00640 1 -- 172.21.15.16:0/4203361332 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe47c019030 con 0x7fe470004d50 2024-04-26T20:14:20.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.587+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe48c0c70e0 con 0x7fe470004d50 2024-04-26T20:14:20.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.587+0000 7fe482a00640 1 -- 172.21.15.16:0/4203361332 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fe47c057600 con 0x7fe470004d50 2024-04-26T20:14:20.592 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:20.592 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4680683b0 msgr2=0x7fe46806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4680683b0 0x7fe46806a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe48c158920 tx=0x7fe474008040 comp rx=0 tx=0).stop 2024-04-26T20:14:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 msgr2=0x7fe48c0cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe48c0cc5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe47c011d00 tx=0x7fe47c00f610 comp rx=0 tx=0).stop 2024-04-26T20:14:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 shutdown_connections 2024-04-26T20:14:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4680683b0 0x7fe46806a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0cced0 0x7fe48c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe48c156cf0 0x7fe48c145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 --2- 172.21.15.16:0/4203361332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe470004d50 0x7fe48c0cc5a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 >> 172.21.15.16:0/4203361332 conn(0x7fe48c06c380 msgr2=0x7fe48c06ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:20.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 shutdown_connections 2024-04-26T20:14:20.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.591+0000 7fe491600640 1 -- 172.21.15.16:0/4203361332 wait complete. 2024-04-26T20:14:20.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:20.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.763+0000 7f8776a00640 1 Processor -- start 2024-04-26T20:14:20.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.763+0000 7f8776a00640 1 -- start start 2024-04-26T20:14:20.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8776a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87700c7b80 0x7f87700c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8776a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87700c9d90 con 0x7f87700c9010 2024-04-26T20:14:20.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8776a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87700ca070 con 0x7f8770153af0 2024-04-26T20:14:20.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8776a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f877015dec0 con 0x7f87700c7b80 2024-04-26T20:14:20.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8774a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f87700c9010 0x7f87700c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42848/0 (socket says 172.21.15.16:42848) 2024-04-26T20:14:20.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8774a00640 1 -- 172.21.15.16:0/1166825211 learned_addr learned my addr 172.21.15.16:0/1166825211 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:20.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8767400640 1 --2- 172.21.15.16:0/1166825211 >> v2:172.21.15.192:3300/0 conn(0x7f87700c7b80 0x7f87700c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63760410 0 0) 0x7f87700c9d90 con 0x7f87700c9010 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8754003530 con 0x7f87700c9010 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 381823046 0 0) 0x7f8754003530 con 0x7f87700c9010 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 >> v2:172.21.15.192:3300/0 conn(0x7f87700c7b80 msgr2=0x7f87700c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 --2- 172.21.15.16:0/1166825211 >> v2:172.21.15.192:3300/0 conn(0x7f87700c7b80 0x7f87700c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 >> v1:172.21.15.192:6789/0 conn(0x7f8770153af0 legacy=0x7f877015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87700ca350 con 0x7f87700c9010 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f8768001a00 con 0x7f87700c9010 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 >> v1:172.21.15.16:6789/0 conn(0x7f87700c9010 legacy=0x7f87700c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87540039c0 0x7f8754003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8754004810 0x7f8754004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540051d0 0x7f875400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f877015dec0 con 0x7f87540039c0 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f875400c080 con 0x7f87540051d0 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f875400c280 con 0x7f8754004810 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876fe00640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87540039c0 0x7f8754003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8774a00640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540051d0 0x7f875400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8767400640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8754004810 0x7f8754004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876fe00640 1 -- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8754004810 msgr2=0x7f8754004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876fe00640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8754004810 0x7f8754004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876fe00640 1 -- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540051d0 msgr2=0x7f875400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876fe00640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540051d0 0x7f875400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f8774a00640 1 -- 172.21.15.16:0/1166825211 reap_dead start 2024-04-26T20:14:20.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.767+0000 7f876fe00640 1 -- 172.21.15.16:0/1166825211 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8754003530 con 0x7f87540039c0 2024-04-26T20:14:20.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f876fe00640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87540039c0 0x7f8754003de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8760001780 tx=0x7f876001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5535f73f426288 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87600013a0 con 0x7f87540039c0 2024-04-26T20:14:20.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87600052f0 con 0x7f87540039c0 2024-04-26T20:14:20.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f876f400640 1 -- 172.21.15.16:0/1166825211 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760003840 con 0x7f87540039c0 2024-04-26T20:14:20.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f8776a00640 1 -- 172.21.15.16:0/1166825211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87540039c0 msgr2=0x7f8754003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f8776a00640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87540039c0 0x7f8754003de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8760001780 tx=0x7f876001c400 comp rx=0 tx=0).stop 2024-04-26T20:14:20.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f8776a00640 1 -- 172.21.15.16:0/1166825211 shutdown_connections 2024-04-26T20:14:20.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f8776a00640 1 --2- 172.21.15.16:0/1166825211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87540039c0 0x7f8754003de0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f8776a00640 1 -- 172.21.15.16:0/1166825211 >> 172.21.15.16:0/1166825211 conn(0x7f877006c380 msgr2=0x7f877006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:20.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f8776a00640 1 -- 172.21.15.16:0/1166825211 shutdown_connections 2024-04-26T20:14:20.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.771+0000 7f8776a00640 1 -- 172.21.15.16:0/1166825211 wait complete. 2024-04-26T20:14:20.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 Processor -- start 2024-04-26T20:14:20.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 -- start start 2024-04-26T20:14:20.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540039c0 0x7f8770156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f877015cb00 0x7f87701579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87700cddc0 0x7f877014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f877015d290 con 0x7f87700cddc0 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87700ca630 con 0x7f87540039c0 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8770153ed0 con 0x7f877015cb00 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87700cddc0 0x7f877014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87700cddc0 0x7f877014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51086/0 (socket says 172.21.15.16:51086) 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 -- 172.21.15.16:0/1985280179 learned_addr learned my addr 172.21.15.16:0/1985280179 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f876fe00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540039c0 0x7f8770156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8767400640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f877015cb00 0x7f87701579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 -- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f877015cb00 msgr2=0x7f87701579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f877015cb00 0x7f87701579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 -- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540039c0 msgr2=0x7f8770156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540039c0 0x7f8770156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 -- 172.21.15.16:0/1985280179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8770151b70 con 0x7f87700cddc0 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f876fe00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540039c0 0x7f8770156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8774a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87700cddc0 0x7f877014e010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8770070d30 tx=0x7f87680115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f876cc00640 1 -- 172.21.15.16:0/1985280179 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876801c070 con 0x7f87700cddc0 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f876cc00640 1 -- 172.21.15.16:0/1985280179 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8768011de0 con 0x7f87700cddc0 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f876cc00640 1 -- 172.21.15.16:0/1985280179 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768010040 con 0x7f87700cddc0 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8770151e30 con 0x7f87700cddc0 2024-04-26T20:14:20.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877014fb40 con 0x7f87700cddc0 2024-04-26T20:14:20.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.775+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8770077c20 con 0x7f87700cddc0 2024-04-26T20:14:20.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.779+0000 7f876cc00640 1 -- 172.21.15.16:0/1985280179 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f876801f070 con 0x7f87700cddc0 2024-04-26T20:14:20.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.779+0000 7f876cc00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f874c0683b0 0x7f874c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:20.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.779+0000 7f876cc00640 1 -- 172.21.15.16:0/1985280179 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8768089b10 con 0x7f87700cddc0 2024-04-26T20:14:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.779+0000 7f876fe00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f874c0683b0 0x7f874c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.779+0000 7f876fe00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f874c0683b0 0x7f874c06a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8760001750 tx=0x7f87600011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.783+0000 7f876cc00640 1 -- 172.21.15.16:0/1985280179 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8768059d00 con 0x7f87700cddc0 2024-04-26T20:14:20.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87700c8670 con 0x7f87700cddc0 2024-04-26T20:14:20.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f876cc00640 1 -- 172.21.15.16:0/1985280179 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6834 (secure 0 0 0) 0x7f8768059600 con 0x7f87700cddc0 2024-04-26T20:14:20.987 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:20.987 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:19.492982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-26T20:14:20.987 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 6 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f874c0683b0 msgr2=0x7f874c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f874c0683b0 0x7f874c06a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8760001750 tx=0x7f87600011a0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87700cddc0 msgr2=0x7f877014e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87700cddc0 0x7f877014e010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8770070d30 tx=0x7f87680115c0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 shutdown_connections 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f874c0683b0 0x7f874c06a870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87700cddc0 0x7f877014e010 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f877015cb00 0x7f87701579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 --2- 172.21.15.16:0/1985280179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87540039c0 0x7f8770156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 >> 172.21.15.16:0/1985280179 conn(0x7f877006c380 msgr2=0x7f877006cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:20.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 shutdown_connections 2024-04-26T20:14:20.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:20.983+0000 7f8776a00640 1 -- 172.21.15.16:0/1985280179 wait complete. 2024-04-26T20:14:21.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:21.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.143+0000 7f6f4a400640 1 Processor -- start 2024-04-26T20:14:21.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.143+0000 7f6f4a400640 1 -- start start 2024-04-26T20:14:21.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f4a400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6f44153e50 0x7f6f440c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:21.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f4a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f440c9eb0 0x7f6f440c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f4a400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f440c7db0 con 0x7f6f440cc740 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f4a400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f6f440c87f0 con 0x7f6f44153e50 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f4a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6f440cb8e0 con 0x7f6f440c9eb0 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f43400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6f44153e50 0x7f6f440c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f43e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6f440cc740 0x7f6f44159c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:42948/0 (socket says 172.21.15.16:42948) 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f43e00640 1 -- 172.21.15.16:0/983215895 learned_addr learned my addr 172.21.15.16:0/983215895 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f3be00640 1 --2- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f440c9eb0 0x7f6f440c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:21.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f43400640 1 -- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f440c9eb0 msgr2=0x7f6f440c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:21.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f43400640 1 --2- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f440c9eb0 0x7f6f440c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f43400640 1 -- 172.21.15.16:0/983215895 >> v1:172.21.15.192:6789/0 conn(0x7f6f440cc740 legacy=0x7f6f44159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:21.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.147+0000 7f6f43400640 1 -- 172.21.15.16:0/983215895 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f440cb0e0 con 0x7f6f44153e50 2024-04-26T20:14:21.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f43400640 1 --2- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f44153e50 0x7f6f440c6fd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097c0 tx=0x7f6f3401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fff6be1740afcc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f42a00640 1 -- 172.21.15.16:0/983215895 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f340b5070 con 0x7f6f44153e50 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f42a00640 1 -- 172.21.15.16:0/983215895 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f340a8990 con 0x7f6f44153e50 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f42a00640 1 -- 172.21.15.16:0/983215895 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f340a8d60 con 0x7f6f44153e50 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 -- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f44153e50 msgr2=0x7f6f440c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 --2- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f44153e50 0x7f6f440c6fd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097c0 tx=0x7f6f3401ec90 comp rx=0 tx=0).stop 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 -- 172.21.15.16:0/983215895 shutdown_connections 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 --2- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f440c9eb0 0x7f6f440c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 --2- 172.21.15.16:0/983215895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f44153e50 0x7f6f440c6fd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 -- 172.21.15.16:0/983215895 >> 172.21.15.16:0/983215895 conn(0x7f6f440ca3e0 msgr2=0x7f6f440ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 -- 172.21.15.16:0/983215895 shutdown_connections 2024-04-26T20:14:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 -- 172.21.15.16:0/983215895 wait complete. 2024-04-26T20:14:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 Processor -- start 2024-04-26T20:14:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.151+0000 7f6f4a400640 1 -- start start 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f440c9eb0 0x7f6f44155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f440cc740 0x7f6f44144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f44153e50 0x7f6f44144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4415a490 con 0x7f6f440c9eb0 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4415a310 con 0x7f6f440cc740 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6f441558e0 con 0x7f6f44153e50 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f440c9eb0 0x7f6f44155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:21.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f440c9eb0 0x7f6f44155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51090/0 (socket says 172.21.15.16:51090) 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 -- 172.21.15.16:0/2852513400 learned_addr learned my addr 172.21.15.16:0/2852513400 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f3be00640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f440cc740 0x7f6f44144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43e00640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f44153e50 0x7f6f44144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 -- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f44153e50 msgr2=0x7f6f44144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f44153e50 0x7f6f44144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 -- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f440cc740 msgr2=0x7f6f44144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f440cc740 0x7f6f44144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 -- 172.21.15.16:0/2852513400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4414a1b0 con 0x7f6f440c9eb0 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43e00640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f44153e50 0x7f6f44144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f43400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f440c9eb0 0x7f6f44155e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f340b3040 tx=0x7f6f3401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f3b400640 1 -- 172.21.15.16:0/2852513400 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f340bf070 con 0x7f6f440c9eb0 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f3b400640 1 -- 172.21.15.16:0/2852513400 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f340b0660 con 0x7f6f440c9eb0 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f44151720 con 0x7f6f440c9eb0 2024-04-26T20:14:21.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f3b400640 1 -- 172.21.15.16:0/2852513400 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f340b5040 con 0x7f6f440c9eb0 2024-04-26T20:14:21.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f44072df0 con 0x7f6f440c9eb0 2024-04-26T20:14:21.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f44077c20 con 0x7f6f440c9eb0 2024-04-26T20:14:21.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.155+0000 7f6f3b400640 1 -- 172.21.15.16:0/2852513400 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f340c2070 con 0x7f6f440c9eb0 2024-04-26T20:14:21.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.159+0000 7f6f3b400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6f200683b0 0x7f6f2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:21.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.159+0000 7f6f3b400640 1 -- 172.21.15.16:0/2852513400 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6f34123420 con 0x7f6f440c9eb0 2024-04-26T20:14:21.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.159+0000 7f6f3be00640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6f200683b0 0x7f6f2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:21.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.159+0000 7f6f3be00640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6f200683b0 0x7f6f2006a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f44148630 tx=0x7f6f2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:21.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.163+0000 7f6f3b400640 1 -- 172.21.15.16:0/2852513400 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6f340187f0 con 0x7f6f440c9eb0 2024-04-26T20:14:21.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.331+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f440736a0 con 0x7f6f440c9eb0 2024-04-26T20:14:21.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.331+0000 7f6f3b400640 1 -- 172.21.15.16:0/2852513400 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f6f340f3600 con 0x7f6f440c9eb0 2024-04-26T20:14:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:21.335 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:21.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6f200683b0 msgr2=0x7f6f2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:21.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6f200683b0 0x7f6f2006a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f44148630 tx=0x7f6f2c008040 comp rx=0 tx=0).stop 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f440c9eb0 msgr2=0x7f6f44155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f440c9eb0 0x7f6f44155e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f340b3040 tx=0x7f6f3401ba30 comp rx=0 tx=0).stop 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 shutdown_connections 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6f200683b0 0x7f6f2006a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f44153e50 0x7f6f44144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f440cc740 0x7f6f44144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 --2- 172.21.15.16:0/2852513400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f440c9eb0 0x7f6f44155e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 >> 172.21.15.16:0/2852513400 conn(0x7f6f440ca3e0 msgr2=0x7f6f44149aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 shutdown_connections 2024-04-26T20:14:21.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:21.335+0000 7f6f4a400640 1 -- 172.21.15.16:0/2852513400 wait complete. 2024-04-26T20:14:21.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:14:13.851430+0000', 'modified': '2024-04-26T20:14:19.492982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.16:6837/1962586875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6835', 'nonce': 1962586875}, {'type': 'v1', 'addr': '172.21.15.16:6837', 'nonce': 1962586875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-04-26T20:14:21.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T20:14:21.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-26T20:14:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.107+0000 7f94c1200640 1 Processor -- start 2024-04-26T20:14:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.107+0000 7f94c1200640 1 -- start start 2024-04-26T20:14:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.107+0000 7f94c1200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f94bc06f460 0x7f94bc15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.107+0000 7f94c1200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94bc06ff50 0x7f94bc0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.107+0000 7f94c1200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc0c96a0 con 0x7f94bc153eb0 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.107+0000 7f94c1200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc15ac00 con 0x7f94bc06f460 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.107+0000 7f94c1200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc0c9980 con 0x7f94bc06ff50 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f94bc06f460 0x7f94bc15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f94bc06f460 0x7f94bc15a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51104/0 (socket says 172.21.15.16:51104) 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 -- 172.21.15.16:0/1365359164 learned_addr learned my addr 172.21.15.16:0/1365359164 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94ba800640 1 --2- 172.21.15.16:0/1365359164 >> v2:172.21.15.192:3300/0 conn(0x7f94bc06ff50 0x7f94bc0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 -- 172.21.15.16:0/1365359164 >> v2:172.21.15.192:3300/0 conn(0x7f94bc06ff50 msgr2=0x7f94bc0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 --2- 172.21.15.16:0/1365359164 >> v2:172.21.15.192:3300/0 conn(0x7f94bc06ff50 0x7f94bc0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 -- 172.21.15.16:0/1365359164 >> v1:172.21.15.192:6789/0 conn(0x7f94bc153eb0 legacy=0x7f94bc06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:22.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 -- 172.21.15.16:0/1365359164 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc070610 con 0x7f94bc06f460 2024-04-26T20:14:22.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9e00640 1 --2- 172.21.15.16:0/1365359164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc06f460 0x7f94bc15a6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0718c0 tx=0x7f94ac01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249f68d728bafc03 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9400640 1 -- 172.21.15.16:0/1365359164 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0b5070 con 0x7f94bc06f460 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9400640 1 -- 172.21.15.16:0/1365359164 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac0a89d0 con 0x7f94bc06f460 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.111+0000 7f94b9400640 1 -- 172.21.15.16:0/1365359164 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0a8da0 con 0x7f94bc06f460 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- 172.21.15.16:0/1365359164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc06f460 msgr2=0x7f94bc15a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 --2- 172.21.15.16:0/1365359164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc06f460 0x7f94bc15a6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0718c0 tx=0x7f94ac01ecd0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- 172.21.15.16:0/1365359164 shutdown_connections 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 --2- 172.21.15.16:0/1365359164 >> v2:172.21.15.192:3300/0 conn(0x7f94bc06ff50 0x7f94bc0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 --2- 172.21.15.16:0/1365359164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc06f460 0x7f94bc15a6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- 172.21.15.16:0/1365359164 >> 172.21.15.16:0/1365359164 conn(0x7f94bc0c9d10 msgr2=0x7f94bc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- 172.21.15.16:0/1365359164 shutdown_connections 2024-04-26T20:14:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- 172.21.15.16:0/1365359164 wait complete. 2024-04-26T20:14:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 Processor -- start 2024-04-26T20:14:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- start start 2024-04-26T20:14:22.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94bc06f460 0x7f94bc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94bc06ff50 0x7f94bc1f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc154e50 0x7f94bc0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc0c4d70 con 0x7f94bc154e50 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc0c5120 con 0x7f94bc06f460 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94c1200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc0c4ef0 con 0x7f94bc06ff50 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc154e50 0x7f94bc0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc154e50 0x7f94bc0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51112/0 (socket says 172.21.15.16:51112) 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 -- 172.21.15.16:0/436566309 learned_addr learned my addr 172.21.15.16:0/436566309 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94b9e00640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94bc06f460 0x7f94bc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94b3e00640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94bc06ff50 0x7f94bc1f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 -- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94bc06ff50 msgr2=0x7f94bc1f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94bc06ff50 0x7f94bc1f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 -- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94bc06f460 msgr2=0x7f94bc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94bc06f460 0x7f94bc156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 -- 172.21.15.16:0/436566309 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc155390 con 0x7f94bc154e50 2024-04-26T20:14:22.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.115+0000 7f94ba800640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc154e50 0x7f94bc0c7f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94b4007e60 tx=0x7f94b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94b2000640 1 -- 172.21.15.16:0/436566309 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4014620 con 0x7f94bc154e50 2024-04-26T20:14:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94b2000640 1 -- 172.21.15.16:0/436566309 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b4019070 con 0x7f94bc154e50 2024-04-26T20:14:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94b2000640 1 -- 172.21.15.16:0/436566309 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4014a00 con 0x7f94bc154e50 2024-04-26T20:14:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc155650 con 0x7f94bc154e50 2024-04-26T20:14:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc1f1960 con 0x7f94bc154e50 2024-04-26T20:14:22.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94b2000640 1 -- 172.21.15.16:0/436566309 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f94b4014ba0 con 0x7f94bc154e50 2024-04-26T20:14:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94b2000640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9498068380 0x7f949806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.119+0000 7f94b2000640 1 -- 172.21.15.16:0/436566309 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f94b4087570 con 0x7f94bc154e50 2024-04-26T20:14:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9498068380 0x7f949806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 Processor -- start 2024-04-26T20:14:22.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- start start 2024-04-26T20:14:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9498068380 0x7f949806a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0b2000 tx=0x7f94ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2b9dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2b9e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e940 0x5563b2beb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563b2a58140 con 0x5563b2b9d700 2024-04-26T20:14:22.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563b29ede00 con 0x5563b2b9e940 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5563b29a6a00 con 0x5563b2b9e020 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2b9dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2b9dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51116/0 (socket says 172.21.15.16:51116) 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 -- 172.21.15.16:0/2791505912 learned_addr learned my addr 172.21.15.16:0/2791505912 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94ba800640 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e940 0x5563b2beb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b3e00640 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2b9e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 -- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 msgr2=0x5563b2b9e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2b9e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 -- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e940 msgr2=0x5563b2beb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e940 0x5563b2beb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 -- 172.21.15.16:0/2791505912 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b29ab0e0 con 0x5563b2b9d700 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94ba800640 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e940 0x5563b2beb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94b9e00640 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2b9dae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94ac09b4f0 tx=0x7f94ac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e0c71bccdef75e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:22.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94aaa00640 1 -- 172.21.15.16:0/2791505912 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0b5040 con 0x5563b2b9d700 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94aaa00640 1 -- 172.21.15.16:0/2791505912 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac0a8e30 con 0x5563b2b9d700 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94aaa00640 1 -- 172.21.15.16:0/2791505912 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0bab50 con 0x5563b2b9d700 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- 172.21.15.16:0/2791505912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 msgr2=0x5563b2b9dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2b9dae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94ac09b4f0 tx=0x7f94ac004740 comp rx=0 tx=0).stop 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- 172.21.15.16:0/2791505912 shutdown_connections 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e940 0x5563b2beb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2b9e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 --2- 172.21.15.16:0/2791505912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2b9dae0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- 172.21.15.16:0/2791505912 >> 172.21.15.16:0/2791505912 conn(0x5563b2bdf5f0 msgr2=0x5563b2be19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- 172.21.15.16:0/2791505912 shutdown_connections 2024-04-26T20:14:22.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.123+0000 7f94c4674000 1 -- 172.21.15.16:0/2791505912 wait complete. 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 -- start start 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 Processor -- start 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9d700 0x5563b2bde3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9e020 0x5563b2bde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e940 0x5563b2be9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563b29fb200 con 0x5563b2b9e020 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563b2991e80 con 0x5563b2b9d700 2024-04-26T20:14:22.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5563b29e8ae0 con 0x5563b2b9e940 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 10 client.0 _ll_register_callbacks cb 0x5563b29fada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9e020 0x5563b2bde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9e020 0x5563b2bde910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51122/0 (socket says 172.21.15.16:51122) 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 -- 172.21.15.16:0/1673499883 learned_addr learned my addr 172.21.15.16:0/1673499883 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b9e00640 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9d700 0x5563b2bde3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94ba800640 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e940 0x5563b2be9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 -- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e940 msgr2=0x5563b2be9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e940 0x5563b2be9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 -- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9d700 msgr2=0x5563b2bde3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9d700 0x5563b2bde3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 -- 172.21.15.16:0/1673499883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b298d4e0 con 0x5563b2b9e020 2024-04-26T20:14:22.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b3e00640 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9e020 0x5563b2bde910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94a400deb0 tx=0x7f94a400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59879c96468ccbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f949f400640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f949f400640 1 -- 172.21.15.16:0/1673499883 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4015610 con 0x5563b2b9e020 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f949f400640 1 -- 172.21.15.16:0/1673499883 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f94a40157b0 con 0x5563b2b9e020 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94ac0a8e30 con 0x5563b2b9e020 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f949f400640 1 -- 172.21.15.16:0/1673499883 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f94a4022050 con 0x5563b2b9e020 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 10 client.4374 fetch_fsmap learned FSMap version 6 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5563b2973e80 con 0x5563b2b9e020 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f949f400640 1 -- 172.21.15.16:0/1673499883 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac0a8e30 con 0x5563b2b9e020 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f949f400640 1 -- 172.21.15.16:0/1673499883 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f94a4025020 con 0x5563b2b9e020 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 10 client.4374 fetch_fsmap finished waiting for FSMap version 6 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 10 client.4374 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 20 client.4374 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2bea960 0x5563b2bead40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:22.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 4 client.4374 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:14:22.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 --> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563b2986bc0 con 0x5563b2bea960 2024-04-26T20:14:22.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.127+0000 7f94b9e00640 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2bea960 0x5563b2bead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:22.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.131+0000 7f949f400640 10 client.4374 ms_handle_connect on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:22.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:22.131+0000 7f94b9e00640 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2bea960 0x5563b2bead40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da6688bf99ba599 server_cookie=fe717f59a0fdb526 in_seq=0 out_seq=0 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f949f400640 1 -- 172.21.15.16:0/1673499883 <== mds.0 v2:172.21.15.16:6835/1962586875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5563b2986bc0 con 0x5563b2bea960 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f949f400640 10 client.4374 handle_command_reply: tid=0 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 client.4374 shutdown 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9e020 msgr2=0x5563b2bde910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9e020 0x5563b2bde910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94a400deb0 tx=0x7f94a400f5b0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 shutdown_connections 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2bea960 0x5563b2bead40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e940 0x5563b2be9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9e020 0x5563b2bde910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 --2- 172.21.15.16:0/1673499883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9d700 0x5563b2bde3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f949f400640 0 client.4374 ms_handle_reset on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:24.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 >> 172.21.15.16:0/1673499883 conn(0x5563b2bdf5f0 msgr2=0x5563b2b9ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:24.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 shutdown_connections 2024-04-26T20:14:24.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 1 -- 172.21.15.16:0/1673499883 wait complete. 2024-04-26T20:14:24.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.510+0000 7f94c4674000 20 client.4374 trim_cache size 0 max 16384 2024-04-26T20:14:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 Processor -- start 2024-04-26T20:14:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 -- start start 2024-04-26T20:14:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2bdf5f0 0x5563b2bebf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e020 0x5563b2bdd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc1fe010 con 0x5563b2b9d700 2024-04-26T20:14:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc1fe640 con 0x5563b2b9e020 2024-04-26T20:14:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.530+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5563b29837b0 con 0x5563b2bdf5f0 2024-04-26T20:14:24.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51128/0 (socket says 172.21.15.16:51128) 2024-04-26T20:14:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 -- 172.21.15.16:0/997927541 learned_addr learned my addr 172.21.15.16:0/997927541 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b9e00640 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2bdf5f0 0x5563b2bebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94ba800640 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e020 0x5563b2bdd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 -- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2bdf5f0 msgr2=0x5563b2bebf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2bdf5f0 0x5563b2bebf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 -- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e020 msgr2=0x5563b2bdd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e020 0x5563b2bdd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 -- 172.21.15.16:0/997927541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b29a6c50 con 0x5563b2b9d700 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94ba800640 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e020 0x5563b2bdd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94b3e00640 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94a4001ec0 tx=0x7f94a4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a26e3ee75e25183 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94aa000640 1 -- 172.21.15.16:0/997927541 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a400da20 con 0x5563b2b9d700 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94aa000640 1 -- 172.21.15.16:0/997927541 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a4015e50 con 0x5563b2b9d700 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94aa000640 1 -- 172.21.15.16:0/997927541 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4004280 con 0x5563b2b9d700 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 -- 172.21.15.16:0/997927541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 msgr2=0x5563b2bec4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94a4001ec0 tx=0x7f94a4015000 comp rx=0 tx=0).stop 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 -- 172.21.15.16:0/997927541 shutdown_connections 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2b9e020 0x5563b2bdd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec4a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 --2- 172.21.15.16:0/997927541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2bdf5f0 0x5563b2bebf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 -- 172.21.15.16:0/997927541 >> 172.21.15.16:0/997927541 conn(0x5563b2ba3300 msgr2=0x5563b2bfb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 -- 172.21.15.16:0/997927541 shutdown_connections 2024-04-26T20:14:24.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 -- 172.21.15.16:0/997927541 wait complete. 2024-04-26T20:14:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 -- start start 2024-04-26T20:14:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.534+0000 7f94c4674000 1 Processor -- start 2024-04-26T20:14:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2befd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2bdf5f0 0x5563b2bf0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563b29f2430 con 0x5563b2b9d700 2024-04-26T20:14:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563b29ed110 con 0x5563b2bdf5f0 2024-04-26T20:14:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5563b29fa0a0 con 0x5563b2b9e020 2024-04-26T20:14:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 10 client.0 _ll_register_callbacks cb 0x7f94a400d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51130/0 (socket says 172.21.15.16:51130) 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 -- 172.21.15.16:0/3984365948 learned_addr learned my addr 172.21.15.16:0/3984365948 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b3e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2befd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94ba800640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2bdf5f0 0x5563b2bf0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 -- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 msgr2=0x5563b2befd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2befd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 -- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2bdf5f0 msgr2=0x5563b2bf0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2bdf5f0 0x5563b2bf0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 -- 172.21.15.16:0/3984365948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b2a70160 con 0x5563b2b9d700 2024-04-26T20:14:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b9e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94ac09b4f0 tx=0x7f94ac01d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235d8d5a18609197 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f949f400640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f949f400640 1 -- 172.21.15.16:0/3984365948 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0b5040 con 0x5563b2b9d700 2024-04-26T20:14:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f949f400640 1 -- 172.21.15.16:0/3984365948 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f94ac0c2040 con 0x5563b2b9d700 2024-04-26T20:14:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94a4015e50 con 0x5563b2b9d700 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f949f400640 1 -- 172.21.15.16:0/3984365948 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f94ac0bad60 con 0x5563b2b9d700 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 10 client.4380 fetch_fsmap learned FSMap version 6 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5563b26a70c0 con 0x5563b2b9d700 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f949f400640 1 -- 172.21.15.16:0/3984365948 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a4015e50 con 0x5563b2b9d700 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f949f400640 1 -- 172.21.15.16:0/3984365948 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f94ac0d5180 con 0x5563b2b9d700 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 10 client.4380 fetch_fsmap finished waiting for FSMap version 6 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 10 client.4380 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 20 client.4380 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 0x5563b2bf0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 4 client.4380 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 --> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] -- command(tid 0: {"prefix": "status"}) -- 0x5563b29fba10 con 0x5563b2b9e940 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b3e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 0x5563b2bf0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b3e00640 1 -- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 msgr2=0x5563b2bf0790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 17 2024-04-26T20:14:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b3e00640 1 -- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 msgr2=0x5563b2bf0790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:14:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b3e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 0x5563b2bf0790 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:14:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.538+0000 7f94b3e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 0x5563b2bf0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T20:14:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94b3e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 0x5563b2bf0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94b3e00640 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 0x5563b2bf0790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dd36aa64eb12ce server_cookie=951649ad8027791f in_seq=0 out_seq=0 2024-04-26T20:14:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f949f400640 10 client.4380 ms_handle_connect on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f949f400640 1 -- 172.21.15.16:0/3984365948 <== mds.0 v2:172.21.15.16:6835/1962586875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5563b29fba10 con 0x5563b2b9e940 2024-04-26T20:14:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f949f400640 10 client.4380 handle_command_reply: tid=0 2024-04-26T20:14:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 client.4380 shutdown 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 msgr2=0x5563b2bec400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94ac09b4f0 tx=0x7f94ac01d510 comp rx=0 tx=0).stop 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 shutdown_connections 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x5563b2b9e940 0x5563b2bf0790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b2bdf5f0 0x5563b2bf0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5563b2b9e020 0x5563b2befd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 --2- 172.21.15.16:0/3984365948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5563b2b9d700 0x5563b2bec400 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f949f400640 0 client.4380 ms_handle_reset on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 >> 172.21.15.16:0/3984365948 conn(0x5563b2ba3300 msgr2=0x5563b2bfbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 shutdown_connections 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 1 -- 172.21.15.16:0/3984365948 wait complete. 2024-04-26T20:14:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c4674000 20 client.4380 trim_cache size 0 max 16384 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "fae48009-e478-45bc-aae9-8a365e3cb2e9", 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4279, 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 10.306579172999999, 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 5, 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 25, 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 25, 2024-04-26T20:14:24.749 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 17.688581156000001 2024-04-26T20:14:24.750 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:14:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9498068380 msgr2=0x7f949806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9498068380 0x7f949806a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0b2000 tx=0x7f94ac009040 comp rx=0 tx=0).stop 2024-04-26T20:14:24.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc154e50 msgr2=0x7f94bc0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc154e50 0x7f94bc0c7f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94b4007e60 tx=0x7f94b400e4b0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 shutdown_connections 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9498068380 0x7f949806a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f94bc154e50 0x7f94bc0c7f40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f94bc06ff50 0x7f94bc1f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 --2- 172.21.15.16:0/436566309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94bc06f460 0x7f94bc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 >> 172.21.15.16:0/436566309 conn(0x7f94bc0c9d10 msgr2=0x7f94bc14f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 shutdown_connections 2024-04-26T20:14:24.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.742+0000 7f94c1200640 1 -- 172.21.15.16:0/436566309 wait complete. 2024-04-26T20:14:24.774 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:14:24.774 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:24.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:14:24.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a9bc00640 1 Processor -- start 2024-04-26T20:14:24.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a9bc00640 1 -- start start 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a9bc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a941574b0 0x7f0a940ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a9bc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a940c63f0 0x7f0a94164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a9bc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a940cb7f0 con 0x7f0a940b47e0 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a9bc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0a940ccd80 con 0x7f0a940c63f0 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a9bc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f0a940c9e80 con 0x7f0a941574b0 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a99c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a940c63f0 0x7f0a94164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a99c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a940c63f0 0x7f0a94164520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51132/0 (socket says 172.21.15.16:51132) 2024-04-26T20:14:24.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a99c00640 1 -- 172.21.15.16:0/232822146 learned_addr learned my addr 172.21.15.16:0/232822146 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a99c00640 1 -- 172.21.15.16:0/232822146 >> v2:172.21.15.192:3300/0 conn(0x7f0a941574b0 msgr2=0x7f0a940ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a99c00640 1 --2- 172.21.15.16:0/232822146 >> v2:172.21.15.192:3300/0 conn(0x7f0a941574b0 0x7f0a940ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a99c00640 1 -- 172.21.15.16:0/232822146 >> v1:172.21.15.192:6789/0 conn(0x7f0a940b47e0 legacy=0x7f0a9406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:24.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.918+0000 7f0a99c00640 1 -- 172.21.15.16:0/232822146 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a940ca0d0 con 0x7f0a940c63f0 2024-04-26T20:14:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a99c00640 1 --2- 172.21.15.16:0/232822146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940c63f0 0x7f0a94164520 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a940c6850 tx=0x7f0a8c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56317f123e5691dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a93e00640 1 -- 172.21.15.16:0/232822146 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0a5760 con 0x7f0a940c63f0 2024-04-26T20:14:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a93e00640 1 -- 172.21.15.16:0/232822146 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c0a5900 con 0x7f0a940c63f0 2024-04-26T20:14:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a93e00640 1 -- 172.21.15.16:0/232822146 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0a5cd0 con 0x7f0a940c63f0 2024-04-26T20:14:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 -- 172.21.15.16:0/232822146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940c63f0 msgr2=0x7f0a94164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/232822146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940c63f0 0x7f0a94164520 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a940c6850 tx=0x7f0a8c01c9b0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 -- 172.21.15.16:0/232822146 shutdown_connections 2024-04-26T20:14:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/232822146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940c63f0 0x7f0a94164520 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/232822146 >> v2:172.21.15.192:3300/0 conn(0x7f0a941574b0 0x7f0a940ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 -- 172.21.15.16:0/232822146 >> 172.21.15.16:0/232822146 conn(0x7f0a94071160 msgr2=0x7f0a94068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 -- 172.21.15.16:0/232822146 shutdown_connections 2024-04-26T20:14:24.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.922+0000 7f0a9bc00640 1 -- 172.21.15.16:0/232822146 wait complete. 2024-04-26T20:14:24.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 Processor -- start 2024-04-26T20:14:24.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 -- start start 2024-04-26T20:14:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940b47e0 0x7f0a940c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a940c63f0 0x7f0a941553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a941574b0 0x7f0a94155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0a940705c0 con 0x7f0a940b47e0 2024-04-26T20:14:24.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a940ca3b0 con 0x7f0a940c63f0 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a94070740 con 0x7f0a941574b0 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940b47e0 0x7f0a940c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940b47e0 0x7f0a940c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51140/0 (socket says 172.21.15.16:51140) 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 -- 172.21.15.16:0/1856376042 learned_addr learned my addr 172.21.15.16:0/1856376042 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99c00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a941574b0 0x7f0a94155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a8be00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a940c63f0 0x7f0a941553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 -- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a941574b0 msgr2=0x7f0a94155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a941574b0 0x7f0a94155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 -- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a940c63f0 msgr2=0x7f0a941553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a940c63f0 0x7f0a941553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 -- 172.21.15.16:0/1856376042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a940b2600 con 0x7f0a940b47e0 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a99200640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940b47e0 0x7f0a940c8360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400b410 tx=0x7f0a8400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:24.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a91600640 1 -- 172.21.15.16:0/1856376042 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84015020 con 0x7f0a940b47e0 2024-04-26T20:14:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a91600640 1 -- 172.21.15.16:0/1856376042 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a84011830 con 0x7f0a940b47e0 2024-04-26T20:14:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a91600640 1 -- 172.21.15.16:0/1856376042 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011c20 con 0x7f0a940b47e0 2024-04-26T20:14:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a940c8c70 con 0x7f0a940b47e0 2024-04-26T20:14:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.926+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a940c91f0 con 0x7f0a940b47e0 2024-04-26T20:14:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.930+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a94077c20 con 0x7f0a940b47e0 2024-04-26T20:14:24.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.930+0000 7f0a91600640 1 -- 172.21.15.16:0/1856376042 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a84018020 con 0x7f0a940b47e0 2024-04-26T20:14:24.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.930+0000 7f0a91600640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0a70068380 0x7f0a7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:24.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.930+0000 7f0a91600640 1 -- 172.21.15.16:0/1856376042 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0a84086cb0 con 0x7f0a940b47e0 2024-04-26T20:14:24.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.930+0000 7f0a8be00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0a70068380 0x7f0a7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:24.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.930+0000 7f0a8be00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0a70068380 0x7f0a7006a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a941f7260 tx=0x7f0a7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:24.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:24.934+0000 7f0a91600640 1 -- 172.21.15.16:0/1856376042 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0a8401f020 con 0x7f0a940b47e0 2024-04-26T20:14:25.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.138+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a940d01a0 con 0x7f0a940b47e0 2024-04-26T20:14:25.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a91600640 1 -- 172.21.15.16:0/1856376042 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f0a840172c0 con 0x7f0a940b47e0 2024-04-26T20:14:25.145 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:14:25.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0a70068380 msgr2=0x7f0a7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0a70068380 0x7f0a7006a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a941f7260 tx=0x7f0a7c009040 comp rx=0 tx=0).stop 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940b47e0 msgr2=0x7f0a940c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940b47e0 0x7f0a940c8360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400b410 tx=0x7f0a8400b8d0 comp rx=0 tx=0).stop 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 shutdown_connections 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0a70068380 0x7f0a7006a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a941574b0 0x7f0a94155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a940c63f0 0x7f0a941553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 --2- 172.21.15.16:0/1856376042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a940b47e0 0x7f0a940c8360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 >> 172.21.15.16:0/1856376042 conn(0x7f0a94071160 msgr2=0x7f0a94154310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 shutdown_connections 2024-04-26T20:14:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25.142+0000 7f0a9bc00640 1 -- 172.21.15.16:0/1856376042 wait complete. 2024-04-26T20:14:25.167 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T20:14:25.167 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:14:25.167 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-04-26T20:14:25.167 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T20:14:25.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:25.168 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T20:14:25.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:14:25.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:14:25.168 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T20:14:25.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:25.168 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-04-26T20:14:25.177 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:14:25.177 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:14:25.177 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:14:25.177 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:25.177 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-04-26T20:14:25.177 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:25.177 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42409sec preferred_lft 42409sec 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:14:25.178 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:25.179 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-04-26T20:14:25.179 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:14:25.179 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:4d:77:e2:2f brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:25.179 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:14:25.179 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:25.180 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:14:25.180 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:25.180 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:25.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:14:25.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-04-26T20:14:25.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-04-26T20:14:25.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:14:25.181 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:25.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:25.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:25.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:25.336 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:14:25.356 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-04-26T20:14:25.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:25.358 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-04-26T20:14:25.431 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-04-26T20:14:25.431 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:14:25.431 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T20:14:25.432 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:14:25.432 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T20:14:25.432 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:14:25.432 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:25.433 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:25.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T20:14:25.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T20:14:25.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T20:14:25.433 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:25.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:25.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:25.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:25.569 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T20:14:25.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:25.626 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-04-26T20:14:25.677 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:25.677 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:25.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:25.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T20:14:25.678 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:25.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:25.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:25.810 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T20:14:25.810 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:25.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:26.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:26.026 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:26.026 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:26.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-04-26T20:14:26.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:14:26.026 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:26.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:26.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:26.113 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T20:14:26.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:14:26.113 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:26.122 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T20:14:26.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:14:26.122 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:26.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T20:14:26.237 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:14:26.294 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T20:14:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T20:14:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T20:14:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T20:14:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T20:14:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T20:14:26.295 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T20:14:26.296 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T20:14:26.296 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T20:14:26.296 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T20:14:26.296 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T20:14:26.296 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T20:14:26.296 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:14:26.296 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T20:14:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T20:14:26.298 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T20:14:26.298 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T20:14:26.298 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T20:14:26.298 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T20:14:26.298 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T20:14:26.298 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T20:14:26.299 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:26.299 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:26.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:26.300 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T20:14:26.353 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T20:14:26.353 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T20:14:26.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T20:14:26.423 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:14:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T20:14:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T20:14:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T20:14:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T20:14:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T20:14:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T20:14:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T20:14:26.475 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:26.476 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:26.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:26.477 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T20:14:26.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:2024-04-26T20:14:26.498+0000 7f831dece580 -1 init, newargv = 0x55eb4fb45b90 newargc=15 2024-04-26T20:14:26.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:ceph-fuse[31948]: starting ceph client 2024-04-26T20:14:26.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:ceph-fuse[31948]: starting fuse 2024-04-26T20:14:27.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T20:14:27.636 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T20:14:27.691 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T20:14:27.691 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T20:14:27.691 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T20:14:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T20:14:27.693 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:27.694 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:27.694 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:27.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:27.695 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T20:14:27.745 INFO:teuthology.orchestra.run.smithi016.stdout:44 2024-04-26T20:14:27.746 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo stdin-killer -- python3 -c ' 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> import glob 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> import re 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> import os 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> import subprocess 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> def _find_admin_socket(client_name): 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> files = glob.glob(asok_path) 2024-04-26T20:14:27.746 DEBUG:teuthology.orchestra.run.smithi016:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> # Given a non-glob path, it better be there 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> if "*" not in asok_path: 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> assert(len(files) == 1) 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> return files[0] 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> for f in files: 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> contents = proc_f.read() 2024-04-26T20:14:27.747 DEBUG:teuthology.orchestra.run.smithi016:> if mountpoint in contents: 2024-04-26T20:14:27.748 DEBUG:teuthology.orchestra.run.smithi016:> return f 2024-04-26T20:14:27.748 DEBUG:teuthology.orchestra.run.smithi016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T20:14:27.748 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T20:14:27.748 DEBUG:teuthology.orchestra.run.smithi016:> print(_find_admin_socket("client.admin")) 2024-04-26T20:14:27.748 DEBUG:teuthology.orchestra.run.smithi016:> ' 2024-04-26T20:14:27.881 INFO:teuthology.orchestra.run.smithi016.stdout:/var/run/ceph/ceph-client.admin.31948.asok 2024-04-26T20:14:27.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:27.893 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31948.asok 2024-04-26T20:14:27.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:27.893 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31948.asok status 2024-04-26T20:14:28.053 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-26T20:14:28.050+0000 7f31e9800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:14:28.071 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:14:28.071 INFO:teuthology.orchestra.run.smithi016.stdout: "metadata": { 2024-04-26T20:14:28.071 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "entity_id": "admin", 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": "smithi016", 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "pid": "31948", 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "root": "/" 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_count": 0, 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_pinned_count": 0, 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4392, 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "inst": { 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "name": { 2024-04-26T20:14:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "client", 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "num": 4392 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3570586854 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 3570586854 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T20:14:28.073 INFO:teuthology.orchestra.run.smithi016.stdout: "inst_str": "client.4392 192.168.0.1:0/3570586854", 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout: "addr_str": "192.168.0.1:0/3570586854", 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout: "inode_count": 1, 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_epoch": 5, 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch": 25, 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch_barrier": 0, 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout: "blocklisted": false, 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs" 2024-04-26T20:14:28.074 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:14:28.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:28.088 DEBUG:teuthology.orchestra.run.smithi016:> stat --file-system '--printf=%T 2024-04-26T20:14:28.088 DEBUG:teuthology.orchestra.run.smithi016:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:28.097 INFO:teuthology.orchestra.run.smithi016.stdout:fuseblk 2024-04-26T20:14:28.097 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:28.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:28.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:28.165 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T20:14:28.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:14:28.291 INFO:teuthology.orchestra.run.smithi016.stdout:# file: . 2024-04-26T20:14:28.291 INFO:teuthology.orchestra.run.smithi016.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T20:14:28.292 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:28.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:28.299 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:14:28.299 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:14:28.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:28.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.482+0000 7f3e61e00640 1 Processor -- start 2024-04-26T20:14:28.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.482+0000 7f3e61e00640 1 -- start start 2024-04-26T20:14:28.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e61e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 0x7f3e5c073190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e61e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e5c0c9b60 0x7f3e5c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e61e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e5c152fa0 con 0x7f3e5c152bc0 2024-04-26T20:14:28.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e61e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5c159790 con 0x7f3e5c0c9b60 2024-04-26T20:14:28.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e61e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c158930 con 0x7f3e5c072d70 2024-04-26T20:14:28.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5aa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3e5c152bc0 0x7f3e5c0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35860/0 (socket says 172.21.15.16:35860) 2024-04-26T20:14:28.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5aa00640 1 -- 172.21.15.16:0/1512752569 learned_addr learned my addr 172.21.15.16:0/1512752569 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:28.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e52000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 0x7f3e5c073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5b400640 1 --2- 172.21.15.16:0/1512752569 >> v2:172.21.15.192:3300/0 conn(0x7f3e5c0c9b60 0x7f3e5c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715748815 0 0) 0x7f3e5c152fa0 con 0x7f3e5c152bc0 2024-04-26T20:14:28.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e40005740 con 0x7f3e5c152bc0 2024-04-26T20:14:28.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2193723925 0 0) 0x7f3e40005740 con 0x7f3e5c152bc0 2024-04-26T20:14:28.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 msgr2=0x7f3e5c073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:28.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 0x7f3e5c073190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 >> v2:172.21.15.192:3300/0 conn(0x7f3e5c0c9b60 msgr2=0x7f3e5c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:28.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 --2- 172.21.15.16:0/1512752569 >> v2:172.21.15.192:3300/0 conn(0x7f3e5c0c9b60 0x7f3e5c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c158c10 con 0x7f3e5c152bc0 2024-04-26T20:14:28.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f3e4c001680 con 0x7f3e5c152bc0 2024-04-26T20:14:28.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 >> v1:172.21.15.16:6789/0 conn(0x7f3e5c152bc0 legacy=0x7f3e5c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e40005bd0 0x7f3e40005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e40006a20 0x7f3e40006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 0x7f3e400073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c159790 con 0x7f3e40006a20 2024-04-26T20:14:28.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c158930 con 0x7f3e40005bd0 2024-04-26T20:14:28.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4000dbe0 con 0x7f3e5c072d70 2024-04-26T20:14:28.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e52000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e40006a20 0x7f3e40006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5aa00640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e40005bd0 0x7f3e40005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e5b400640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 0x7f3e400073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e52000640 1 -- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 msgr2=0x7f3e400073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:28.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e52000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c072d70 0x7f3e400073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e52000640 1 -- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e40005bd0 msgr2=0x7f3e40005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:28.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e52000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e40005bd0 0x7f3e40005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.486+0000 7f3e52000640 1 -- 172.21.15.16:0/1512752569 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e40005740 con 0x7f3e40006a20 2024-04-26T20:14:28.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e52000640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e40006a20 0x7f3e40006ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009ae0 tx=0x7f3e4401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bce7900f19b3def server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:28.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440b2070 con 0x7f3e40006a20 2024-04-26T20:14:28.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e440a5580 con 0x7f3e40006a20 2024-04-26T20:14:28.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e5a000640 1 -- 172.21.15.16:0/1512752569 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440096b0 con 0x7f3e40006a20 2024-04-26T20:14:28.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 -- 172.21.15.16:0/1512752569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e40006a20 msgr2=0x7f3e40006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 --2- 172.21.15.16:0/1512752569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e40006a20 0x7f3e40006ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009ae0 tx=0x7f3e4401ca70 comp rx=0 tx=0).stop 2024-04-26T20:14:28.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e5b400640 1 -- 172.21.15.16:0/1512752569 reap_dead start 2024-04-26T20:14:28.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 -- 172.21.15.16:0/1512752569 shutdown_connections 2024-04-26T20:14:28.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 -- 172.21.15.16:0/1512752569 >> 172.21.15.16:0/1512752569 conn(0x7f3e5c06c380 msgr2=0x7f3e5c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:28.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 -- 172.21.15.16:0/1512752569 shutdown_connections 2024-04-26T20:14:28.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 -- 172.21.15.16:0/1512752569 wait complete. 2024-04-26T20:14:28.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 Processor -- start 2024-04-26T20:14:28.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.490+0000 7f3e61e00640 1 -- start start 2024-04-26T20:14:28.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e40006a20 0x7f3e5c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c1e3d10 0x7f3e5c1f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c1f3a40 0x7f3e5c14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1594b0 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1591d0 con 0x7f3e5c1f3a40 2024-04-26T20:14:28.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c0ca4f0 con 0x7f3e40006a20 2024-04-26T20:14:28.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c1e3d10 0x7f3e5c1f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c1e3d10 0x7f3e5c1f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34470/0 (socket says 172.21.15.16:34470) 2024-04-26T20:14:28.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 -- 172.21.15.16:0/2465993733 learned_addr learned my addr 172.21.15.16:0/2465993733 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:28.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e5aa00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e40006a20 0x7f3e5c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e5b400640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c1f3a40 0x7f3e5c14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 -- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e40006a20 msgr2=0x7f3e5c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e40006a20 0x7f3e5c151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 -- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c1f3a40 msgr2=0x7f3e5c14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c1f3a40 0x7f3e5c14f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 -- 172.21.15.16:0/2465993733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c1e2b90 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e52000640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c1e3d10 0x7f3e5c1f3500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009ae0 tx=0x7f3e40007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:28.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e53e00640 1 -- 172.21.15.16:0/2465993733 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440b2040 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e53e00640 1 -- 172.21.15.16:0/2465993733 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4400f000 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e53e00640 1 -- 172.21.15.16:0/2465993733 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440096b0 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c1f2dd0 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c1e20b0 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.494+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c077c20 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.498+0000 7f3e53e00640 1 -- 172.21.15.16:0/2465993733 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e440c0030 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.498+0000 7f3e53e00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e38068380 0x7f3e3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.498+0000 7f3e53e00640 1 -- 172.21.15.16:0/2465993733 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e44120960 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.498+0000 7f3e5aa00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e38068380 0x7f3e3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.498+0000 7f3e5aa00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e38068380 0x7f3e3806a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c001560 tx=0x7f3e4c007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:28.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.502+0000 7f3e53e00640 1 -- 172.21.15.16:0/2465993733 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e440c7060 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.666+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e5c156180 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.666+0000 7f3e53e00640 1 -- 172.21.15.16:0/2465993733 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f3e44016780 con 0x7f3e5c1e3d10 2024-04-26T20:14:28.673 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:28.673 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e38068380 msgr2=0x7f3e3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e38068380 0x7f3e3806a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c001560 tx=0x7f3e4c007900 comp rx=0 tx=0).stop 2024-04-26T20:14:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c1e3d10 msgr2=0x7f3e5c1f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c1e3d10 0x7f3e5c1f3500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009ae0 tx=0x7f3e40007a50 comp rx=0 tx=0).stop 2024-04-26T20:14:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 shutdown_connections 2024-04-26T20:14:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e38068380 0x7f3e3806a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c1f3a40 0x7f3e5c14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c1e3d10 0x7f3e5c1f3500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 --2- 172.21.15.16:0/2465993733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e40006a20 0x7f3e5c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 >> 172.21.15.16:0/2465993733 conn(0x7f3e5c06c380 msgr2=0x7f3e5c0759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 shutdown_connections 2024-04-26T20:14:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.670+0000 7f3e61e00640 1 -- 172.21.15.16:0/2465993733 wait complete. 2024-04-26T20:14:28.695 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:14:28.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:14:28.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2757c00640 1 Processor -- start 2024-04-26T20:14:28.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2757c00640 1 -- start start 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2757c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f275006f460 0x7f275015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2757c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2750153eb0 0x7f275006f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2757c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27500701f0 con 0x7f275006fd80 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2757c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f275015ac00 con 0x7f275006f460 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2757c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f27500c96a0 con 0x7f2750153eb0 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2755200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f275006f460 0x7f275015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2755c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f275006fd80 0x7f27500c5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35872/0 (socket says 172.21.15.16:35872) 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2755c00640 1 -- 172.21.15.16:0/2895641590 learned_addr learned my addr 172.21.15.16:0/2895641590 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f274fe00640 1 --2- 172.21.15.16:0/2895641590 >> v2:172.21.15.192:3300/0 conn(0x7f2750153eb0 0x7f275006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2755200640 1 -- 172.21.15.16:0/2895641590 >> v2:172.21.15.192:3300/0 conn(0x7f2750153eb0 msgr2=0x7f275006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2755200640 1 --2- 172.21.15.16:0/2895641590 >> v2:172.21.15.192:3300/0 conn(0x7f2750153eb0 0x7f275006f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2755200640 1 -- 172.21.15.16:0/2895641590 >> v1:172.21.15.16:6789/0 conn(0x7f275006fd80 legacy=0x7f27500c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f2755200640 1 -- 172.21.15.16:0/2895641590 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500c9980 con 0x7f275006f460 2024-04-26T20:14:28.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.834+0000 7f274f400640 1 -- 172.21.15.16:0/2895641590 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511798115 0 0) 0x7f27480014a0 con 0x7f275006fd80 2024-04-26T20:14:28.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2755200640 1 --2- 172.21.15.16:0/2895641590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275015a6c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2750068e20 tx=0x7f274401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b28cc01fa30be8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:28.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f274f400640 1 -- 172.21.15.16:0/2895641590 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440b5070 con 0x7f275006f460 2024-04-26T20:14:28.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f274f400640 1 -- 172.21.15.16:0/2895641590 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27440a8970 con 0x7f275006f460 2024-04-26T20:14:28.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f274f400640 1 -- 172.21.15.16:0/2895641590 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440a8d40 con 0x7f275006f460 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 -- 172.21.15.16:0/2895641590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 msgr2=0x7f275015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 --2- 172.21.15.16:0/2895641590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275015a6c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2750068e20 tx=0x7f274401ec70 comp rx=0 tx=0).stop 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 -- 172.21.15.16:0/2895641590 shutdown_connections 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 --2- 172.21.15.16:0/2895641590 >> v2:172.21.15.192:3300/0 conn(0x7f2750153eb0 0x7f275006f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 --2- 172.21.15.16:0/2895641590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275015a6c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 -- 172.21.15.16:0/2895641590 >> 172.21.15.16:0/2895641590 conn(0x7f27500c9d10 msgr2=0x7f27500ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 -- 172.21.15.16:0/2895641590 shutdown_connections 2024-04-26T20:14:28.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.838+0000 7f2757c00640 1 -- 172.21.15.16:0/2895641590 wait complete. 2024-04-26T20:14:28.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 Processor -- start 2024-04-26T20:14:28.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 -- start start 2024-04-26T20:14:28.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f275006fd80 0x7f275014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27501542a0 0x7f27501478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f27500c5120 con 0x7f275006f460 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27500708f0 con 0x7f27501542a0 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f27500c4d70 con 0x7f275006fd80 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34488/0 (socket says 172.21.15.16:34488) 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 -- 172.21.15.16:0/658144335 learned_addr learned my addr 172.21.15.16:0/658144335 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f274fe00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f275006fd80 0x7f275014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27501542a0 0x7f27501478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 -- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f275006fd80 msgr2=0x7f275014b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f275006fd80 0x7f275014b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 -- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27501542a0 msgr2=0x7f27501478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:28.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27501542a0 0x7f27501478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:28.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 -- 172.21.15.16:0/658144335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275014c4d0 con 0x7f275006f460 2024-04-26T20:14:28.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27501542a0 0x7f27501478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:28.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2755200640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275014ae40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27440b3040 tx=0x7f274401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f274cc00640 1 -- 172.21.15.16:0/658144335 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440bf070 con 0x7f275006f460 2024-04-26T20:14:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f274cc00640 1 -- 172.21.15.16:0/658144335 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27440b07a0 con 0x7f275006f460 2024-04-26T20:14:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275014c770 con 0x7f275006f460 2024-04-26T20:14:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f274cc00640 1 -- 172.21.15.16:0/658144335 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440b5040 con 0x7f275006f460 2024-04-26T20:14:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.842+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275014d770 con 0x7f275006f460 2024-04-26T20:14:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.846+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2750077c20 con 0x7f275006f460 2024-04-26T20:14:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.846+0000 7f274cc00640 1 -- 172.21.15.16:0/658144335 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27440c2070 con 0x7f275006f460 2024-04-26T20:14:28.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.846+0000 7f274cc00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2730068380 0x7f273006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:28.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.846+0000 7f274cc00640 1 -- 172.21.15.16:0/658144335 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f27441235b0 con 0x7f275006f460 2024-04-26T20:14:28.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.846+0000 7f274fe00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2730068380 0x7f273006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:28.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.846+0000 7f274fe00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2730068380 0x7f273006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f275014d3c0 tx=0x7f273c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:28.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:28.850+0000 7f274cc00640 1 -- 172.21.15.16:0/658144335 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f27440187d0 con 0x7f275006f460 2024-04-26T20:14:29.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.014+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2750070c20 con 0x7f275006f460 2024-04-26T20:14:29.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.014+0000 7f274cc00640 1 -- 172.21.15.16:0/658144335 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f27440f3710 con 0x7f275006f460 2024-04-26T20:14:29.020 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:14:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2730068380 msgr2=0x7f273006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2730068380 0x7f273006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f275014d3c0 tx=0x7f273c008040 comp rx=0 tx=0).stop 2024-04-26T20:14:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 msgr2=0x7f275014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275014ae40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27440b3040 tx=0x7f274401ba10 comp rx=0 tx=0).stop 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 shutdown_connections 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2730068380 0x7f273006a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27501542a0 0x7f27501478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f275006fd80 0x7f275014b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 --2- 172.21.15.16:0/658144335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275006f460 0x7f275014ae40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 >> 172.21.15.16:0/658144335 conn(0x7f27500c9d10 msgr2=0x7f275014f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 shutdown_connections 2024-04-26T20:14:29.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.018+0000 7f2757c00640 1 -- 172.21.15.16:0/658144335 wait complete. 2024-04-26T20:14:29.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:14:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.178+0000 7f8e13c00640 1 Processor -- start 2024-04-26T20:14:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.178+0000 7f8e13c00640 1 -- start start 2024-04-26T20:14:29.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e13c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c0c9e50 0x7f8e0c0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e13c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e0c15f340 0x7f8e0c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e13c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e0c0cbb70 con 0x7f8e0c1593d0 2024-04-26T20:14:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e13c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8e0c0cbf50 con 0x7f8e0c15f340 2024-04-26T20:14:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e13c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0c0ca630 con 0x7f8e0c0c9e50 2024-04-26T20:14:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e0c15f340 0x7f8e0c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e0c15f340 0x7f8e0c071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34500/0 (socket says 172.21.15.16:34500) 2024-04-26T20:14:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 -- 172.21.15.16:0/126977247 learned_addr learned my addr 172.21.15.16:0/126977247 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e0be00640 1 --2- 172.21.15.16:0/126977247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c0c9e50 0x7f8e0c0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 -- 172.21.15.16:0/126977247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c0c9e50 msgr2=0x7f8e0c0cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:29.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 --2- 172.21.15.16:0/126977247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c0c9e50 0x7f8e0c0cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 -- 172.21.15.16:0/126977247 >> v1:172.21.15.192:6789/0 conn(0x7f8e0c1593d0 legacy=0x7f8e0c0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 -- 172.21.15.16:0/126977247 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c0ca910 con 0x7f8e0c15f340 2024-04-26T20:14:29.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e11c00640 1 --2- 172.21.15.16:0/126977247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c071f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009e50 tx=0x7f8e0401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1389596ceea97b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e0b400640 1 -- 172.21.15.16:0/126977247 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040b4070 con 0x7f8e0c15f340 2024-04-26T20:14:29.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e0b400640 1 -- 172.21.15.16:0/126977247 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e040af400 con 0x7f8e0c15f340 2024-04-26T20:14:29.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.182+0000 7f8e0b400640 1 -- 172.21.15.16:0/126977247 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040af7d0 con 0x7f8e0c15f340 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- 172.21.15.16:0/126977247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 msgr2=0x7f8e0c071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 --2- 172.21.15.16:0/126977247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c071f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009e50 tx=0x7f8e0401f210 comp rx=0 tx=0).stop 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- 172.21.15.16:0/126977247 shutdown_connections 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 --2- 172.21.15.16:0/126977247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c071f40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 --2- 172.21.15.16:0/126977247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c0c9e50 0x7f8e0c0cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- 172.21.15.16:0/126977247 >> 172.21.15.16:0/126977247 conn(0x7f8e0c070570 msgr2=0x7f8e0c06f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- 172.21.15.16:0/126977247 shutdown_connections 2024-04-26T20:14:29.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- 172.21.15.16:0/126977247 wait complete. 2024-04-26T20:14:29.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 Processor -- start 2024-04-26T20:14:29.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- start start 2024-04-26T20:14:29.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e0c0c9e50 0x7f8e0c14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c1593d0 0x7f8e0c1f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1597b0 con 0x7f8e0c15f340 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c0caed0 con 0x7f8e0c0c9e50 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e13c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0c0c62c0 con 0x7f8e0c1593d0 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34512/0 (socket says 172.21.15.16:34512) 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 -- 172.21.15.16:0/160674935 learned_addr learned my addr 172.21.15.16:0/160674935 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e0be00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c1593d0 0x7f8e0c1f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11200640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e0c0c9e50 0x7f8e0c14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 -- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c1593d0 msgr2=0x7f8e0c1f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c1593d0 0x7f8e0c1f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 -- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e0c0c9e50 msgr2=0x7f8e0c14e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e0c0c9e50 0x7f8e0c14e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.186+0000 7f8e11c00640 1 -- 172.21.15.16:0/160674935 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c14fbf0 con 0x7f8e0c15f340 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e11c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c148d20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e040b2040 tx=0x7f8e0401bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e08c00640 1 -- 172.21.15.16:0/160674935 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040be020 con 0x7f8e0c15f340 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e08c00640 1 -- 172.21.15.16:0/160674935 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e040090d0 con 0x7f8e0c15f340 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e08c00640 1 -- 172.21.15.16:0/160674935 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040b4040 con 0x7f8e0c15f340 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0c1f59a0 con 0x7f8e0c15f340 2024-04-26T20:14:29.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0c0c6850 con 0x7f8e0c15f340 2024-04-26T20:14:29.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e0c077c20 con 0x7f8e0c15f340 2024-04-26T20:14:29.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e08c00640 1 -- 172.21.15.16:0/160674935 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e040a8d10 con 0x7f8e0c15f340 2024-04-26T20:14:29.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e08c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8dec068380 0x7f8dec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e08c00640 1 -- 172.21.15.16:0/160674935 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e041245e0 con 0x7f8e0c15f340 2024-04-26T20:14:29.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.190+0000 7f8e11200640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8dec068380 0x7f8dec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.194+0000 7f8e11200640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8dec068380 0x7f8dec06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e00000f70 tx=0x7f8e00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.194+0000 7f8e08c00640 1 -- 172.21.15.16:0/160674935 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e040c8060 con 0x7f8e0c15f340 2024-04-26T20:14:29.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.362+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8e0c0727b0 con 0x7f8e0c15f340 2024-04-26T20:14:29.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.362+0000 7f8e08c00640 1 -- 172.21.15.16:0/160674935 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f8e04018d70 con 0x7f8e0c15f340 2024-04-26T20:14:29.370 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8dec068380 msgr2=0x7f8dec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8dec068380 0x7f8dec06a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e00000f70 tx=0x7f8e00009040 comp rx=0 tx=0).stop 2024-04-26T20:14:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 msgr2=0x7f8e0c148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c148d20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e040b2040 tx=0x7f8e0401bfb0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 shutdown_connections 2024-04-26T20:14:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8dec068380 0x7f8dec06a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e0c15f340 0x7f8e0c148d20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e0c1593d0 0x7f8e0c1f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 --2- 172.21.15.16:0/160674935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e0c0c9e50 0x7f8e0c14e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 >> 172.21.15.16:0/160674935 conn(0x7f8e0c070570 msgr2=0x7f8e0c156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:29.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 shutdown_connections 2024-04-26T20:14:29.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.366+0000 7f8e13c00640 1 -- 172.21.15.16:0/160674935 wait complete. 2024-04-26T20:14:29.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:14:29.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc850200640 1 Processor -- start 2024-04-26T20:14:29.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc850200640 1 -- start start 2024-04-26T20:14:29.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc850200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848073940 0x7fc8480c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc850200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc84815c070 0x7fc84815c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc850200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8480c4b30 con 0x7fc848152d00 2024-04-26T20:14:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc850200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc8480c6f60 con 0x7fc84815c070 2024-04-26T20:14:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc850200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc8480c7240 con 0x7fc848073940 2024-04-26T20:14:29.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84e200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc84815c070 0x7fc84815c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84e200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc84815c070 0x7fc84815c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34514/0 (socket says 172.21.15.16:34514) 2024-04-26T20:14:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84e200640 1 -- 172.21.15.16:0/721621215 learned_addr learned my addr 172.21.15.16:0/721621215 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84ce00640 1 --2- 172.21.15.16:0/721621215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848073940 0x7fc8480c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84e200640 1 -- 172.21.15.16:0/721621215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848073940 msgr2=0x7fc8480c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84e200640 1 --2- 172.21.15.16:0/721621215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848073940 0x7fc8480c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84e200640 1 -- 172.21.15.16:0/721621215 >> v1:172.21.15.192:6789/0 conn(0x7fc848152d00 legacy=0x7fc848073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.530+0000 7fc84e200640 1 -- 172.21.15.16:0/721621215 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8480c7520 con 0x7fc84815c070 2024-04-26T20:14:29.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc84e200640 1 --2- 172.21.15.16:0/721621215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc84815c4a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc840009e50 tx=0x7fc84001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c4c0a1a773feb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc847e00640 1 -- 172.21.15.16:0/721621215 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a58a0 con 0x7fc84815c070 2024-04-26T20:14:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc847e00640 1 -- 172.21.15.16:0/721621215 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400a5a40 con 0x7fc84815c070 2024-04-26T20:14:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc847e00640 1 -- 172.21.15.16:0/721621215 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a5e10 con 0x7fc84815c070 2024-04-26T20:14:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 -- 172.21.15.16:0/721621215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 msgr2=0x7fc84815c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 --2- 172.21.15.16:0/721621215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc84815c4a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc840009e50 tx=0x7fc84001ca30 comp rx=0 tx=0).stop 2024-04-26T20:14:29.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 -- 172.21.15.16:0/721621215 shutdown_connections 2024-04-26T20:14:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 --2- 172.21.15.16:0/721621215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc84815c4a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 --2- 172.21.15.16:0/721621215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848073940 0x7fc8480c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 -- 172.21.15.16:0/721621215 >> 172.21.15.16:0/721621215 conn(0x7fc8480c9d10 msgr2=0x7fc8480ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 -- 172.21.15.16:0/721621215 shutdown_connections 2024-04-26T20:14:29.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.534+0000 7fc850200640 1 -- 172.21.15.16:0/721621215 wait complete. 2024-04-26T20:14:29.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 Processor -- start 2024-04-26T20:14:29.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 -- start start 2024-04-26T20:14:29.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc848073940 0x7fc8481535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848152d00 0x7fc848149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc8481541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc84815cf70 con 0x7fc84815c070 2024-04-26T20:14:29.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc84815cdf0 con 0x7fc848073940 2024-04-26T20:14:29.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc848165c20 con 0x7fc848152d00 2024-04-26T20:14:29.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc8481541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc8481541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34524/0 (socket says 172.21.15.16:34524) 2024-04-26T20:14:29.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 -- 172.21.15.16:0/229336493 learned_addr learned my addr 172.21.15.16:0/229336493 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:29.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84d800640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc848073940 0x7fc8481535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84ce00640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848152d00 0x7fc848149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 -- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848152d00 msgr2=0x7fc848149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848152d00 0x7fc848149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 -- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc848073940 msgr2=0x7fc8481535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc848073940 0x7fc8481535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 -- 172.21.15.16:0/229336493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84814a800 con 0x7fc84815c070 2024-04-26T20:14:29.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc84e200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc8481541b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc8400af040 tx=0x7fc8400197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc845600640 1 -- 172.21.15.16:0/229336493 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a58a0 con 0x7fc84815c070 2024-04-26T20:14:29.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc845600640 1 -- 172.21.15.16:0/229336493 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400be070 con 0x7fc84815c070 2024-04-26T20:14:29.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc845600640 1 -- 172.21.15.16:0/229336493 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840009510 con 0x7fc84815c070 2024-04-26T20:14:29.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84814aa80 con 0x7fc84815c070 2024-04-26T20:14:29.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84814a370 con 0x7fc84815c070 2024-04-26T20:14:29.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.538+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc848077c20 con 0x7fc84815c070 2024-04-26T20:14:29.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.542+0000 7fc845600640 1 -- 172.21.15.16:0/229336493 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8400b8470 con 0x7fc84815c070 2024-04-26T20:14:29.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.542+0000 7fc845600640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc828068380 0x7fc82806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.542+0000 7fc845600640 1 -- 172.21.15.16:0/229336493 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc8401223d0 con 0x7fc84815c070 2024-04-26T20:14:29.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.542+0000 7fc84d800640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc828068380 0x7fc82806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.542+0000 7fc84d800640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc828068380 0x7fc82806a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc83c001650 tx=0x7fc83c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.546+0000 7fc845600640 1 -- 172.21.15.16:0/229336493 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc84814a800 con 0x7fc84815c070 2024-04-26T20:14:29.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc84815be50 con 0x7fc84815c070 2024-04-26T20:14:29.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc845600640 1 -- 172.21.15.16:0/229336493 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fc840016620 con 0x7fc84815c070 2024-04-26T20:14:29.715 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc828068380 msgr2=0x7fc82806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc828068380 0x7fc82806a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc83c001650 tx=0x7fc83c009040 comp rx=0 tx=0).stop 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 msgr2=0x7fc8481541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc8481541b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc8400af040 tx=0x7fc8400197d0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 shutdown_connections 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc828068380 0x7fc82806a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84815c070 0x7fc8481541b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc848152d00 0x7fc848149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 --2- 172.21.15.16:0/229336493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc848073940 0x7fc8481535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 >> 172.21.15.16:0/229336493 conn(0x7fc8480c9d10 msgr2=0x7fc84814b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:29.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 shutdown_connections 2024-04-26T20:14:29.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.710+0000 7fc850200640 1 -- 172.21.15.16:0/229336493 wait complete. 2024-04-26T20:14:29.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:14:29.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.874+0000 7f33cde00640 1 Processor -- start 2024-04-26T20:14:29.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.874+0000 7f33cde00640 1 -- start start 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.874+0000 7f33cde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f33c80c9e50 0x7f33c815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.874+0000 7f33cde00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c80cb050 con 0x7f33c815ff30 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.874+0000 7f33cde00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c80caa90 con 0x7f33c80b1fa0 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.874+0000 7f33cde00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f33c80b2380 con 0x7f33c80c9e50 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.874+0000 7f33bfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f33c80c9e50 0x7f33c815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33bfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f33c80c9e50 0x7f33c815bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34538/0 (socket says 172.21.15.16:34538) 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33bfe00640 1 -- 172.21.15.16:0/495149219 learned_addr learned my addr 172.21.15.16:0/495149219 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:29.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33c7400640 1 --1- 172.21.15.16:0/495149219 >> v1:172.21.15.16:6789/0 conn(0x7f33c815ff30 0x7f33c8166670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35886/0 (socket says 172.21.15.16:35886) 2024-04-26T20:14:29.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33bfe00640 1 -- 172.21.15.16:0/495149219 >> v1:172.21.15.192:6789/0 conn(0x7f33c80b1fa0 legacy=0x7f33c806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33bfe00640 1 -- 172.21.15.16:0/495149219 >> v1:172.21.15.16:6789/0 conn(0x7f33c815ff30 legacy=0x7f33c8166670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33bfe00640 1 -- 172.21.15.16:0/495149219 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c80cad70 con 0x7f33c80c9e50 2024-04-26T20:14:29.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33bfe00640 1 --2- 172.21.15.16:0/495149219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80c9e50 0x7f33c815bdd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009870 tx=0x7f33b001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a2ff5e1fcba476 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33c6000640 1 -- 172.21.15.16:0/495149219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00b2070 con 0x7f33c80c9e50 2024-04-26T20:14:29.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33c6000640 1 -- 172.21.15.16:0/495149219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b00a9070 con 0x7f33c80c9e50 2024-04-26T20:14:29.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33c6000640 1 -- 172.21.15.16:0/495149219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00ad880 con 0x7f33c80c9e50 2024-04-26T20:14:29.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33cde00640 1 -- 172.21.15.16:0/495149219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80c9e50 msgr2=0x7f33c815bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.878+0000 7f33cde00640 1 --2- 172.21.15.16:0/495149219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80c9e50 0x7f33c815bdd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009870 tx=0x7f33b001c560 comp rx=0 tx=0).stop 2024-04-26T20:14:29.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- 172.21.15.16:0/495149219 shutdown_connections 2024-04-26T20:14:29.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 --2- 172.21.15.16:0/495149219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80c9e50 0x7f33c815bdd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- 172.21.15.16:0/495149219 >> 172.21.15.16:0/495149219 conn(0x7f33c8070570 msgr2=0x7f33c806f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:29.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- 172.21.15.16:0/495149219 shutdown_connections 2024-04-26T20:14:29.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- 172.21.15.16:0/495149219 wait complete. 2024-04-26T20:14:29.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 Processor -- start 2024-04-26T20:14:29.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- start start 2024-04-26T20:14:29.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80b1fa0 0x7f33c8154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33c80c9e50 0x7f33c815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33c815ff30 0x7f33c80b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33c806dba0 con 0x7f33c80b1fa0 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f33c806f3e0 con 0x7f33c80c9e50 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f33c806dd20 con 0x7f33c815ff30 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80b1fa0 0x7f33c8154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80b1fa0 0x7f33c8154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34546/0 (socket says 172.21.15.16:34546) 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 -- 172.21.15.16:0/814084117 learned_addr learned my addr 172.21.15.16:0/814084117 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c7400640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33c815ff30 0x7f33c80b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33bfe00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33c80c9e50 0x7f33c815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 -- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33c815ff30 msgr2=0x7f33c80b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33c815ff30 0x7f33c80b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 -- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33c80c9e50 msgr2=0x7f33c815b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33c80c9e50 0x7f33c815b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:29.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 -- 172.21.15.16:0/814084117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c80b12d0 con 0x7f33c80b1fa0 2024-04-26T20:14:29.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33bfe00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33c80c9e50 0x7f33c815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:29.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33c6a00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80b1fa0 0x7f33c8154d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c370 tx=0x7f33b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33bf400640 1 -- 172.21.15.16:0/814084117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80052d0 con 0x7f33c80b1fa0 2024-04-26T20:14:29.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33bf400640 1 -- 172.21.15.16:0/814084117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b8005470 con 0x7f33c80b1fa0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33bf400640 1 -- 172.21.15.16:0/814084117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8007260 con 0x7f33c80b1fa0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.882+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c80b4550 con 0x7f33c80b1fa0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.886+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c8153c00 con 0x7f33c80b1fa0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.886+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c8153a10 con 0x7f33c80b1fa0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.886+0000 7f33bf400640 1 -- 172.21.15.16:0/814084117 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33b8007400 con 0x7f33c80b1fa0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.886+0000 7f33bf400640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f33a40683b0 0x7f33a406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.886+0000 7f33bf400640 1 -- 172.21.15.16:0/814084117 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f33b80861e0 con 0x7f33c80b1fa0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.886+0000 7f33bfe00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f33a40683b0 0x7f33a406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:29.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.886+0000 7f33bfe00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f33a40683b0 0x7f33a406a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33b00af000 tx=0x7f33b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:29.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:29.890+0000 7f33bf400640 1 -- 172.21.15.16:0/814084117 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f33b8055ce0 con 0x7f33c80b1fa0 2024-04-26T20:14:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.058+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f33c8077c20 con 0x7f33c80b1fa0 2024-04-26T20:14:30.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.058+0000 7f33bf400640 1 -- 172.21.15.16:0/814084117 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f33b8059fe0 con 0x7f33c80b1fa0 2024-04-26T20:14:30.064 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f33a40683b0 msgr2=0x7f33a406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f33a40683b0 0x7f33a406a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33b00af000 tx=0x7f33b0008040 comp rx=0 tx=0).stop 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80b1fa0 msgr2=0x7f33c8154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80b1fa0 0x7f33c8154d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c370 tx=0x7f33b800c830 comp rx=0 tx=0).stop 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 shutdown_connections 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f33a40683b0 0x7f33a406a870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33c815ff30 0x7f33c80b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33c80c9e50 0x7f33c815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 --2- 172.21.15.16:0/814084117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33c80b1fa0 0x7f33c8154d50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 >> 172.21.15.16:0/814084117 conn(0x7f33c8070570 msgr2=0x7f33c8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 shutdown_connections 2024-04-26T20:14:30.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.062+0000 7f33cde00640 1 -- 172.21.15.16:0/814084117 wait complete. 2024-04-26T20:14:30.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:14:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8be600640 1 Processor -- start 2024-04-26T20:14:30.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8be600640 1 -- start start 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8be600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8b8152d00 0x7fb8b80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8be600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8be600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b80c4b30 con 0x7fb8b8073230 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8be600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b80c6f60 con 0x7fb8b8152d00 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8be600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b80c7240 con 0x7fb8b815c070 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8aea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb8b8073230 0x7fb8b80736a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35900/0 (socket says 172.21.15.16:35900) 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8aea00640 1 -- 172.21.15.16:0/1273378238 learned_addr learned my addr 172.21.15.16:0/1273378238 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8b7e00640 1 --2- 172.21.15.16:0/1273378238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8b7400640 1 --2- 172.21.15.16:0/1273378238 >> v2:172.21.15.192:3300/0 conn(0x7fb8b8152d00 0x7fb8b80c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8b6a00640 1 -- 172.21.15.16:0/1273378238 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435931541 0 0) 0x7fb8b80c4b30 con 0x7fb8b8073230 2024-04-26T20:14:30.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.222+0000 7fb8b6a00640 1 -- 172.21.15.16:0/1273378238 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb89c003530 con 0x7fb8b8073230 2024-04-26T20:14:30.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b7e00640 1 -- 172.21.15.16:0/1273378238 >> v2:172.21.15.192:3300/0 conn(0x7fb8b8152d00 msgr2=0x7fb8b80c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:30.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b7e00640 1 --2- 172.21.15.16:0/1273378238 >> v2:172.21.15.192:3300/0 conn(0x7fb8b8152d00 0x7fb8b80c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b7e00640 1 -- 172.21.15.16:0/1273378238 >> v1:172.21.15.16:6789/0 conn(0x7fb8b8073230 legacy=0x7fb8b80736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b7e00640 1 -- 172.21.15.16:0/1273378238 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b80c7520 con 0x7fb8b815c070 2024-04-26T20:14:30.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b7e00640 1 --2- 172.21.15.16:0/1273378238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b815c4e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00097c0 tx=0x7fb8b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dad2e7ed2db1fdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:30.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b6a00640 1 -- 172.21.15.16:0/1273378238 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00ab640 con 0x7fb8b815c070 2024-04-26T20:14:30.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b6a00640 1 -- 172.21.15.16:0/1273378238 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b00b0070 con 0x7fb8b815c070 2024-04-26T20:14:30.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8b6a00640 1 -- 172.21.15.16:0/1273378238 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00ab9e0 con 0x7fb8b815c070 2024-04-26T20:14:30.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8be600640 1 -- 172.21.15.16:0/1273378238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 msgr2=0x7fb8b815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8be600640 1 --2- 172.21.15.16:0/1273378238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b815c4e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00097c0 tx=0x7fb8b001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.226+0000 7fb8be600640 1 -- 172.21.15.16:0/1273378238 shutdown_connections 2024-04-26T20:14:30.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 --2- 172.21.15.16:0/1273378238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b815c4e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 --2- 172.21.15.16:0/1273378238 >> v2:172.21.15.192:3300/0 conn(0x7fb8b8152d00 0x7fb8b80c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- 172.21.15.16:0/1273378238 >> 172.21.15.16:0/1273378238 conn(0x7fb8b80c9d10 msgr2=0x7fb8b80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:30.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- 172.21.15.16:0/1273378238 shutdown_connections 2024-04-26T20:14:30.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- 172.21.15.16:0/1273378238 wait complete. 2024-04-26T20:14:30.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 Processor -- start 2024-04-26T20:14:30.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- start start 2024-04-26T20:14:30.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b8073230 0x7fb8b81f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b8152d00 0x7fb8b81f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b81f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b815cfb0 con 0x7fb8b8073230 2024-04-26T20:14:30.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b815ce30 con 0x7fb8b8152d00 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b8165c20 con 0x7fb8b815c070 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b8073230 0x7fb8b81f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b8073230 0x7fb8b81f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34556/0 (socket says 172.21.15.16:34556) 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 -- 172.21.15.16:0/1000843068 learned_addr learned my addr 172.21.15.16:0/1000843068 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7e00640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b81f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8aea00640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b8152d00 0x7fb8b81f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 -- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 msgr2=0x7fb8b81f7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b81f7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 -- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b8152d00 msgr2=0x7fb8b81f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b8152d00 0x7fb8b81f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 -- 172.21.15.16:0/1000843068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b8153fb0 con 0x7fb8b8073230 2024-04-26T20:14:30.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8aea00640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b8152d00 0x7fb8b81f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:30.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8b7400640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b8073230 0x7fb8b81f5ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d10 tx=0x7fb8a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:30.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8afe00640 1 -- 172.21.15.16:0/1000843068 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8018020 con 0x7fb8b8073230 2024-04-26T20:14:30.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8afe00640 1 -- 172.21.15.16:0/1000843068 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8014480 con 0x7fb8b8073230 2024-04-26T20:14:30.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8afe00640 1 -- 172.21.15.16:0/1000843068 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8014830 con 0x7fb8b8073230 2024-04-26T20:14:30.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.230+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b8154270 con 0x7fb8b8073230 2024-04-26T20:14:30.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.234+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b8154830 con 0x7fb8b8073230 2024-04-26T20:14:30.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.234+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b8077c20 con 0x7fb8b8073230 2024-04-26T20:14:30.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.234+0000 7fb8afe00640 1 -- 172.21.15.16:0/1000843068 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8a801b020 con 0x7fb8b8073230 2024-04-26T20:14:30.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.234+0000 7fb8afe00640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb894068380 0x7fb89406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.234+0000 7fb8afe00640 1 -- 172.21.15.16:0/1000843068 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb8a80876d0 con 0x7fb8b8073230 2024-04-26T20:14:30.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.234+0000 7fb8aea00640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb894068380 0x7fb89406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.238+0000 7fb8aea00640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb894068380 0x7fb89406a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8070c40 tx=0x7fb8a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:30.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.238+0000 7fb8afe00640 1 -- 172.21.15.16:0/1000843068 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb8a8022070 con 0x7fb8b8073230 2024-04-26T20:14:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.418+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb8b806fa90 con 0x7fb8b8073230 2024-04-26T20:14:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.418+0000 7fb8afe00640 1 -- 172.21.15.16:0/1000843068 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fb8a8010040 con 0x7fb8b8073230 2024-04-26T20:14:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-26T20:14:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb894068380 msgr2=0x7fb89406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb894068380 0x7fb89406a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8070c40 tx=0x7fb8a0009040 comp rx=0 tx=0).stop 2024-04-26T20:14:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b8073230 msgr2=0x7fb8b81f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b8073230 0x7fb8b81f5ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d10 tx=0x7fb8a800c490 comp rx=0 tx=0).stop 2024-04-26T20:14:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 shutdown_connections 2024-04-26T20:14:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb894068380 0x7fb89406a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8b815c070 0x7fb8b81f7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b8152d00 0x7fb8b81f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 --2- 172.21.15.16:0/1000843068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b8073230 0x7fb8b81f5ea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 >> 172.21.15.16:0/1000843068 conn(0x7fb8b80c9d10 msgr2=0x7fb8b814ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 shutdown_connections 2024-04-26T20:14:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.422+0000 7fb8be600640 1 -- 172.21.15.16:0/1000843068 wait complete. 2024-04-26T20:14:30.446 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:14:30.447 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:14:30.456 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:30.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8191e00640 1 Processor -- start 2024-04-26T20:14:30.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8191e00640 1 -- start start 2024-04-26T20:14:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8191e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f818c0b1d80 0x7f818c06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8191e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818c0cfb50 con 0x7f818c0c6340 2024-04-26T20:14:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8191e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f818c0cfe10 con 0x7f818c15c7e0 2024-04-26T20:14:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8191e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f818c0cce10 con 0x7f818c0b1d80 2024-04-26T20:14:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8182000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f818c0c6340 0x7f818c15c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35914/0 (socket says 172.21.15.16:35914) 2024-04-26T20:14:30.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f8182000640 1 -- 172.21.15.16:0/3596259403 learned_addr learned my addr 172.21.15.16:0/3596259403 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:30.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f818aa00640 1 --2- 172.21.15.16:0/3596259403 >> v2:172.21.15.192:3300/0 conn(0x7f818c0b1d80 0x7f818c06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f818a000640 1 -- 172.21.15.16:0/3596259403 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307009177 0 0) 0x7f818c0cfb50 con 0x7f818c0c6340 2024-04-26T20:14:30.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f818a000640 1 -- 172.21.15.16:0/3596259403 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8170003530 con 0x7f818c0c6340 2024-04-26T20:14:30.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f818a000640 1 -- 172.21.15.16:0/3596259403 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2644429573 0 0) 0x7f8170003530 con 0x7f818c0c6340 2024-04-26T20:14:30.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f818aa00640 1 -- 172.21.15.16:0/3596259403 >> v1:172.21.15.192:6789/0 conn(0x7f818c15c7e0 legacy=0x7f818c166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f818aa00640 1 -- 172.21.15.16:0/3596259403 >> v1:172.21.15.16:6789/0 conn(0x7f818c0c6340 legacy=0x7f818c15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.638+0000 7f818aa00640 1 -- 172.21.15.16:0/3596259403 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c06d650 con 0x7f818c0b1d80 2024-04-26T20:14:30.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f818aa00640 1 --2- 172.21.15.16:0/3596259403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c0b1d80 0x7f818c06feb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f817c009d90 tx=0x7f817c01f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2babcfee0b1194e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:30.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f818a000640 1 -- 172.21.15.16:0/3596259403 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c0b5070 con 0x7f818c0b1d80 2024-04-26T20:14:30.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f818a000640 1 -- 172.21.15.16:0/3596259403 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c0a8c10 con 0x7f818c0b1d80 2024-04-26T20:14:30.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f818a000640 1 -- 172.21.15.16:0/3596259403 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174001680 con 0x7f818c0b1d80 2024-04-26T20:14:30.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f8191e00640 1 -- 172.21.15.16:0/3596259403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c0b1d80 msgr2=0x7f818c06feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f8191e00640 1 --2- 172.21.15.16:0/3596259403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c0b1d80 0x7f818c06feb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f817c009d90 tx=0x7f817c01f080 comp rx=0 tx=0).stop 2024-04-26T20:14:30.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f8191e00640 1 -- 172.21.15.16:0/3596259403 shutdown_connections 2024-04-26T20:14:30.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f8191e00640 1 --2- 172.21.15.16:0/3596259403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c0b1d80 0x7f818c06feb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f8191e00640 1 -- 172.21.15.16:0/3596259403 >> 172.21.15.16:0/3596259403 conn(0x7f818c071160 msgr2=0x7f818c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:30.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f8191e00640 1 -- 172.21.15.16:0/3596259403 shutdown_connections 2024-04-26T20:14:30.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.642+0000 7f8191e00640 1 -- 172.21.15.16:0/3596259403 wait complete. 2024-04-26T20:14:30.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 Processor -- start 2024-04-26T20:14:30.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 -- start start 2024-04-26T20:14:30.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818c0b1d80 0x7f818c14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f818c0c6340 0x7f818c154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c15c7e0 0x7f818c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f818c0b2160 con 0x7f818c0b1d80 2024-04-26T20:14:30.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f818c06dc10 con 0x7f818c15c7e0 2024-04-26T20:14:30.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f818c071970 con 0x7f818c0c6340 2024-04-26T20:14:30.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818c0b1d80 0x7f818c14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818c0b1d80 0x7f818c14f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34558/0 (socket says 172.21.15.16:34558) 2024-04-26T20:14:30.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 -- 172.21.15.16:0/1265027426 learned_addr learned my addr 172.21.15.16:0/1265027426 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:30.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818b400640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c15c7e0 0x7f818c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8182000640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f818c0c6340 0x7f818c154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 -- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f818c0c6340 msgr2=0x7f818c154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f818c0c6340 0x7f818c154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 -- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c15c7e0 msgr2=0x7f818c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c15c7e0 0x7f818c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 -- 172.21.15.16:0/1265027426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818c0b1410 con 0x7f818c0b1d80 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8182000640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f818c0c6340 0x7f818c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f818aa00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818c0b1d80 0x7f818c14f1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f817c01ccb0 tx=0x7f817c01be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:30.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8183e00640 1 -- 172.21.15.16:0/1265027426 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c0b5040 con 0x7f818c0b1d80 2024-04-26T20:14:30.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8183e00640 1 -- 172.21.15.16:0/1265027426 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c0a9e50 con 0x7f818c0b1d80 2024-04-26T20:14:30.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818c0b16f0 con 0x7f818c0b1d80 2024-04-26T20:14:30.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8183e00640 1 -- 172.21.15.16:0/1265027426 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c004260 con 0x7f818c0b1d80 2024-04-26T20:14:30.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.646+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f818c0b0030 con 0x7f818c0b1d80 2024-04-26T20:14:30.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.650+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818c077c20 con 0x7f818c0b1d80 2024-04-26T20:14:30.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.650+0000 7f8183e00640 1 -- 172.21.15.16:0/1265027426 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f817c0c4020 con 0x7f818c0b1d80 2024-04-26T20:14:30.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.650+0000 7f8183e00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8168068380 0x7f816806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.650+0000 7f8183e00640 1 -- 172.21.15.16:0/1265027426 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f817c124b80 con 0x7f818c0b1d80 2024-04-26T20:14:30.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.650+0000 7f8182000640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8168068380 0x7f816806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.650+0000 7f8182000640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8168068380 0x7f816806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f818c0b0f80 tx=0x7f8174009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:30.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.654+0000 7f8183e00640 1 -- 172.21.15.16:0/1265027426 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f817c0cb020 con 0x7f818c0b1d80 2024-04-26T20:14:30.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.822+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f818c0d0210 con 0x7f818c0b1d80 2024-04-26T20:14:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8183e00640 1 -- 172.21.15.16:0/1265027426 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f817c018be0 con 0x7f818c0b1d80 2024-04-26T20:14:30.829 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:30.830 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8168068380 msgr2=0x7f816806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8168068380 0x7f816806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f818c0b0f80 tx=0x7f8174009040 comp rx=0 tx=0).stop 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818c0b1d80 msgr2=0x7f818c14f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818c0b1d80 0x7f818c14f1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f817c01ccb0 tx=0x7f817c01be20 comp rx=0 tx=0).stop 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 shutdown_connections 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8168068380 0x7f816806a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f818c15c7e0 0x7f818c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f818c0c6340 0x7f818c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 --2- 172.21.15.16:0/1265027426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818c0b1d80 0x7f818c14f1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:30.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 >> 172.21.15.16:0/1265027426 conn(0x7f818c071160 msgr2=0x7f818c15b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:30.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 shutdown_connections 2024-04-26T20:14:30.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.826+0000 7f8191e00640 1 -- 172.21.15.16:0/1265027426 wait complete. 2024-04-26T20:14:30.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:14:30.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:14:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397f200640 1 Processor -- start 2024-04-26T20:14:30.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397f200640 1 -- start start 2024-04-26T20:14:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397f200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3980159510 0x7f39800cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397f200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39800ca710 con 0x7f39800cab70 2024-04-26T20:14:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397f200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3980070cc0 con 0x7f3980159130 2024-04-26T20:14:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397f200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f39800ca4e0 con 0x7f3980159510 2024-04-26T20:14:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f3975400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3980159510 0x7f39800cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397e800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f39800cab70 0x7f3980166560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35926/0 (socket says 172.21.15.16:35926) 2024-04-26T20:14:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f3975400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3980159510 0x7f39800cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34564/0 (socket says 172.21.15.16:34564) 2024-04-26T20:14:30.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.990+0000 7f397e800640 1 -- 172.21.15.16:0/2052527239 learned_addr learned my addr 172.21.15.16:0/2052527239 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:30.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f3975400640 1 -- 172.21.15.16:0/2052527239 >> v1:172.21.15.192:6789/0 conn(0x7f3980159130 legacy=0x7f398015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f3975400640 1 -- 172.21.15.16:0/2052527239 >> v1:172.21.15.16:6789/0 conn(0x7f39800cab70 legacy=0x7f3980166560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:30.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f3975400640 1 -- 172.21.15.16:0/2052527239 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980070fa0 con 0x7f3980159510 2024-04-26T20:14:30.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397d400640 1 -- 172.21.15.16:0/2052527239 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327830270 0 0) 0x7f39800ca710 con 0x7f39800cab70 2024-04-26T20:14:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f3975400640 1 --2- 172.21.15.16:0/2052527239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800cf220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39680097c0 tx=0x7f396801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224e54757fdd30f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397d400640 1 -- 172.21.15.16:0/2052527239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680b5070 con 0x7f3980159510 2024-04-26T20:14:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397d400640 1 -- 172.21.15.16:0/2052527239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39680a8990 con 0x7f3980159510 2024-04-26T20:14:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397d400640 1 -- 172.21.15.16:0/2052527239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680a8d60 con 0x7f3980159510 2024-04-26T20:14:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397f200640 1 -- 172.21.15.16:0/2052527239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 msgr2=0x7f39800cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397f200640 1 --2- 172.21.15.16:0/2052527239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800cf220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39680097c0 tx=0x7f396801ec90 comp rx=0 tx=0).stop 2024-04-26T20:14:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397f200640 1 -- 172.21.15.16:0/2052527239 shutdown_connections 2024-04-26T20:14:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397f200640 1 --2- 172.21.15.16:0/2052527239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800cf220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397f200640 1 -- 172.21.15.16:0/2052527239 >> 172.21.15.16:0/2052527239 conn(0x7f398006c980 msgr2=0x7f3980068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397f200640 1 -- 172.21.15.16:0/2052527239 shutdown_connections 2024-04-26T20:14:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.994+0000 7f397f200640 1 -- 172.21.15.16:0/2052527239 wait complete. 2024-04-26T20:14:31.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 Processor -- start 2024-04-26T20:14:31.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 -- start start 2024-04-26T20:14:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39800cab70 0x7f39800c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3980159130 0x7f39801f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3980071610 con 0x7f3980159510 2024-04-26T20:14:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39800c9cd0 con 0x7f39800cab70 2024-04-26T20:14:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f398015cb00 con 0x7f3980159130 2024-04-26T20:14:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34574/0 (socket says 172.21.15.16:34574) 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 -- 172.21.15.16:0/3237513761 learned_addr learned my addr 172.21.15.16:0/3237513761 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397de00640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39800cab70 0x7f39800c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f3975400640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3980159130 0x7f39801f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 -- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3980159130 msgr2=0x7f39801f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3980159130 0x7f39801f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 -- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39800cab70 msgr2=0x7f39800c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39800cab70 0x7f39800c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 -- 172.21.15.16:0/3237513761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39800b1ef0 con 0x7f3980159510 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397e800640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800b0b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f397800c480 tx=0x7f397800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f3976a00640 1 -- 172.21.15.16:0/3237513761 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978018070 con 0x7f3980159510 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f3976a00640 1 -- 172.21.15.16:0/3237513761 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39780074e0 con 0x7f3980159510 2024-04-26T20:14:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f3976a00640 1 -- 172.21.15.16:0/3237513761 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978004a30 con 0x7f3980159510 2024-04-26T20:14:31.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:30.998+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39800b21b0 con 0x7f3980159510 2024-04-26T20:14:31.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.002+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39801f4d20 con 0x7f3980159510 2024-04-26T20:14:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.002+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39800506d0 con 0x7f3980159510 2024-04-26T20:14:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.002+0000 7f3976a00640 1 -- 172.21.15.16:0/3237513761 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f397801b070 con 0x7f3980159510 2024-04-26T20:14:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.002+0000 7f3976a00640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f395c0683b0 0x7f395c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.002+0000 7f3976a00640 1 -- 172.21.15.16:0/3237513761 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3978085f60 con 0x7f3980159510 2024-04-26T20:14:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.002+0000 7f397de00640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f395c0683b0 0x7f395c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.006+0000 7f397de00640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f395c0683b0 0x7f395c06a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39700012f0 tx=0x7f3970009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.006+0000 7f3976a00640 1 -- 172.21.15.16:0/3237513761 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3978055b80 con 0x7f3980159510 2024-04-26T20:14:31.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.174+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f39800713f0 con 0x7f3980159510 2024-04-26T20:14:31.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.174+0000 7f3976a00640 1 -- 172.21.15.16:0/3237513761 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f3978059e80 con 0x7f3980159510 2024-04-26T20:14:31.180 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f395c0683b0 msgr2=0x7f395c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f395c0683b0 0x7f395c06a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39700012f0 tx=0x7f3970009040 comp rx=0 tx=0).stop 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 msgr2=0x7f39800b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800b0b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f397800c480 tx=0x7f397800c940 comp rx=0 tx=0).stop 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 shutdown_connections 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f395c0683b0 0x7f395c06a870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3980159510 0x7f39800b0b80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3980159130 0x7f39801f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 --2- 172.21.15.16:0/3237513761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39800cab70 0x7f39800c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 >> 172.21.15.16:0/3237513761 conn(0x7f398006c980 msgr2=0x7f3980156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:31.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 shutdown_connections 2024-04-26T20:14:31.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.178+0000 7f397f200640 1 -- 172.21.15.16:0/3237513761 wait complete. 2024-04-26T20:14:31.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:14:31.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 Processor -- start 2024-04-26T20:14:31.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 -- start start 2024-04-26T20:14:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25cc1573a0 0x7f25cc0c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc0c4580 0x7f25cc0722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25cc0c5810 0x7f25cc0727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc0ca5a0 con 0x7f25cc1573a0 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc0cf620 con 0x7f25cc0c5810 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25d2000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc0cf900 con 0x7f25cc0c4580 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25cc1573a0 0x7f25cc0c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25cc1573a0 0x7f25cc0c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34578/0 (socket says 172.21.15.16:34578) 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 -- 172.21.15.16:0/2107176247 learned_addr learned my addr 172.21.15.16:0/2107176247 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cbe00640 1 --2- 172.21.15.16:0/2107176247 >> v2:172.21.15.192:3300/0 conn(0x7f25cc0c5810 0x7f25cc0727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25c2a00640 1 --2- 172.21.15.16:0/2107176247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc0c4580 0x7f25cc0722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 -- 172.21.15.16:0/2107176247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc0c4580 msgr2=0x7f25cc0722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 --2- 172.21.15.16:0/2107176247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc0c4580 0x7f25cc0722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 -- 172.21.15.16:0/2107176247 >> v2:172.21.15.192:3300/0 conn(0x7f25cc0c5810 msgr2=0x7f25cc0727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:31.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 --2- 172.21.15.16:0/2107176247 >> v2:172.21.15.192:3300/0 conn(0x7f25cc0c5810 0x7f25cc0727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cb400640 1 -- 172.21.15.16:0/2107176247 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc0cfbe0 con 0x7f25cc1573a0 2024-04-26T20:14:31.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25cbe00640 1 --2- 172.21.15.16:0/2107176247 >> v2:172.21.15.192:3300/0 conn(0x7f25cc0c5810 0x7f25cc0727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:31.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.342+0000 7f25c2a00640 1 --2- 172.21.15.16:0/2107176247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc0c4580 0x7f25cc0722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25cb400640 1 --2- 172.21.15.16:0/2107176247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc1573a0 0x7f25cc0c9f60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f25cc15ad80 tx=0x7f25bc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c354551c9df18896 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25caa00640 1 -- 172.21.15.16:0/2107176247 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0b0070 con 0x7f25cc1573a0 2024-04-26T20:14:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25caa00640 1 -- 172.21.15.16:0/2107176247 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25bc0ab600 con 0x7f25cc1573a0 2024-04-26T20:14:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25caa00640 1 -- 172.21.15.16:0/2107176247 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0ab9d0 con 0x7f25cc1573a0 2024-04-26T20:14:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 -- 172.21.15.16:0/2107176247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc1573a0 msgr2=0x7f25cc0c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 --2- 172.21.15.16:0/2107176247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc1573a0 0x7f25cc0c9f60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f25cc15ad80 tx=0x7f25bc01c490 comp rx=0 tx=0).stop 2024-04-26T20:14:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 -- 172.21.15.16:0/2107176247 shutdown_connections 2024-04-26T20:14:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 --2- 172.21.15.16:0/2107176247 >> v2:172.21.15.192:3300/0 conn(0x7f25cc0c5810 0x7f25cc0727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 --2- 172.21.15.16:0/2107176247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc0c4580 0x7f25cc0722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 --2- 172.21.15.16:0/2107176247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc1573a0 0x7f25cc0c9f60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 -- 172.21.15.16:0/2107176247 >> 172.21.15.16:0/2107176247 conn(0x7f25cc0704d0 msgr2=0x7f25cc0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 -- 172.21.15.16:0/2107176247 shutdown_connections 2024-04-26T20:14:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.346+0000 7f25d2000640 1 -- 172.21.15.16:0/2107176247 wait complete. 2024-04-26T20:14:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 Processor -- start 2024-04-26T20:14:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 -- start start 2024-04-26T20:14:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25cc0c4580 0x7f25cc1f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc0c5810 0x7f25cc150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc1573a0 0x7f25cc14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0cb210 con 0x7f25cc0c5810 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0cb090 con 0x7f25cc0c4580 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc0cb390 con 0x7f25cc1573a0 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc0c5810 0x7f25cc150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc0c5810 0x7f25cc150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34586/0 (socket says 172.21.15.16:34586) 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 -- 172.21.15.16:0/3751479275 learned_addr learned my addr 172.21.15.16:0/3751479275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25cbe00640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc1573a0 0x7f25cc14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25cb400640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25cc0c4580 0x7f25cc1f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 -- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc1573a0 msgr2=0x7f25cc14ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc1573a0 0x7f25cc14ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 -- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25cc0c4580 msgr2=0x7f25cc1f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25cc0c4580 0x7f25cc1f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 -- 172.21.15.16:0/3751479275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc151270 con 0x7f25cc0c5810 2024-04-26T20:14:31.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c2a00640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc0c5810 0x7f25cc150710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e840 tx=0x7f25b400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c3e00640 1 -- 172.21.15.16:0/3751479275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4017070 con 0x7f25cc0c5810 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c3e00640 1 -- 172.21.15.16:0/3751479275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b400c8d0 con 0x7f25cc0c5810 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc15ae40 con 0x7f25cc0c5810 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25c3e00640 1 -- 172.21.15.16:0/3751479275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b400f040 con 0x7f25cc0c5810 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc162780 con 0x7f25cc0c5810 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.350+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc077c20 con 0x7f25cc0c5810 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.354+0000 7f25c3e00640 1 -- 172.21.15.16:0/3751479275 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25b401a070 con 0x7f25cc0c5810 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.354+0000 7f25c3e00640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25a8068380 0x7f25a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.354+0000 7f25c3e00640 1 -- 172.21.15.16:0/3751479275 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f25b40869d0 con 0x7f25cc0c5810 2024-04-26T20:14:31.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.354+0000 7f25cb400640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25a8068380 0x7f25a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.354+0000 7f25cb400640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25a8068380 0x7f25a806a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ad000 tx=0x7f25bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.358+0000 7f25c3e00640 1 -- 172.21.15.16:0/3751479275 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f25b40564d0 con 0x7f25cc0c5810 2024-04-26T20:14:31.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.522+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f25cc0ca780 con 0x7f25cc0c5810 2024-04-26T20:14:31.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.522+0000 7f25c3e00640 1 -- 172.21.15.16:0/3751479275 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f25b405a7d0 con 0x7f25cc0c5810 2024-04-26T20:14:31.529 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:31.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25a8068380 msgr2=0x7f25a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25a8068380 0x7f25a806a840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ad000 tx=0x7f25bc008040 comp rx=0 tx=0).stop 2024-04-26T20:14:31.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc0c5810 msgr2=0x7f25cc150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc0c5810 0x7f25cc150710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e840 tx=0x7f25b400ed00 comp rx=0 tx=0).stop 2024-04-26T20:14:31.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 shutdown_connections 2024-04-26T20:14:31.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25a8068380 0x7f25a806a840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25cc1573a0 0x7f25cc14ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25cc0c5810 0x7f25cc150710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 --2- 172.21.15.16:0/3751479275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25cc0c4580 0x7f25cc1f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 >> 172.21.15.16:0/3751479275 conn(0x7f25cc0704d0 msgr2=0x7f25cc0c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:31.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 shutdown_connections 2024-04-26T20:14:31.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.526+0000 7f25d2000640 1 -- 172.21.15.16:0/3751479275 wait complete. 2024-04-26T20:14:31.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:14:31.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.690+0000 7f06da000640 1 Processor -- start 2024-04-26T20:14:31.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.690+0000 7f06da000640 1 -- start start 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.690+0000 7f06da000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 0x7f06d4071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.690+0000 7f06da000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d40c8e50 con 0x7f06d415c770 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.690+0000 7f06da000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d4160290 con 0x7f06d4070da0 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.690+0000 7f06da000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f06d40c9110 con 0x7f06d40c9520 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06caa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f06d415c770 0x7f06d4164850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35930/0 (socket says 172.21.15.16:35930) 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06caa00640 1 -- 172.21.15.16:0/3733766762 learned_addr learned my addr 172.21.15.16:0/3733766762 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3e00640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 0x7f06d4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583903039 0 0) 0x7f06d40c8e50 con 0x7f06d415c770 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b8003530 con 0x7f06d415c770 2024-04-26T20:14:31.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 130656208 0 0) 0x7f06b8003530 con 0x7f06d415c770 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 msgr2=0x7f06d4071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 0x7f06d4071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 >> v1:172.21.15.192:6789/0 conn(0x7f06d4070da0 legacy=0x7f06d415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d40c9d70 con 0x7f06d415c770 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f06bc001680 con 0x7f06d415c770 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 >> v1:172.21.15.16:6789/0 conn(0x7f06d415c770 legacy=0x7f06d4164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06b80039f0 0x7f06b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b80043a0 0x7f06b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 0x7f06b80050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40c9110 con 0x7f06b80039f0 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06b800b9d0 con 0x7f06b80043a0 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f06b800bbd0 con 0x7f06d40c9520 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3400640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06b80039f0 0x7f06b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06caa00640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b80043a0 0x7f06b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3e00640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 0x7f06b80050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3400640 1 -- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 msgr2=0x7f06b80050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3400640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06d40c9520 0x7f06b80050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3400640 1 -- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b80043a0 msgr2=0x7f06b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3400640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b80043a0 0x7f06b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.694+0000 7f06d3400640 1 -- 172.21.15.16:0/3733766762 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b8003530 con 0x7f06b80039f0 2024-04-26T20:14:31.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06d3400640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06b80039f0 0x7f06b8003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06c4002010 tx=0x7f06c401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabf1d79e75753b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4001c10 con 0x7f06b80039f0 2024-04-26T20:14:31.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c40a8660 con 0x7f06b80039f0 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06d2a00640 1 -- 172.21.15.16:0/3733766762 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c40a8a50 con 0x7f06b80039f0 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 -- 172.21.15.16:0/3733766762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06b80039f0 msgr2=0x7f06b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 --2- 172.21.15.16:0/3733766762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06b80039f0 0x7f06b8003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06c4002010 tx=0x7f06c401c900 comp rx=0 tx=0).stop 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06d3e00640 1 -- 172.21.15.16:0/3733766762 reap_dead start 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 -- 172.21.15.16:0/3733766762 shutdown_connections 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 -- 172.21.15.16:0/3733766762 >> 172.21.15.16:0/3733766762 conn(0x7f06d40ce2c0 msgr2=0x7f06d40ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 -- 172.21.15.16:0/3733766762 shutdown_connections 2024-04-26T20:14:31.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 -- 172.21.15.16:0/3733766762 wait complete. 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 Processor -- start 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.698+0000 7f06da000640 1 -- start start 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b80039f0 0x7f06d414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cca10 0x7f06d41f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d414e180 0x7f06d40cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4168910 con 0x7f06d40cca10 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4168790 con 0x7f06d414e180 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f06d4168a90 con 0x7f06b80039f0 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cca10 0x7f06d41f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cca10 0x7f06d41f93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34608/0 (socket says 172.21.15.16:34608) 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 -- 172.21.15.16:0/1912242714 learned_addr learned my addr 172.21.15.16:0/1912242714 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06d3400640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b80039f0 0x7f06d414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06d3e00640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d414e180 0x7f06d40cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 -- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b80039f0 msgr2=0x7f06d414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b80039f0 0x7f06d414c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 -- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d414e180 msgr2=0x7f06d40cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d414e180 0x7f06d40cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 -- 172.21.15.16:0/1912242714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d4151830 con 0x7f06d40cca10 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06caa00640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cca10 0x7f06d41f93e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00e7e0 tx=0x7f06bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06cbe00640 1 -- 172.21.15.16:0/1912242714 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00ee90 con 0x7f06d40cca10 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06cbe00640 1 -- 172.21.15.16:0/1912242714 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc018070 con 0x7f06d40cca10 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06cbe00640 1 -- 172.21.15.16:0/1912242714 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00ca90 con 0x7f06d40cca10 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d4151ad0 con 0x7f06d40cca10 2024-04-26T20:14:31.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d4152090 con 0x7f06d40cca10 2024-04-26T20:14:31.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d4077c20 con 0x7f06d40cca10 2024-04-26T20:14:31.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.702+0000 7f06cbe00640 1 -- 172.21.15.16:0/1912242714 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06bc00cc30 con 0x7f06d40cca10 2024-04-26T20:14:31.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.706+0000 7f06cbe00640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06b0068550 0x7f06b006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:31.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.706+0000 7f06cbe00640 1 -- 172.21.15.16:0/1912242714 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f06bc0867a0 con 0x7f06d40cca10 2024-04-26T20:14:31.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.706+0000 7f06d3400640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06b0068550 0x7f06b006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:31.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.706+0000 7f06d3400640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06b0068550 0x7f06b006aa10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06c4002010 tx=0x7f06c40b2040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:31.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.710+0000 7f06cbe00640 1 -- 172.21.15.16:0/1912242714 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f06bc0568f0 con 0x7f06d40cca10 2024-04-26T20:14:31.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.870+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f06d40c99b0 con 0x7f06d40cca10 2024-04-26T20:14:31.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.870+0000 7f06cbe00640 1 -- 172.21.15.16:0/1912242714 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f06bc0561f0 con 0x7f06d40cca10 2024-04-26T20:14:31.877 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:14:31.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06b0068550 msgr2=0x7f06b006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06b0068550 0x7f06b006aa10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06c4002010 tx=0x7f06c40b2040 comp rx=0 tx=0).stop 2024-04-26T20:14:31.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cca10 msgr2=0x7f06d41f93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:31.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cca10 0x7f06d41f93e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00e7e0 tx=0x7f06bc00eca0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 shutdown_connections 2024-04-26T20:14:31.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06b0068550 0x7f06b006aa10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d414e180 0x7f06d40cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cca10 0x7f06d41f93e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 --2- 172.21.15.16:0/1912242714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b80039f0 0x7f06d414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:31.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 >> 172.21.15.16:0/1912242714 conn(0x7f06d40ce2c0 msgr2=0x7f06d4155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:31.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 shutdown_connections 2024-04-26T20:14:31.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:31.874+0000 7f06da000640 1 -- 172.21.15.16:0/1912242714 wait complete. 2024-04-26T20:14:31.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:14:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 Processor -- start 2024-04-26T20:14:32.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 -- start start 2024-04-26T20:14:32.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fddc40ccc10 0x7fddc406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddc40b1f60 0x7fddc4070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fddc41601b0 con 0x7fddc40b1f60 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fddc406d610 con 0x7fddc40ccc10 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddca200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fddc415f3f0 con 0x7fddc4155e80 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddc40b1f60 0x7fddc4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddc40b1f60 0x7fddc4070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34612/0 (socket says 172.21.15.16:34612) 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 -- 172.21.15.16:0/3120368190 learned_addr learned my addr 172.21.15.16:0/3120368190 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3400640 1 --2- 172.21.15.16:0/3120368190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddbbe00640 1 --2- 172.21.15.16:0/3120368190 >> v2:172.21.15.192:3300/0 conn(0x7fddc40ccc10 0x7fddc406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 -- 172.21.15.16:0/3120368190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 msgr2=0x7fddc415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:32.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 --2- 172.21.15.16:0/3120368190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 -- 172.21.15.16:0/3120368190 >> v2:172.21.15.192:3300/0 conn(0x7fddc40ccc10 msgr2=0x7fddc406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 --2- 172.21.15.16:0/3120368190 >> v2:172.21.15.192:3300/0 conn(0x7fddc40ccc10 0x7fddc406ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.038+0000 7fddc3e00640 1 -- 172.21.15.16:0/3120368190 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc415f6d0 con 0x7fddc40b1f60 2024-04-26T20:14:32.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddc3e00640 1 --2- 172.21.15.16:0/3120368190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40b1f60 0x7fddc4070440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fddc4070ad0 tx=0x7fddbc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13d755a0ed4b331 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddc2a00640 1 -- 172.21.15.16:0/3120368190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0a64e0 con 0x7fddc40b1f60 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddc2a00640 1 -- 172.21.15.16:0/3120368190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc0a6680 con 0x7fddc40b1f60 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddc2a00640 1 -- 172.21.15.16:0/3120368190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0a6a50 con 0x7fddc40b1f60 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 -- 172.21.15.16:0/3120368190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40b1f60 msgr2=0x7fddc4070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 --2- 172.21.15.16:0/3120368190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40b1f60 0x7fddc4070440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fddc4070ad0 tx=0x7fddbc01c960 comp rx=0 tx=0).stop 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 -- 172.21.15.16:0/3120368190 shutdown_connections 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 --2- 172.21.15.16:0/3120368190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40b1f60 0x7fddc4070440 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 --2- 172.21.15.16:0/3120368190 >> v2:172.21.15.192:3300/0 conn(0x7fddc40ccc10 0x7fddc406ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 --2- 172.21.15.16:0/3120368190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 -- 172.21.15.16:0/3120368190 >> 172.21.15.16:0/3120368190 conn(0x7fddc4068140 msgr2=0x7fddc4068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 -- 172.21.15.16:0/3120368190 shutdown_connections 2024-04-26T20:14:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.042+0000 7fddca200640 1 -- 172.21.15.16:0/3120368190 wait complete. 2024-04-26T20:14:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 Processor -- start 2024-04-26T20:14:32.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 -- start start 2024-04-26T20:14:32.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddc40b1f60 0x7fddc40cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40ccc10 0x7fddc40c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fddc40cfda0 con 0x7fddc40ccc10 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fddc40cfc20 con 0x7fddc40b1f60 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fddc40cff20 con 0x7fddc4155e80 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40ccc10 0x7fddc40c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40ccc10 0x7fddc40c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34620/0 (socket says 172.21.15.16:34620) 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddc3400640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddc40b1f60 0x7fddc40cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 -- 172.21.15.16:0/34422954 learned_addr learned my addr 172.21.15.16:0/34422954 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddc3e00640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 -- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 msgr2=0x7fddc415ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 -- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddc40b1f60 msgr2=0x7fddc40cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddc40b1f60 0x7fddc40cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 -- 172.21.15.16:0/34422954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc40b0810 con 0x7fddc40ccc10 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbbe00640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40ccc10 0x7fddc40c56e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fddac00e8b0 tx=0x7fddac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbb400640 1 -- 172.21.15.16:0/34422954 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac017070 con 0x7fddc40ccc10 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbb400640 1 -- 172.21.15.16:0/34422954 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddac00c940 con 0x7fddc40ccc10 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddbb400640 1 -- 172.21.15.16:0/34422954 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac00cd10 con 0x7fddc40ccc10 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc40b0af0 con 0x7fddc40ccc10 2024-04-26T20:14:32.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc40b10b0 con 0x7fddc40ccc10 2024-04-26T20:14:32.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.046+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc4077c20 con 0x7fddc40ccc10 2024-04-26T20:14:32.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.050+0000 7fddbb400640 1 -- 172.21.15.16:0/34422954 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fddac01a070 con 0x7fddc40ccc10 2024-04-26T20:14:32.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.050+0000 7fddbb400640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdda00683b0 0x7fdda006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.050+0000 7fddbb400640 1 -- 172.21.15.16:0/34422954 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fddac086fe0 con 0x7fddc40ccc10 2024-04-26T20:14:32.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.050+0000 7fddc3400640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdda00683b0 0x7fdda006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.050+0000 7fddc3400640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdda00683b0 0x7fdda006a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009ac0 tx=0x7fddb4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.054+0000 7fddbb400640 1 -- 172.21.15.16:0/34422954 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fddac056bb0 con 0x7fddc40ccc10 2024-04-26T20:14:32.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.218+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fddc4149660 con 0x7fddc40ccc10 2024-04-26T20:14:32.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.218+0000 7fddbb400640 1 -- 172.21.15.16:0/34422954 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fddac05aeb0 con 0x7fddc40ccc10 2024-04-26T20:14:32.225 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:32.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdda00683b0 msgr2=0x7fdda006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdda00683b0 0x7fdda006a870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009ac0 tx=0x7fddb4009190 comp rx=0 tx=0).stop 2024-04-26T20:14:32.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40ccc10 msgr2=0x7fddc40c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40ccc10 0x7fddc40c56e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fddac00e8b0 tx=0x7fddac00ed70 comp rx=0 tx=0).stop 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 shutdown_connections 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdda00683b0 0x7fdda006a870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fddc4155e80 0x7fddc415ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddc40ccc10 0x7fddc40c56e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 --2- 172.21.15.16:0/34422954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddc40b1f60 0x7fddc40cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 >> 172.21.15.16:0/34422954 conn(0x7fddc4068140 msgr2=0x7fddc4068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 shutdown_connections 2024-04-26T20:14:32.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.222+0000 7fddca200640 1 -- 172.21.15.16:0/34422954 wait complete. 2024-04-26T20:14:32.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:14:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 Processor -- start 2024-04-26T20:14:32.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 -- start start 2024-04-26T20:14:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0152d00 0x7fd9d00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd9d0073230 0x7fd9d0073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9d0158a80 0x7fd9d0158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd9d0073bb0 con 0x7fd9d0073230 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fd9d00c4b30 con 0x7fd9d0158a80 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9d5600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d00c6f60 con 0x7fd9d0152d00 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9c6000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd9d0073230 0x7fd9d0073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9c6000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd9d0073230 0x7fd9d0073670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34622/0 (socket says 172.21.15.16:34622) 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9c6000640 1 -- 172.21.15.16:0/2614298427 learned_addr learned my addr 172.21.15.16:0/2614298427 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9cea00640 1 --2- 172.21.15.16:0/2614298427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0152d00 0x7fd9d00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.382+0000 7fd9cf400640 1 --2- 172.21.15.16:0/2614298427 >> v2:172.21.15.192:3300/0 conn(0x7fd9d0158a80 0x7fd9d0158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9c6000640 1 -- 172.21.15.16:0/2614298427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0152d00 msgr2=0x7fd9d00c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9c6000640 1 --2- 172.21.15.16:0/2614298427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0152d00 0x7fd9d00c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9c6000640 1 -- 172.21.15.16:0/2614298427 >> v2:172.21.15.192:3300/0 conn(0x7fd9d0158a80 msgr2=0x7fd9d0158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9c6000640 1 --2- 172.21.15.16:0/2614298427 >> v2:172.21.15.192:3300/0 conn(0x7fd9d0158a80 0x7fd9d0158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9c6000640 1 -- 172.21.15.16:0/2614298427 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d00c7240 con 0x7fd9d0073230 2024-04-26T20:14:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9c6000640 1 --2- 172.21.15.16:0/2614298427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0073230 0x7fd9d0073670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00c4540 tx=0x7fd9b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741f8923344c8e1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9ce000640 1 -- 172.21.15.16:0/2614298427 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80ab650 con 0x7fd9d0073230 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9ce000640 1 -- 172.21.15.16:0/2614298427 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b80b0070 con 0x7fd9d0073230 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9ce000640 1 -- 172.21.15.16:0/2614298427 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80aba10 con 0x7fd9d0073230 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 -- 172.21.15.16:0/2614298427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0073230 msgr2=0x7fd9d0073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2614298427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0073230 0x7fd9d0073670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00c4540 tx=0x7fd9b801c4f0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 -- 172.21.15.16:0/2614298427 shutdown_connections 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2614298427 >> v2:172.21.15.192:3300/0 conn(0x7fd9d0158a80 0x7fd9d0158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2614298427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0073230 0x7fd9d0073670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2614298427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0152d00 0x7fd9d00c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 -- 172.21.15.16:0/2614298427 >> 172.21.15.16:0/2614298427 conn(0x7fd9d00c9d10 msgr2=0x7fd9d00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 -- 172.21.15.16:0/2614298427 shutdown_connections 2024-04-26T20:14:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.386+0000 7fd9d5600640 1 -- 172.21.15.16:0/2614298427 wait complete. 2024-04-26T20:14:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 Processor -- start 2024-04-26T20:14:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 -- start start 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0073230 0x7fd9d01f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0152d00 0x7fd9d00c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d0158a80 0x7fd9d01482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00c4f90 con 0x7fd9d0152d00 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00c4e10 con 0x7fd9d0158a80 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d00c4710 con 0x7fd9d0073230 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0152d00 0x7fd9d00c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0152d00 0x7fd9d00c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34634/0 (socket says 172.21.15.16:34634) 2024-04-26T20:14:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 -- 172.21.15.16:0/2135455345 learned_addr learned my addr 172.21.15.16:0/2135455345 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:32.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9cf400640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d0158a80 0x7fd9d01482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9cea00640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0073230 0x7fd9d01f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 -- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0073230 msgr2=0x7fd9d01f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0073230 0x7fd9d01f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 -- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d0158a80 msgr2=0x7fd9d01482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d0158a80 0x7fd9d01482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 -- 172.21.15.16:0/2135455345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d0162bd0 con 0x7fd9d0152d00 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9cea00640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0073230 0x7fd9d01f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c6000640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0152d00 0x7fd9d00c6710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9b801aba0 tx=0x7fd9b801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c7400640 1 -- 172.21.15.16:0/2135455345 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80be5f0 con 0x7fd9d0152d00 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c7400640 1 -- 172.21.15.16:0/2135455345 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b80be790 con 0x7fd9d0152d00 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9c7400640 1 -- 172.21.15.16:0/2135455345 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80beb80 con 0x7fd9d0152d00 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d0162e90 con 0x7fd9d0152d00 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.390+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d0144030 con 0x7fd9d0152d00 2024-04-26T20:14:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.394+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d0077c20 con 0x7fd9d0152d00 2024-04-26T20:14:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.394+0000 7fd9c7400640 1 -- 172.21.15.16:0/2135455345 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9b80b43f0 con 0x7fd9d0152d00 2024-04-26T20:14:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.394+0000 7fd9c7400640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd9ac068380 0x7fd9ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.394+0000 7fd9c7400640 1 -- 172.21.15.16:0/2135455345 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd9b81215d0 con 0x7fd9d0152d00 2024-04-26T20:14:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.394+0000 7fd9cea00640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd9ac068380 0x7fd9ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.394+0000 7fd9cea00640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd9ac068380 0x7fd9ac06a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009fd0 tx=0x7fd9c000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.398+0000 7fd9c7400640 1 -- 172.21.15.16:0/2135455345 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd9b8016110 con 0x7fd9d0152d00 2024-04-26T20:14:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.574+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd9d014dac0 con 0x7fd9d0152d00 2024-04-26T20:14:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.574+0000 7fd9c7400640 1 -- 172.21.15.16:0/2135455345 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fd9b80f1200 con 0x7fd9d0152d00 2024-04-26T20:14:32.580 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-26T20:14:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd9ac068380 msgr2=0x7fd9ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd9ac068380 0x7fd9ac06a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009fd0 tx=0x7fd9c000d040 comp rx=0 tx=0).stop 2024-04-26T20:14:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0152d00 msgr2=0x7fd9d00c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0152d00 0x7fd9d00c6710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9b801aba0 tx=0x7fd9b801ad30 comp rx=0 tx=0).stop 2024-04-26T20:14:32.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 shutdown_connections 2024-04-26T20:14:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd9ac068380 0x7fd9ac06a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d0158a80 0x7fd9d01482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9d0152d00 0x7fd9d00c6710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 --2- 172.21.15.16:0/2135455345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9d0073230 0x7fd9d01f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 >> 172.21.15.16:0/2135455345 conn(0x7fd9d00c9d10 msgr2=0x7fd9d0070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 shutdown_connections 2024-04-26T20:14:32.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.578+0000 7fd9d5600640 1 -- 172.21.15.16:0/2135455345 wait complete. 2024-04-26T20:14:32.602 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi016.front.sepia.ceph.com... 2024-04-26T20:14:32.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:32.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T20:14:32.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:ceph-fuse[31948]: fuse finished with error 0 and tester_r 0 2024-04-26T20:14:32.636 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:14:32.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:14:32.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:32.689 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T20:14:32.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.878+0000 7fae9a800640 1 Processor -- start 2024-04-26T20:14:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.878+0000 7fae9a800640 1 -- start start 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae9a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae9415ca90 0x7fae94070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae9a800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae940712e0 0x7fae940ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae9a800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae940c9560 con 0x7fae941594f0 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae9a800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fae941598d0 con 0x7fae9415ca90 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae9a800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fae94160240 con 0x7fae940712e0 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae940712e0 0x7fae940ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae8aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae9415ca90 0x7fae94070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fae941594f0 0x7fae940c8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:33568/0 (socket says 172.21.15.16:33568) 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae940712e0 0x7fae940ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:53132/0 (socket says 172.21.15.16:53132) 2024-04-26T20:14:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93400640 1 -- 172.21.15.16:0/3902295032 learned_addr learned my addr 172.21.15.16:0/3902295032 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93e00640 1 -- 172.21.15.16:0/3902295032 >> v2:172.21.15.192:3300/0 conn(0x7fae9415ca90 msgr2=0x7fae94070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93e00640 1 --2- 172.21.15.16:0/3902295032 >> v2:172.21.15.192:3300/0 conn(0x7fae9415ca90 0x7fae94070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93e00640 1 -- 172.21.15.16:0/3902295032 >> v1:172.21.15.192:6789/0 conn(0x7fae941594f0 legacy=0x7fae940c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.882+0000 7fae93e00640 1 -- 172.21.15.16:0/3902295032 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9415f6c0 con 0x7fae940712e0 2024-04-26T20:14:32.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae93e00640 1 --2- 172.21.15.16:0/3902295032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae940712e0 0x7fae940ca170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0097c0 tx=0x7fae8c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7982415ec9f8ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae92a00640 1 -- 172.21.15.16:0/3902295032 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0b5070 con 0x7fae940712e0 2024-04-26T20:14:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae92a00640 1 -- 172.21.15.16:0/3902295032 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae8c0a8990 con 0x7fae940712e0 2024-04-26T20:14:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae92a00640 1 -- 172.21.15.16:0/3902295032 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0a8d60 con 0x7fae940712e0 2024-04-26T20:14:32.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- 172.21.15.16:0/3902295032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae940712e0 msgr2=0x7fae940ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 --2- 172.21.15.16:0/3902295032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae940712e0 0x7fae940ca170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0097c0 tx=0x7fae8c01ec90 comp rx=0 tx=0).stop 2024-04-26T20:14:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- 172.21.15.16:0/3902295032 shutdown_connections 2024-04-26T20:14:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 --2- 172.21.15.16:0/3902295032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae940712e0 0x7fae940ca170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 --2- 172.21.15.16:0/3902295032 >> v2:172.21.15.192:3300/0 conn(0x7fae9415ca90 0x7fae94070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- 172.21.15.16:0/3902295032 >> 172.21.15.16:0/3902295032 conn(0x7fae940ce2c0 msgr2=0x7fae940ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- 172.21.15.16:0/3902295032 shutdown_connections 2024-04-26T20:14:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- 172.21.15.16:0/3902295032 wait complete. 2024-04-26T20:14:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 Processor -- start 2024-04-26T20:14:32.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- start start 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae940712e0 0x7fae9415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae941594f0 0x7fae940c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae9415ca90 0x7fae9415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae9415ff60 con 0x7fae941594f0 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae9415fc80 con 0x7fae940712e0 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae9a800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fae940c9c50 con 0x7fae9415ca90 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.886+0000 7fae8aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae941594f0 0x7fae940c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae941594f0 0x7fae940c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34650/0 (socket says 172.21.15.16:34650) 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 -- 172.21.15.16:0/3479691598 learned_addr learned my addr 172.21.15.16:0/3479691598 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae93e00640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae9415ca90 0x7fae9415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae93400640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae940712e0 0x7fae9415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 -- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae9415ca90 msgr2=0x7fae9415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae9415ca90 0x7fae9415ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 -- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae940712e0 msgr2=0x7fae9415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae940712e0 0x7fae9415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 -- 172.21.15.16:0/3479691598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9415b6b0 con 0x7fae941594f0 2024-04-26T20:14:32.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8aa00640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae941594f0 0x7fae940c7d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00e8a0 tx=0x7fae7c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8be00640 1 -- 172.21.15.16:0/3479691598 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c017070 con 0x7fae941594f0 2024-04-26T20:14:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8be00640 1 -- 172.21.15.16:0/3479691598 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c00c940 con 0x7fae941594f0 2024-04-26T20:14:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8be00640 1 -- 172.21.15.16:0/3479691598 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00ccf0 con 0x7fae941594f0 2024-04-26T20:14:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae9415b970 con 0x7fae941594f0 2024-04-26T20:14:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae940c6cf0 con 0x7fae941594f0 2024-04-26T20:14:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae94077c20 con 0x7fae941594f0 2024-04-26T20:14:32.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8be00640 1 -- 172.21.15.16:0/3479691598 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae7c01a070 con 0x7fae941594f0 2024-04-26T20:14:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8be00640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fae70068380 0x7fae7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.890+0000 7fae8be00640 1 -- 172.21.15.16:0/3479691598 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fae7c086f50 con 0x7fae941594f0 2024-04-26T20:14:32.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.894+0000 7fae93400640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fae70068380 0x7fae7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:32.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.894+0000 7fae93400640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fae70068380 0x7fae7006a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae84005c10 tx=0x7fae84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:32.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:32.894+0000 7fae8be00640 1 -- 172.21.15.16:0/3479691598 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fae7c056ae0 con 0x7fae941594f0 2024-04-26T20:14:33.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.062+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae940c9990 con 0x7fae941594f0 2024-04-26T20:14:33.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.062+0000 7fae8be00640 1 -- 172.21.15.16:0/3479691598 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fae7c05ade0 con 0x7fae941594f0 2024-04-26T20:14:33.069 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:33.069 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:33.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fae70068380 msgr2=0x7fae7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fae70068380 0x7fae7006a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae84005c10 tx=0x7fae84009040 comp rx=0 tx=0).stop 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae941594f0 msgr2=0x7fae940c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae941594f0 0x7fae940c7d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00e8a0 tx=0x7fae7c00eca0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 shutdown_connections 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fae70068380 0x7fae7006a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae9415ca90 0x7fae9415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae941594f0 0x7fae940c7d30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 --2- 172.21.15.16:0/3479691598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae940712e0 0x7fae9415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 >> 172.21.15.16:0/3479691598 conn(0x7fae940ce2c0 msgr2=0x7fae94157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 shutdown_connections 2024-04-26T20:14:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.066+0000 7fae9a800640 1 -- 172.21.15.16:0/3479691598 wait complete. 2024-04-26T20:14:33.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.226+0000 7f3064400640 1 Processor -- start 2024-04-26T20:14:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.226+0000 7f3064400640 1 -- start start 2024-04-26T20:14:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3064400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f305c152bc0 0x7f305c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3064400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f305c152fa0 con 0x7f305c0c9340 2024-04-26T20:14:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3064400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f305c159790 con 0x7f305c073480 2024-04-26T20:14:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3064400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f305c158930 con 0x7f305c152bc0 2024-04-26T20:14:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3061000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f305c0c9340 0x7f305c072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35940/0 (socket says 172.21.15.16:35940) 2024-04-26T20:14:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3061000640 1 -- 172.21.15.16:0/2749726910 learned_addr learned my addr 172.21.15.16:0/2749726910 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3061a00640 1 --2- 172.21.15.16:0/2749726910 >> v2:172.21.15.192:3300/0 conn(0x7f305c152bc0 0x7f305c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f305be00640 1 -- 172.21.15.16:0/2749726910 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824091418 0 0) 0x7f305c152fa0 con 0x7f305c0c9340 2024-04-26T20:14:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f305be00640 1 -- 172.21.15.16:0/2749726910 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3044003530 con 0x7f305c0c9340 2024-04-26T20:14:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f305be00640 1 -- 172.21.15.16:0/2749726910 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3194686463 0 0) 0x7f3044003530 con 0x7f305c0c9340 2024-04-26T20:14:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3061a00640 1 -- 172.21.15.16:0/2749726910 >> v1:172.21.15.192:6789/0 conn(0x7f305c073480 legacy=0x7f305c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3061a00640 1 -- 172.21.15.16:0/2749726910 >> v1:172.21.15.16:6789/0 conn(0x7f305c0c9340 legacy=0x7f305c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.230+0000 7f3061a00640 1 -- 172.21.15.16:0/2749726910 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c158c10 con 0x7f305c152bc0 2024-04-26T20:14:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3061a00640 1 --2- 172.21.15.16:0/2749726910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 0x7f305c0c8e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30500097f0 tx=0x7f305001ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63bbd4b3f2254694 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f305be00640 1 -- 172.21.15.16:0/2749726910 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500b5070 con 0x7f305c152bc0 2024-04-26T20:14:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f305be00640 1 -- 172.21.15.16:0/2749726910 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30500a8670 con 0x7f305c152bc0 2024-04-26T20:14:33.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f305be00640 1 -- 172.21.15.16:0/2749726910 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048001680 con 0x7f305c152bc0 2024-04-26T20:14:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 -- 172.21.15.16:0/2749726910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 msgr2=0x7f305c0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 --2- 172.21.15.16:0/2749726910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 0x7f305c0c8e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30500097f0 tx=0x7f305001ebb0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 -- 172.21.15.16:0/2749726910 shutdown_connections 2024-04-26T20:14:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 --2- 172.21.15.16:0/2749726910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 0x7f305c0c8e00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 -- 172.21.15.16:0/2749726910 >> 172.21.15.16:0/2749726910 conn(0x7f305c06c380 msgr2=0x7f305c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 -- 172.21.15.16:0/2749726910 shutdown_connections 2024-04-26T20:14:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 -- 172.21.15.16:0/2749726910 wait complete. 2024-04-26T20:14:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 Processor -- start 2024-04-26T20:14:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.234+0000 7f3064400640 1 -- start start 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f305c073480 0x7f305c151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f305c0c9340 0x7f305c142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 0x7f305c142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f305c1594b0 con 0x7f305c073480 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f305c1591d0 con 0x7f305c152bc0 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f305c0c47d0 con 0x7f305c0c9340 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f305c073480 0x7f305c151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f305c073480 0x7f305c151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34656/0 (socket says 172.21.15.16:34656) 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 -- 172.21.15.16:0/3247182474 learned_addr learned my addr 172.21.15.16:0/3247182474 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061000640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f305c0c9340 0x7f305c142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3062400640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 0x7f305c142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 -- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f305c0c9340 msgr2=0x7f305c142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f305c0c9340 0x7f305c142a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 -- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 msgr2=0x7f305c142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 0x7f305c142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 -- 172.21.15.16:0/3247182474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305c157a20 con 0x7f305c073480 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3061a00640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f305c073480 0x7f305c151f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30500b3040 tx=0x7f305001b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3059600640 1 -- 172.21.15.16:0/3247182474 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500b5040 con 0x7f305c073480 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3059600640 1 -- 172.21.15.16:0/3247182474 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30500c0070 con 0x7f305c073480 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3059600640 1 -- 172.21.15.16:0/3247182474 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500b0860 con 0x7f305c073480 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305c157460 con 0x7f305c073480 2024-04-26T20:14:33.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305c0cb020 con 0x7f305c073480 2024-04-26T20:14:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305c077c20 con 0x7f305c073480 2024-04-26T20:14:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.238+0000 7f3059600640 1 -- 172.21.15.16:0/3247182474 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30500b0a00 con 0x7f305c073480 2024-04-26T20:14:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.242+0000 7f3059600640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f303c068380 0x7f303c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.242+0000 7f3059600640 1 -- 172.21.15.16:0/3247182474 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3050124180 con 0x7f305c073480 2024-04-26T20:14:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.242+0000 7f3061000640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f303c068380 0x7f303c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.242+0000 7f3061000640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f303c068380 0x7f303c06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f305c148cd0 tx=0x7f3048009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:33.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.246+0000 7f3059600640 1 -- 172.21.15.16:0/3247182474 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3050018750 con 0x7f305c073480 2024-04-26T20:14:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.410+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f305c0c9940 con 0x7f305c073480 2024-04-26T20:14:33.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.410+0000 7f3059600640 1 -- 172.21.15.16:0/3247182474 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f30500f4510 con 0x7f305c073480 2024-04-26T20:14:33.417 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:33.417 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f303c068380 msgr2=0x7f303c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f303c068380 0x7f303c06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f305c148cd0 tx=0x7f3048009040 comp rx=0 tx=0).stop 2024-04-26T20:14:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f305c073480 msgr2=0x7f305c151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f305c073480 0x7f305c151f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30500b3040 tx=0x7f305001b950 comp rx=0 tx=0).stop 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 shutdown_connections 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f303c068380 0x7f303c06a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f305c152bc0 0x7f305c142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f305c0c9340 0x7f305c142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 --2- 172.21.15.16:0/3247182474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f305c073480 0x7f305c151f20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 >> 172.21.15.16:0/3247182474 conn(0x7f305c06c380 msgr2=0x7f305c0c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 shutdown_connections 2024-04-26T20:14:33.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.414+0000 7f3064400640 1 -- 172.21.15.16:0/3247182474 wait complete. 2024-04-26T20:14:33.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T20:14:33.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de7800640 1 Processor -- start 2024-04-26T20:14:33.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de7800640 1 -- start start 2024-04-26T20:14:33.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de7800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1de015d8a0 0x7f1de0165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de7800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de00c49e0 con 0x7f1de0157250 2024-04-26T20:14:33.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de7800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de00caf80 con 0x7f1de00c44a0 2024-04-26T20:14:33.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de7800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f1de00cbb50 con 0x7f1de015d8a0 2024-04-26T20:14:33.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1de0157250 0x7f1de006ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35954/0 (socket says 172.21.15.16:35954) 2024-04-26T20:14:33.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 -- 172.21.15.16:0/2693387870 learned_addr learned my addr 172.21.15.16:0/2693387870 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:33.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de5800640 1 --2- 172.21.15.16:0/2693387870 >> v2:172.21.15.192:3300/0 conn(0x7f1de015d8a0 0x7f1de0165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776064133 0 0) 0x7f1de00c49e0 con 0x7f1de0157250 2024-04-26T20:14:33.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc8003530 con 0x7f1de0157250 2024-04-26T20:14:33.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 528050759 0 0) 0x7f1dc8003530 con 0x7f1de0157250 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 >> v2:172.21.15.192:3300/0 conn(0x7f1de015d8a0 msgr2=0x7f1de0165440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 --2- 172.21.15.16:0/2693387870 >> v2:172.21.15.192:3300/0 conn(0x7f1de015d8a0 0x7f1de0165440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 >> v1:172.21.15.192:6789/0 conn(0x7f1de00c44a0 legacy=0x7f1de015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de00c6450 con 0x7f1de0157250 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f1dd4001680 con 0x7f1de0157250 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 >> v1:172.21.15.16:6789/0 conn(0x7f1de0157250 legacy=0x7f1de006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1dc80039c0 0x7f1dc8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc8004810 0x7f1dc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc8005220 0x7f1dc800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1de00cbb50 con 0x7f1dc80039c0 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc800c150 con 0x7f1dc8004810 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc800c350 con 0x7f1dc8005220 2024-04-26T20:14:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1dc80039c0 0x7f1dc8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1ddfe00640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc8004810 0x7f1dc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de5800640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc8005220 0x7f1dc800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 -- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc8005220 msgr2=0x7f1dc800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc8005220 0x7f1dc800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 -- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc8004810 msgr2=0x7f1dc8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc8004810 0x7f1dc8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de4e00640 1 -- 172.21.15.16:0/2693387870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc8003530 con 0x7f1dc80039c0 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.578+0000 7f1de5800640 1 -- 172.21.15.16:0/2693387870 reap_dead start 2024-04-26T20:14:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de4e00640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1dc80039c0 0x7f1dc8003e00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c210 tx=0x7f1dd401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485045d17aefb3d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4007d40 con 0x7f1dc80039c0 2024-04-26T20:14:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd40a9070 con 0x7f1dc80039c0 2024-04-26T20:14:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1ddf400640 1 -- 172.21.15.16:0/2693387870 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4005d80 con 0x7f1dc80039c0 2024-04-26T20:14:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de7800640 1 -- 172.21.15.16:0/2693387870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1dc80039c0 msgr2=0x7f1dc8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de7800640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1dc80039c0 0x7f1dc8003e00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c210 tx=0x7f1dd401cc20 comp rx=0 tx=0).stop 2024-04-26T20:14:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de7800640 1 -- 172.21.15.16:0/2693387870 shutdown_connections 2024-04-26T20:14:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de7800640 1 --2- 172.21.15.16:0/2693387870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1dc80039c0 0x7f1dc8003e00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de7800640 1 -- 172.21.15.16:0/2693387870 >> 172.21.15.16:0/2693387870 conn(0x7f1de0068140 msgr2=0x7f1de0068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de7800640 1 -- 172.21.15.16:0/2693387870 shutdown_connections 2024-04-26T20:14:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.582+0000 7f1de7800640 1 -- 172.21.15.16:0/2693387870 wait complete. 2024-04-26T20:14:33.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 Processor -- start 2024-04-26T20:14:33.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 -- start start 2024-04-26T20:14:33.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc80039c0 0x7f1de01528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de015acf0 0x7f1de0152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1de014dca0 0x7f1de00b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1de00706e0 con 0x7f1de015acf0 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1de0157630 con 0x7f1de014dca0 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1de015d580 con 0x7f1dc80039c0 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de015acf0 0x7f1de0152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de015acf0 0x7f1de0152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34678/0 (socket says 172.21.15.16:34678) 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 -- 172.21.15.16:0/1613814736 learned_addr learned my addr 172.21.15.16:0/1613814736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de5800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1de014dca0 0x7f1de00b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de4e00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc80039c0 0x7f1de01528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 -- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc80039c0 msgr2=0x7f1de01528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc80039c0 0x7f1de01528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 -- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1de014dca0 msgr2=0x7f1de00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1de014dca0 0x7f1de00b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 -- 172.21.15.16:0/1613814736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de01f5680 con 0x7f1de015acf0 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de5800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1de014dca0 0x7f1de00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de4e00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc80039c0 0x7f1de01528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddfe00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de015acf0 0x7f1de0152e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00f540 tx=0x7f1dcc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddcc00640 1 -- 172.21.15.16:0/1613814736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc01a070 con 0x7f1de015acf0 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddcc00640 1 -- 172.21.15.16:0/1613814736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc005320 con 0x7f1de015acf0 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1ddcc00640 1 -- 172.21.15.16:0/1613814736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc007290 con 0x7f1de015acf0 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de00afa50 con 0x7f1de015acf0 2024-04-26T20:14:33.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.586+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de00b0010 con 0x7f1de015acf0 2024-04-26T20:14:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.590+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de0077c20 con 0x7f1de015acf0 2024-04-26T20:14:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.590+0000 7f1ddcc00640 1 -- 172.21.15.16:0/1613814736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1dcc007430 con 0x7f1de015acf0 2024-04-26T20:14:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.590+0000 7f1ddcc00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1dc0068380 0x7f1dc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.590+0000 7f1ddcc00640 1 -- 172.21.15.16:0/1613814736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1dcc086460 con 0x7f1de015acf0 2024-04-26T20:14:33.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.590+0000 7f1de4e00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1dc0068380 0x7f1dc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:33.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.590+0000 7f1de4e00640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1dc0068380 0x7f1dc006a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ab000 tx=0x7f1dd40b0040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:33.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.594+0000 7f1ddcc00640 1 -- 172.21.15.16:0/1613814736 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1dcc0565b0 con 0x7f1de015acf0 2024-04-26T20:14:33.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:33.794+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1de00ca540 con 0x7f1de015acf0 2024-04-26T20:14:34.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.038+0000 7f1ddcc00640 1 -- 172.21.15.16:0/1613814736 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f1dcc055eb0 con 0x7f1de015acf0 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1dc0068380 msgr2=0x7f1dc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1dc0068380 0x7f1dc006a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40ab000 tx=0x7f1dd40b0040 comp rx=0 tx=0).stop 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de015acf0 msgr2=0x7f1de0152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de015acf0 0x7f1de0152e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00f540 tx=0x7f1dcc00fa00 comp rx=0 tx=0).stop 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 shutdown_connections 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1dc0068380 0x7f1dc006a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1de014dca0 0x7f1de00b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de015acf0 0x7f1de0152e10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 --2- 172.21.15.16:0/1613814736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc80039c0 0x7f1de01528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 >> 172.21.15.16:0/1613814736 conn(0x7f1de0068140 msgr2=0x7f1de00b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 shutdown_connections 2024-04-26T20:14:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.042+0000 7f1de7800640 1 -- 172.21.15.16:0/1613814736 wait complete. 2024-04-26T20:14:34.069 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-04-26T20:14:34.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-26T20:14:34.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.206+0000 7f5185000640 1 Processor -- start 2024-04-26T20:14:34.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.206+0000 7f5185000640 1 -- start start 2024-04-26T20:14:34.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f5185000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180152d00 0x7f51800c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f5185000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f518015c070 0x7f518015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f5185000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51800c4b30 con 0x7f5180073230 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f5185000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f51800c6f60 con 0x7f518015c070 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f5185000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f51800c7240 con 0x7f5180152d00 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f517e800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f518015c070 0x7f518015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f5175400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5180073230 0x7f5180073670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35956/0 (socket says 172.21.15.16:35956) 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f5175400640 1 -- 172.21.15.16:0/2705339214 learned_addr learned my addr 172.21.15.16:0/2705339214 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f517de00640 1 --2- 172.21.15.16:0/2705339214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180152d00 0x7f51800c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f517e800640 1 -- 172.21.15.16:0/2705339214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180152d00 msgr2=0x7f51800c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f517e800640 1 --2- 172.21.15.16:0/2705339214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180152d00 0x7f51800c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f517e800640 1 -- 172.21.15.16:0/2705339214 >> v1:172.21.15.16:6789/0 conn(0x7f5180073230 legacy=0x7f5180073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.210+0000 7f517e800640 1 -- 172.21.15.16:0/2705339214 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51800c7520 con 0x7f518015c070 2024-04-26T20:14:34.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f517e800640 1 --2- 172.21.15.16:0/2705339214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f518015c4a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5178009d90 tx=0x7f517801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0af1bcb2de098a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:34.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f517d400640 1 -- 172.21.15.16:0/2705339214 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51780b2070 con 0x7f518015c070 2024-04-26T20:14:34.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f517d400640 1 -- 172.21.15.16:0/2705339214 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51780a59d0 con 0x7f518015c070 2024-04-26T20:14:34.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f517d400640 1 -- 172.21.15.16:0/2705339214 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51780a5da0 con 0x7f518015c070 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- 172.21.15.16:0/2705339214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 msgr2=0x7f518015c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 --2- 172.21.15.16:0/2705339214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f518015c4a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5178009d90 tx=0x7f517801c970 comp rx=0 tx=0).stop 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- 172.21.15.16:0/2705339214 shutdown_connections 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 --2- 172.21.15.16:0/2705339214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f518015c4a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 --2- 172.21.15.16:0/2705339214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180152d00 0x7f51800c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- 172.21.15.16:0/2705339214 >> 172.21.15.16:0/2705339214 conn(0x7f51800c9d10 msgr2=0x7f51800ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- 172.21.15.16:0/2705339214 shutdown_connections 2024-04-26T20:14:34.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- 172.21.15.16:0/2705339214 wait complete. 2024-04-26T20:14:34.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 Processor -- start 2024-04-26T20:14:34.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- start start 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180073230 0x7f5180148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5180152d00 0x7f51801f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f51801f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f518015cf70 con 0x7f518015c070 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f518015cdf0 con 0x7f5180152d00 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.214+0000 7f5185000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5180165c20 con 0x7f5180073230 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f51801f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f51801f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34694/0 (socket says 172.21.15.16:34694) 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 -- 172.21.15.16:0/2950780144 learned_addr learned my addr 172.21.15.16:0/2950780144 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517de00640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180073230 0x7f5180148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5175400640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5180152d00 0x7f51801f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 -- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180073230 msgr2=0x7f5180148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180073230 0x7f5180148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 -- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5180152d00 msgr2=0x7f51801f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5180152d00 0x7f51801f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 -- 172.21.15.16:0/2950780144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5180157bd0 con 0x7f518015c070 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5175400640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5180152d00 0x7f51801f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f517e800640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f51801f6ac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5178009d90 tx=0x7f5178019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5176a00640 1 -- 172.21.15.16:0/2950780144 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51780b2050 con 0x7f518015c070 2024-04-26T20:14:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5176a00640 1 -- 172.21.15.16:0/2950780144 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51780be070 con 0x7f518015c070 2024-04-26T20:14:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5176a00640 1 -- 172.21.15.16:0/2950780144 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51780adb10 con 0x7f518015c070 2024-04-26T20:14:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518014d510 con 0x7f518015c070 2024-04-26T20:14:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518014dad0 con 0x7f518015c070 2024-04-26T20:14:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5180073670 con 0x7f518015c070 2024-04-26T20:14:34.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.218+0000 7f5176a00640 1 -- 172.21.15.16:0/2950780144 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51780adcb0 con 0x7f518015c070 2024-04-26T20:14:34.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.222+0000 7f5176a00640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f515c068380 0x7f515c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:34.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.222+0000 7f5176a00640 1 -- 172.21.15.16:0/2950780144 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f51781220d0 con 0x7f518015c070 2024-04-26T20:14:34.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.222+0000 7f517de00640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f515c068380 0x7f515c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.222+0000 7f517de00640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f515c068380 0x7f515c06a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f517000b9d0 tx=0x7f5170008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.226+0000 7f5176a00640 1 -- 172.21.15.16:0/2950780144 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5178016560 con 0x7f518015c070 2024-04-26T20:14:34.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:34.426+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f518006fc20 con 0x7f518015c070 2024-04-26T20:14:35.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.050+0000 7f5176a00640 1 -- 172.21.15.16:0/2950780144 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f51780f23e0 con 0x7f518015c070 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f515c068380 msgr2=0x7f515c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f515c068380 0x7f515c06a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f517000b9d0 tx=0x7f5170008040 comp rx=0 tx=0).stop 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 msgr2=0x7f51801f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f51801f6ac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5178009d90 tx=0x7f5178019710 comp rx=0 tx=0).stop 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 shutdown_connections 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f515c068380 0x7f515c06a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f518015c070 0x7f51801f6ac0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5180152d00 0x7f51801f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 --2- 172.21.15.16:0/2950780144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5180073230 0x7f5180148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:35.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 >> 172.21.15.16:0/2950780144 conn(0x7f51800c9d10 msgr2=0x7f51800cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 shutdown_connections 2024-04-26T20:14:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.054+0000 7f5185000640 1 -- 172.21.15.16:0/2950780144 wait complete. 2024-04-26T20:14:35.084 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T20:14:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.226+0000 7fa8a1e00640 1 Processor -- start 2024-04-26T20:14:35.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.226+0000 7fa8a1e00640 1 -- start start 2024-04-26T20:14:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa89c15d9f0 0x7fa89c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89c0b5120 con 0x7fa89c0d1df0 2024-04-26T20:14:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89c0b5400 con 0x7fa89c0d1a10 2024-04-26T20:14:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa89c15cd40 con 0x7fa89c15d9f0 2024-04-26T20:14:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa89c15d9f0 0x7fa89c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa89be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa89c0d1df0 0x7fa89c15d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41720/0 (socket says 172.21.15.16:41720) 2024-04-26T20:14:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa89be00640 1 -- 172.21.15.16:0/576925174 learned_addr learned my addr 172.21.15.16:0/576925174 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:35.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1400640 1 -- 172.21.15.16:0/576925174 >> v1:172.21.15.192:6789/0 conn(0x7fa89c0d1a10 legacy=0x7fa89c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:35.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1400640 1 -- 172.21.15.16:0/576925174 >> v1:172.21.15.16:6789/0 conn(0x7fa89c0d1df0 legacy=0x7fa89c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:35.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1400640 1 -- 172.21.15.16:0/576925174 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89c0b56e0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.230+0000 7fa8a1400640 1 --2- 172.21.15.16:0/576925174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c1559f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa894009d90 tx=0x7fa89401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f67d4a71601dd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:35.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa89b400640 1 -- 172.21.15.16:0/576925174 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8940b4070 con 0x7fa89c15d9f0 2024-04-26T20:14:35.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa89b400640 1 -- 172.21.15.16:0/576925174 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8940af600 con 0x7fa89c15d9f0 2024-04-26T20:14:35.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa89b400640 1 -- 172.21.15.16:0/576925174 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8940af9d0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- 172.21.15.16:0/576925174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 msgr2=0x7fa89c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:35.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/576925174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c1559f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa894009d90 tx=0x7fa89401f150 comp rx=0 tx=0).stop 2024-04-26T20:14:35.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- 172.21.15.16:0/576925174 shutdown_connections 2024-04-26T20:14:35.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/576925174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c1559f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:35.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- 172.21.15.16:0/576925174 >> 172.21.15.16:0/576925174 conn(0x7fa89c06d090 msgr2=0x7fa89c06d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:35.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- 172.21.15.16:0/576925174 shutdown_connections 2024-04-26T20:14:35.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- 172.21.15.16:0/576925174 wait complete. 2024-04-26T20:14:35.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 Processor -- start 2024-04-26T20:14:35.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- start start 2024-04-26T20:14:35.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa89c0d1a10 0x7fa89c0683a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:35.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa89c0d1df0 0x7fa89c1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:35.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:35.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c0b4d10 con 0x7fa89c15d9f0 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c0b5ca0 con 0x7fa89c0d1a10 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa89c0b4e90 con 0x7fa89c0d1df0 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53432/0 (socket says 172.21.15.16:53432) 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a1400640 1 -- 172.21.15.16:0/343224621 learned_addr learned my addr 172.21.15.16:0/343224621 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa89be00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa89c0d1df0 0x7fa89c1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.234+0000 7fa8a0a00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa89c0d1a10 0x7fa89c0683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1400640 1 -- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa89c0d1df0 msgr2=0x7fa89c1f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1400640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa89c0d1df0 0x7fa89c1f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1400640 1 -- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa89c0d1a10 msgr2=0x7fa89c0683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1400640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa89c0d1a10 0x7fa89c0683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1400640 1 -- 172.21.15.16:0/343224621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89c1f17d0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a0a00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa89c0d1a10 0x7fa89c0683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:35.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1400640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c152470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8940b2040 tx=0x7fa89401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:35.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa898c00640 1 -- 172.21.15.16:0/343224621 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8940b4040 con 0x7fa89c15d9f0 2024-04-26T20:14:35.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa898c00640 1 -- 172.21.15.16:0/343224621 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8940c1070 con 0x7fa89c15d9f0 2024-04-26T20:14:35.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa898c00640 1 -- 172.21.15.16:0/343224621 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8940ba6b0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89c1f5200 con 0x7fa89c15d9f0 2024-04-26T20:14:35.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89c1f57c0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89c0506d0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa898c00640 1 -- 172.21.15.16:0/343224621 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8940ba850 con 0x7fa89c15d9f0 2024-04-26T20:14:35.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa898c00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa87c068380 0x7fa87c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:35.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.238+0000 7fa898c00640 1 -- 172.21.15.16:0/343224621 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa8941256b0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.242+0000 7fa8a0a00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa87c068380 0x7fa87c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:35.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.242+0000 7fa8a0a00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa87c068380 0x7fa87c06a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa890000f70 tx=0x7fa890009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:35.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.242+0000 7fa898c00640 1 -- 172.21.15.16:0/343224621 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa894018cb0 con 0x7fa89c15d9f0 2024-04-26T20:14:35.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:35.450+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa89c15d4c0 con 0x7fa89c15d9f0 2024-04-26T20:14:36.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.062+0000 7fa898c00640 1 -- 172.21.15.16:0/343224621 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fa8940f5a70 con 0x7fa89c15d9f0 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa87c068380 msgr2=0x7fa87c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa87c068380 0x7fa87c06a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa890000f70 tx=0x7fa890009040 comp rx=0 tx=0).stop 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 msgr2=0x7fa89c152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c152470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8940b2040 tx=0x7fa89401bef0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 shutdown_connections 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa87c068380 0x7fa87c06a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa89c15d9f0 0x7fa89c152470 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa89c0d1df0 0x7fa89c1f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 --2- 172.21.15.16:0/343224621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa89c0d1a10 0x7fa89c0683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 >> 172.21.15.16:0/343224621 conn(0x7fa89c06d090 msgr2=0x7fa89c15bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 shutdown_connections 2024-04-26T20:14:36.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.066+0000 7fa8a1e00640 1 -- 172.21.15.16:0/343224621 wait complete. 2024-04-26T20:14:36.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-26T20:14:36.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d3600640 1 Processor -- start 2024-04-26T20:14:36.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d3600640 1 -- start start 2024-04-26T20:14:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d3600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72cc15d8a0 0x7f72cc165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d3600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72cc0c49e0 con 0x7f72cc0c44a0 2024-04-26T20:14:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d3600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72cc0caf80 con 0x7f72cc157250 2024-04-26T20:14:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d3600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f72cc0cbb50 con 0x7f72cc15d8a0 2024-04-26T20:14:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72cbe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f72cc0c44a0 0x7f72cc15d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41730/0 (socket says 172.21.15.16:41730) 2024-04-26T20:14:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72cbe00640 1 -- 172.21.15.16:0/2689354538 learned_addr learned my addr 172.21.15.16:0/2689354538 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d1600640 1 --2- 172.21.15.16:0/2689354538 >> v2:172.21.15.192:3300/0 conn(0x7f72cc15d8a0 0x7f72cc165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72cb400640 1 -- 172.21.15.16:0/2689354538 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623227715 0 0) 0x7f72cc0c49e0 con 0x7f72cc0c44a0 2024-04-26T20:14:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72cb400640 1 -- 172.21.15.16:0/2689354538 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72b0003530 con 0x7f72cc0c44a0 2024-04-26T20:14:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72cb400640 1 -- 172.21.15.16:0/2689354538 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3736170326 0 0) 0x7f72b0003530 con 0x7f72cc0c44a0 2024-04-26T20:14:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d1600640 1 -- 172.21.15.16:0/2689354538 >> v1:172.21.15.192:6789/0 conn(0x7f72cc157250 legacy=0x7f72cc06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d1600640 1 -- 172.21.15.16:0/2689354538 >> v1:172.21.15.16:6789/0 conn(0x7f72cc0c44a0 legacy=0x7f72cc15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.238+0000 7f72d1600640 1 -- 172.21.15.16:0/2689354538 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc0c6450 con 0x7f72cc15d8a0 2024-04-26T20:14:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d1600640 1 --2- 172.21.15.16:0/2689354538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc15d8a0 0x7f72cc165440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0cbcd0 tx=0x7f72c401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=563798225eed0082 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72cb400640 1 -- 172.21.15.16:0/2689354538 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40b2070 con 0x7f72cc15d8a0 2024-04-26T20:14:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72cb400640 1 -- 172.21.15.16:0/2689354538 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c40a5510 con 0x7f72cc15d8a0 2024-04-26T20:14:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72cb400640 1 -- 172.21.15.16:0/2689354538 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8001680 con 0x7f72cc15d8a0 2024-04-26T20:14:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d3600640 1 -- 172.21.15.16:0/2689354538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc15d8a0 msgr2=0x7f72cc165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d3600640 1 --2- 172.21.15.16:0/2689354538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc15d8a0 0x7f72cc165440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0cbcd0 tx=0x7f72c401c7e0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d3600640 1 -- 172.21.15.16:0/2689354538 shutdown_connections 2024-04-26T20:14:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d3600640 1 --2- 172.21.15.16:0/2689354538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc15d8a0 0x7f72cc165440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d3600640 1 -- 172.21.15.16:0/2689354538 >> 172.21.15.16:0/2689354538 conn(0x7f72cc068140 msgr2=0x7f72cc068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d3600640 1 -- 172.21.15.16:0/2689354538 shutdown_connections 2024-04-26T20:14:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.242+0000 7f72d3600640 1 -- 172.21.15.16:0/2689354538 wait complete. 2024-04-26T20:14:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 Processor -- start 2024-04-26T20:14:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 -- start start 2024-04-26T20:14:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72cc0c44a0 0x7f72cc1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc157250 0x7f72cc0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72cc15d8a0 0x7f72cc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc0b26c0 con 0x7f72cc0c44a0 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc157670 con 0x7f72cc157250 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f72cc0b2840 con 0x7f72cc15d8a0 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72cc0c44a0 0x7f72cc1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d1600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72cc15d8a0 0x7f72cc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72cc0c44a0 0x7f72cc1552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53436/0 (socket says 172.21.15.16:53436) 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 -- 172.21.15.16:0/3968732100 learned_addr learned my addr 172.21.15.16:0/3968732100 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:36.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72cbe00640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc157250 0x7f72cc0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:36.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 -- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72cc15d8a0 msgr2=0x7f72cc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:36.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72cc15d8a0 0x7f72cc0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 -- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc157250 msgr2=0x7f72cc0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc157250 0x7f72cc0cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 -- 172.21.15.16:0/3968732100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc1f28f0 con 0x7f72cc0c44a0 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d0c00640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72cc0c44a0 0x7f72cc1552d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c480 tx=0x7f72bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72c8c00640 1 -- 172.21.15.16:0/3968732100 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0052d0 con 0x7f72cc0c44a0 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72c8c00640 1 -- 172.21.15.16:0/3968732100 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc005490 con 0x7f72cc0c44a0 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc1f2b90 con 0x7f72cc0c44a0 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72c8c00640 1 -- 172.21.15.16:0/3968732100 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc012850 con 0x7f72cc0c44a0 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.246+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc1f3150 con 0x7f72cc0c44a0 2024-04-26T20:14:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.250+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72cc077c20 con 0x7f72cc0c44a0 2024-04-26T20:14:36.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.250+0000 7f72c8c00640 1 -- 172.21.15.16:0/3968732100 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72bc0129f0 con 0x7f72cc0c44a0 2024-04-26T20:14:36.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.250+0000 7f72c8c00640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f72ac0683b0 0x7f72ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:36.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.250+0000 7f72c8c00640 1 -- 172.21.15.16:0/3968732100 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f72bc086850 con 0x7f72cc0c44a0 2024-04-26T20:14:36.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.250+0000 7f72cbe00640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f72ac0683b0 0x7f72ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:36.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.250+0000 7f72cbe00640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f72ac0683b0 0x7f72ac06a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f72cc155bf0 tx=0x7f72b8005800 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:36.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.254+0000 7f72c8c00640 1 -- 172.21.15.16:0/3968732100 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f72bc056470 con 0x7f72cc0c44a0 2024-04-26T20:14:36.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:36.454+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f72cc0b4a30 con 0x7f72cc0c44a0 2024-04-26T20:14:37.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.070+0000 7f72c8c00640 1 -- 172.21.15.16:0/3968732100 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f72bc05a770 con 0x7f72cc0c44a0 2024-04-26T20:14:37.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f72ac0683b0 msgr2=0x7f72ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f72ac0683b0 0x7f72ac06a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f72cc155bf0 tx=0x7f72b8005800 comp rx=0 tx=0).stop 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72cc0c44a0 msgr2=0x7f72cc1552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72cc0c44a0 0x7f72cc1552d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00c480 tx=0x7f72bc00c940 comp rx=0 tx=0).stop 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 shutdown_connections 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f72ac0683b0 0x7f72ac06a870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72cc15d8a0 0x7f72cc0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72cc157250 0x7f72cc0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 --2- 172.21.15.16:0/3968732100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72cc0c44a0 0x7f72cc1552d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 >> 172.21.15.16:0/3968732100 conn(0x7f72cc068140 msgr2=0x7f72cc06ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 shutdown_connections 2024-04-26T20:14:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.074+0000 7f72d3600640 1 -- 172.21.15.16:0/3968732100 wait complete. 2024-04-26T20:14:37.101 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T20:14:37.101 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.242+0000 7f910be00640 1 Processor -- start 2024-04-26T20:14:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.242+0000 7f910be00640 1 -- start start 2024-04-26T20:14:37.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910be00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f910c0b1d90 0x7f910c15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910be00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910c070ce0 con 0x7f910c0cf290 2024-04-26T20:14:37.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910be00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f910c070fc0 con 0x7f910c0b1d90 2024-04-26T20:14:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910be00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0ca6f0 con 0x7f910c0c5b50 2024-04-26T20:14:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f910c0cf290 0x7f910c15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41734/0 (socket says 172.21.15.16:41734) 2024-04-26T20:14:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910b400640 1 -- 172.21.15.16:0/2964666140 learned_addr learned my addr 172.21.15.16:0/2964666140 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f9102000640 1 --2- 172.21.15.16:0/2964666140 >> v2:172.21.15.192:3300/0 conn(0x7f910c0b1d90 0x7f910c15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910aa00640 1 --2- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910a000640 1 -- 172.21.15.16:0/2964666140 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823260804 0 0) 0x7f910c070ce0 con 0x7f910c0cf290 2024-04-26T20:14:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910a000640 1 -- 172.21.15.16:0/2964666140 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f0003530 con 0x7f910c0cf290 2024-04-26T20:14:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f9102000640 1 -- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 msgr2=0x7f910c0c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f9102000640 1 --2- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c0c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f9102000640 1 -- 172.21.15.16:0/2964666140 >> v1:172.21.15.16:6789/0 conn(0x7f910c0cf290 legacy=0x7f910c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910a000640 1 -- 172.21.15.16:0/2964666140 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2414783053 0 0) 0x7f90f0003530 con 0x7f910c0cf290 2024-04-26T20:14:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f9102000640 1 -- 172.21.15.16:0/2964666140 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0ca9d0 con 0x7f910c0b1d90 2024-04-26T20:14:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.246+0000 7f910aa00640 1 --2- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:37.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f9102000640 1 --2- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 0x7f910c15bcc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f90f40097c0 tx=0x7f90f401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b915c983a66d974 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910a000640 1 -- 172.21.15.16:0/2964666140 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40b5070 con 0x7f910c0b1d90 2024-04-26T20:14:37.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910a000640 1 -- 172.21.15.16:0/2964666140 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f40a85f0 con 0x7f910c0b1d90 2024-04-26T20:14:37.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910a000640 1 -- 172.21.15.16:0/2964666140 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104001680 con 0x7f910c0b1d90 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 -- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 msgr2=0x7f910c15bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 --2- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 0x7f910c15bcc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f90f40097c0 tx=0x7f90f401ebb0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 -- 172.21.15.16:0/2964666140 shutdown_connections 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 --2- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 0x7f910c15bcc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 --2- 172.21.15.16:0/2964666140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 -- 172.21.15.16:0/2964666140 >> 172.21.15.16:0/2964666140 conn(0x7f910c06c7b0 msgr2=0x7f910c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 -- 172.21.15.16:0/2964666140 shutdown_connections 2024-04-26T20:14:37.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 -- 172.21.15.16:0/2964666140 wait complete. 2024-04-26T20:14:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 Processor -- start 2024-04-26T20:14:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 -- start start 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 0x7f910c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f910c0cf290 0x7f910c14e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.250+0000 7f910be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f910c15c380 con 0x7f910c0cf290 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910be00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f910c15c200 con 0x7f910c0b1d90 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910be00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0caef0 con 0x7f910c0c5b50 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f910c0cf290 0x7f910c14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f910c0cf290 0x7f910c14e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53444/0 (socket says 172.21.15.16:53444) 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 -- 172.21.15.16:0/3540319047 learned_addr learned my addr 172.21.15.16:0/3540319047 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f9102000640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910aa00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 0x7f910c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 -- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 msgr2=0x7f910c154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 -- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 msgr2=0x7f910c0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 0x7f910c0b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 -- 172.21.15.16:0/3540319047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c159500 con 0x7f910c0cf290 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910b400640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f910c0cf290 0x7f910c14e830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f910400c5d0 tx=0x7f910400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f9103e00640 1 -- 172.21.15.16:0/3540319047 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104005cf0 con 0x7f910c0cf290 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f9103e00640 1 -- 172.21.15.16:0/3540319047 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104007070 con 0x7f910c0cf290 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c0b0f60 con 0x7f910c0cf290 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f9103e00640 1 -- 172.21.15.16:0/3540319047 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104007460 con 0x7f910c0cf290 2024-04-26T20:14:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c0b3bb0 con 0x7f910c0cf290 2024-04-26T20:14:37.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910c0506d0 con 0x7f910c0cf290 2024-04-26T20:14:37.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.254+0000 7f9103e00640 1 -- 172.21.15.16:0/3540319047 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9104007600 con 0x7f910c0cf290 2024-04-26T20:14:37.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.258+0000 7f9103e00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f90e8068380 0x7f90e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.258+0000 7f9103e00640 1 -- 172.21.15.16:0/3540319047 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9104086900 con 0x7f910c0cf290 2024-04-26T20:14:37.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.258+0000 7f910aa00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f90e8068380 0x7f90e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.258+0000 7f910aa00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f90e8068380 0x7f90e806a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009bd0 tx=0x7f90fc00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.262+0000 7f9103e00640 1 -- 172.21.15.16:0/3540319047 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f91040565c0 con 0x7f910c0cf290 2024-04-26T20:14:37.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.462+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f910c0c6060 con 0x7f910c0cf290 2024-04-26T20:14:37.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.462+0000 7f9103e00640 1 -- 172.21.15.16:0/3540319047 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6853 (secure 0 0 0) 0x7f910405a8c0 con 0x7f910c0cf290 2024-04-26T20:14:37.468 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:37.468 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:36.461130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4279,"mds_1":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-26T20:14:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 11 2024-04-26T20:14:37.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f90e8068380 msgr2=0x7f90e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f90e8068380 0x7f90e806a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009bd0 tx=0x7f90fc00b040 comp rx=0 tx=0).stop 2024-04-26T20:14:37.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f910c0cf290 msgr2=0x7f910c14e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f910c0cf290 0x7f910c14e830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f910400c5d0 tx=0x7f910400ca90 comp rx=0 tx=0).stop 2024-04-26T20:14:37.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 shutdown_connections 2024-04-26T20:14:37.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f90e8068380 0x7f90e806a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f910c0cf290 0x7f910c14e830 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f910c0c5b50 0x7f910c154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 --2- 172.21.15.16:0/3540319047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f910c0b1d90 0x7f910c0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 >> 172.21.15.16:0/3540319047 conn(0x7f910c06c7b0 msgr2=0x7f910c0cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:37.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 shutdown_connections 2024-04-26T20:14:37.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.466+0000 7f910be00640 1 -- 172.21.15.16:0/3540319047 wait complete. 2024-04-26T20:14:37.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:37.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d2c00640 1 Processor -- start 2024-04-26T20:14:37.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d2c00640 1 -- start start 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d2c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f06cc1574b0 0x7f06cc0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d2c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f06cc0c63f0 0x7f06cc164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d2c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc0cb7f0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d2c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f06cc0ccd80 con 0x7f06cc1574b0 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d2c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f06cc0c9e80 con 0x7f06cc0c63f0 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f06cc1574b0 0x7f06cc0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f06cc1574b0 0x7f06cc0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53454/0 (socket says 172.21.15.16:53454) 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cb400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f06cc0b47e0 0x7f06cc06feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41748/0 (socket says 172.21.15.16:41748) 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cbe00640 1 -- 172.21.15.16:0/519472477 learned_addr learned my addr 172.21.15.16:0/519472477 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d0c00640 1 --2- 172.21.15.16:0/519472477 >> v2:172.21.15.192:3300/0 conn(0x7f06cc0c63f0 0x7f06cc164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cbe00640 1 -- 172.21.15.16:0/519472477 >> v2:172.21.15.192:3300/0 conn(0x7f06cc0c63f0 msgr2=0x7f06cc164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cbe00640 1 --2- 172.21.15.16:0/519472477 >> v2:172.21.15.192:3300/0 conn(0x7f06cc0c63f0 0x7f06cc164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cbe00640 1 -- 172.21.15.16:0/519472477 >> v1:172.21.15.16:6789/0 conn(0x7f06cc0b47e0 legacy=0x7f06cc06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06cbe00640 1 -- 172.21.15.16:0/519472477 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc0ca0d0 con 0x7f06cc1574b0 2024-04-26T20:14:37.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06d0c00640 1 --2- 172.21.15.16:0/519472477 >> v2:172.21.15.192:3300/0 conn(0x7f06cc0c63f0 0x7f06cc164520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:37.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.626+0000 7f06caa00640 1 -- 172.21.15.16:0/519472477 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467899805 0 0) 0x7f06cc0cb7f0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06cbe00640 1 --2- 172.21.15.16:0/519472477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc1574b0 0x7f06cc0ca730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b2330 tx=0x7f06bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5fee28689c62b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06caa00640 1 -- 172.21.15.16:0/519472477 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc0ab610 con 0x7f06cc1574b0 2024-04-26T20:14:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06caa00640 1 -- 172.21.15.16:0/519472477 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc0b0070 con 0x7f06cc1574b0 2024-04-26T20:14:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06caa00640 1 -- 172.21.15.16:0/519472477 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc0ab9d0 con 0x7f06cc1574b0 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 -- 172.21.15.16:0/519472477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc1574b0 msgr2=0x7f06cc0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 --2- 172.21.15.16:0/519472477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc1574b0 0x7f06cc0ca730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b2330 tx=0x7f06bc01c520 comp rx=0 tx=0).stop 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 -- 172.21.15.16:0/519472477 shutdown_connections 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 --2- 172.21.15.16:0/519472477 >> v2:172.21.15.192:3300/0 conn(0x7f06cc0c63f0 0x7f06cc164520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 --2- 172.21.15.16:0/519472477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc1574b0 0x7f06cc0ca730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 -- 172.21.15.16:0/519472477 >> 172.21.15.16:0/519472477 conn(0x7f06cc071160 msgr2=0x7f06cc068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 -- 172.21.15.16:0/519472477 shutdown_connections 2024-04-26T20:14:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 -- 172.21.15.16:0/519472477 wait complete. 2024-04-26T20:14:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.630+0000 7f06d2c00640 1 Processor -- start 2024-04-26T20:14:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 -- start start 2024-04-26T20:14:37.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc0b47e0 0x7f06cc149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06cc0c63f0 0x7f06cc1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06cc1574b0 0x7f06cc0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc0705c0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc0ca3b0 con 0x7f06cc1574b0 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f06cc070740 con 0x7f06cc0c63f0 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc0b47e0 0x7f06cc149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc0b47e0 0x7f06cc149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53464/0 (socket says 172.21.15.16:53464) 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 -- 172.21.15.16:0/1763953933 learned_addr learned my addr 172.21.15.16:0/1763953933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cb400640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06cc0c63f0 0x7f06cc1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d0c00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06cc1574b0 0x7f06cc0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 -- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06cc0c63f0 msgr2=0x7f06cc1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06cc0c63f0 0x7f06cc1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 -- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06cc1574b0 msgr2=0x7f06cc0b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06cc1574b0 0x7f06cc0b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 -- 172.21.15.16:0/1763953933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc146290 con 0x7f06cc0b47e0 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06cbe00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc0b47e0 0x7f06cc149e60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06bc01a150 tx=0x7f06bc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06c3e00640 1 -- 172.21.15.16:0/1763953933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc0be5f0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06c3e00640 1 -- 172.21.15.16:0/1763953933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc0be7b0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06c3e00640 1 -- 172.21.15.16:0/1763953933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc0beba0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc0b0490 con 0x7f06cc0b47e0 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc14bba0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.634+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06cc077c20 con 0x7f06cc0b47e0 2024-04-26T20:14:37.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.638+0000 7f06c3e00640 1 -- 172.21.15.16:0/1763953933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06bc0b43f0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.638+0000 7f06c3e00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06ac0683b0 0x7f06ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.638+0000 7f06c3e00640 1 -- 172.21.15.16:0/1763953933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f06bc1212c0 con 0x7f06cc0b47e0 2024-04-26T20:14:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.638+0000 7f06cb400640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06ac0683b0 0x7f06ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.638+0000 7f06cb400640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06ac0683b0 0x7f06ac06a870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b2eb0 tx=0x7f06b8007b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.642+0000 7f06c3e00640 1 -- 172.21.15.16:0/1763953933 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f06bc0c4060 con 0x7f06cc0b47e0 2024-04-26T20:14:37.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.806+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06cc14ce10 con 0x7f06cc0b47e0 2024-04-26T20:14:37.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.806+0000 7f06c3e00640 1 -- 172.21.15.16:0/1763953933 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f06cc146290 con 0x7f06cc0b47e0 2024-04-26T20:14:37.812 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:37.812 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06ac0683b0 msgr2=0x7f06ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06ac0683b0 0x7f06ac06a870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b2eb0 tx=0x7f06b8007b80 comp rx=0 tx=0).stop 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc0b47e0 msgr2=0x7f06cc149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc0b47e0 0x7f06cc149e60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06bc01a150 tx=0x7f06bc01ad60 comp rx=0 tx=0).stop 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 shutdown_connections 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f06ac0683b0 0x7f06ac06a870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06cc1574b0 0x7f06cc0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06cc0c63f0 0x7f06cc1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 --2- 172.21.15.16:0/1763953933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc0b47e0 0x7f06cc149e60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 >> 172.21.15.16:0/1763953933 conn(0x7f06cc071160 msgr2=0x7f06cc071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:37.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 shutdown_connections 2024-04-26T20:14:37.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.810+0000 7f06d2c00640 1 -- 172.21.15.16:0/1763953933 wait complete. 2024-04-26T20:14:37.833 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T20:14:37.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:14:37.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0dde00640 1 Processor -- start 2024-04-26T20:14:37.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0dde00640 1 -- start start 2024-04-26T20:14:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0dde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0d8072a40 0x7fb0d80c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0dde00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d80c9190 con 0x7fb0d80708f0 2024-04-26T20:14:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0dde00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d80c7c20 con 0x7fb0d81589e0 2024-04-26T20:14:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0dde00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d80c8f40 con 0x7fb0d8072a40 2024-04-26T20:14:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb0d80708f0 0x7fb0d8152120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41756/0 (socket says 172.21.15.16:41756) 2024-04-26T20:14:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6a00640 1 -- 172.21.15.16:0/1201984746 learned_addr learned my addr 172.21.15.16:0/1201984746 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d7400640 1 --2- 172.21.15.16:0/1201984746 >> v2:172.21.15.192:3300/0 conn(0x7fb0d8072a40 0x7fb0d80c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930224014 0 0) 0x7fb0d80c9190 con 0x7fb0d80708f0 2024-04-26T20:14:37.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0bc003530 con 0x7fb0d80708f0 2024-04-26T20:14:37.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493942960 0 0) 0x7fb0d80c7c20 con 0x7fb0d81589e0 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d80c9190 con 0x7fb0d81589e0 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 443176465 0 0) 0x7fb0bc003530 con 0x7fb0d80708f0 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 >> v2:172.21.15.192:3300/0 conn(0x7fb0d8072a40 msgr2=0x7fb0d80c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 --2- 172.21.15.16:0/1201984746 >> v2:172.21.15.192:3300/0 conn(0x7fb0d8072a40 0x7fb0d80c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 >> v1:172.21.15.192:6789/0 conn(0x7fb0d81589e0 legacy=0x7fb0d80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d80c7f00 con 0x7fb0d80708f0 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fb0c8001680 con 0x7fb0d80708f0 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 >> v1:172.21.15.16:6789/0 conn(0x7fb0d80708f0 legacy=0x7fb0d8152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0bc003ba0 0x7fb0bc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc004810 0x7fb0bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0bc0051d0 0x7fb0bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d80c8f40 con 0x7fb0bc0051d0 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc00c0a0 con 0x7fb0bc004810 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc00c2a0 con 0x7fb0bc003ba0 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d7400640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0bc0051d0 0x7fb0bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d6a00640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0bc003ba0 0x7fb0bc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0cfe00640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc004810 0x7fb0bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d7400640 1 -- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0bc003ba0 msgr2=0x7fb0bc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d7400640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0bc003ba0 0x7fb0bc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d7400640 1 -- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc004810 msgr2=0x7fb0bc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d7400640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc004810 0x7fb0bc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0d7400640 1 -- 172.21.15.16:0/1201984746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc003530 con 0x7fb0bc0051d0 2024-04-26T20:14:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.970+0000 7fb0cfe00640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc004810 0x7fb0bc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0d7400640 1 -- 172.21.15.16:0/1201984746 reap_dead start 2024-04-26T20:14:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0d7400640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0bc0051d0 0x7fb0bc00b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009fc0 tx=0x7fb0d001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8501bf09d7456938 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0009c10 con 0x7fb0bc0051d0 2024-04-26T20:14:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d00a5ad0 con 0x7fb0bc0051d0 2024-04-26T20:14:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0d6000640 1 -- 172.21.15.16:0/1201984746 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00039a0 con 0x7fb0bc0051d0 2024-04-26T20:14:37.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0dde00640 1 -- 172.21.15.16:0/1201984746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0bc0051d0 msgr2=0x7fb0bc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0dde00640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0bc0051d0 0x7fb0bc00b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009fc0 tx=0x7fb0d001ccc0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0dde00640 1 -- 172.21.15.16:0/1201984746 shutdown_connections 2024-04-26T20:14:37.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0dde00640 1 --2- 172.21.15.16:0/1201984746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0bc0051d0 0x7fb0bc00b9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0dde00640 1 -- 172.21.15.16:0/1201984746 >> 172.21.15.16:0/1201984746 conn(0x7fb0d806c380 msgr2=0x7fb0d806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:37.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0dde00640 1 -- 172.21.15.16:0/1201984746 shutdown_connections 2024-04-26T20:14:37.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.974+0000 7fb0dde00640 1 -- 172.21.15.16:0/1201984746 wait complete. 2024-04-26T20:14:37.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 Processor -- start 2024-04-26T20:14:37.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 -- start start 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc0051d0 0x7fb0d80c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d81463a0 0x7fb0d80c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0d8157ae0 0x7fb0d8145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d80c9470 con 0x7fb0d8157ae0 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8072e60 con 0x7fb0bc0051d0 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d8158e00 con 0x7fb0d81463a0 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0d8157ae0 0x7fb0d8145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0d8157ae0 0x7fb0d8145650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53490/0 (socket says 172.21.15.16:53490) 2024-04-26T20:14:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 -- 172.21.15.16:0/3262542754 learned_addr learned my addr 172.21.15.16:0/3262542754 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d6a00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc0051d0 0x7fb0d80c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0cfe00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d81463a0 0x7fb0d80c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 -- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d81463a0 msgr2=0x7fb0d80c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d81463a0 0x7fb0d80c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 -- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc0051d0 msgr2=0x7fb0d80c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc0051d0 0x7fb0d80c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 -- 172.21.15.16:0/3262542754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d8146840 con 0x7fb0d8157ae0 2024-04-26T20:14:37.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0d7400640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0d8157ae0 0x7fb0d8145650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0d001cd00 tx=0x7fb0d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0cf400640 1 -- 172.21.15.16:0/3262542754 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0009c10 con 0x7fb0d8157ae0 2024-04-26T20:14:37.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0cf400640 1 -- 172.21.15.16:0/3262542754 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d00bd070 con 0x7fb0d8157ae0 2024-04-26T20:14:37.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d8146ae0 con 0x7fb0d8157ae0 2024-04-26T20:14:37.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0cf400640 1 -- 172.21.15.16:0/3262542754 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00ae8d0 con 0x7fb0d8157ae0 2024-04-26T20:14:37.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.978+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d8147040 con 0x7fb0d8157ae0 2024-04-26T20:14:37.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.982+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d8077c20 con 0x7fb0d8157ae0 2024-04-26T20:14:37.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.982+0000 7fb0cf400640 1 -- 172.21.15.16:0/3262542754 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb0d00aea90 con 0x7fb0d8157ae0 2024-04-26T20:14:37.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.982+0000 7fb0cf400640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb0b4068380 0x7fb0b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.982+0000 7fb0cf400640 1 -- 172.21.15.16:0/3262542754 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb0d0122460 con 0x7fb0d8157ae0 2024-04-26T20:14:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.982+0000 7fb0d6a00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb0b4068380 0x7fb0b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.982+0000 7fb0d6a00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb0b4068380 0x7fb0b406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8000c10 tx=0x7fb0c8001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:37.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:37.986+0000 7fb0cf400640 1 -- 172.21.15.16:0/3262542754 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb0d00c7020 con 0x7fb0d8157ae0 2024-04-26T20:14:38.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.150+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0d81e54a0 con 0x7fb0b4068380 2024-04-26T20:14:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.174+0000 7fb0cf400640 1 -- 172.21.15.16:0/3262542754 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332635 (secure 0 0 0) 0x7fb0d81e54a0 con 0x7fb0b4068380 2024-04-26T20:14:38.183 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:38.186 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:14:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb0b4068380 msgr2=0x7fb0b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb0b4068380 0x7fb0b406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8000c10 tx=0x7fb0c8001a10 comp rx=0 tx=0).stop 2024-04-26T20:14:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0d8157ae0 msgr2=0x7fb0d8145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0d8157ae0 0x7fb0d8145650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0d001cd00 tx=0x7fb0d0009750 comp rx=0 tx=0).stop 2024-04-26T20:14:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 shutdown_connections 2024-04-26T20:14:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb0b4068380 0x7fb0b406a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0d8157ae0 0x7fb0d8145650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d81463a0 0x7fb0d80c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 --2- 172.21.15.16:0/3262542754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0bc0051d0 0x7fb0d80c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 >> 172.21.15.16:0/3262542754 conn(0x7fb0d806c380 msgr2=0x7fb0d80738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 shutdown_connections 2024-04-26T20:14:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.178+0000 7fb0dde00640 1 -- 172.21.15.16:0/3262542754 wait complete. 2024-04-26T20:14:38.203 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-26T20:14:36.956300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2293760,"data_stored":2018206,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004663"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885563+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:14:19.885563+0000","last_peered":"2024-04-26T20:14:19.885563+0000","last_clean":"2024-04-26T20:14:19.885563+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:14:19.885563+0000","last_undegraded":"2024-04-26T20:14:19.885563+0000","last_fullsized":"2024-04-26T20:14:19.885563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547330+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:14:20.547330+0000","last_peered":"2024-04-26T20:14:20.547330+0000","last_clean":"2024-04-26T20:14:20.547330+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:14:20.547330+0000","last_undegraded":"2024-04-26T20:14:20.547330+0000","last_fullsized":"2024-04-26T20:14:20.547330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547016+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:14:20.547016+0000","last_peered":"2024-04-26T20:14:20.547016+0000","last_clean":"2024-04-26T20:14:20.547016+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:14:20.547016+0000","last_undegraded":"2024-04-26T20:14:20.547016+0000","last_fullsized":"2024-04-26T20:14:20.547016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547682+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:14:20.547682+0000","last_peered":"2024-04-26T20:14:20.547682+0000","last_clean":"2024-04-26T20:14:20.547682+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:14:20.547682+0000","last_undegraded":"2024-04-26T20:14:20.547682+0000","last_fullsized":"2024-04-26T20:14:20.547682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885447+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:14:19.885447+0000","last_peered":"2024-04-26T20:14:19.885447+0000","last_clean":"2024-04-26T20:14:19.885447+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:14:19.885447+0000","last_undegraded":"2024-04-26T20:14:19.885447+0000","last_fullsized":"2024-04-26T20:14:19.885447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507611+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:14:19.507611+0000","last_peered":"2024-04-26T20:14:19.507611+0000","last_clean":"2024-04-26T20:14:19.507611+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:14:19.507611+0000","last_undegraded":"2024-04-26T20:14:19.507611+0000","last_fullsized":"2024-04-26T20:14:19.507611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340700+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:14:20.340700+0000","last_peered":"2024-04-26T20:14:20.340700+0000","last_clean":"2024-04-26T20:14:20.340700+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:14:20.340700+0000","last_undegraded":"2024-04-26T20:14:20.340700+0000","last_fullsized":"2024-04-26T20:14:20.340700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551492+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:14:20.551492+0000","last_peered":"2024-04-26T20:14:20.551492+0000","last_clean":"2024-04-26T20:14:20.551492+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:14:20.551492+0000","last_undegraded":"2024-04-26T20:14:20.551492+0000","last_fullsized":"2024-04-26T20:14:20.551492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507856+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:14:19.507856+0000","last_peered":"2024-04-26T20:14:19.507856+0000","last_clean":"2024-04-26T20:14:19.507856+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:14:19.507856+0000","last_undegraded":"2024-04-26T20:14:19.507856+0000","last_fullsized":"2024-04-26T20:14:19.507856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340190+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:14:20.340190+0000","last_peered":"2024-04-26T20:14:20.340190+0000","last_clean":"2024-04-26T20:14:20.340190+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:14:20.340190+0000","last_undegraded":"2024-04-26T20:14:20.340190+0000","last_fullsized":"2024-04-26T20:14:20.340190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551323+0000","last_change":"2024-04-26T20:14:14.499292+0000","last_active":"2024-04-26T20:14:20.551323+0000","last_peered":"2024-04-26T20:14:20.551323+0000","last_clean":"2024-04-26T20:14:20.551323+0000","last_became_active":"2024-04-26T20:14:14.498610+0000","last_became_peered":"2024-04-26T20:14:14.498610+0000","last_unstale":"2024-04-26T20:14:20.551323+0000","last_undegraded":"2024-04-26T20:14:20.551323+0000","last_fullsized":"2024-04-26T20:14:20.551323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:44.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508054+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:14:19.508054+0000","last_peered":"2024-04-26T20:14:19.508054+0000","last_clean":"2024-04-26T20:14:19.508054+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:14:19.508054+0000","last_undegraded":"2024-04-26T20:14:19.508054+0000","last_fullsized":"2024-04-26T20:14:19.508054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504675+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:14:19.504675+0000","last_peered":"2024-04-26T20:14:19.504675+0000","last_clean":"2024-04-26T20:14:19.504675+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:14:19.504675+0000","last_undegraded":"2024-04-26T20:14:19.504675+0000","last_fullsized":"2024-04-26T20:14:19.504675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340743+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:14:20.340743+0000","last_peered":"2024-04-26T20:14:20.340743+0000","last_clean":"2024-04-26T20:14:20.340743+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:14:20.340743+0000","last_undegraded":"2024-04-26T20:14:20.340743+0000","last_fullsized":"2024-04-26T20:14:20.340743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509512+0000","last_change":"2024-04-26T20:14:18.527474+0000","last_active":"2024-04-26T20:14:19.509512+0000","last_peered":"2024-04-26T20:14:19.509512+0000","last_clean":"2024-04-26T20:14:19.509512+0000","last_became_active":"2024-04-26T20:14:18.526374+0000","last_became_peered":"2024-04-26T20:14:18.526374+0000","last_unstale":"2024-04-26T20:14:19.509512+0000","last_undegraded":"2024-04-26T20:14:19.509512+0000","last_fullsized":"2024-04-26T20:14:19.509512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:31.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547337+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:14:20.547337+0000","last_peered":"2024-04-26T20:14:20.547337+0000","last_clean":"2024-04-26T20:14:20.547337+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:14:20.547337+0000","last_undegraded":"2024-04-26T20:14:20.547337+0000","last_fullsized":"2024-04-26T20:14:20.547337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537855+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:14:20.537855+0000","last_peered":"2024-04-26T20:14:20.537855+0000","last_clean":"2024-04-26T20:14:20.537855+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:14:20.537855+0000","last_undegraded":"2024-04-26T20:14:20.537855+0000","last_fullsized":"2024-04-26T20:14:20.537855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509176+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:14:19.509176+0000","last_peered":"2024-04-26T20:14:19.509176+0000","last_clean":"2024-04-26T20:14:19.509176+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:14:19.509176+0000","last_undegraded":"2024-04-26T20:14:19.509176+0000","last_fullsized":"2024-04-26T20:14:19.509176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547119+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:14:20.547119+0000","last_peered":"2024-04-26T20:14:20.547119+0000","last_clean":"2024-04-26T20:14:20.547119+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:14:20.547119+0000","last_undegraded":"2024-04-26T20:14:20.547119+0000","last_fullsized":"2024-04-26T20:14:20.547119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537604+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:14:20.537604+0000","last_peered":"2024-04-26T20:14:20.537604+0000","last_clean":"2024-04-26T20:14:20.537604+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:14:20.537604+0000","last_undegraded":"2024-04-26T20:14:20.537604+0000","last_fullsized":"2024-04-26T20:14:20.537604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508115+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:14:19.508115+0000","last_peered":"2024-04-26T20:14:19.508115+0000","last_clean":"2024-04-26T20:14:19.508115+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:14:19.508115+0000","last_undegraded":"2024-04-26T20:14:19.508115+0000","last_fullsized":"2024-04-26T20:14:19.508115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339512+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:14:20.339512+0000","last_peered":"2024-04-26T20:14:20.339512+0000","last_clean":"2024-04-26T20:14:20.339512+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:14:20.339512+0000","last_undegraded":"2024-04-26T20:14:20.339512+0000","last_fullsized":"2024-04-26T20:14:20.339512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509417+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:14:19.509417+0000","last_peered":"2024-04-26T20:14:19.509417+0000","last_clean":"2024-04-26T20:14:19.509417+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:14:19.509417+0000","last_undegraded":"2024-04-26T20:14:19.509417+0000","last_fullsized":"2024-04-26T20:14:19.509417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885352+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:14:19.885352+0000","last_peered":"2024-04-26T20:14:19.885352+0000","last_clean":"2024-04-26T20:14:19.885352+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:14:19.885352+0000","last_undegraded":"2024-04-26T20:14:19.885352+0000","last_fullsized":"2024-04-26T20:14:19.885352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506778+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:14:19.506778+0000","last_peered":"2024-04-26T20:14:19.506778+0000","last_clean":"2024-04-26T20:14:19.506778+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:14:19.506778+0000","last_undegraded":"2024-04-26T20:14:19.506778+0000","last_fullsized":"2024-04-26T20:14:19.506778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507739+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:14:19.507739+0000","last_peered":"2024-04-26T20:14:19.507739+0000","last_clean":"2024-04-26T20:14:19.507739+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:14:19.507739+0000","last_undegraded":"2024-04-26T20:14:19.507739+0000","last_fullsized":"2024-04-26T20:14:19.507739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547916+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:14:20.547916+0000","last_peered":"2024-04-26T20:14:20.547916+0000","last_clean":"2024-04-26T20:14:20.547916+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:14:20.547916+0000","last_undegraded":"2024-04-26T20:14:20.547916+0000","last_fullsized":"2024-04-26T20:14:20.547916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538299+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:14:20.538299+0000","last_peered":"2024-04-26T20:14:20.538299+0000","last_clean":"2024-04-26T20:14:20.538299+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:14:20.538299+0000","last_undegraded":"2024-04-26T20:14:20.538299+0000","last_fullsized":"2024-04-26T20:14:20.538299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546922+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:14:20.546922+0000","last_peered":"2024-04-26T20:14:20.546922+0000","last_clean":"2024-04-26T20:14:20.546922+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:14:20.546922+0000","last_undegraded":"2024-04-26T20:14:20.546922+0000","last_fullsized":"2024-04-26T20:14:20.546922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538010+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:14:20.538010+0000","last_peered":"2024-04-26T20:14:20.538010+0000","last_clean":"2024-04-26T20:14:20.538010+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:14:20.538010+0000","last_undegraded":"2024-04-26T20:14:20.538010+0000","last_fullsized":"2024-04-26T20:14:20.538010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340902+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:14:20.340902+0000","last_peered":"2024-04-26T20:14:20.340902+0000","last_clean":"2024-04-26T20:14:20.340902+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:14:20.340902+0000","last_undegraded":"2024-04-26T20:14:20.340902+0000","last_fullsized":"2024-04-26T20:14:20.340902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885059+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:14:19.885059+0000","last_peered":"2024-04-26T20:14:19.885059+0000","last_clean":"2024-04-26T20:14:19.885059+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:14:19.885059+0000","last_undegraded":"2024-04-26T20:14:19.885059+0000","last_fullsized":"2024-04-26T20:14:19.885059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551624+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:14:20.551624+0000","last_peered":"2024-04-26T20:14:20.551624+0000","last_clean":"2024-04-26T20:14:20.551624+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:14:20.551624+0000","last_undegraded":"2024-04-26T20:14:20.551624+0000","last_fullsized":"2024-04-26T20:14:20.551624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538130+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:14:20.538130+0000","last_peered":"2024-04-26T20:14:20.538130+0000","last_clean":"2024-04-26T20:14:20.538130+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:14:20.538130+0000","last_undegraded":"2024-04-26T20:14:20.538130+0000","last_fullsized":"2024-04-26T20:14:20.538130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537670+0000","last_change":"2024-04-26T20:14:18.532352+0000","last_active":"2024-04-26T20:14:20.537670+0000","last_peered":"2024-04-26T20:14:20.537670+0000","last_clean":"2024-04-26T20:14:20.537670+0000","last_became_active":"2024-04-26T20:14:18.531948+0000","last_became_peered":"2024-04-26T20:14:18.531948+0000","last_unstale":"2024-04-26T20:14:20.537670+0000","last_undegraded":"2024-04-26T20:14:20.537670+0000","last_fullsized":"2024-04-26T20:14:20.537670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:07.005152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508466+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:14:19.508466+0000","last_peered":"2024-04-26T20:14:19.508466+0000","last_clean":"2024-04-26T20:14:19.508466+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:14:19.508466+0000","last_undegraded":"2024-04-26T20:14:19.508466+0000","last_fullsized":"2024-04-26T20:14:19.508466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551200+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:14:20.551200+0000","last_peered":"2024-04-26T20:14:20.551200+0000","last_clean":"2024-04-26T20:14:20.551200+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:14:20.551200+0000","last_undegraded":"2024-04-26T20:14:20.551200+0000","last_fullsized":"2024-04-26T20:14:20.551200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538131+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:14:20.538131+0000","last_peered":"2024-04-26T20:14:20.538131+0000","last_clean":"2024-04-26T20:14:20.538131+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:14:20.538131+0000","last_undegraded":"2024-04-26T20:14:20.538131+0000","last_fullsized":"2024-04-26T20:14:20.538131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537632+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:14:20.537632+0000","last_peered":"2024-04-26T20:14:20.537632+0000","last_clean":"2024-04-26T20:14:20.537632+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:14:20.537632+0000","last_undegraded":"2024-04-26T20:14:20.537632+0000","last_fullsized":"2024-04-26T20:14:20.537632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496549+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:14:19.496549+0000","last_peered":"2024-04-26T20:14:19.496549+0000","last_clean":"2024-04-26T20:14:19.496549+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:14:19.496549+0000","last_undegraded":"2024-04-26T20:14:19.496549+0000","last_fullsized":"2024-04-26T20:14:19.496549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884667+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:14:19.884667+0000","last_peered":"2024-04-26T20:14:19.884667+0000","last_clean":"2024-04-26T20:14:19.884667+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:14:19.884667+0000","last_undegraded":"2024-04-26T20:14:19.884667+0000","last_fullsized":"2024-04-26T20:14:19.884667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339582+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:14:20.339582+0000","last_peered":"2024-04-26T20:14:20.339582+0000","last_clean":"2024-04-26T20:14:20.339582+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:14:20.339582+0000","last_undegraded":"2024-04-26T20:14:20.339582+0000","last_fullsized":"2024-04-26T20:14:20.339582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885284+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:14:19.885284+0000","last_peered":"2024-04-26T20:14:19.885284+0000","last_clean":"2024-04-26T20:14:19.885284+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:14:19.885284+0000","last_undegraded":"2024-04-26T20:14:19.885284+0000","last_fullsized":"2024-04-26T20:14:19.885284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547171+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:14:20.547171+0000","last_peered":"2024-04-26T20:14:20.547171+0000","last_clean":"2024-04-26T20:14:20.547171+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:14:20.547171+0000","last_undegraded":"2024-04-26T20:14:20.547171+0000","last_fullsized":"2024-04-26T20:14:20.547171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550883+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:14:20.550883+0000","last_peered":"2024-04-26T20:14:20.550883+0000","last_clean":"2024-04-26T20:14:20.550883+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:14:20.550883+0000","last_undegraded":"2024-04-26T20:14:20.550883+0000","last_fullsized":"2024-04-26T20:14:20.550883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339797+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:14:20.339797+0000","last_peered":"2024-04-26T20:14:20.339797+0000","last_clean":"2024-04-26T20:14:20.339797+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:14:20.339797+0000","last_undegraded":"2024-04-26T20:14:20.339797+0000","last_fullsized":"2024-04-26T20:14:20.339797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505934+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:14:19.505934+0000","last_peered":"2024-04-26T20:14:19.505934+0000","last_clean":"2024-04-26T20:14:19.505934+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:14:19.505934+0000","last_undegraded":"2024-04-26T20:14:19.505934+0000","last_fullsized":"2024-04-26T20:14:19.505934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340425+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:14:20.340425+0000","last_peered":"2024-04-26T20:14:20.340425+0000","last_clean":"2024-04-26T20:14:20.340425+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:14:20.340425+0000","last_undegraded":"2024-04-26T20:14:20.340425+0000","last_fullsized":"2024-04-26T20:14:20.340425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496906+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:14:19.496906+0000","last_peered":"2024-04-26T20:14:19.496906+0000","last_clean":"2024-04-26T20:14:19.496906+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:14:19.496906+0000","last_undegraded":"2024-04-26T20:14:19.496906+0000","last_fullsized":"2024-04-26T20:14:19.496906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504513+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:14:19.504513+0000","last_peered":"2024-04-26T20:14:19.504513+0000","last_clean":"2024-04-26T20:14:19.504513+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:14:19.504513+0000","last_undegraded":"2024-04-26T20:14:19.504513+0000","last_fullsized":"2024-04-26T20:14:19.504513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551589+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:14:20.551589+0000","last_peered":"2024-04-26T20:14:20.551589+0000","last_clean":"2024-04-26T20:14:20.551589+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:14:20.551589+0000","last_undegraded":"2024-04-26T20:14:20.551589+0000","last_fullsized":"2024-04-26T20:14:20.551589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538251+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:14:20.538251+0000","last_peered":"2024-04-26T20:14:20.538251+0000","last_clean":"2024-04-26T20:14:20.538251+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:14:20.538251+0000","last_undegraded":"2024-04-26T20:14:20.538251+0000","last_fullsized":"2024-04-26T20:14:20.538251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885149+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:14:19.885149+0000","last_peered":"2024-04-26T20:14:19.885149+0000","last_clean":"2024-04-26T20:14:19.885149+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:14:19.885149+0000","last_undegraded":"2024-04-26T20:14:19.885149+0000","last_fullsized":"2024-04-26T20:14:19.885149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341171+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:14:20.341171+0000","last_peered":"2024-04-26T20:14:20.341171+0000","last_clean":"2024-04-26T20:14:20.341171+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:14:20.341171+0000","last_undegraded":"2024-04-26T20:14:20.341171+0000","last_fullsized":"2024-04-26T20:14:20.341171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.497025+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:14:19.497025+0000","last_peered":"2024-04-26T20:14:19.497025+0000","last_clean":"2024-04-26T20:14:19.497025+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:14:19.497025+0000","last_undegraded":"2024-04-26T20:14:19.497025+0000","last_fullsized":"2024-04-26T20:14:19.497025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550272+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:14:20.550272+0000","last_peered":"2024-04-26T20:14:20.550272+0000","last_clean":"2024-04-26T20:14:20.550272+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:14:20.550272+0000","last_undegraded":"2024-04-26T20:14:20.550272+0000","last_fullsized":"2024-04-26T20:14:20.550272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341179+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:14:20.341179+0000","last_peered":"2024-04-26T20:14:20.341179+0000","last_clean":"2024-04-26T20:14:20.341179+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:14:20.341179+0000","last_undegraded":"2024-04-26T20:14:20.341179+0000","last_fullsized":"2024-04-26T20:14:20.341179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509614+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:14:19.509614+0000","last_peered":"2024-04-26T20:14:19.509614+0000","last_clean":"2024-04-26T20:14:19.509614+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:14:19.509614+0000","last_undegraded":"2024-04-26T20:14:19.509614+0000","last_fullsized":"2024-04-26T20:14:19.509614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507544+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:14:19.507544+0000","last_peered":"2024-04-26T20:14:19.507544+0000","last_clean":"2024-04-26T20:14:19.507544+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:14:19.507544+0000","last_undegraded":"2024-04-26T20:14:19.507544+0000","last_fullsized":"2024-04-26T20:14:19.507544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340080+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:14:20.340080+0000","last_peered":"2024-04-26T20:14:20.340080+0000","last_clean":"2024-04-26T20:14:20.340080+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:14:20.340080+0000","last_undegraded":"2024-04-26T20:14:20.340080+0000","last_fullsized":"2024-04-26T20:14:20.340080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496440+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:14:19.496440+0000","last_peered":"2024-04-26T20:14:19.496440+0000","last_clean":"2024-04-26T20:14:19.496440+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:14:19.496440+0000","last_undegraded":"2024-04-26T20:14:19.496440+0000","last_fullsized":"2024-04-26T20:14:19.496440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885253+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:14:19.885253+0000","last_peered":"2024-04-26T20:14:19.885253+0000","last_clean":"2024-04-26T20:14:19.885253+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:14:19.885253+0000","last_undegraded":"2024-04-26T20:14:19.885253+0000","last_fullsized":"2024-04-26T20:14:19.885253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504382+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:14:19.504382+0000","last_peered":"2024-04-26T20:14:19.504382+0000","last_clean":"2024-04-26T20:14:19.504382+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:14:19.504382+0000","last_undegraded":"2024-04-26T20:14:19.504382+0000","last_fullsized":"2024-04-26T20:14:19.504382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504483+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:14:19.504483+0000","last_peered":"2024-04-26T20:14:19.504483+0000","last_clean":"2024-04-26T20:14:19.504483+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:14:19.504483+0000","last_undegraded":"2024-04-26T20:14:19.504483+0000","last_fullsized":"2024-04-26T20:14:19.504483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547904+0000","last_change":"2024-04-26T20:14:18.642156+0000","last_active":"2024-04-26T20:14:20.547904+0000","last_peered":"2024-04-26T20:14:20.547904+0000","last_clean":"2024-04-26T20:14:20.547904+0000","last_became_active":"2024-04-26T20:14:18.641452+0000","last_became_peered":"2024-04-26T20:14:18.641452+0000","last_unstale":"2024-04-26T20:14:20.547904+0000","last_undegraded":"2024-04-26T20:14:20.547904+0000","last_fullsized":"2024-04-26T20:14:20.547904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:30.242536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340685+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:14:20.340685+0000","last_peered":"2024-04-26T20:14:20.340685+0000","last_clean":"2024-04-26T20:14:20.340685+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:14:20.340685+0000","last_undegraded":"2024-04-26T20:14:20.340685+0000","last_fullsized":"2024-04-26T20:14:20.340685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550939+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:14:20.550939+0000","last_peered":"2024-04-26T20:14:20.550939+0000","last_clean":"2024-04-26T20:14:20.550939+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:14:20.550939+0000","last_undegraded":"2024-04-26T20:14:20.550939+0000","last_fullsized":"2024-04-26T20:14:20.550939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547744+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:14:20.547744+0000","last_peered":"2024-04-26T20:14:20.547744+0000","last_clean":"2024-04-26T20:14:20.547744+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:14:20.547744+0000","last_undegraded":"2024-04-26T20:14:20.547744+0000","last_fullsized":"2024-04-26T20:14:20.547744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884892+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:14:19.884892+0000","last_peered":"2024-04-26T20:14:19.884892+0000","last_clean":"2024-04-26T20:14:19.884892+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:14:19.884892+0000","last_undegraded":"2024-04-26T20:14:19.884892+0000","last_fullsized":"2024-04-26T20:14:19.884892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885235+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:14:19.885235+0000","last_peered":"2024-04-26T20:14:19.885235+0000","last_clean":"2024-04-26T20:14:19.885235+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:14:19.885235+0000","last_undegraded":"2024-04-26T20:14:19.885235+0000","last_fullsized":"2024-04-26T20:14:19.885235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551667+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:14:20.551667+0000","last_peered":"2024-04-26T20:14:20.551667+0000","last_clean":"2024-04-26T20:14:20.551667+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:14:20.551667+0000","last_undegraded":"2024-04-26T20:14:20.551667+0000","last_fullsized":"2024-04-26T20:14:20.551667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340243+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:14:20.340243+0000","last_peered":"2024-04-26T20:14:20.340243+0000","last_clean":"2024-04-26T20:14:20.340243+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:14:20.340243+0000","last_undegraded":"2024-04-26T20:14:20.340243+0000","last_fullsized":"2024-04-26T20:14:20.340243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:26.512144+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:14:26.512144+0000","last_peered":"2024-04-26T20:14:26.512144+0000","last_clean":"2024-04-26T20:14:26.512144+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:14:26.512144+0000","last_undegraded":"2024-04-26T20:14:26.512144+0000","last_fullsized":"2024-04-26T20:14:26.512144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537725+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:14:20.537725+0000","last_peered":"2024-04-26T20:14:20.537725+0000","last_clean":"2024-04-26T20:14:20.537725+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:14:20.537725+0000","last_undegraded":"2024-04-26T20:14:20.537725+0000","last_fullsized":"2024-04-26T20:14:20.537725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509332+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:14:19.509332+0000","last_peered":"2024-04-26T20:14:19.509332+0000","last_clean":"2024-04-26T20:14:19.509332+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:14:19.509332+0000","last_undegraded":"2024-04-26T20:14:19.509332+0000","last_fullsized":"2024-04-26T20:14:19.509332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538143+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:14:20.538143+0000","last_peered":"2024-04-26T20:14:20.538143+0000","last_clean":"2024-04-26T20:14:20.538143+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:14:20.538143+0000","last_undegraded":"2024-04-26T20:14:20.538143+0000","last_fullsized":"2024-04-26T20:14:20.538143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508332+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:14:19.508332+0000","last_peered":"2024-04-26T20:14:19.508332+0000","last_clean":"2024-04-26T20:14:19.508332+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:14:19.508332+0000","last_undegraded":"2024-04-26T20:14:19.508332+0000","last_fullsized":"2024-04-26T20:14:19.508332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885496+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:14:19.885496+0000","last_peered":"2024-04-26T20:14:19.885496+0000","last_clean":"2024-04-26T20:14:19.885496+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:14:19.885496+0000","last_undegraded":"2024-04-26T20:14:19.885496+0000","last_fullsized":"2024-04-26T20:14:19.885496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551280+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:14:20.551280+0000","last_peered":"2024-04-26T20:14:20.551280+0000","last_clean":"2024-04-26T20:14:20.551280+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:14:20.551280+0000","last_undegraded":"2024-04-26T20:14:20.551280+0000","last_fullsized":"2024-04-26T20:14:20.551280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547103+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:14:20.547103+0000","last_peered":"2024-04-26T20:14:20.547103+0000","last_clean":"2024-04-26T20:14:20.547103+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:14:20.547103+0000","last_undegraded":"2024-04-26T20:14:20.547103+0000","last_fullsized":"2024-04-26T20:14:20.547103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551023+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:14:20.551023+0000","last_peered":"2024-04-26T20:14:20.551023+0000","last_clean":"2024-04-26T20:14:20.551023+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:14:20.551023+0000","last_undegraded":"2024-04-26T20:14:20.551023+0000","last_fullsized":"2024-04-26T20:14:20.551023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506515+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:14:19.506515+0000","last_peered":"2024-04-26T20:14:19.506515+0000","last_clean":"2024-04-26T20:14:19.506515+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:14:19.506515+0000","last_undegraded":"2024-04-26T20:14:19.506515+0000","last_fullsized":"2024-04-26T20:14:19.506515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547062+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:14:20.547062+0000","last_peered":"2024-04-26T20:14:20.547062+0000","last_clean":"2024-04-26T20:14:20.547062+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:14:20.547062+0000","last_undegraded":"2024-04-26T20:14:20.547062+0000","last_fullsized":"2024-04-26T20:14:20.547062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885190+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:14:19.885190+0000","last_peered":"2024-04-26T20:14:19.885190+0000","last_clean":"2024-04-26T20:14:19.885190+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:14:19.885190+0000","last_undegraded":"2024-04-26T20:14:19.885190+0000","last_fullsized":"2024-04-26T20:14:19.885190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537488+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:14:20.537488+0000","last_peered":"2024-04-26T20:14:20.537488+0000","last_clean":"2024-04-26T20:14:20.537488+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:14:20.537488+0000","last_undegraded":"2024-04-26T20:14:20.537488+0000","last_fullsized":"2024-04-26T20:14:20.537488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550628+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:14:20.550628+0000","last_peered":"2024-04-26T20:14:20.550628+0000","last_clean":"2024-04-26T20:14:20.550628+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:14:20.550628+0000","last_undegraded":"2024-04-26T20:14:20.550628+0000","last_fullsized":"2024-04-26T20:14:20.550628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506621+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:14:19.506621+0000","last_peered":"2024-04-26T20:14:19.506621+0000","last_clean":"2024-04-26T20:14:19.506621+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:14:19.506621+0000","last_undegraded":"2024-04-26T20:14:19.506621+0000","last_fullsized":"2024-04-26T20:14:19.506621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547012+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:14:20.547012+0000","last_peered":"2024-04-26T20:14:20.547012+0000","last_clean":"2024-04-26T20:14:20.547012+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:14:20.547012+0000","last_undegraded":"2024-04-26T20:14:20.547012+0000","last_fullsized":"2024-04-26T20:14:20.547012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547247+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:14:20.547247+0000","last_peered":"2024-04-26T20:14:20.547247+0000","last_clean":"2024-04-26T20:14:20.547247+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:14:20.547247+0000","last_undegraded":"2024-04-26T20:14:20.547247+0000","last_fullsized":"2024-04-26T20:14:20.547247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505171+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:14:19.505171+0000","last_peered":"2024-04-26T20:14:19.505171+0000","last_clean":"2024-04-26T20:14:19.505171+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:14:19.505171+0000","last_undegraded":"2024-04-26T20:14:19.505171+0000","last_fullsized":"2024-04-26T20:14:19.505171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885205+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:14:19.885205+0000","last_peered":"2024-04-26T20:14:19.885205+0000","last_clean":"2024-04-26T20:14:19.885205+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:14:19.885205+0000","last_undegraded":"2024-04-26T20:14:19.885205+0000","last_fullsized":"2024-04-26T20:14:19.885205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496841+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:14:19.496841+0000","last_peered":"2024-04-26T20:14:19.496841+0000","last_clean":"2024-04-26T20:14:19.496841+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:14:19.496841+0000","last_undegraded":"2024-04-26T20:14:19.496841+0000","last_fullsized":"2024-04-26T20:14:19.496841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547386+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:14:20.547386+0000","last_peered":"2024-04-26T20:14:20.547386+0000","last_clean":"2024-04-26T20:14:20.547386+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:14:20.547386+0000","last_undegraded":"2024-04-26T20:14:20.547386+0000","last_fullsized":"2024-04-26T20:14:20.547386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508517+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:14:19.508517+0000","last_peered":"2024-04-26T20:14:19.508517+0000","last_clean":"2024-04-26T20:14:19.508517+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:14:19.508517+0000","last_undegraded":"2024-04-26T20:14:19.508517+0000","last_fullsized":"2024-04-26T20:14:19.508517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547503+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:14:20.547503+0000","last_peered":"2024-04-26T20:14:20.547503+0000","last_clean":"2024-04-26T20:14:20.547503+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:14:20.547503+0000","last_undegraded":"2024-04-26T20:14:20.547503+0000","last_fullsized":"2024-04-26T20:14:20.547503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504099+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:14:19.504099+0000","last_peered":"2024-04-26T20:14:19.504099+0000","last_clean":"2024-04-26T20:14:19.504099+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:14:19.504099+0000","last_undegraded":"2024-04-26T20:14:19.504099+0000","last_fullsized":"2024-04-26T20:14:19.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496540+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:14:19.496540+0000","last_peered":"2024-04-26T20:14:19.496540+0000","last_clean":"2024-04-26T20:14:19.496540+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:14:19.496540+0000","last_undegraded":"2024-04-26T20:14:19.496540+0000","last_fullsized":"2024-04-26T20:14:19.496540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550979+0000","last_change":"2024-04-26T20:14:14.482803+0000","last_active":"2024-04-26T20:14:20.550979+0000","last_peered":"2024-04-26T20:14:20.550979+0000","last_clean":"2024-04-26T20:14:20.550979+0000","last_became_active":"2024-04-26T20:14:14.482022+0000","last_became_peered":"2024-04-26T20:14:14.482022+0000","last_unstale":"2024-04-26T20:14:20.550979+0000","last_undegraded":"2024-04-26T20:14:20.550979+0000","last_fullsized":"2024-04-26T20:14:20.550979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885112+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:14:19.885112+0000","last_peered":"2024-04-26T20:14:19.885112+0000","last_clean":"2024-04-26T20:14:19.885112+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:14:19.885112+0000","last_undegraded":"2024-04-26T20:14:19.885112+0000","last_fullsized":"2024-04-26T20:14:19.885112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547807+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:14:20.547807+0000","last_peered":"2024-04-26T20:14:20.547807+0000","last_clean":"2024-04-26T20:14:20.547807+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:14:20.547807+0000","last_undegraded":"2024-04-26T20:14:20.547807+0000","last_fullsized":"2024-04-26T20:14:20.547807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537992+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:14:20.537992+0000","last_peered":"2024-04-26T20:14:20.537992+0000","last_clean":"2024-04-26T20:14:20.537992+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:14:20.537992+0000","last_undegraded":"2024-04-26T20:14:20.537992+0000","last_fullsized":"2024-04-26T20:14:20.537992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506318+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:14:19.506318+0000","last_peered":"2024-04-26T20:14:19.506318+0000","last_clean":"2024-04-26T20:14:19.506318+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:14:19.506318+0000","last_undegraded":"2024-04-26T20:14:19.506318+0000","last_fullsized":"2024-04-26T20:14:19.506318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547804+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:14:20.547804+0000","last_peered":"2024-04-26T20:14:20.547804+0000","last_clean":"2024-04-26T20:14:20.547804+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:14:20.547804+0000","last_undegraded":"2024-04-26T20:14:20.547804+0000","last_fullsized":"2024-04-26T20:14:20.547804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550486+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:14:20.550486+0000","last_peered":"2024-04-26T20:14:20.550486+0000","last_clean":"2024-04-26T20:14:20.550486+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:14:20.550486+0000","last_undegraded":"2024-04-26T20:14:20.550486+0000","last_fullsized":"2024-04-26T20:14:20.550486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547253+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:14:20.547253+0000","last_peered":"2024-04-26T20:14:20.547253+0000","last_clean":"2024-04-26T20:14:20.547253+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:14:20.547253+0000","last_undegraded":"2024-04-26T20:14:20.547253+0000","last_fullsized":"2024-04-26T20:14:20.547253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550633+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:14:20.550633+0000","last_peered":"2024-04-26T20:14:20.550633+0000","last_clean":"2024-04-26T20:14:20.550633+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:14:20.550633+0000","last_undegraded":"2024-04-26T20:14:20.550633+0000","last_fullsized":"2024-04-26T20:14:20.550633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884953+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:14:19.884953+0000","last_peered":"2024-04-26T20:14:19.884953+0000","last_clean":"2024-04-26T20:14:19.884953+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:14:19.884953+0000","last_undegraded":"2024-04-26T20:14:19.884953+0000","last_fullsized":"2024-04-26T20:14:19.884953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505625+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:14:19.505625+0000","last_peered":"2024-04-26T20:14:19.505625+0000","last_clean":"2024-04-26T20:14:19.505625+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:14:19.505625+0000","last_undegraded":"2024-04-26T20:14:19.505625+0000","last_fullsized":"2024-04-26T20:14:19.505625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340721+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:14:20.340721+0000","last_peered":"2024-04-26T20:14:20.340721+0000","last_clean":"2024-04-26T20:14:20.340721+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:14:20.340721+0000","last_undegraded":"2024-04-26T20:14:20.340721+0000","last_fullsized":"2024-04-26T20:14:20.340721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496988+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:14:19.496988+0000","last_peered":"2024-04-26T20:14:19.496988+0000","last_clean":"2024-04-26T20:14:19.496988+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:14:19.496988+0000","last_undegraded":"2024-04-26T20:14:19.496988+0000","last_fullsized":"2024-04-26T20:14:19.496988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551847+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:14:20.551847+0000","last_peered":"2024-04-26T20:14:20.551847+0000","last_clean":"2024-04-26T20:14:20.551847+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:14:20.551847+0000","last_undegraded":"2024-04-26T20:14:20.551847+0000","last_fullsized":"2024-04-26T20:14:20.551847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550171+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:14:20.550171+0000","last_peered":"2024-04-26T20:14:20.550171+0000","last_clean":"2024-04-26T20:14:20.550171+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:14:20.550171+0000","last_undegraded":"2024-04-26T20:14:20.550171+0000","last_fullsized":"2024-04-26T20:14:20.550171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537556+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:14:20.537556+0000","last_peered":"2024-04-26T20:14:20.537556+0000","last_clean":"2024-04-26T20:14:20.537556+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:14:20.537556+0000","last_undegraded":"2024-04-26T20:14:20.537556+0000","last_fullsized":"2024-04-26T20:14:20.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884895+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:14:19.884895+0000","last_peered":"2024-04-26T20:14:19.884895+0000","last_clean":"2024-04-26T20:14:19.884895+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:14:19.884895+0000","last_undegraded":"2024-04-26T20:14:19.884895+0000","last_fullsized":"2024-04-26T20:14:19.884895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547283+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:14:20.547283+0000","last_peered":"2024-04-26T20:14:20.547283+0000","last_clean":"2024-04-26T20:14:20.547283+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:14:20.547283+0000","last_undegraded":"2024-04-26T20:14:20.547283+0000","last_fullsized":"2024-04-26T20:14:20.547283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509243+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:14:19.509243+0000","last_peered":"2024-04-26T20:14:19.509243+0000","last_clean":"2024-04-26T20:14:19.509243+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:14:19.509243+0000","last_undegraded":"2024-04-26T20:14:19.509243+0000","last_fullsized":"2024-04-26T20:14:19.509243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505396+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:14:19.505396+0000","last_peered":"2024-04-26T20:14:19.505396+0000","last_clean":"2024-04-26T20:14:19.505396+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:14:19.505396+0000","last_undegraded":"2024-04-26T20:14:19.505396+0000","last_fullsized":"2024-04-26T20:14:19.505396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506202+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:14:19.506202+0000","last_peered":"2024-04-26T20:14:19.506202+0000","last_clean":"2024-04-26T20:14:19.506202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:14:19.506202+0000","last_undegraded":"2024-04-26T20:14:19.506202+0000","last_fullsized":"2024-04-26T20:14:19.506202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341083+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:14:20.341083+0000","last_peered":"2024-04-26T20:14:20.341083+0000","last_clean":"2024-04-26T20:14:20.341083+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:14:20.341083+0000","last_undegraded":"2024-04-26T20:14:20.341083+0000","last_fullsized":"2024-04-26T20:14:20.341083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546910+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:14:20.546910+0000","last_peered":"2024-04-26T20:14:20.546910+0000","last_clean":"2024-04-26T20:14:20.546910+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:14:20.546910+0000","last_undegraded":"2024-04-26T20:14:20.546910+0000","last_fullsized":"2024-04-26T20:14:20.546910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339971+0000","last_change":"2024-04-26T20:14:14.463139+0000","last_active":"2024-04-26T20:14:20.339971+0000","last_peered":"2024-04-26T20:14:20.339971+0000","last_clean":"2024-04-26T20:14:20.339971+0000","last_became_active":"2024-04-26T20:14:14.462083+0000","last_became_peered":"2024-04-26T20:14:14.462083+0000","last_unstale":"2024-04-26T20:14:20.339971+0000","last_undegraded":"2024-04-26T20:14:20.339971+0000","last_fullsized":"2024-04-26T20:14:20.339971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:28.615893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550418+0000","last_change":"2024-04-26T20:14:14.475535+0000","last_active":"2024-04-26T20:14:20.550418+0000","last_peered":"2024-04-26T20:14:20.550418+0000","last_clean":"2024-04-26T20:14:20.550418+0000","last_became_active":"2024-04-26T20:14:14.474445+0000","last_became_peered":"2024-04-26T20:14:14.474445+0000","last_unstale":"2024-04-26T20:14:20.550418+0000","last_undegraded":"2024-04-26T20:14:20.550418+0000","last_fullsized":"2024-04-26T20:14:20.550418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:51.715142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339972+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:14:20.339972+0000","last_peered":"2024-04-26T20:14:20.339972+0000","last_clean":"2024-04-26T20:14:20.339972+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:14:20.339972+0000","last_undegraded":"2024-04-26T20:14:20.339972+0000","last_fullsized":"2024-04-26T20:14:20.339972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551012+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:14:20.551012+0000","last_peered":"2024-04-26T20:14:20.551012+0000","last_clean":"2024-04-26T20:14:20.551012+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:14:20.551012+0000","last_undegraded":"2024-04-26T20:14:20.551012+0000","last_fullsized":"2024-04-26T20:14:20.551012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885153+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:14:19.885153+0000","last_peered":"2024-04-26T20:14:19.885153+0000","last_clean":"2024-04-26T20:14:19.885153+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:14:19.885153+0000","last_undegraded":"2024-04-26T20:14:19.885153+0000","last_fullsized":"2024-04-26T20:14:19.885153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538165+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:14:20.538165+0000","last_peered":"2024-04-26T20:14:20.538165+0000","last_clean":"2024-04-26T20:14:20.538165+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:14:20.538165+0000","last_undegraded":"2024-04-26T20:14:20.538165+0000","last_fullsized":"2024-04-26T20:14:20.538165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340878+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:14:20.340878+0000","last_peered":"2024-04-26T20:14:20.340878+0000","last_clean":"2024-04-26T20:14:20.340878+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:14:20.340878+0000","last_undegraded":"2024-04-26T20:14:20.340878+0000","last_fullsized":"2024-04-26T20:14:20.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":694509,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":694565,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:14:38.209 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:14:38.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.378+0000 7fbfb8e00640 1 Processor -- start 2024-04-26T20:14:38.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.378+0000 7fbfb8e00640 1 -- start start 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb8e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbfb4155ee0 0x7fbfb406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb8e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfb406e440 0x7fbfb40c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb8e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb4070380 con 0x7fbfb415fbb0 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb8e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb4070660 con 0x7fbfb4155ee0 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb8e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb4070940 con 0x7fbfb406e440 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbfb415fbb0 0x7fbfb406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41758/0 (socket says 172.21.15.16:41758) 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 -- 172.21.15.16:0/1386493164 learned_addr learned my addr 172.21.15.16:0/1386493164 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1386493164 >> v2:172.21.15.192:3300/0 conn(0x7fbfb4155ee0 0x7fbfb406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb2800640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfb406e440 0x7fbfb40c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566478804 0 0) 0x7fbfb4070380 con 0x7fbfb415fbb0 2024-04-26T20:14:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf98003530 con 0x7fbfb415fbb0 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3471815474 0 0) 0x7fbf98003530 con 0x7fbfb415fbb0 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfb406e440 msgr2=0x7fbfb40c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfb406e440 0x7fbfb40c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 >> v2:172.21.15.192:3300/0 conn(0x7fbfb4155ee0 msgr2=0x7fbfb406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 --2- 172.21.15.16:0/1386493164 >> v2:172.21.15.192:3300/0 conn(0x7fbfb4155ee0 0x7fbfb406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb4070c20 con 0x7fbfb415fbb0 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fbf9c0016a0 con 0x7fbfb415fbb0 2024-04-26T20:14:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 >> v1:172.21.15.16:6789/0 conn(0x7fbfb415fbb0 legacy=0x7fbfb406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf980039c0 0x7fbf98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf98004810 0x7fbf98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf980051d0 0x7fbf9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4070660 con 0x7fbf98004810 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4070940 con 0x7fbf980039c0 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbf98004610 con 0x7fbf980051d0 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf98004810 0x7fbf98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf980039c0 0x7fbf98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfb2800640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf980051d0 0x7fbf9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 -- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf980051d0 msgr2=0x7fbf9800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf980051d0 0x7fbf9800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 -- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf980039c0 msgr2=0x7fbf98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf980039c0 0x7fbf98003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.382+0000 7fbfabe00640 1 -- 172.21.15.16:0/1386493164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf98003530 con 0x7fbf98004810 2024-04-26T20:14:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfabe00640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf98004810 0x7fbf98004c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40b2130 tx=0x7fbf9c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d255bb0eab969e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c007d70 con 0x7fbf98004810 2024-04-26T20:14:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c005ae0 con 0x7fbf98004810 2024-04-26T20:14:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb1400640 1 -- 172.21.15.16:0/1386493164 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c007070 con 0x7fbf98004810 2024-04-26T20:14:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb8e00640 1 -- 172.21.15.16:0/1386493164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf98004810 msgr2=0x7fbf98004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb8e00640 1 --2- 172.21.15.16:0/1386493164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf98004810 0x7fbf98004c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40b2130 tx=0x7fbf9c01f3d0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb2800640 1 -- 172.21.15.16:0/1386493164 reap_dead start 2024-04-26T20:14:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb8e00640 1 -- 172.21.15.16:0/1386493164 shutdown_connections 2024-04-26T20:14:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb8e00640 1 -- 172.21.15.16:0/1386493164 >> 172.21.15.16:0/1386493164 conn(0x7fbfb4071f60 msgr2=0x7fbfb4072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb8e00640 1 -- 172.21.15.16:0/1386493164 shutdown_connections 2024-04-26T20:14:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.386+0000 7fbfb8e00640 1 -- 172.21.15.16:0/1386493164 wait complete. 2024-04-26T20:14:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 Processor -- start 2024-04-26T20:14:38.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 -- start start 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf98004810 0x7fbfb415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfb414add0 0x7fbfb414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfb40ce3f0 0x7fbfb414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb415fff0 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41562c0 con 0x7fbfb414add0 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb40c9fe0 con 0x7fbf98004810 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfb40ce3f0 0x7fbfb414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfb40ce3f0 0x7fbfb414a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53500/0 (socket says 172.21.15.16:53500) 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 -- 172.21.15.16:0/2945916168 learned_addr learned my addr 172.21.15.16:0/2945916168 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf98004810 0x7fbfb415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfabe00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfb414add0 0x7fbfb414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 -- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf98004810 msgr2=0x7fbfb415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf98004810 0x7fbfb415f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 -- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfb414add0 msgr2=0x7fbfb414a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfb414add0 0x7fbfb414a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 -- 172.21.15.16:0/2945916168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb40ce930 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf98004810 0x7fbfb415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb2800640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfb40ce3f0 0x7fbfb414a650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4072aa0 tx=0x7fbfac00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfaa000640 1 -- 172.21.15.16:0/2945916168 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00fe10 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfaa000640 1 -- 172.21.15.16:0/2945916168 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfac01d070 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfaa000640 1 -- 172.21.15.16:0/2945916168 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac015670 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb41f47a0 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb41f4d60 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.390+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb4077c20 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.394+0000 7fbfaa000640 1 -- 172.21.15.16:0/2945916168 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbfac015810 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.394+0000 7fbfaa000640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf90068380 0x7fbf9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.394+0000 7fbfaa000640 1 -- 172.21.15.16:0/2945916168 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbfac0875f0 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.394+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf90068380 0x7fbf9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.394+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf90068380 0x7fbf9006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009be0 tx=0x7fbfa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:38.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.398+0000 7fbfaa000640 1 -- 172.21.15.16:0/2945916168 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbfac010040 con 0x7fbfb40ce3f0 2024-04-26T20:14:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.562+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfb40caa80 con 0x7fbf90068380 2024-04-26T20:14:38.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.586+0000 7fbfaa000640 1 -- 172.21.15.16:0/2945916168 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332635 (secure 0 0 0) 0x7fbfb40caa80 con 0x7fbf90068380 2024-04-26T20:14:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:38.595 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:14:38.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf90068380 msgr2=0x7fbf9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf90068380 0x7fbf9006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009be0 tx=0x7fbfa4008040 comp rx=0 tx=0).stop 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfb40ce3f0 msgr2=0x7fbfb414a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfb40ce3f0 0x7fbfb414a650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4072aa0 tx=0x7fbfac00f580 comp rx=0 tx=0).stop 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 shutdown_connections 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf90068380 0x7fbf9006a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfb40ce3f0 0x7fbfb414a650 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfb414add0 0x7fbfb414a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 --2- 172.21.15.16:0/2945916168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf98004810 0x7fbfb415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 >> 172.21.15.16:0/2945916168 conn(0x7fbfb4071f60 msgr2=0x7fbfb415aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 shutdown_connections 2024-04-26T20:14:38.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.590+0000 7fbfb8e00640 1 -- 172.21.15.16:0/2945916168 wait complete. 2024-04-26T20:14:38.613 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-26T20:14:36.956300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2293760,"data_stored":2018206,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004663"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885563+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:14:19.885563+0000","last_peered":"2024-04-26T20:14:19.885563+0000","last_clean":"2024-04-26T20:14:19.885563+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:14:19.885563+0000","last_undegraded":"2024-04-26T20:14:19.885563+0000","last_fullsized":"2024-04-26T20:14:19.885563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547330+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:14:20.547330+0000","last_peered":"2024-04-26T20:14:20.547330+0000","last_clean":"2024-04-26T20:14:20.547330+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:14:20.547330+0000","last_undegraded":"2024-04-26T20:14:20.547330+0000","last_fullsized":"2024-04-26T20:14:20.547330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547016+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:14:20.547016+0000","last_peered":"2024-04-26T20:14:20.547016+0000","last_clean":"2024-04-26T20:14:20.547016+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:14:20.547016+0000","last_undegraded":"2024-04-26T20:14:20.547016+0000","last_fullsized":"2024-04-26T20:14:20.547016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547682+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:14:20.547682+0000","last_peered":"2024-04-26T20:14:20.547682+0000","last_clean":"2024-04-26T20:14:20.547682+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:14:20.547682+0000","last_undegraded":"2024-04-26T20:14:20.547682+0000","last_fullsized":"2024-04-26T20:14:20.547682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885447+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:14:19.885447+0000","last_peered":"2024-04-26T20:14:19.885447+0000","last_clean":"2024-04-26T20:14:19.885447+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:14:19.885447+0000","last_undegraded":"2024-04-26T20:14:19.885447+0000","last_fullsized":"2024-04-26T20:14:19.885447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507611+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:14:19.507611+0000","last_peered":"2024-04-26T20:14:19.507611+0000","last_clean":"2024-04-26T20:14:19.507611+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:14:19.507611+0000","last_undegraded":"2024-04-26T20:14:19.507611+0000","last_fullsized":"2024-04-26T20:14:19.507611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340700+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:14:20.340700+0000","last_peered":"2024-04-26T20:14:20.340700+0000","last_clean":"2024-04-26T20:14:20.340700+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:14:20.340700+0000","last_undegraded":"2024-04-26T20:14:20.340700+0000","last_fullsized":"2024-04-26T20:14:20.340700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551492+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:14:20.551492+0000","last_peered":"2024-04-26T20:14:20.551492+0000","last_clean":"2024-04-26T20:14:20.551492+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:14:20.551492+0000","last_undegraded":"2024-04-26T20:14:20.551492+0000","last_fullsized":"2024-04-26T20:14:20.551492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507856+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:14:19.507856+0000","last_peered":"2024-04-26T20:14:19.507856+0000","last_clean":"2024-04-26T20:14:19.507856+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:14:19.507856+0000","last_undegraded":"2024-04-26T20:14:19.507856+0000","last_fullsized":"2024-04-26T20:14:19.507856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340190+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:14:20.340190+0000","last_peered":"2024-04-26T20:14:20.340190+0000","last_clean":"2024-04-26T20:14:20.340190+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:14:20.340190+0000","last_undegraded":"2024-04-26T20:14:20.340190+0000","last_fullsized":"2024-04-26T20:14:20.340190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551323+0000","last_change":"2024-04-26T20:14:14.499292+0000","last_active":"2024-04-26T20:14:20.551323+0000","last_peered":"2024-04-26T20:14:20.551323+0000","last_clean":"2024-04-26T20:14:20.551323+0000","last_became_active":"2024-04-26T20:14:14.498610+0000","last_became_peered":"2024-04-26T20:14:14.498610+0000","last_unstale":"2024-04-26T20:14:20.551323+0000","last_undegraded":"2024-04-26T20:14:20.551323+0000","last_fullsized":"2024-04-26T20:14:20.551323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:44.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508054+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:14:19.508054+0000","last_peered":"2024-04-26T20:14:19.508054+0000","last_clean":"2024-04-26T20:14:19.508054+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:14:19.508054+0000","last_undegraded":"2024-04-26T20:14:19.508054+0000","last_fullsized":"2024-04-26T20:14:19.508054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504675+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:14:19.504675+0000","last_peered":"2024-04-26T20:14:19.504675+0000","last_clean":"2024-04-26T20:14:19.504675+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:14:19.504675+0000","last_undegraded":"2024-04-26T20:14:19.504675+0000","last_fullsized":"2024-04-26T20:14:19.504675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340743+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:14:20.340743+0000","last_peered":"2024-04-26T20:14:20.340743+0000","last_clean":"2024-04-26T20:14:20.340743+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:14:20.340743+0000","last_undegraded":"2024-04-26T20:14:20.340743+0000","last_fullsized":"2024-04-26T20:14:20.340743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509512+0000","last_change":"2024-04-26T20:14:18.527474+0000","last_active":"2024-04-26T20:14:19.509512+0000","last_peered":"2024-04-26T20:14:19.509512+0000","last_clean":"2024-04-26T20:14:19.509512+0000","last_became_active":"2024-04-26T20:14:18.526374+0000","last_became_peered":"2024-04-26T20:14:18.526374+0000","last_unstale":"2024-04-26T20:14:19.509512+0000","last_undegraded":"2024-04-26T20:14:19.509512+0000","last_fullsized":"2024-04-26T20:14:19.509512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:31.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547337+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:14:20.547337+0000","last_peered":"2024-04-26T20:14:20.547337+0000","last_clean":"2024-04-26T20:14:20.547337+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:14:20.547337+0000","last_undegraded":"2024-04-26T20:14:20.547337+0000","last_fullsized":"2024-04-26T20:14:20.547337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537855+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:14:20.537855+0000","last_peered":"2024-04-26T20:14:20.537855+0000","last_clean":"2024-04-26T20:14:20.537855+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:14:20.537855+0000","last_undegraded":"2024-04-26T20:14:20.537855+0000","last_fullsized":"2024-04-26T20:14:20.537855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509176+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:14:19.509176+0000","last_peered":"2024-04-26T20:14:19.509176+0000","last_clean":"2024-04-26T20:14:19.509176+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:14:19.509176+0000","last_undegraded":"2024-04-26T20:14:19.509176+0000","last_fullsized":"2024-04-26T20:14:19.509176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547119+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:14:20.547119+0000","last_peered":"2024-04-26T20:14:20.547119+0000","last_clean":"2024-04-26T20:14:20.547119+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:14:20.547119+0000","last_undegraded":"2024-04-26T20:14:20.547119+0000","last_fullsized":"2024-04-26T20:14:20.547119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537604+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:14:20.537604+0000","last_peered":"2024-04-26T20:14:20.537604+0000","last_clean":"2024-04-26T20:14:20.537604+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:14:20.537604+0000","last_undegraded":"2024-04-26T20:14:20.537604+0000","last_fullsized":"2024-04-26T20:14:20.537604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508115+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:14:19.508115+0000","last_peered":"2024-04-26T20:14:19.508115+0000","last_clean":"2024-04-26T20:14:19.508115+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:14:19.508115+0000","last_undegraded":"2024-04-26T20:14:19.508115+0000","last_fullsized":"2024-04-26T20:14:19.508115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339512+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:14:20.339512+0000","last_peered":"2024-04-26T20:14:20.339512+0000","last_clean":"2024-04-26T20:14:20.339512+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:14:20.339512+0000","last_undegraded":"2024-04-26T20:14:20.339512+0000","last_fullsized":"2024-04-26T20:14:20.339512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509417+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:14:19.509417+0000","last_peered":"2024-04-26T20:14:19.509417+0000","last_clean":"2024-04-26T20:14:19.509417+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:14:19.509417+0000","last_undegraded":"2024-04-26T20:14:19.509417+0000","last_fullsized":"2024-04-26T20:14:19.509417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885352+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:14:19.885352+0000","last_peered":"2024-04-26T20:14:19.885352+0000","last_clean":"2024-04-26T20:14:19.885352+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:14:19.885352+0000","last_undegraded":"2024-04-26T20:14:19.885352+0000","last_fullsized":"2024-04-26T20:14:19.885352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506778+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:14:19.506778+0000","last_peered":"2024-04-26T20:14:19.506778+0000","last_clean":"2024-04-26T20:14:19.506778+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:14:19.506778+0000","last_undegraded":"2024-04-26T20:14:19.506778+0000","last_fullsized":"2024-04-26T20:14:19.506778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507739+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:14:19.507739+0000","last_peered":"2024-04-26T20:14:19.507739+0000","last_clean":"2024-04-26T20:14:19.507739+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:14:19.507739+0000","last_undegraded":"2024-04-26T20:14:19.507739+0000","last_fullsized":"2024-04-26T20:14:19.507739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547916+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:14:20.547916+0000","last_peered":"2024-04-26T20:14:20.547916+0000","last_clean":"2024-04-26T20:14:20.547916+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:14:20.547916+0000","last_undegraded":"2024-04-26T20:14:20.547916+0000","last_fullsized":"2024-04-26T20:14:20.547916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538299+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:14:20.538299+0000","last_peered":"2024-04-26T20:14:20.538299+0000","last_clean":"2024-04-26T20:14:20.538299+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:14:20.538299+0000","last_undegraded":"2024-04-26T20:14:20.538299+0000","last_fullsized":"2024-04-26T20:14:20.538299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546922+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:14:20.546922+0000","last_peered":"2024-04-26T20:14:20.546922+0000","last_clean":"2024-04-26T20:14:20.546922+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:14:20.546922+0000","last_undegraded":"2024-04-26T20:14:20.546922+0000","last_fullsized":"2024-04-26T20:14:20.546922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538010+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:14:20.538010+0000","last_peered":"2024-04-26T20:14:20.538010+0000","last_clean":"2024-04-26T20:14:20.538010+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:14:20.538010+0000","last_undegraded":"2024-04-26T20:14:20.538010+0000","last_fullsized":"2024-04-26T20:14:20.538010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340902+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:14:20.340902+0000","last_peered":"2024-04-26T20:14:20.340902+0000","last_clean":"2024-04-26T20:14:20.340902+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:14:20.340902+0000","last_undegraded":"2024-04-26T20:14:20.340902+0000","last_fullsized":"2024-04-26T20:14:20.340902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885059+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:14:19.885059+0000","last_peered":"2024-04-26T20:14:19.885059+0000","last_clean":"2024-04-26T20:14:19.885059+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:14:19.885059+0000","last_undegraded":"2024-04-26T20:14:19.885059+0000","last_fullsized":"2024-04-26T20:14:19.885059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551624+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:14:20.551624+0000","last_peered":"2024-04-26T20:14:20.551624+0000","last_clean":"2024-04-26T20:14:20.551624+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:14:20.551624+0000","last_undegraded":"2024-04-26T20:14:20.551624+0000","last_fullsized":"2024-04-26T20:14:20.551624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538130+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:14:20.538130+0000","last_peered":"2024-04-26T20:14:20.538130+0000","last_clean":"2024-04-26T20:14:20.538130+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:14:20.538130+0000","last_undegraded":"2024-04-26T20:14:20.538130+0000","last_fullsized":"2024-04-26T20:14:20.538130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537670+0000","last_change":"2024-04-26T20:14:18.532352+0000","last_active":"2024-04-26T20:14:20.537670+0000","last_peered":"2024-04-26T20:14:20.537670+0000","last_clean":"2024-04-26T20:14:20.537670+0000","last_became_active":"2024-04-26T20:14:18.531948+0000","last_became_peered":"2024-04-26T20:14:18.531948+0000","last_unstale":"2024-04-26T20:14:20.537670+0000","last_undegraded":"2024-04-26T20:14:20.537670+0000","last_fullsized":"2024-04-26T20:14:20.537670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:07.005152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508466+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:14:19.508466+0000","last_peered":"2024-04-26T20:14:19.508466+0000","last_clean":"2024-04-26T20:14:19.508466+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:14:19.508466+0000","last_undegraded":"2024-04-26T20:14:19.508466+0000","last_fullsized":"2024-04-26T20:14:19.508466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551200+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:14:20.551200+0000","last_peered":"2024-04-26T20:14:20.551200+0000","last_clean":"2024-04-26T20:14:20.551200+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:14:20.551200+0000","last_undegraded":"2024-04-26T20:14:20.551200+0000","last_fullsized":"2024-04-26T20:14:20.551200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538131+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:14:20.538131+0000","last_peered":"2024-04-26T20:14:20.538131+0000","last_clean":"2024-04-26T20:14:20.538131+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:14:20.538131+0000","last_undegraded":"2024-04-26T20:14:20.538131+0000","last_fullsized":"2024-04-26T20:14:20.538131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537632+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:14:20.537632+0000","last_peered":"2024-04-26T20:14:20.537632+0000","last_clean":"2024-04-26T20:14:20.537632+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:14:20.537632+0000","last_undegraded":"2024-04-26T20:14:20.537632+0000","last_fullsized":"2024-04-26T20:14:20.537632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496549+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:14:19.496549+0000","last_peered":"2024-04-26T20:14:19.496549+0000","last_clean":"2024-04-26T20:14:19.496549+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:14:19.496549+0000","last_undegraded":"2024-04-26T20:14:19.496549+0000","last_fullsized":"2024-04-26T20:14:19.496549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884667+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:14:19.884667+0000","last_peered":"2024-04-26T20:14:19.884667+0000","last_clean":"2024-04-26T20:14:19.884667+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:14:19.884667+0000","last_undegraded":"2024-04-26T20:14:19.884667+0000","last_fullsized":"2024-04-26T20:14:19.884667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339582+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:14:20.339582+0000","last_peered":"2024-04-26T20:14:20.339582+0000","last_clean":"2024-04-26T20:14:20.339582+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:14:20.339582+0000","last_undegraded":"2024-04-26T20:14:20.339582+0000","last_fullsized":"2024-04-26T20:14:20.339582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885284+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:14:19.885284+0000","last_peered":"2024-04-26T20:14:19.885284+0000","last_clean":"2024-04-26T20:14:19.885284+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:14:19.885284+0000","last_undegraded":"2024-04-26T20:14:19.885284+0000","last_fullsized":"2024-04-26T20:14:19.885284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547171+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:14:20.547171+0000","last_peered":"2024-04-26T20:14:20.547171+0000","last_clean":"2024-04-26T20:14:20.547171+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:14:20.547171+0000","last_undegraded":"2024-04-26T20:14:20.547171+0000","last_fullsized":"2024-04-26T20:14:20.547171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550883+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:14:20.550883+0000","last_peered":"2024-04-26T20:14:20.550883+0000","last_clean":"2024-04-26T20:14:20.550883+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:14:20.550883+0000","last_undegraded":"2024-04-26T20:14:20.550883+0000","last_fullsized":"2024-04-26T20:14:20.550883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339797+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:14:20.339797+0000","last_peered":"2024-04-26T20:14:20.339797+0000","last_clean":"2024-04-26T20:14:20.339797+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:14:20.339797+0000","last_undegraded":"2024-04-26T20:14:20.339797+0000","last_fullsized":"2024-04-26T20:14:20.339797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505934+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:14:19.505934+0000","last_peered":"2024-04-26T20:14:19.505934+0000","last_clean":"2024-04-26T20:14:19.505934+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:14:19.505934+0000","last_undegraded":"2024-04-26T20:14:19.505934+0000","last_fullsized":"2024-04-26T20:14:19.505934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340425+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:14:20.340425+0000","last_peered":"2024-04-26T20:14:20.340425+0000","last_clean":"2024-04-26T20:14:20.340425+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:14:20.340425+0000","last_undegraded":"2024-04-26T20:14:20.340425+0000","last_fullsized":"2024-04-26T20:14:20.340425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496906+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:14:19.496906+0000","last_peered":"2024-04-26T20:14:19.496906+0000","last_clean":"2024-04-26T20:14:19.496906+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:14:19.496906+0000","last_undegraded":"2024-04-26T20:14:19.496906+0000","last_fullsized":"2024-04-26T20:14:19.496906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504513+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:14:19.504513+0000","last_peered":"2024-04-26T20:14:19.504513+0000","last_clean":"2024-04-26T20:14:19.504513+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:14:19.504513+0000","last_undegraded":"2024-04-26T20:14:19.504513+0000","last_fullsized":"2024-04-26T20:14:19.504513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551589+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:14:20.551589+0000","last_peered":"2024-04-26T20:14:20.551589+0000","last_clean":"2024-04-26T20:14:20.551589+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:14:20.551589+0000","last_undegraded":"2024-04-26T20:14:20.551589+0000","last_fullsized":"2024-04-26T20:14:20.551589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538251+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:14:20.538251+0000","last_peered":"2024-04-26T20:14:20.538251+0000","last_clean":"2024-04-26T20:14:20.538251+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:14:20.538251+0000","last_undegraded":"2024-04-26T20:14:20.538251+0000","last_fullsized":"2024-04-26T20:14:20.538251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885149+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:14:19.885149+0000","last_peered":"2024-04-26T20:14:19.885149+0000","last_clean":"2024-04-26T20:14:19.885149+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:14:19.885149+0000","last_undegraded":"2024-04-26T20:14:19.885149+0000","last_fullsized":"2024-04-26T20:14:19.885149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341171+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:14:20.341171+0000","last_peered":"2024-04-26T20:14:20.341171+0000","last_clean":"2024-04-26T20:14:20.341171+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:14:20.341171+0000","last_undegraded":"2024-04-26T20:14:20.341171+0000","last_fullsized":"2024-04-26T20:14:20.341171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.497025+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:14:19.497025+0000","last_peered":"2024-04-26T20:14:19.497025+0000","last_clean":"2024-04-26T20:14:19.497025+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:14:19.497025+0000","last_undegraded":"2024-04-26T20:14:19.497025+0000","last_fullsized":"2024-04-26T20:14:19.497025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550272+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:14:20.550272+0000","last_peered":"2024-04-26T20:14:20.550272+0000","last_clean":"2024-04-26T20:14:20.550272+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:14:20.550272+0000","last_undegraded":"2024-04-26T20:14:20.550272+0000","last_fullsized":"2024-04-26T20:14:20.550272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341179+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:14:20.341179+0000","last_peered":"2024-04-26T20:14:20.341179+0000","last_clean":"2024-04-26T20:14:20.341179+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:14:20.341179+0000","last_undegraded":"2024-04-26T20:14:20.341179+0000","last_fullsized":"2024-04-26T20:14:20.341179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509614+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:14:19.509614+0000","last_peered":"2024-04-26T20:14:19.509614+0000","last_clean":"2024-04-26T20:14:19.509614+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:14:19.509614+0000","last_undegraded":"2024-04-26T20:14:19.509614+0000","last_fullsized":"2024-04-26T20:14:19.509614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507544+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:14:19.507544+0000","last_peered":"2024-04-26T20:14:19.507544+0000","last_clean":"2024-04-26T20:14:19.507544+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:14:19.507544+0000","last_undegraded":"2024-04-26T20:14:19.507544+0000","last_fullsized":"2024-04-26T20:14:19.507544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340080+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:14:20.340080+0000","last_peered":"2024-04-26T20:14:20.340080+0000","last_clean":"2024-04-26T20:14:20.340080+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:14:20.340080+0000","last_undegraded":"2024-04-26T20:14:20.340080+0000","last_fullsized":"2024-04-26T20:14:20.340080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496440+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:14:19.496440+0000","last_peered":"2024-04-26T20:14:19.496440+0000","last_clean":"2024-04-26T20:14:19.496440+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:14:19.496440+0000","last_undegraded":"2024-04-26T20:14:19.496440+0000","last_fullsized":"2024-04-26T20:14:19.496440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885253+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:14:19.885253+0000","last_peered":"2024-04-26T20:14:19.885253+0000","last_clean":"2024-04-26T20:14:19.885253+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:14:19.885253+0000","last_undegraded":"2024-04-26T20:14:19.885253+0000","last_fullsized":"2024-04-26T20:14:19.885253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504382+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:14:19.504382+0000","last_peered":"2024-04-26T20:14:19.504382+0000","last_clean":"2024-04-26T20:14:19.504382+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:14:19.504382+0000","last_undegraded":"2024-04-26T20:14:19.504382+0000","last_fullsized":"2024-04-26T20:14:19.504382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504483+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:14:19.504483+0000","last_peered":"2024-04-26T20:14:19.504483+0000","last_clean":"2024-04-26T20:14:19.504483+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:14:19.504483+0000","last_undegraded":"2024-04-26T20:14:19.504483+0000","last_fullsized":"2024-04-26T20:14:19.504483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547904+0000","last_change":"2024-04-26T20:14:18.642156+0000","last_active":"2024-04-26T20:14:20.547904+0000","last_peered":"2024-04-26T20:14:20.547904+0000","last_clean":"2024-04-26T20:14:20.547904+0000","last_became_active":"2024-04-26T20:14:18.641452+0000","last_became_peered":"2024-04-26T20:14:18.641452+0000","last_unstale":"2024-04-26T20:14:20.547904+0000","last_undegraded":"2024-04-26T20:14:20.547904+0000","last_fullsized":"2024-04-26T20:14:20.547904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:30.242536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340685+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:14:20.340685+0000","last_peered":"2024-04-26T20:14:20.340685+0000","last_clean":"2024-04-26T20:14:20.340685+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:14:20.340685+0000","last_undegraded":"2024-04-26T20:14:20.340685+0000","last_fullsized":"2024-04-26T20:14:20.340685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550939+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:14:20.550939+0000","last_peered":"2024-04-26T20:14:20.550939+0000","last_clean":"2024-04-26T20:14:20.550939+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:14:20.550939+0000","last_undegraded":"2024-04-26T20:14:20.550939+0000","last_fullsized":"2024-04-26T20:14:20.550939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547744+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:14:20.547744+0000","last_peered":"2024-04-26T20:14:20.547744+0000","last_clean":"2024-04-26T20:14:20.547744+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:14:20.547744+0000","last_undegraded":"2024-04-26T20:14:20.547744+0000","last_fullsized":"2024-04-26T20:14:20.547744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884892+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:14:19.884892+0000","last_peered":"2024-04-26T20:14:19.884892+0000","last_clean":"2024-04-26T20:14:19.884892+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:14:19.884892+0000","last_undegraded":"2024-04-26T20:14:19.884892+0000","last_fullsized":"2024-04-26T20:14:19.884892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885235+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:14:19.885235+0000","last_peered":"2024-04-26T20:14:19.885235+0000","last_clean":"2024-04-26T20:14:19.885235+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:14:19.885235+0000","last_undegraded":"2024-04-26T20:14:19.885235+0000","last_fullsized":"2024-04-26T20:14:19.885235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551667+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:14:20.551667+0000","last_peered":"2024-04-26T20:14:20.551667+0000","last_clean":"2024-04-26T20:14:20.551667+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:14:20.551667+0000","last_undegraded":"2024-04-26T20:14:20.551667+0000","last_fullsized":"2024-04-26T20:14:20.551667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340243+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:14:20.340243+0000","last_peered":"2024-04-26T20:14:20.340243+0000","last_clean":"2024-04-26T20:14:20.340243+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:14:20.340243+0000","last_undegraded":"2024-04-26T20:14:20.340243+0000","last_fullsized":"2024-04-26T20:14:20.340243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:26.512144+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:14:26.512144+0000","last_peered":"2024-04-26T20:14:26.512144+0000","last_clean":"2024-04-26T20:14:26.512144+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:14:26.512144+0000","last_undegraded":"2024-04-26T20:14:26.512144+0000","last_fullsized":"2024-04-26T20:14:26.512144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537725+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:14:20.537725+0000","last_peered":"2024-04-26T20:14:20.537725+0000","last_clean":"2024-04-26T20:14:20.537725+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:14:20.537725+0000","last_undegraded":"2024-04-26T20:14:20.537725+0000","last_fullsized":"2024-04-26T20:14:20.537725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509332+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:14:19.509332+0000","last_peered":"2024-04-26T20:14:19.509332+0000","last_clean":"2024-04-26T20:14:19.509332+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:14:19.509332+0000","last_undegraded":"2024-04-26T20:14:19.509332+0000","last_fullsized":"2024-04-26T20:14:19.509332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538143+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:14:20.538143+0000","last_peered":"2024-04-26T20:14:20.538143+0000","last_clean":"2024-04-26T20:14:20.538143+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:14:20.538143+0000","last_undegraded":"2024-04-26T20:14:20.538143+0000","last_fullsized":"2024-04-26T20:14:20.538143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508332+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:14:19.508332+0000","last_peered":"2024-04-26T20:14:19.508332+0000","last_clean":"2024-04-26T20:14:19.508332+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:14:19.508332+0000","last_undegraded":"2024-04-26T20:14:19.508332+0000","last_fullsized":"2024-04-26T20:14:19.508332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885496+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:14:19.885496+0000","last_peered":"2024-04-26T20:14:19.885496+0000","last_clean":"2024-04-26T20:14:19.885496+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:14:19.885496+0000","last_undegraded":"2024-04-26T20:14:19.885496+0000","last_fullsized":"2024-04-26T20:14:19.885496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551280+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:14:20.551280+0000","last_peered":"2024-04-26T20:14:20.551280+0000","last_clean":"2024-04-26T20:14:20.551280+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:14:20.551280+0000","last_undegraded":"2024-04-26T20:14:20.551280+0000","last_fullsized":"2024-04-26T20:14:20.551280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547103+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:14:20.547103+0000","last_peered":"2024-04-26T20:14:20.547103+0000","last_clean":"2024-04-26T20:14:20.547103+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:14:20.547103+0000","last_undegraded":"2024-04-26T20:14:20.547103+0000","last_fullsized":"2024-04-26T20:14:20.547103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551023+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:14:20.551023+0000","last_peered":"2024-04-26T20:14:20.551023+0000","last_clean":"2024-04-26T20:14:20.551023+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:14:20.551023+0000","last_undegraded":"2024-04-26T20:14:20.551023+0000","last_fullsized":"2024-04-26T20:14:20.551023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506515+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:14:19.506515+0000","last_peered":"2024-04-26T20:14:19.506515+0000","last_clean":"2024-04-26T20:14:19.506515+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:14:19.506515+0000","last_undegraded":"2024-04-26T20:14:19.506515+0000","last_fullsized":"2024-04-26T20:14:19.506515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547062+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:14:20.547062+0000","last_peered":"2024-04-26T20:14:20.547062+0000","last_clean":"2024-04-26T20:14:20.547062+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:14:20.547062+0000","last_undegraded":"2024-04-26T20:14:20.547062+0000","last_fullsized":"2024-04-26T20:14:20.547062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885190+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:14:19.885190+0000","last_peered":"2024-04-26T20:14:19.885190+0000","last_clean":"2024-04-26T20:14:19.885190+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:14:19.885190+0000","last_undegraded":"2024-04-26T20:14:19.885190+0000","last_fullsized":"2024-04-26T20:14:19.885190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537488+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:14:20.537488+0000","last_peered":"2024-04-26T20:14:20.537488+0000","last_clean":"2024-04-26T20:14:20.537488+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:14:20.537488+0000","last_undegraded":"2024-04-26T20:14:20.537488+0000","last_fullsized":"2024-04-26T20:14:20.537488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550628+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:14:20.550628+0000","last_peered":"2024-04-26T20:14:20.550628+0000","last_clean":"2024-04-26T20:14:20.550628+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:14:20.550628+0000","last_undegraded":"2024-04-26T20:14:20.550628+0000","last_fullsized":"2024-04-26T20:14:20.550628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506621+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:14:19.506621+0000","last_peered":"2024-04-26T20:14:19.506621+0000","last_clean":"2024-04-26T20:14:19.506621+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:14:19.506621+0000","last_undegraded":"2024-04-26T20:14:19.506621+0000","last_fullsized":"2024-04-26T20:14:19.506621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547012+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:14:20.547012+0000","last_peered":"2024-04-26T20:14:20.547012+0000","last_clean":"2024-04-26T20:14:20.547012+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:14:20.547012+0000","last_undegraded":"2024-04-26T20:14:20.547012+0000","last_fullsized":"2024-04-26T20:14:20.547012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547247+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:14:20.547247+0000","last_peered":"2024-04-26T20:14:20.547247+0000","last_clean":"2024-04-26T20:14:20.547247+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:14:20.547247+0000","last_undegraded":"2024-04-26T20:14:20.547247+0000","last_fullsized":"2024-04-26T20:14:20.547247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505171+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:14:19.505171+0000","last_peered":"2024-04-26T20:14:19.505171+0000","last_clean":"2024-04-26T20:14:19.505171+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:14:19.505171+0000","last_undegraded":"2024-04-26T20:14:19.505171+0000","last_fullsized":"2024-04-26T20:14:19.505171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885205+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:14:19.885205+0000","last_peered":"2024-04-26T20:14:19.885205+0000","last_clean":"2024-04-26T20:14:19.885205+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:14:19.885205+0000","last_undegraded":"2024-04-26T20:14:19.885205+0000","last_fullsized":"2024-04-26T20:14:19.885205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496841+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:14:19.496841+0000","last_peered":"2024-04-26T20:14:19.496841+0000","last_clean":"2024-04-26T20:14:19.496841+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:14:19.496841+0000","last_undegraded":"2024-04-26T20:14:19.496841+0000","last_fullsized":"2024-04-26T20:14:19.496841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547386+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:14:20.547386+0000","last_peered":"2024-04-26T20:14:20.547386+0000","last_clean":"2024-04-26T20:14:20.547386+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:14:20.547386+0000","last_undegraded":"2024-04-26T20:14:20.547386+0000","last_fullsized":"2024-04-26T20:14:20.547386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508517+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:14:19.508517+0000","last_peered":"2024-04-26T20:14:19.508517+0000","last_clean":"2024-04-26T20:14:19.508517+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:14:19.508517+0000","last_undegraded":"2024-04-26T20:14:19.508517+0000","last_fullsized":"2024-04-26T20:14:19.508517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547503+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:14:20.547503+0000","last_peered":"2024-04-26T20:14:20.547503+0000","last_clean":"2024-04-26T20:14:20.547503+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:14:20.547503+0000","last_undegraded":"2024-04-26T20:14:20.547503+0000","last_fullsized":"2024-04-26T20:14:20.547503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504099+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:14:19.504099+0000","last_peered":"2024-04-26T20:14:19.504099+0000","last_clean":"2024-04-26T20:14:19.504099+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:14:19.504099+0000","last_undegraded":"2024-04-26T20:14:19.504099+0000","last_fullsized":"2024-04-26T20:14:19.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496540+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:14:19.496540+0000","last_peered":"2024-04-26T20:14:19.496540+0000","last_clean":"2024-04-26T20:14:19.496540+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:14:19.496540+0000","last_undegraded":"2024-04-26T20:14:19.496540+0000","last_fullsized":"2024-04-26T20:14:19.496540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550979+0000","last_change":"2024-04-26T20:14:14.482803+0000","last_active":"2024-04-26T20:14:20.550979+0000","last_peered":"2024-04-26T20:14:20.550979+0000","last_clean":"2024-04-26T20:14:20.550979+0000","last_became_active":"2024-04-26T20:14:14.482022+0000","last_became_peered":"2024-04-26T20:14:14.482022+0000","last_unstale":"2024-04-26T20:14:20.550979+0000","last_undegraded":"2024-04-26T20:14:20.550979+0000","last_fullsized":"2024-04-26T20:14:20.550979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885112+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:14:19.885112+0000","last_peered":"2024-04-26T20:14:19.885112+0000","last_clean":"2024-04-26T20:14:19.885112+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:14:19.885112+0000","last_undegraded":"2024-04-26T20:14:19.885112+0000","last_fullsized":"2024-04-26T20:14:19.885112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547807+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:14:20.547807+0000","last_peered":"2024-04-26T20:14:20.547807+0000","last_clean":"2024-04-26T20:14:20.547807+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:14:20.547807+0000","last_undegraded":"2024-04-26T20:14:20.547807+0000","last_fullsized":"2024-04-26T20:14:20.547807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537992+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:14:20.537992+0000","last_peered":"2024-04-26T20:14:20.537992+0000","last_clean":"2024-04-26T20:14:20.537992+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:14:20.537992+0000","last_undegraded":"2024-04-26T20:14:20.537992+0000","last_fullsized":"2024-04-26T20:14:20.537992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506318+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:14:19.506318+0000","last_peered":"2024-04-26T20:14:19.506318+0000","last_clean":"2024-04-26T20:14:19.506318+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:14:19.506318+0000","last_undegraded":"2024-04-26T20:14:19.506318+0000","last_fullsized":"2024-04-26T20:14:19.506318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547804+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:14:20.547804+0000","last_peered":"2024-04-26T20:14:20.547804+0000","last_clean":"2024-04-26T20:14:20.547804+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:14:20.547804+0000","last_undegraded":"2024-04-26T20:14:20.547804+0000","last_fullsized":"2024-04-26T20:14:20.547804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550486+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:14:20.550486+0000","last_peered":"2024-04-26T20:14:20.550486+0000","last_clean":"2024-04-26T20:14:20.550486+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:14:20.550486+0000","last_undegraded":"2024-04-26T20:14:20.550486+0000","last_fullsized":"2024-04-26T20:14:20.550486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547253+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:14:20.547253+0000","last_peered":"2024-04-26T20:14:20.547253+0000","last_clean":"2024-04-26T20:14:20.547253+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:14:20.547253+0000","last_undegraded":"2024-04-26T20:14:20.547253+0000","last_fullsized":"2024-04-26T20:14:20.547253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550633+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:14:20.550633+0000","last_peered":"2024-04-26T20:14:20.550633+0000","last_clean":"2024-04-26T20:14:20.550633+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:14:20.550633+0000","last_undegraded":"2024-04-26T20:14:20.550633+0000","last_fullsized":"2024-04-26T20:14:20.550633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884953+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:14:19.884953+0000","last_peered":"2024-04-26T20:14:19.884953+0000","last_clean":"2024-04-26T20:14:19.884953+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:14:19.884953+0000","last_undegraded":"2024-04-26T20:14:19.884953+0000","last_fullsized":"2024-04-26T20:14:19.884953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505625+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:14:19.505625+0000","last_peered":"2024-04-26T20:14:19.505625+0000","last_clean":"2024-04-26T20:14:19.505625+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:14:19.505625+0000","last_undegraded":"2024-04-26T20:14:19.505625+0000","last_fullsized":"2024-04-26T20:14:19.505625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340721+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:14:20.340721+0000","last_peered":"2024-04-26T20:14:20.340721+0000","last_clean":"2024-04-26T20:14:20.340721+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:14:20.340721+0000","last_undegraded":"2024-04-26T20:14:20.340721+0000","last_fullsized":"2024-04-26T20:14:20.340721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496988+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:14:19.496988+0000","last_peered":"2024-04-26T20:14:19.496988+0000","last_clean":"2024-04-26T20:14:19.496988+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:14:19.496988+0000","last_undegraded":"2024-04-26T20:14:19.496988+0000","last_fullsized":"2024-04-26T20:14:19.496988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551847+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:14:20.551847+0000","last_peered":"2024-04-26T20:14:20.551847+0000","last_clean":"2024-04-26T20:14:20.551847+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:14:20.551847+0000","last_undegraded":"2024-04-26T20:14:20.551847+0000","last_fullsized":"2024-04-26T20:14:20.551847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550171+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:14:20.550171+0000","last_peered":"2024-04-26T20:14:20.550171+0000","last_clean":"2024-04-26T20:14:20.550171+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:14:20.550171+0000","last_undegraded":"2024-04-26T20:14:20.550171+0000","last_fullsized":"2024-04-26T20:14:20.550171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537556+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:14:20.537556+0000","last_peered":"2024-04-26T20:14:20.537556+0000","last_clean":"2024-04-26T20:14:20.537556+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:14:20.537556+0000","last_undegraded":"2024-04-26T20:14:20.537556+0000","last_fullsized":"2024-04-26T20:14:20.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884895+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:14:19.884895+0000","last_peered":"2024-04-26T20:14:19.884895+0000","last_clean":"2024-04-26T20:14:19.884895+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:14:19.884895+0000","last_undegraded":"2024-04-26T20:14:19.884895+0000","last_fullsized":"2024-04-26T20:14:19.884895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547283+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:14:20.547283+0000","last_peered":"2024-04-26T20:14:20.547283+0000","last_clean":"2024-04-26T20:14:20.547283+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:14:20.547283+0000","last_undegraded":"2024-04-26T20:14:20.547283+0000","last_fullsized":"2024-04-26T20:14:20.547283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509243+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:14:19.509243+0000","last_peered":"2024-04-26T20:14:19.509243+0000","last_clean":"2024-04-26T20:14:19.509243+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:14:19.509243+0000","last_undegraded":"2024-04-26T20:14:19.509243+0000","last_fullsized":"2024-04-26T20:14:19.509243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505396+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:14:19.505396+0000","last_peered":"2024-04-26T20:14:19.505396+0000","last_clean":"2024-04-26T20:14:19.505396+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:14:19.505396+0000","last_undegraded":"2024-04-26T20:14:19.505396+0000","last_fullsized":"2024-04-26T20:14:19.505396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506202+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:14:19.506202+0000","last_peered":"2024-04-26T20:14:19.506202+0000","last_clean":"2024-04-26T20:14:19.506202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:14:19.506202+0000","last_undegraded":"2024-04-26T20:14:19.506202+0000","last_fullsized":"2024-04-26T20:14:19.506202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341083+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:14:20.341083+0000","last_peered":"2024-04-26T20:14:20.341083+0000","last_clean":"2024-04-26T20:14:20.341083+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:14:20.341083+0000","last_undegraded":"2024-04-26T20:14:20.341083+0000","last_fullsized":"2024-04-26T20:14:20.341083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546910+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:14:20.546910+0000","last_peered":"2024-04-26T20:14:20.546910+0000","last_clean":"2024-04-26T20:14:20.546910+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:14:20.546910+0000","last_undegraded":"2024-04-26T20:14:20.546910+0000","last_fullsized":"2024-04-26T20:14:20.546910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339971+0000","last_change":"2024-04-26T20:14:14.463139+0000","last_active":"2024-04-26T20:14:20.339971+0000","last_peered":"2024-04-26T20:14:20.339971+0000","last_clean":"2024-04-26T20:14:20.339971+0000","last_became_active":"2024-04-26T20:14:14.462083+0000","last_became_peered":"2024-04-26T20:14:14.462083+0000","last_unstale":"2024-04-26T20:14:20.339971+0000","last_undegraded":"2024-04-26T20:14:20.339971+0000","last_fullsized":"2024-04-26T20:14:20.339971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:28.615893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550418+0000","last_change":"2024-04-26T20:14:14.475535+0000","last_active":"2024-04-26T20:14:20.550418+0000","last_peered":"2024-04-26T20:14:20.550418+0000","last_clean":"2024-04-26T20:14:20.550418+0000","last_became_active":"2024-04-26T20:14:14.474445+0000","last_became_peered":"2024-04-26T20:14:14.474445+0000","last_unstale":"2024-04-26T20:14:20.550418+0000","last_undegraded":"2024-04-26T20:14:20.550418+0000","last_fullsized":"2024-04-26T20:14:20.550418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:51.715142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339972+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:14:20.339972+0000","last_peered":"2024-04-26T20:14:20.339972+0000","last_clean":"2024-04-26T20:14:20.339972+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:14:20.339972+0000","last_undegraded":"2024-04-26T20:14:20.339972+0000","last_fullsized":"2024-04-26T20:14:20.339972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551012+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:14:20.551012+0000","last_peered":"2024-04-26T20:14:20.551012+0000","last_clean":"2024-04-26T20:14:20.551012+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:14:20.551012+0000","last_undegraded":"2024-04-26T20:14:20.551012+0000","last_fullsized":"2024-04-26T20:14:20.551012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885153+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:14:19.885153+0000","last_peered":"2024-04-26T20:14:19.885153+0000","last_clean":"2024-04-26T20:14:19.885153+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:14:19.885153+0000","last_undegraded":"2024-04-26T20:14:19.885153+0000","last_fullsized":"2024-04-26T20:14:19.885153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538165+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:14:20.538165+0000","last_peered":"2024-04-26T20:14:20.538165+0000","last_clean":"2024-04-26T20:14:20.538165+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:14:20.538165+0000","last_undegraded":"2024-04-26T20:14:20.538165+0000","last_fullsized":"2024-04-26T20:14:20.538165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340878+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:14:20.340878+0000","last_peered":"2024-04-26T20:14:20.340878+0000","last_clean":"2024-04-26T20:14:20.340878+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:14:20.340878+0000","last_undegraded":"2024-04-26T20:14:20.340878+0000","last_fullsized":"2024-04-26T20:14:20.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":694509,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":694565,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:14:38.618 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T20:14:38.618 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T20:14:38.618 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T20:14:38.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T20:14:38.619 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T20:14:38.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f960b600640 1 Processor -- start 2024-04-26T20:14:38.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f960b600640 1 -- start start 2024-04-26T20:14:38.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f960b600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f96040c7b80 0x7f96040c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f960b600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96040c9d90 con 0x7f9604153af0 2024-04-26T20:14:38.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f960b600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96040ca070 con 0x7f96040c9010 2024-04-26T20:14:38.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f960b600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f960415dec0 con 0x7f96040c7b80 2024-04-26T20:14:38.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9608c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9604153af0 0x7f960415d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41760/0 (socket says 172.21.15.16:41760) 2024-04-26T20:14:38.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9608c00640 1 -- 172.21.15.16:0/989815305 learned_addr learned my addr 172.21.15.16:0/989815305 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:38.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603e00640 1 --2- 172.21.15.16:0/989815305 >> v2:172.21.15.192:3300/0 conn(0x7f96040c7b80 0x7f96040c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427156489 0 0) 0x7f96040c9d90 con 0x7f9604153af0 2024-04-26T20:14:38.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95ec003530 con 0x7f9604153af0 2024-04-26T20:14:38.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4212383920 0 0) 0x7f95ec003530 con 0x7f9604153af0 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 >> v2:172.21.15.192:3300/0 conn(0x7f96040c7b80 msgr2=0x7f96040c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 --2- 172.21.15.16:0/989815305 >> v2:172.21.15.192:3300/0 conn(0x7f96040c7b80 0x7f96040c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 >> v1:172.21.15.192:6789/0 conn(0x7f96040c9010 legacy=0x7f96040c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96040ca350 con 0x7f9604153af0 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f95f8001680 con 0x7f9604153af0 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 >> v1:172.21.15.16:6789/0 conn(0x7f9604153af0 legacy=0x7f960415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95ec0039c0 0x7f95ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95ec004810 0x7f95ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f95ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f960415dec0 con 0x7f95ec0051d0 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec00c080 con 0x7f95ec0039c0 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec00c280 con 0x7f95ec004810 2024-04-26T20:14:38.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9609600640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f95ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9608c00640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95ec0039c0 0x7f95ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9603e00640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95ec004810 0x7f95ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9609600640 1 -- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95ec004810 msgr2=0x7f95ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:38.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9609600640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95ec004810 0x7f95ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9609600640 1 -- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95ec0039c0 msgr2=0x7f95ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:38.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9609600640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95ec0039c0 0x7f95ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.794+0000 7f9609600640 1 -- 172.21.15.16:0/989815305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec003530 con 0x7f95ec0051d0 2024-04-26T20:14:38.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f9609600640 1 -- 172.21.15.16:0/989815305 reap_dead start 2024-04-26T20:14:38.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f9609600640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f95ec00b9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f95fc001e70 tx=0x7f95fc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222252776e1f61b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:38.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc001a90 con 0x7f95ec0051d0 2024-04-26T20:14:38.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc003bc0 con 0x7f95ec0051d0 2024-04-26T20:14:38.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f9603400640 1 -- 172.21.15.16:0/989815305 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc005020 con 0x7f95ec0051d0 2024-04-26T20:14:38.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f960b600640 1 -- 172.21.15.16:0/989815305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 msgr2=0x7f95ec00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f960b600640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f95ec00b9d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f95fc001e70 tx=0x7f95fc01c780 comp rx=0 tx=0).stop 2024-04-26T20:14:38.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f960b600640 1 -- 172.21.15.16:0/989815305 shutdown_connections 2024-04-26T20:14:38.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f960b600640 1 --2- 172.21.15.16:0/989815305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f95ec00b9d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f960b600640 1 -- 172.21.15.16:0/989815305 >> 172.21.15.16:0/989815305 conn(0x7f960406c380 msgr2=0x7f960406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:38.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f960b600640 1 -- 172.21.15.16:0/989815305 shutdown_connections 2024-04-26T20:14:38.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.798+0000 7f960b600640 1 -- 172.21.15.16:0/989815305 wait complete. 2024-04-26T20:14:38.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 Processor -- start 2024-04-26T20:14:38.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 -- start start 2024-04-26T20:14:38.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f9604159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96041e4ae0 0x7f960414a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9604159a00 0x7f960414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f96040ca630 con 0x7f95ec0051d0 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96040c9c10 con 0x7f96041e4ae0 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f960415d290 con 0x7f9604159a00 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f9604159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f9604159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53510/0 (socket says 172.21.15.16:53510) 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 -- 172.21.15.16:0/2536788326 learned_addr learned my addr 172.21.15.16:0/2536788326 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9603e00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96041e4ae0 0x7f960414a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9609600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9604159a00 0x7f960414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 -- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9604159a00 msgr2=0x7f960414aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9604159a00 0x7f960414aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 -- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96041e4ae0 msgr2=0x7f960414a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:38.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96041e4ae0 0x7f960414a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 -- 172.21.15.16:0/2536788326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96041e2f50 con 0x7f95ec0051d0 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9609600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9604159a00 0x7f960414aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9603e00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96041e4ae0 0x7f960414a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9608c00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f9604159190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95f8007290 tx=0x7f95f8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9600c00640 1 -- 172.21.15.16:0/2536788326 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f800f940 con 0x7f95ec0051d0 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9600c00640 1 -- 172.21.15.16:0/2536788326 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f8018070 con 0x7f95ec0051d0 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f9600c00640 1 -- 172.21.15.16:0/2536788326 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f800fd60 con 0x7f95ec0051d0 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96041e3230 con 0x7f95ec0051d0 2024-04-26T20:14:38.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.802+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96041e37f0 con 0x7f95ec0051d0 2024-04-26T20:14:38.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.806+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9604077c20 con 0x7f95ec0051d0 2024-04-26T20:14:38.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.806+0000 7f9600c00640 1 -- 172.21.15.16:0/2536788326 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95f801d460 con 0x7f95ec0051d0 2024-04-26T20:14:38.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.806+0000 7f9600c00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95e4068380 0x7f95e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:38.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.806+0000 7f9600c00640 1 -- 172.21.15.16:0/2536788326 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f95f8086ee0 con 0x7f95ec0051d0 2024-04-26T20:14:38.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.806+0000 7f9603e00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95e4068380 0x7f95e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:38.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.806+0000 7f9603e00640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95e4068380 0x7f95e406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f960415b640 tx=0x7f95f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:38.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:38.810+0000 7f9600c00640 1 -- 172.21.15.16:0/2536788326 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f95f80570c0 con 0x7f95ec0051d0 2024-04-26T20:14:39.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.014+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9604075b30 con 0x7f95ec0051d0 2024-04-26T20:14:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.018+0000 7f9600c00640 1 -- 172.21.15.16:0/2536788326 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168088 (secure 0 0 0) 0x7f95f80569c0 con 0x7f95ec0051d0 2024-04-26T20:14:39.024 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:39.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.018+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95e4068380 msgr2=0x7f95e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.018+0000 7f960b600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95e4068380 0x7f95e406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f960415b640 tx=0x7f95f0008040 comp rx=0 tx=0).stop 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.018+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 msgr2=0x7f9604159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.018+0000 7f960b600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f9604159190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95f8007290 tx=0x7f95f8007750 comp rx=0 tx=0).stop 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 shutdown_connections 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95e4068380 0x7f95e406a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9604159a00 0x7f960414aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96041e4ae0 0x7f960414a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 --2- 172.21.15.16:0/2536788326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95ec0051d0 0x7f9604159190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 >> 172.21.15.16:0/2536788326 conn(0x7f960406c380 msgr2=0x7f96040c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 shutdown_connections 2024-04-26T20:14:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.022+0000 7f960b600640 1 -- 172.21.15.16:0/2536788326 wait complete. 2024-04-26T20:14:39.044 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":773157316},{"type":"v1","addr":"172.21.15.192:6833","nonce":773157316}]},"active_addr":"172.21.15.192:6833/773157316","active_change":"2024-04-26T20:14:00.935160+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2685489098}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":809712711}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2393849889}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3472772505}]}]} 2024-04-26T20:14:39.048 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T20:14:39.048 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T20:14:39.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:39.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca56a00640 1 Processor -- start 2024-04-26T20:14:39.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca56a00640 1 -- start start 2024-04-26T20:14:39.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca56a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fca501574b0 0x7fca500ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca56a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500cb7f0 con 0x7fca500c63f0 2024-04-26T20:14:39.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca56a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500ca0d0 con 0x7fca500b47e0 2024-04-26T20:14:39.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca56a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fca500ccd80 con 0x7fca501574b0 2024-04-26T20:14:39.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca54a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fca500c63f0 0x7fca50164520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41774/0 (socket says 172.21.15.16:41774) 2024-04-26T20:14:39.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca54a00640 1 -- 172.21.15.16:0/3351409376 learned_addr learned my addr 172.21.15.16:0/3351409376 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:39.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca4fe00640 1 --2- 172.21.15.16:0/3351409376 >> v2:172.21.15.192:3300/0 conn(0x7fca501574b0 0x7fca500ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca4ea00640 1 -- 172.21.15.16:0/3351409376 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700800867 0 0) 0x7fca500cb7f0 con 0x7fca500c63f0 2024-04-26T20:14:39.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca4ea00640 1 -- 172.21.15.16:0/3351409376 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca34003530 con 0x7fca500c63f0 2024-04-26T20:14:39.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca4fe00640 1 -- 172.21.15.16:0/3351409376 >> v1:172.21.15.192:6789/0 conn(0x7fca500b47e0 legacy=0x7fca5006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca4fe00640 1 -- 172.21.15.16:0/3351409376 >> v1:172.21.15.16:6789/0 conn(0x7fca500c63f0 legacy=0x7fca50164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca4ea00640 1 -- 172.21.15.16:0/3351409376 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 42957989 0 0) 0x7fca34003530 con 0x7fca500c63f0 2024-04-26T20:14:39.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.186+0000 7fca4fe00640 1 -- 172.21.15.16:0/3351409376 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca500cba90 con 0x7fca501574b0 2024-04-26T20:14:39.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca4fe00640 1 --2- 172.21.15.16:0/3351409376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca501574b0 0x7fca500ca730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca400097c0 tx=0x7fca4001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a494a0d82147bc72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:39.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca4ea00640 1 -- 172.21.15.16:0/3351409376 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca400b0070 con 0x7fca501574b0 2024-04-26T20:14:39.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca4ea00640 1 -- 172.21.15.16:0/3351409376 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca400ab400 con 0x7fca501574b0 2024-04-26T20:14:39.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca4ea00640 1 -- 172.21.15.16:0/3351409376 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48001a00 con 0x7fca501574b0 2024-04-26T20:14:39.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca56a00640 1 -- 172.21.15.16:0/3351409376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca501574b0 msgr2=0x7fca500ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca56a00640 1 --2- 172.21.15.16:0/3351409376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca501574b0 0x7fca500ca730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca400097c0 tx=0x7fca4001c3c0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca56a00640 1 -- 172.21.15.16:0/3351409376 shutdown_connections 2024-04-26T20:14:39.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca56a00640 1 --2- 172.21.15.16:0/3351409376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca501574b0 0x7fca500ca730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca56a00640 1 -- 172.21.15.16:0/3351409376 >> 172.21.15.16:0/3351409376 conn(0x7fca50071160 msgr2=0x7fca50068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:39.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca56a00640 1 -- 172.21.15.16:0/3351409376 shutdown_connections 2024-04-26T20:14:39.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.190+0000 7fca56a00640 1 -- 172.21.15.16:0/3351409376 wait complete. 2024-04-26T20:14:39.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 Processor -- start 2024-04-26T20:14:39.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 -- start start 2024-04-26T20:14:39.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b47e0 0x7fca5015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca500c63f0 0x7fca500ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca501574b0 0x7fca501f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fca50070740 con 0x7fca501574b0 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fca500705c0 con 0x7fca500c63f0 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fca50168460 con 0x7fca500b47e0 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca501574b0 0x7fca501f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca4fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b47e0 0x7fca5015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca501574b0 0x7fca501f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53516/0 (socket says 172.21.15.16:53516) 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 -- 172.21.15.16:0/3485854372 learned_addr learned my addr 172.21.15.16:0/3485854372 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca4f400640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca500c63f0 0x7fca500ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 -- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b47e0 msgr2=0x7fca5015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b47e0 0x7fca5015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 -- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca500c63f0 msgr2=0x7fca500ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca500c63f0 0x7fca500ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 -- 172.21.15.16:0/3485854372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca500cef00 con 0x7fca501574b0 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca54a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca501574b0 0x7fca501f54e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca4800cbc0 tx=0x7fca4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca47e00640 1 -- 172.21.15.16:0/3485854372 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4800ad40 con 0x7fca501574b0 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca47e00640 1 -- 172.21.15.16:0/3485854372 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca48012400 con 0x7fca501574b0 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca47e00640 1 -- 172.21.15.16:0/3485854372 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480127f0 con 0x7fca501574b0 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5015a9d0 con 0x7fca501574b0 2024-04-26T20:14:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.194+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501f8f80 con 0x7fca501574b0 2024-04-26T20:14:39.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.198+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca50077c20 con 0x7fca501574b0 2024-04-26T20:14:39.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.198+0000 7fca47e00640 1 -- 172.21.15.16:0/3485854372 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca48012990 con 0x7fca501574b0 2024-04-26T20:14:39.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.198+0000 7fca47e00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fca30068380 0x7fca3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.198+0000 7fca47e00640 1 -- 172.21.15.16:0/3485854372 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fca48087370 con 0x7fca501574b0 2024-04-26T20:14:39.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.198+0000 7fca4fe00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fca30068380 0x7fca3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.198+0000 7fca4fe00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fca30068380 0x7fca3006a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca400ad000 tx=0x7fca400a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:39.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.202+0000 7fca47e00640 1 -- 172.21.15.16:0/3485854372 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fca500cef00 con 0x7fca501574b0 2024-04-26T20:14:39.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.370+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca50076f90 con 0x7fca501574b0 2024-04-26T20:14:39.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.370+0000 7fca47e00640 1 -- 172.21.15.16:0/3485854372 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fca4807ee20 con 0x7fca501574b0 2024-04-26T20:14:39.376 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:39.376 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:39.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fca30068380 msgr2=0x7fca3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fca30068380 0x7fca3006a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca400ad000 tx=0x7fca400a6000 comp rx=0 tx=0).stop 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca501574b0 msgr2=0x7fca501f54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca501574b0 0x7fca501f54e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca4800cbc0 tx=0x7fca4800a430 comp rx=0 tx=0).stop 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 shutdown_connections 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fca30068380 0x7fca3006a840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca501574b0 0x7fca501f54e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca500c63f0 0x7fca500ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 --2- 172.21.15.16:0/3485854372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b47e0 0x7fca5015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 >> 172.21.15.16:0/3485854372 conn(0x7fca50071160 msgr2=0x7fca50151040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 shutdown_connections 2024-04-26T20:14:39.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.374+0000 7fca56a00640 1 -- 172.21.15.16:0/3485854372 wait complete. 2024-04-26T20:14:39.398 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T20:14:39.398 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:39.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c7600640 1 Processor -- start 2024-04-26T20:14:39.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c7600640 1 -- start start 2024-04-26T20:14:39.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c7600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92c00b1d80 0x7f92c006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c7600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92c00c6340 0x7f92c00703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c7600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c00cfb50 con 0x7f92c00c9e80 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c7600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f92c00cce10 con 0x7f92c00b1d80 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c7600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f92c00cfe10 con 0x7f92c00c6340 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c4c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92c00b1d80 0x7f92c006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c5600640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f92c00c9e80 0x7f92c015c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41780/0 (socket says 172.21.15.16:41780) 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c5600640 1 -- 172.21.15.16:0/1528464125 learned_addr learned my addr 172.21.15.16:0/1528464125 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92b7e00640 1 --2- 172.21.15.16:0/1528464125 >> v2:172.21.15.192:3300/0 conn(0x7f92c00c6340 0x7f92c00703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c4c00640 1 -- 172.21.15.16:0/1528464125 >> v2:172.21.15.192:3300/0 conn(0x7f92c00c6340 msgr2=0x7f92c00703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c4c00640 1 --2- 172.21.15.16:0/1528464125 >> v2:172.21.15.192:3300/0 conn(0x7f92c00c6340 0x7f92c00703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c4c00640 1 -- 172.21.15.16:0/1528464125 >> v1:172.21.15.16:6789/0 conn(0x7f92c00c9e80 legacy=0x7f92c015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92c4c00640 1 -- 172.21.15.16:0/1528464125 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c006d650 con 0x7f92c00b1d80 2024-04-26T20:14:39.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.534+0000 7f92bfe00640 1 -- 172.21.15.16:0/1528464125 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013960832 0 0) 0x7f92c00cfb50 con 0x7f92c00c9e80 2024-04-26T20:14:39.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c4c00640 1 --2- 172.21.15.16:0/1528464125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00b1d80 0x7f92c006feb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f92c0070c30 tx=0x7f92b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aac265fad70c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:39.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92bfe00640 1 -- 172.21.15.16:0/1528464125 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b00aa600 con 0x7f92c00b1d80 2024-04-26T20:14:39.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92bfe00640 1 -- 172.21.15.16:0/1528464125 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b00af070 con 0x7f92c00b1d80 2024-04-26T20:14:39.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92bfe00640 1 -- 172.21.15.16:0/1528464125 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b00aa9c0 con 0x7f92c00b1d80 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 -- 172.21.15.16:0/1528464125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00b1d80 msgr2=0x7f92c006feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 --2- 172.21.15.16:0/1528464125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00b1d80 0x7f92c006feb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f92c0070c30 tx=0x7f92b001c480 comp rx=0 tx=0).stop 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 -- 172.21.15.16:0/1528464125 shutdown_connections 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 --2- 172.21.15.16:0/1528464125 >> v2:172.21.15.192:3300/0 conn(0x7f92c00c6340 0x7f92c00703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 --2- 172.21.15.16:0/1528464125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00b1d80 0x7f92c006feb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 -- 172.21.15.16:0/1528464125 >> 172.21.15.16:0/1528464125 conn(0x7f92c0071160 msgr2=0x7f92c0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 -- 172.21.15.16:0/1528464125 shutdown_connections 2024-04-26T20:14:39.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 -- 172.21.15.16:0/1528464125 wait complete. 2024-04-26T20:14:39.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.538+0000 7f92c7600640 1 Processor -- start 2024-04-26T20:14:39.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 -- start start 2024-04-26T20:14:39.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c00b1d80 0x7f92c00b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00c6340 0x7f92c014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92c00c9e80 0x7f92c01f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f92c00cf6f0 con 0x7f92c00c6340 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0071970 con 0x7f92c00b1d80 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f92c00cf870 con 0x7f92c00c9e80 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00c6340 0x7f92c014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00c6340 0x7f92c014cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53546/0 (socket says 172.21.15.16:53546) 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 -- 172.21.15.16:0/2411546618 learned_addr learned my addr 172.21.15.16:0/2411546618 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c4c00640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c00b1d80 0x7f92c00b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c5600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92c00c9e80 0x7f92c01f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 -- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92c00c9e80 msgr2=0x7f92c01f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92c00c9e80 0x7f92c01f81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 -- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c00b1d80 msgr2=0x7f92c00b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c00b1d80 0x7f92c00b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 -- 172.21.15.16:0/2411546618 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c00cc710 con 0x7f92c00c6340 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c4c00640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c00b1d80 0x7f92c00b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:39.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92b7e00640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00c6340 0x7f92c014cb20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f92a800e8a0 tx=0x7f92a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:39.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92bd600640 1 -- 172.21.15.16:0/2411546618 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8017070 con 0x7f92c00c6340 2024-04-26T20:14:39.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92bd600640 1 -- 172.21.15.16:0/2411546618 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a800c940 con 0x7f92c00c6340 2024-04-26T20:14:39.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92bd600640 1 -- 172.21.15.16:0/2411546618 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a800ccf0 con 0x7f92c00c6340 2024-04-26T20:14:39.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c00b0d00 con 0x7f92c00c6340 2024-04-26T20:14:39.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c00b1570 con 0x7f92c00c6340 2024-04-26T20:14:39.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.542+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c01f8e20 con 0x7f92c00c6340 2024-04-26T20:14:39.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.546+0000 7f92bd600640 1 -- 172.21.15.16:0/2411546618 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f92a801a070 con 0x7f92c00c6340 2024-04-26T20:14:39.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.546+0000 7f92bd600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f929c0683b0 0x7f929c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.546+0000 7f92bd600640 1 -- 172.21.15.16:0/2411546618 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f92a8086c10 con 0x7f92c00c6340 2024-04-26T20:14:39.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.546+0000 7f92c4c00640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f929c0683b0 0x7f929c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.546+0000 7f92c4c00640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f929c0683b0 0x7f929c06a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92b00ae000 tx=0x7f92b00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:39.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.550+0000 7f92bd600640 1 -- 172.21.15.16:0/2411546618 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f92c01f8e20 con 0x7f92c00c6340 2024-04-26T20:14:39.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.714+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92c0077c20 con 0x7f92c00c6340 2024-04-26T20:14:39.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.714+0000 7f92bd600640 1 -- 172.21.15.16:0/2411546618 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f92a8056df0 con 0x7f92c00c6340 2024-04-26T20:14:39.721 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:39.721 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f929c0683b0 msgr2=0x7f929c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f929c0683b0 0x7f929c06a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92b00ae000 tx=0x7f92b00a7000 comp rx=0 tx=0).stop 2024-04-26T20:14:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00c6340 msgr2=0x7f92c014cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00c6340 0x7f92c014cb20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f92a800e8a0 tx=0x7f92a800eca0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 shutdown_connections 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f929c0683b0 0x7f929c06a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f92c00c9e80 0x7f92c01f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92c00c6340 0x7f92c014cb20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 --2- 172.21.15.16:0/2411546618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c00b1d80 0x7f92c00b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 >> 172.21.15.16:0/2411546618 conn(0x7f92c0071160 msgr2=0x7f92c015c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 shutdown_connections 2024-04-26T20:14:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.718+0000 7f92c7600640 1 -- 172.21.15.16:0/2411546618 wait complete. 2024-04-26T20:14:39.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T20:14:39.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T20:14:39.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T20:14:39.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T20:14:39.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T20:14:39.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T20:14:39.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T20:14:39.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.982+0000 7fb257200640 1 Processor -- start 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.982+0000 7fb257200640 1 -- start start 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.982+0000 7fb257200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2500c9ae0 0x7fb25006c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb257200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb25006c8c0 0x7fb2501636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb257200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25015ff70 con 0x7fb250159f70 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb257200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb250160210 con 0x7fb25006c8c0 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb257200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb2500cabe0 con 0x7fb2500c9ae0 2024-04-26T20:14:39.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb255e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb250159f70 0x7fb2500ca4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:45112/0 (socket says 172.21.15.16:45112) 2024-04-26T20:14:39.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb255e00640 1 -- 172.21.15.16:0/2243765190 learned_addr learned my addr 172.21.15.16:0/2243765190 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:39.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb256800640 1 --2- 172.21.15.16:0/2243765190 >> v2:172.21.15.16:3300/0 conn(0x7fb25006c8c0 0x7fb2501636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb255400640 1 --2- 172.21.15.16:0/2243765190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2500c9ae0 0x7fb25006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb255400640 1 -- 172.21.15.16:0/2243765190 >> v2:172.21.15.16:3300/0 conn(0x7fb25006c8c0 msgr2=0x7fb2501636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:39.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb255400640 1 --2- 172.21.15.16:0/2243765190 >> v2:172.21.15.16:3300/0 conn(0x7fb25006c8c0 0x7fb2501636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb255400640 1 -- 172.21.15.16:0/2243765190 >> v1:172.21.15.192:6789/0 conn(0x7fb250159f70 legacy=0x7fb2500ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:39.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.986+0000 7fb255400640 1 -- 172.21.15.16:0/2243765190 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2501604d0 con 0x7fb2500c9ae0 2024-04-26T20:14:39.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76ee400640 1 Processor -- start 2024-04-26T20:14:39.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76ee400640 1 -- start start 2024-04-26T20:14:39.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76ee400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 0x7f76e80c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76ee400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76e80c9410 0x7f76e80c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:39.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76ee400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e8073df0 con 0x7f76e80c86b0 2024-04-26T20:14:39.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76ee400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f76e8072e00 con 0x7f76e80c9410 2024-04-26T20:14:39.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76ee400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f76e81641a0 con 0x7f76e815a050 2024-04-26T20:14:39.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e6a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76e80c9410 0x7f76e80c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e6a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76e80c9410 0x7f76e80c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53566/0 (socket says 172.21.15.16:53566) 2024-04-26T20:14:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e6a00640 1 -- 172.21.15.16:0/713053306 learned_addr learned my addr 172.21.15.16:0/713053306 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e7400640 1 --2- 172.21.15.16:0/713053306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 0x7f76e80c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e6a00640 1 -- 172.21.15.16:0/713053306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 msgr2=0x7f76e80c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e6a00640 1 --2- 172.21.15.16:0/713053306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 0x7f76e80c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:39.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e6a00640 1 -- 172.21.15.16:0/713053306 >> v1:172.21.15.192:6789/0 conn(0x7f76e80c86b0 legacy=0x7f76e8163410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:14:39.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7f76e6a00640 1 -- 172.21.15.16:0/713053306 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e8073050 con 0x7f76e80c9410 2024-04-26T20:14:39.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.990+0000 7ff0cd400640 1 Processor -- start 2024-04-26T20:14:39.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7ff0cd400640 1 -- start start 2024-04-26T20:14:39.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb255400640 1 --2- 172.21.15.16:0/2243765190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2500c9ae0 0x7fb25006c380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb250160140 tx=0x7fb24401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccb887949abb90e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:39.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7f3dfc000640 1 Processor -- start 2024-04-26T20:14:39.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7f3dfc000640 1 -- start start 2024-04-26T20:14:39.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb254a00640 1 -- 172.21.15.16:0/2243765190 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2440b5070 con 0x7fb2500c9ae0 2024-04-26T20:14:39.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb254a00640 1 -- 172.21.15.16:0/2243765190 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2440a8990 con 0x7fb2500c9ae0 2024-04-26T20:14:39.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb254a00640 1 -- 172.21.15.16:0/2243765190 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2440b5070 con 0x7fb2500c9ae0 2024-04-26T20:14:40.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7ff0cd400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff0c8152d00 0x7ff0c80c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 -- 172.21.15.16:0/2243765190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2500c9ae0 msgr2=0x7fb25006c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 --2- 172.21.15.16:0/2243765190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2500c9ae0 0x7fb25006c380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb250160140 tx=0x7fb24401ecb0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7ff0cd400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7f3dfc000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3df40ca390 0x7f3df40ca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 -- 172.21.15.16:0/2243765190 shutdown_connections 2024-04-26T20:14:40.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 --2- 172.21.15.16:0/2243765190 >> v2:172.21.15.16:3300/0 conn(0x7fb25006c8c0 0x7fb2501636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 --2- 172.21.15.16:0/2243765190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2500c9ae0 0x7fb25006c380 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 -- 172.21.15.16:0/2243765190 >> 172.21.15.16:0/2243765190 conn(0x7fb25006e0a0 msgr2=0x7fb25006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 -- 172.21.15.16:0/2243765190 shutdown_connections 2024-04-26T20:14:40.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f76e6a00640 1 --2- 172.21.15.16:0/713053306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c9410 0x7f76e80c8170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009870 tx=0x7f76d801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce33723cee57a0a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7f3df8c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3df40ca390 0x7f3df40ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7f3df8c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3df40ca390 0x7f3df40ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53574/0 (socket says 172.21.15.16:53574) 2024-04-26T20:14:40.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7f3df8c00640 1 -- 172.21.15.16:0/3209187151 learned_addr learned my addr 172.21.15.16:0/3209187151 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df40c75f0 con 0x7f3df40744f0 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df40c5930 con 0x7f3df415c0c0 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3df4074110 con 0x7f3df40ca390 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210178797 0 0) 0x7f3df40c5930 con 0x7f3df415c0c0 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ddc003530 con 0x7f3df415c0c0 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377936366 0 0) 0x7f3df40c75f0 con 0x7f3df40744f0 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df40c5930 con 0x7f3df40744f0 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 925716614 0 0) 0x7f3ddc003530 con 0x7f3df415c0c0 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 >> v2:172.21.15.16:3300/0 conn(0x7f3df40ca390 msgr2=0x7f3df40ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 --2- 172.21.15.16:0/3209187151 >> v2:172.21.15.16:3300/0 conn(0x7f3df40ca390 0x7f3df40ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 >> v1:172.21.15.16:6789/0 conn(0x7f3df40744f0 legacy=0x7f3df4073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7fb257200640 1 -- 172.21.15.16:0/2243765190 wait complete. 2024-04-26T20:14:40.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7fb257200640 1 Processor -- start 2024-04-26T20:14:40.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df40c5bf0 con 0x7f3df415c0c0 2024-04-26T20:14:40.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7ff0c6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff0c8152d00 0x7ff0c80c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7ff0c6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff0c8152d00 0x7ff0c80c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:36990/0 (socket says 172.21.15.16:36990) 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7ff0c6800640 1 -- 172.21.15.16:0/1648729415 learned_addr learned my addr 172.21.15.16:0/1648729415 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.994+0000 7ff0cd400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c80c4b30 con 0x7ff0c8073230 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7ff0cd400640 1 -- 172.21.15.16:0/1648729415 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c80c6f60 con 0x7ff0c8152d00 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7ff0cd400640 1 -- 172.21.15.16:0/1648729415 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c80c7240 con 0x7ff0c815c070 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7ff0c7200640 1 --2- 172.21.15.16:0/1648729415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f7097200640 1 Processor -- start 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f7097200640 1 -- start start 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f7097200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7090074060 0x7f7090073240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f7097200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7090073780 0x7f7090163780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f7097200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70900c9750 con 0x7f709015a460 2024-04-26T20:14:40.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f3dec001a00 con 0x7f3df415c0c0 2024-04-26T20:14:40.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f7097200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f70900c9370 con 0x7f7090073780 2024-04-26T20:14:40.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f7097200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f70900744b0 con 0x7f7090074060 2024-04-26T20:14:40.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7fb257200640 1 -- start start 2024-04-26T20:14:40.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 >> v1:172.21.15.192:6789/0 conn(0x7f3df415c0c0 legacy=0x7f3df415c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7ff0c5400640 1 -- 172.21.15.16:0/1648729415 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484202569 0 0) 0x7ff0c80c4b30 con 0x7ff0c8073230 2024-04-26T20:14:40.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7ff0c5400640 1 -- 172.21.15.16:0/1648729415 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0ac003530 con 0x7ff0c8073230 2024-04-26T20:14:40.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f708f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7090074060 0x7f7090073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f76e6000640 1 -- 172.21.15.16:0/713053306 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d80b5070 con 0x7f76e80c9410 2024-04-26T20:14:40.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f76e6000640 1 -- 172.21.15.16:0/713053306 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d80a89d0 con 0x7f76e80c9410 2024-04-26T20:14:40.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f76e6000640 1 -- 172.21.15.16:0/713053306 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d80a8da0 con 0x7f76e80c9410 2024-04-26T20:14:40.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f708f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7090074060 0x7f7090073240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37002/0 (socket says 172.21.15.16:37002) 2024-04-26T20:14:40.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f708f400640 1 -- 172.21.15.16:0/4204277951 learned_addr learned my addr 172.21.15.16:0/4204277951 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ddc003b50 0x7f3ddc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ddc004810 0x7f3ddc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:39.998+0000 7f3df3e00640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ddc0051d0 0x7f3ddc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7ff0c7200640 1 -- 172.21.15.16:0/1648729415 >> v2:172.21.15.192:3300/0 conn(0x7ff0c8152d00 msgr2=0x7ff0c80c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7ff0c7200640 1 --2- 172.21.15.16:0/1648729415 >> v2:172.21.15.192:3300/0 conn(0x7ff0c8152d00 0x7ff0c80c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7ff0c7200640 1 -- 172.21.15.16:0/1648729415 >> v1:172.21.15.192:6789/0 conn(0x7ff0c8073230 legacy=0x7ff0c80736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb257200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb25006c8c0 0x7fb250153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f708f400640 1 -- 172.21.15.16:0/4204277951 >> v2:172.21.15.16:3300/0 conn(0x7f7090073780 msgr2=0x7f7090163780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f7095200640 1 --2- 172.21.15.16:0/4204277951 >> v2:172.21.15.16:3300/0 conn(0x7f7090073780 0x7f7090163780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 -- 172.21.15.16:0/713053306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c9410 msgr2=0x7f76e80c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 --2- 172.21.15.16:0/713053306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c9410 0x7f76e80c8170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009870 tx=0x7f76d801ed10 comp rx=0 tx=0).stop 2024-04-26T20:14:40.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7ff0c7200640 1 -- 172.21.15.16:0/1648729415 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c80c7520 con 0x7ff0c815c070 2024-04-26T20:14:40.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb257200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2500c9ae0 0x7fb2501f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb257200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb250159f70 0x7fb2501f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb257200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2500c7700 con 0x7fb2500c9ae0 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb25006c8c0 0x7fb250153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb257200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb250160a90 con 0x7fb25006c8c0 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb257200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb25015a350 con 0x7fb250159f70 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb25006c8c0 0x7fb250153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37032/0 (socket says 172.21.15.16:37032) 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 -- 172.21.15.16:0/3836088737 learned_addr learned my addr 172.21.15.16:0/3836088737 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 -- 172.21.15.16:0/713053306 shutdown_connections 2024-04-26T20:14:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 --2- 172.21.15.16:0/713053306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c9410 0x7f76e80c8170 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4074110 con 0x7f3ddc0051d0 2024-04-26T20:14:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc00bf90 con 0x7f3ddc003b50 2024-04-26T20:14:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ddc00c190 con 0x7f3ddc004810 2024-04-26T20:14:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 --2- 172.21.15.16:0/713053306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 0x7f76e80c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 -- 172.21.15.16:0/713053306 >> 172.21.15.16:0/713053306 conn(0x7f76e806c380 msgr2=0x7f76e806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 -- 172.21.15.16:0/713053306 shutdown_connections 2024-04-26T20:14:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df8c00640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ddc004810 0x7f3ddc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb256800640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb250159f70 0x7fb2501f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df9600640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ddc003b50 0x7f3ddc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f76ee400640 1 -- 172.21.15.16:0/713053306 wait complete. 2024-04-26T20:14:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 -- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb250159f70 msgr2=0x7fb2501f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb250159f70 0x7fb2501f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 -- 172.21.15.16:0/3836088737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2500c9ae0 msgr2=0x7fb2501f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2500c9ae0 0x7fb2501f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 -- 172.21.15.16:0/3836088737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2501632d0 con 0x7fb25006c8c0 2024-04-26T20:14:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3dfa000640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ddc0051d0 0x7f3ddc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f9635400640 1 Processor -- start 2024-04-26T20:14:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df8c00640 1 -- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ddc003b50 msgr2=0x7f3ddc003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df8c00640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ddc003b50 0x7f3ddc003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df8c00640 1 -- 172.21.15.16:0/3209187151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ddc0051d0 msgr2=0x7f3ddc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df8c00640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ddc0051d0 0x7f3ddc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3df8c00640 1 -- 172.21.15.16:0/3209187151 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc003530 con 0x7f3ddc004810 2024-04-26T20:14:40.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f3dfa000640 1 -- 172.21.15.16:0/3209187151 reap_dead start 2024-04-26T20:14:40.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f9635400640 1 -- start start 2024-04-26T20:14:40.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f71ad000640 1 Processor -- start 2024-04-26T20:14:40.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f0c50c00640 1 Processor -- start 2024-04-26T20:14:40.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7fb255e00640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb25006c8c0 0x7fb250153630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c420 tx=0x7fb24000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f708f400640 1 --2- 172.21.15.16:0/4204277951 >> v2:172.21.15.16:3300/0 conn(0x7f7090073780 0x7f7090163780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f708f400640 1 -- 172.21.15.16:0/4204277951 >> v1:172.21.15.16:6789/0 conn(0x7f709015a460 legacy=0x7f709006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f708f400640 1 -- 172.21.15.16:0/4204277951 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709006cca0 con 0x7f7090074060 2024-04-26T20:14:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240017070 con 0x7fb25006c8c0 2024-04-26T20:14:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f7095200640 1 --2- 172.21.15.16:0/4204277951 >> v2:172.21.15.16:3300/0 conn(0x7f7090073780 0x7f7090163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb240005cf0 con 0x7fb25006c8c0 2024-04-26T20:14:40.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2400072d0 con 0x7fb25006c8c0 2024-04-26T20:14:40.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f71ad000640 1 -- start start 2024-04-26T20:14:40.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71ad000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f71a80d1df0 0x7f71a815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71ad000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 0x7f71a815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.002+0000 7f0c50c00640 1 -- start start 2024-04-26T20:14:40.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c50c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0c4c070480 0x7f0c4c072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2502027d0 con 0x7fb25006c8c0 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb250162ff0 con 0x7fb25006c8c0 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f9635400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96300ca830 0x7f9630151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f9635400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9630070480 0x7f96301587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f9635400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9630158d00 con 0x7f9630072260 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f9635400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f96300c85c0 con 0x7f96300ca830 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f9635400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f96300c7c90 con 0x7f9630070480 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9630070480 0x7f96301587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9630070480 0x7f96301587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37038/0 (socket says 172.21.15.16:37038) 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962de00640 1 -- 172.21.15.16:0/3323092304 learned_addr learned my addr 172.21.15.16:0/3323092304 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962e800640 1 --2- 172.21.15.16:0/3323092304 >> v2:172.21.15.16:3300/0 conn(0x7f96300ca830 0x7f9630151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71a6a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f71a80d1df0 0x7f71a815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71a6a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f71a80d1df0 0x7f71a815d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37042/0 (socket says 172.21.15.16:37042) 2024-04-26T20:14:40.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71a7400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f71a80d1a10 0x7f71a80b4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:45174/0 (socket says 172.21.15.16:45174) 2024-04-26T20:14:40.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c50c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4c070a10 con 0x7f0c4c06f460 2024-04-26T20:14:40.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c50c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4c0c7c90 con 0x7f0c4c152000 2024-04-26T20:14:40.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c50c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4c0c85c0 con 0x7f0c4c070480 2024-04-26T20:14:40.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c49400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0c4c070480 0x7f0c4c072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f76ee400640 1 Processor -- start 2024-04-26T20:14:40.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2500506d0 con 0x7fb25006c8c0 2024-04-26T20:14:40.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71a6a00640 1 -- 172.21.15.16:0/4245479034 learned_addr learned my addr 172.21.15.16:0/4245479034 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c49400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0c4c070480 0x7f0c4c072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37052/0 (socket says 172.21.15.16:37052) 2024-04-26T20:14:40.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c49400640 1 -- 172.21.15.16:0/3523847030 learned_addr learned my addr 172.21.15.16:0/3523847030 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962e800640 1 -- 172.21.15.16:0/3323092304 >> v2:172.21.15.192:3300/0 conn(0x7f9630070480 msgr2=0x7f96301587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962e800640 1 --2- 172.21.15.16:0/3323092304 >> v2:172.21.15.192:3300/0 conn(0x7f9630070480 0x7f96301587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962e800640 1 -- 172.21.15.16:0/3323092304 >> v1:172.21.15.192:6789/0 conn(0x7f9630072260 legacy=0x7f963006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f962e800640 1 -- 172.21.15.16:0/3323092304 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96300c7f70 con 0x7f96300ca830 2024-04-26T20:14:40.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f708f400640 1 --2- 172.21.15.16:0/4204277951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090074060 0x7f7090073240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7090161320 tx=0x7f707c01c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db2a63f60b6b3868 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7ff0c7200640 1 --2- 172.21.15.16:0/1648729415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c815c4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009d90 tx=0x7ff0c001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d39906ea78e55c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71a7e00640 1 --2- 172.21.15.16:0/4245479034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 0x7f71a815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a80b5120 con 0x7f71a80d1a10 2024-04-26T20:14:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f708ea00640 1 -- 172.21.15.16:0/4204277951 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0b0070 con 0x7f7090074060 2024-04-26T20:14:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f76ee400640 1 -- start start 2024-04-26T20:14:40.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7ff0c5400640 1 -- 172.21.15.16:0/1648729415 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00b2070 con 0x7ff0c815c070 2024-04-26T20:14:40.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f71a815cd40 con 0x7f71a80d1df0 2024-04-26T20:14:40.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f71a80b5400 con 0x7f71a80b40f0 2024-04-26T20:14:40.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c49400640 1 -- 172.21.15.16:0/3523847030 >> v1:172.21.15.192:6789/0 conn(0x7f0c4c152000 legacy=0x7f0c4c1587c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:14:40.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c49400640 1 -- 172.21.15.16:0/3523847030 >> v1:172.21.15.16:6789/0 conn(0x7f0c4c06f460 legacy=0x7f0c4c1626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.006+0000 7f0c49400640 1 -- 172.21.15.16:0/3523847030 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c0c7f70 con 0x7f0c4c070480 2024-04-26T20:14:40.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0c5400640 1 -- 172.21.15.16:0/1648729415 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c00a58d0 con 0x7ff0c815c070 2024-04-26T20:14:40.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0c5400640 1 -- 172.21.15.16:0/1648729415 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00a5ca0 con 0x7ff0c815c070 2024-04-26T20:14:40.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3df8c00640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ddc004810 0x7f3ddc004c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009b10 tx=0x7f3de8020b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba5de9a36db7001e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f708ea00640 1 -- 172.21.15.16:0/4204277951 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c0ab600 con 0x7f7090074060 2024-04-26T20:14:40.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f708ea00640 1 -- 172.21.15.16:0/4204277951 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0ab9d0 con 0x7f7090074060 2024-04-26T20:14:40.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f71a6000640 1 -- 172.21.15.16:0/4245479034 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498963012 0 0) 0x7f71a80b5120 con 0x7f71a80d1a10 2024-04-26T20:14:40.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f71a6000640 1 -- 172.21.15.16:0/4245479034 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f718c003530 con 0x7f71a80d1a10 2024-04-26T20:14:40.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de80b6070 con 0x7f3ddc004810 2024-04-26T20:14:40.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76ee400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c86b0 0x7f76e81ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f71a7e00640 1 -- 172.21.15.16:0/4245479034 >> v2:172.21.15.192:3300/0 conn(0x7f71a80d1df0 msgr2=0x7f71a815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76ee400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e80c9410 0x7f76e81ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f71a7e00640 1 --2- 172.21.15.16:0/4245479034 >> v2:172.21.15.192:3300/0 conn(0x7f71a80d1df0 0x7f71a815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f71a7e00640 1 -- 172.21.15.16:0/4245479034 >> v1:172.21.15.192:6789/0 conn(0x7f71a80d1a10 legacy=0x7f71a80b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f71a7e00640 1 -- 172.21.15.16:0/4245479034 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a80b56e0 con 0x7f71a80b40f0 2024-04-26T20:14:40.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76ee400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 0x7f76e80cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76ee400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76e80738f0 con 0x7f76e80c86b0 2024-04-26T20:14:40.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76ee400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8073610 con 0x7f76e80c9410 2024-04-26T20:14:40.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 -- 172.21.15.16:0/4204277951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090074060 msgr2=0x7f7090073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 --2- 172.21.15.16:0/4204277951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090074060 0x7f7090073240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7090161320 tx=0x7f707c01c4e0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76ee400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f76e8160070 con 0x7f76e815a050 2024-04-26T20:14:40.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 -- 172.21.15.16:0/1648729415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 msgr2=0x7ff0c815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 -- 172.21.15.16:0/4204277951 shutdown_connections 2024-04-26T20:14:40.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 --2- 172.21.15.16:0/4204277951 >> v2:172.21.15.16:3300/0 conn(0x7f7090073780 0x7f7090163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 --2- 172.21.15.16:0/4204277951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090074060 0x7f7090073240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 -- 172.21.15.16:0/4204277951 >> 172.21.15.16:0/4204277951 conn(0x7f709006d490 msgr2=0x7f709006d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb24001a070 con 0x7fb25006c8c0 2024-04-26T20:14:40.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 --2- 172.21.15.16:0/1648729415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c815c4e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009d90 tx=0x7ff0c001c970 comp rx=0 tx=0).stop 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de80a98f0 con 0x7f3ddc004810 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3df3e00640 1 -- 172.21.15.16:0/3209187151 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8009760 con 0x7f3ddc004810 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ddc004810 msgr2=0x7f3ddc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3dfc000640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ddc004810 0x7f3ddc004c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009b10 tx=0x7f3de8020b10 comp rx=0 tx=0).stop 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 -- 172.21.15.16:0/4204277951 shutdown_connections 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 -- 172.21.15.16:0/1648729415 shutdown_connections 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 --2- 172.21.15.16:0/1648729415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c815c4e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 --2- 172.21.15.16:0/1648729415 >> v2:172.21.15.192:3300/0 conn(0x7ff0c8152d00 0x7ff0c80c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 -- 172.21.15.16:0/1648729415 >> 172.21.15.16:0/1648729415 conn(0x7ff0c80c9d10 msgr2=0x7ff0c80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 -- 172.21.15.16:0/1648729415 shutdown_connections 2024-04-26T20:14:40.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 shutdown_connections 2024-04-26T20:14:40.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3dfc000640 1 --2- 172.21.15.16:0/3209187151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ddc004810 0x7f3ddc004c90 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009b10 tx=0x7f3de8020b10 comp rx=0 tx=0).stop 2024-04-26T20:14:40.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 >> 172.21.15.16:0/3209187151 conn(0x7f3df406d490 msgr2=0x7f3df406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 shutdown_connections 2024-04-26T20:14:40.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c86b0 0x7f76e81ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c86b0 0x7f76e81ec8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53636/0 (socket says 172.21.15.16:53636) 2024-04-26T20:14:40.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 -- 172.21.15.16:0/1049543314 learned_addr learned my addr 172.21.15.16:0/1049543314 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f3dfc000640 1 -- 172.21.15.16:0/3209187151 wait complete. 2024-04-26T20:14:40.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f962e800640 1 --2- 172.21.15.16:0/3323092304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96300ca830 0x7f9630151da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f96300747f0 tx=0x7f962001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e68c48ce6dd589a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 -- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 msgr2=0x7f76e80cd2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:14:40.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76e815a050 0x7f76e80cd2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 -- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e80c9410 msgr2=0x7f76e81ebc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:14:40.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e80c9410 0x7f76e81ebc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f76e7400640 1 -- 172.21.15.16:0/1049543314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e81ecf50 con 0x7f76e80c86b0 2024-04-26T20:14:40.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7ff0cd400640 1 -- 172.21.15.16:0/1648729415 wait complete. 2024-04-26T20:14:40.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 Processor -- start 2024-04-26T20:14:40.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f76e7400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c86b0 0x7f76e81ec8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c820 tx=0x7f76d400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 -- start start 2024-04-26T20:14:40.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f0c49400640 1 --2- 172.21.15.16:0/3523847030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c070480 0x7f0c4c072260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3801ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36080f5fbe334c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.010+0000 7f7097200640 1 -- 172.21.15.16:0/4204277951 wait complete. 2024-04-26T20:14:40.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 Processor -- start 2024-04-26T20:14:40.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 -- start start 2024-04-26T20:14:40.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f0c48a00640 1 -- 172.21.15.16:0/3523847030 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c380b5070 con 0x7f0c4c070480 2024-04-26T20:14:40.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f0c48a00640 1 -- 172.21.15.16:0/3523847030 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c380a89d0 con 0x7f0c4c070480 2024-04-26T20:14:40.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f0c48a00640 1 -- 172.21.15.16:0/3523847030 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c380a8da0 con 0x7f0c4c070480 2024-04-26T20:14:40.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f3dfc000640 1 Processor -- start 2024-04-26T20:14:40.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0c8073230 0x7ff0c82053a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c8152d00 0x7ff0c81f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c8201bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d4015070 con 0x7f76e80c86b0 2024-04-26T20:14:40.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d4004240 con 0x7f76e80c86b0 2024-04-26T20:14:40.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d400ce10 con 0x7f76e80c86b0 2024-04-26T20:14:40.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e815c3f0 con 0x7f76e80c86b0 2024-04-26T20:14:40.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0c8073230 0x7ff0c82053a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e815c9b0 con 0x7f76e80c86b0 2024-04-26T20:14:40.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c815cfb0 con 0x7ff0c8073230 2024-04-26T20:14:40.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7fb24a000640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb234068450 0x7fb23406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb240086b00 con 0x7fb25006c8c0 2024-04-26T20:14:40.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7fb24a000640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fb234071bc0 0x7fb234074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c8152d00 0x7ff0c81f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c8152d00 0x7ff0c81f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37068/0 (socket says 172.21.15.16:37068) 2024-04-26T20:14:40.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c5e00640 1 -- 172.21.15.16:0/1297504046 learned_addr learned my addr 172.21.15.16:0/1297504046 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f962d400640 1 -- 172.21.15.16:0/3323092304 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96200b5070 con 0x7f96300ca830 2024-04-26T20:14:40.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f962d400640 1 -- 172.21.15.16:0/3323092304 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96200a8970 con 0x7f96300ca830 2024-04-26T20:14:40.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f962d400640 1 -- 172.21.15.16:0/3323092304 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96200b5070 con 0x7f96300ca830 2024-04-26T20:14:40.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f9635400640 1 -- 172.21.15.16:0/3323092304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96300ca830 msgr2=0x7f9630151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f9635400640 1 --2- 172.21.15.16:0/3323092304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96300ca830 0x7f9630151da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f96300747f0 tx=0x7f962001ec70 comp rx=0 tx=0).stop 2024-04-26T20:14:40.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7fb255400640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb234068450 0x7fb23406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c7200640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c8201bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c815ce30 con 0x7ff0c8152d00 2024-04-26T20:14:40.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c8070500 con 0x7ff0c815c070 2024-04-26T20:14:40.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f0c50c00640 1 -- 172.21.15.16:0/3523847030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c070480 msgr2=0x7f0c4c072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f0c50c00640 1 --2- 172.21.15.16:0/3523847030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c070480 0x7f0c4c072260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3801ecd0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f9635400640 1 -- 172.21.15.16:0/3323092304 shutdown_connections 2024-04-26T20:14:40.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f9635400640 1 --2- 172.21.15.16:0/3323092304 >> v2:172.21.15.192:3300/0 conn(0x7f9630070480 0x7f96301587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7fb256800640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fb234071bc0 0x7fb234074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 --> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb240013e50 con 0x7fb234071bc0 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb240086ef0 con 0x7fb25006c8c0 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090073780 0x7f7090164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7090074060 0x7f70902020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f709015a460 0x7f709016a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f709006cf80 con 0x7f7090074060 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f709015a840 con 0x7f7090073780 2024-04-26T20:14:40.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f7097200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f709015a9c0 con 0x7f709015a460 2024-04-26T20:14:40.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76c0001040 con 0x7f76e80c86b0 2024-04-26T20:14:40.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f9635400640 1 --2- 172.21.15.16:0/3323092304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96300ca830 0x7f9630151da0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f9635400640 1 -- 172.21.15.16:0/3323092304 >> 172.21.15.16:0/3323092304 conn(0x7f96300c9d10 msgr2=0x7f96300ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f71a7e00640 1 --2- 172.21.15.16:0/4245479034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 0x7f71a815d820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71940097c0 tx=0x7f719401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c5ffb33f14bf071 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f708fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090073780 0x7f7090164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f708fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090073780 0x7f7090164260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37078/0 (socket says 172.21.15.16:37078) 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f708fe00640 1 -- 172.21.15.16:0/1493715011 learned_addr learned my addr 172.21.15.16:0/1493715011 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c6800640 1 -- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 msgr2=0x7ff0c8201bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c6800640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0c815c070 0x7ff0c8201bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c6800640 1 -- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c8152d00 msgr2=0x7ff0c81f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c6800640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0c8152d00 0x7ff0c81f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7ff0c6800640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c81ef8e0 con 0x7ff0c8073230 2024-04-26T20:14:40.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f9635400640 1 -- 172.21.15.16:0/3323092304 shutdown_connections 2024-04-26T20:14:40.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f0c50c00640 1 -- 172.21.15.16:0/3523847030 shutdown_connections 2024-04-26T20:14:40.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7095200640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f709015a460 0x7f709016a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71a6000640 1 -- 172.21.15.16:0/4245479034 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71940b5070 con 0x7f71a80b40f0 2024-04-26T20:14:40.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71a6000640 1 -- 172.21.15.16:0/4245479034 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71940a8990 con 0x7f71a80b40f0 2024-04-26T20:14:40.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f9635400640 1 -- 172.21.15.16:0/3323092304 wait complete. 2024-04-26T20:14:40.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f3dfc000640 1 -- start start 2024-04-26T20:14:40.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7fb255400640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb234068450 0x7fb23406a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2440b2000 tx=0x7fb244004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.014+0000 7f0c50c00640 1 --2- 172.21.15.16:0/3523847030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c070480 0x7f0c4c072260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f0c50c00640 1 -- 172.21.15.16:0/3523847030 >> 172.21.15.16:0/3523847030 conn(0x7f0c4c0c9d10 msgr2=0x7f0c4c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfc000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df41e9230 0x7f3df40c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfc000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df40c4780 0x7f3df415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfc000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df41f92e0 0x7f3df41eb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfc000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3df40c7b70 con 0x7f3df40c4780 2024-04-26T20:14:40.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfc000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3df40c7890 con 0x7f3df41e9230 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfc000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3df4152f60 con 0x7f3df41f92e0 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7fb256800640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fb234071bc0 0x7fb234074000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f708f400640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7090074060 0x7f70902020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7095200640 1 -- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090073780 msgr2=0x7f7090164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7095200640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7090073780 0x7f7090164260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7095200640 1 -- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7090074060 msgr2=0x7f70902020e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7095200640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7090074060 0x7f70902020e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7095200640 1 -- 172.21.15.16:0/1493715011 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70900ce430 con 0x7f709015a460 2024-04-26T20:14:40.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f708f400640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7090074060 0x7f70902020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:40.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df41f92e0 0x7f3df41eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df41f92e0 0x7f3df41eb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42134/0 (socket says 172.21.15.16:42134) 2024-04-26T20:14:40.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 -- 172.21.15.16:0/1512483703 learned_addr learned my addr 172.21.15.16:0/1512483703 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 msgr2=0x7f71a815d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71a6000640 1 -- 172.21.15.16:0/4245479034 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71940b5070 con 0x7f71a80b40f0 2024-04-26T20:14:40.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 --2- 172.21.15.16:0/4245479034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 0x7f71a815d820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71940097c0 tx=0x7f719401ec90 comp rx=0 tx=0).stop 2024-04-26T20:14:40.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 shutdown_connections 2024-04-26T20:14:40.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 --2- 172.21.15.16:0/4245479034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 0x7f71a815d820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 --2- 172.21.15.16:0/4245479034 >> v2:172.21.15.192:3300/0 conn(0x7f71a80d1df0 0x7f71a815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 >> 172.21.15.16:0/4245479034 conn(0x7f71a806d090 msgr2=0x7f71a806d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f0c50c00640 1 -- 172.21.15.16:0/3523847030 shutdown_connections 2024-04-26T20:14:40.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7ff0c6800640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0c8073230 0x7ff0c82053a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800e8a0 tx=0x7ff0b800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7095200640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f709015a460 0x7f709016a2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f708800cdf0 tx=0x7f708800a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f0c50c00640 1 -- 172.21.15.16:0/3523847030 wait complete. 2024-04-26T20:14:40.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3df8c00640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df40c4780 0x7f3df415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3df9600640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df41e9230 0x7f3df40c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 -- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df41e9230 msgr2=0x7f3df40c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df41e9230 0x7f3df40c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 -- 172.21.15.16:0/1512483703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df40c4780 msgr2=0x7f3df415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df40c4780 0x7f3df415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 -- 172.21.15.16:0/1512483703 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df415b950 con 0x7f3df41f92e0 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3df9600640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df41e9230 0x7f3df40c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708801a070 con 0x7f709015a460 2024-04-26T20:14:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708800d840 con 0x7f709015a460 2024-04-26T20:14:40.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708800dc70 con 0x7f709015a460 2024-04-26T20:14:40.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 shutdown_connections 2024-04-26T20:14:40.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709015b090 con 0x7f709015a460 2024-04-26T20:14:40.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f76d4007830 con 0x7f76e80c86b0 2024-04-26T20:14:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7090205a90 con 0x7f709015a460 2024-04-26T20:14:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f71ad000640 1 -- 172.21.15.16:0/4245479034 wait complete. 2024-04-26T20:14:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== osd.0 v2:172.21.15.16:6808/3068465968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb240013e50 con 0x7fb234071bc0 2024-04-26T20:14:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f3dfa000640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df41f92e0 0x7f3df41eb690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3df4070300 tx=0x7f3dec00f530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7f9635400640 1 Processor -- start 2024-04-26T20:14:40.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8017070 con 0x7ff0c8073230 2024-04-26T20:14:40.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b800c940 con 0x7ff0c8073230 2024-04-26T20:14:40.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b800cd10 con 0x7ff0c8073230 2024-04-26T20:14:40.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c81efbc0 con 0x7ff0c8073230 2024-04-26T20:14:40.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.018+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c82058e0 con 0x7ff0c8073230 2024-04-26T20:14:40.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7068001040 con 0x7f709015a460 2024-04-26T20:14:40.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec007b70 con 0x7f3df41f92e0 2024-04-26T20:14:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f76df400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76c8068450 0x7f76c806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f76d40870f0 con 0x7f76e80c86b0 2024-04-26T20:14:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f76e6a00640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76c8068450 0x7f76c806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df4159ba0 con 0x7f3df41f92e0 2024-04-26T20:14:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec007d10 con 0x7f3df41f92e0 2024-04-26T20:14:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00fab0 con 0x7f3df41f92e0 2024-04-26T20:14:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41f9770 con 0x7f3df41f92e0 2024-04-26T20:14:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 Processor -- start 2024-04-26T20:14:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 -- start start 2024-04-26T20:14:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f76df400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f76c8071bc0 0x7f76c8074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0a0001040 con 0x7ff0c8073230 2024-04-26T20:14:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3df40696e0 con 0x7f3df41f92e0 2024-04-26T20:14:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f9635400640 1 -- start start 2024-04-26T20:14:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 0x7f71a80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f0c50c00640 1 Processor -- start 2024-04-26T20:14:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80d1a10 0x7f71a8151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71a80d1df0 0x7f71a8152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f76e6a00640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76c8068450 0x7f76c806a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b2000 tx=0x7f76d80aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71a6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80d1a10 0x7f71a8151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f71a80b4d10 con 0x7f71a80d1df0 2024-04-26T20:14:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71a80b5ca0 con 0x7f71a80d1a10 2024-04-26T20:14:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71ad000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f71a80b4e90 con 0x7f71a80b40f0 2024-04-26T20:14:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71a7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71a80d1df0 0x7f71a8152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f9635400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9630070480 0x7f96300c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71a6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80d1a10 0x7f71a8151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37100/0 (socket says 172.21.15.16:37100) 2024-04-26T20:14:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f71a6a00640 1 -- 172.21.15.16:0/4256634134 learned_addr learned my addr 172.21.15.16:0/4256634134 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f708801d070 con 0x7f709015a460 2024-04-26T20:14:40.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f9635400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9630072260 0x7f96300c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f9635400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96300ca830 0x7f963015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f9635400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f96300c8bd0 con 0x7f9630070480 2024-04-26T20:14:40.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f9635400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96300c8a50 con 0x7f96300ca830 2024-04-26T20:14:40.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f9635400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f963006fb70 con 0x7f9630072260 2024-04-26T20:14:40.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f0c50c00640 1 -- start start 2024-04-26T20:14:40.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.022+0000 7f962e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9630070480 0x7f96300c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f76e7e00640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f76c8071bc0 0x7f76c8074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9630070480 0x7f96300c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53682/0 (socket says 172.21.15.16:53682) 2024-04-26T20:14:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962e800640 1 -- 172.21.15.16:0/3299704540 learned_addr learned my addr 172.21.15.16:0/3299704540 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962f200640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96300ca830 0x7f963015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71a6a00640 1 -- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 msgr2=0x7f71a80cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71a6a00640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71a80b40f0 0x7f71a80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71a6a00640 1 -- 172.21.15.16:0/4256634134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71a80d1df0 msgr2=0x7f71a8152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71a6a00640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71a80d1df0 0x7f71a8152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71a6a00640 1 -- 172.21.15.16:0/4256634134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a81f5880 con 0x7f71a80d1a10 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71a7e00640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71a80d1df0 0x7f71a8152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71a6a00640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80d1a10 0x7f71a8151ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f719800e8a0 tx=0x7f719800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c50c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c06f460 0x7f0c4c146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c50c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c4c070480 0x7f0c4c147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c50c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c4c152000 0x7f0c4c141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c50c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0c8a50 con 0x7f0c4c152000 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c50c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0727a0 con 0x7f0c4c06f460 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c50c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4c0c8bd0 con 0x7f0c4c070480 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c49e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c06f460 0x7f0c4c146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c4c152000 0x7f0c4c141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0b801a070 con 0x7ff0c8073230 2024-04-26T20:14:40.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c4c152000 0x7f0c4c141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53684/0 (socket says 172.21.15.16:53684) 2024-04-26T20:14:40.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 -- 172.21.15.16:0/434532477 learned_addr learned my addr 172.21.15.16:0/434532477 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f7087e00640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f70700683d0 0x7f707006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3dec01b020 con 0x7f3df41f92e0 2024-04-26T20:14:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7088016e30 con 0x7f709015a460 2024-04-26T20:14:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f708fe00640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f70700683d0 0x7f707006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f7087e00640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7f7070072790 0x7f7070074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 --> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7070075300 con 0x7f7070072790 2024-04-26T20:14:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7088053ad0 con 0x7f709015a460 2024-04-26T20:14:40.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 --> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76d400bfa0 con 0x7f76c8071bc0 2024-04-26T20:14:40.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f76d40874e0 con 0x7f76e80c86b0 2024-04-26T20:14:40.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df1600640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3dd4068480 0x7f3dd406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3dec087000 con 0x7f3df41f92e0 2024-04-26T20:14:40.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962de00640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9630072260 0x7f96300c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962f200640 1 -- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9630072260 msgr2=0x7f96300c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962f200640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9630072260 0x7f96300c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962f200640 1 -- 172.21.15.16:0/3299704540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9630070480 msgr2=0x7f96300c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962f200640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9630070480 0x7f96300c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962f200640 1 -- 172.21.15.16:0/3299704540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963015a3d0 con 0x7f96300ca830 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c49400640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c4c070480 0x7f0c4c147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 -- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c4c070480 msgr2=0x7f0c4c147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c4c070480 0x7f0c4c147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 -- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c06f460 msgr2=0x7f0c4c146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c4c06f460 0x7f0c4c146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 -- 172.21.15.16:0/434532477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c0cc1a0 con 0x7f0c4c152000 2024-04-26T20:14:40.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0bea00640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0a8068400 0x7ff0a806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df1600640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7f3dd4071bf0 0x7f3dd4074030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 --> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dd4074700 con 0x7f3dd4071bf0 2024-04-26T20:14:40.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c4a800640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c4c152000 0x7f0c4c141a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c440 tx=0x7f0c3c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3dec0873f0 con 0x7f3df41f92e0 2024-04-26T20:14:40.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff0b8086d60 con 0x7ff0c8073230 2024-04-26T20:14:40.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0bea00640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7ff0a8071af0 0x7ff0a8073f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f708f400640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7f7070072790 0x7f7070074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f76e7e00640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f76c8071bc0 0x7f76c8074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0c5e00640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0a8068400 0x7ff0a806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df9600640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3dd4068480 0x7f3dd406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c017070 con 0x7f0c4c152000 2024-04-26T20:14:40.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c003600 con 0x7f0c4c152000 2024-04-26T20:14:40.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c017070 con 0x7f0c4c152000 2024-04-26T20:14:40.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198017070 con 0x7f71a80d1a10 2024-04-26T20:14:40.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719800c940 con 0x7f71a80d1a10 2024-04-26T20:14:40.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719800cd10 con 0x7f71a80d1a10 2024-04-26T20:14:40.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f3df8c00640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7f3dd4071bf0 0x7f3dd4074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f962f200640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96300ca830 0x7f963015ae70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f962800c760 tx=0x7f962800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0a8074600 con 0x7ff0a8071af0 2024-04-26T20:14:40.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0b8052da0 con 0x7ff0c8073230 2024-04-26T20:14:40.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7ff0c7200640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7ff0a8071af0 0x7ff0a8073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a81f5b60 con 0x7f71a80d1a10 2024-04-26T20:14:40.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628016020 con 0x7f96300ca830 2024-04-26T20:14:40.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628006d60 con 0x7f96300ca830 2024-04-26T20:14:40.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.026+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81f6120 con 0x7f71a80d1a10 2024-04-26T20:14:40.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628003bc0 con 0x7f96300ca830 2024-04-26T20:14:40.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963014d960 con 0x7f96300ca830 2024-04-26T20:14:40.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c0cc480 con 0x7f0c4c152000 2024-04-26T20:14:40.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f708fe00640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f70700683d0 0x7f707006a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70800099b0 tx=0x7f7080009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== osd.2 v2:172.21.15.16:6816/2566691617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76d400bfa0 con 0x7f76c8071bc0 2024-04-26T20:14:40.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c146430 con 0x7f0c4c152000 2024-04-26T20:14:40.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7ff0c5e00640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0a8068400 0x7ff0a806a8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0c81f7d60 tx=0x7ff0b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f3df8c00640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7f3dd4071bf0 0x7f3dd4074030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f3df9600640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3dd4068480 0x7f3dd406a940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3df406adf0 tx=0x7f3de0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963015a670 con 0x7f96300ca830 2024-04-26T20:14:40.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f708f400640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7f7070072790 0x7f7070074c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7180001040 con 0x7f71a80d1a10 2024-04-26T20:14:40.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c4c0cbf50 con 0x7f0c4c152000 2024-04-26T20:14:40.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9630077c20 con 0x7f96300ca830 2024-04-26T20:14:40.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7ff0c7200640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7ff0a8071af0 0x7ff0a8073f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== osd.4 v2:172.21.15.192:6800/1921936919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dd4074700 con 0x7f3dd4071bf0 2024-04-26T20:14:40.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.030+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== osd.1 v2:172.21.15.16:6800/1572811015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7070075300 con 0x7f7070072790 2024-04-26T20:14:40.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== osd.3 v2:172.21.15.16:6824/3915935540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0a8074600 con 0x7ff0a8071af0 2024-04-26T20:14:40.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f962800a850 con 0x7f96300ca830 2024-04-26T20:14:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f719801a070 con 0x7f71a80d1a10 2024-04-26T20:14:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f719f400640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f71880683d0 0x7f718806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7198087260 con 0x7f71a80d1a10 2024-04-26T20:14:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f719f400640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f7188071b50 0x7f7188073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 --> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7198013e50 con 0x7f7188071b50 2024-04-26T20:14:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7198087740 con 0x7f71a80d1a10 2024-04-26T20:14:40.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f71a7400640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f71880683d0 0x7f718806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f71a7e00640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f7188071b50 0x7f7188073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f9626a00640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9610068480 0x7f961006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f71a7400640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f71880683d0 0x7f718806a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71a0001d20 tx=0x7f71a0007cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9628087510 con 0x7f96300ca830 2024-04-26T20:14:40.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f962e800640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9610068480 0x7f961006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c3c0037d0 con 0x7f0c4c152000 2024-04-26T20:14:40.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.034+0000 7f9626a00640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f9610071c00 0x7f9610074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 --> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9628024e50 con 0x7f9610071c00 2024-04-26T20:14:40.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9628087900 con 0x7f96300ca830 2024-04-26T20:14:40.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c42000640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c2c068580 0x7f0c2c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f962e800640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9610068480 0x7f961006a940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96200091d0 tx=0x7f96200aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c3c086080 con 0x7f0c4c152000 2024-04-26T20:14:40.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c42000640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f0c2c071cf0 0x7f0c2c074130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 --> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c3c013e50 con 0x7f0c2c071cf0 2024-04-26T20:14:40.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0c3c086470 con 0x7f0c4c152000 2024-04-26T20:14:40.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c49400640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f0c2c071cf0 0x7f0c2c074130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f71a7e00640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f7188071b50 0x7f7188073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c49e00640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c2c068580 0x7f0c2c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f962de00640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f9610071c00 0x7f9610074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c49400640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f0c2c071cf0 0x7f0c2c074130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.038+0000 7f0c49e00640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c2c068580 0x7f0c2c06aa40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009fd0 tx=0x7f0c4400d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.042+0000 7f962de00640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f9610071c00 0x7f9610074040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.042+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== osd.6 v2:172.21.15.192:6808/3572924654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7198013e50 con 0x7f7188071b50 2024-04-26T20:14:40.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.042+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== osd.7 v2:172.21.15.192:6824/3143162750 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c3c013e50 con 0x7f0c2c071cf0 2024-04-26T20:14:40.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.046+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== osd.5 v2:172.21.15.192:6811/3980303039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9628024e50 con 0x7f9610071c00 2024-04-26T20:14:40.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.054+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 --> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2500c40d0 con 0x7fb234071bc0 2024-04-26T20:14:40.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.058+0000 7fb24a000640 1 -- 172.21.15.16:0/3836088737 <== osd.0 v2:172.21.15.16:6808/3068465968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb2500c40d0 con 0x7fb234071bc0 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.058+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fb234071bc0 msgr2=0x7fb234074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.058+0000 7fb257200640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fb234071bc0 0x7fb234074000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.058+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb234068450 msgr2=0x7fb23406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.058+0000 7fb257200640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb234068450 0x7fb23406a910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb2440b2000 tx=0x7fb244004740 comp rx=0 tx=0).stop 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.058+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb25006c8c0 msgr2=0x7fb250153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.058+0000 7fb257200640 1 --2- 172.21.15.16:0/3836088737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb25006c8c0 0x7fb250153630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c420 tx=0x7fb24000c8e0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7fb256800640 1 -- 172.21.15.16:0/3836088737 reap_dead start 2024-04-26T20:14:40.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 --> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76c0002de0 con 0x7f76c8071bc0 2024-04-26T20:14:40.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 shutdown_connections 2024-04-26T20:14:40.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 >> 172.21.15.16:0/3836088737 conn(0x7fb25006e0a0 msgr2=0x7fb250073240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 shutdown_connections 2024-04-26T20:14:40.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7fb257200640 1 -- 172.21.15.16:0/3836088737 wait complete. 2024-04-26T20:14:40.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76df400640 1 -- 172.21.15.16:0/1049543314 <== osd.2 v2:172.21.15.16:6816/2566691617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f76c0002de0 con 0x7f76c8071bc0 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f76c8071bc0 msgr2=0x7f76c8074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f76c8071bc0 0x7f76c8074000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76c8068450 msgr2=0x7f76c806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76c8068450 0x7f76c806a910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b2000 tx=0x7f76d80aa070 comp rx=0 tx=0).stop 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c86b0 msgr2=0x7f76e81ec8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 --2- 172.21.15.16:0/1049543314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e80c86b0 0x7f76e81ec8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f76d400c820 tx=0x7f76d400cce0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76e7e00640 1 -- 172.21.15.16:0/1049543314 reap_dead start 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 shutdown_connections 2024-04-26T20:14:40.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 >> 172.21.15.16:0/1049543314 conn(0x7f76e806c380 msgr2=0x7f76e80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 --> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3df4149a70 con 0x7f3dd4071bf0 2024-04-26T20:14:40.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 shutdown_connections 2024-04-26T20:14:40.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.062+0000 7f76ee400640 1 -- 172.21.15.16:0/1049543314 wait complete. 2024-04-26T20:14:40.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 --> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7180002de0 con 0x7f7188071b50 2024-04-26T20:14:40.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 --> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7068002de0 con 0x7f7070072790 2024-04-26T20:14:40.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3df1600640 1 -- 172.21.15.16:0/1512483703 <== osd.4 v2:172.21.15.192:6800/1921936919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3df4149a70 con 0x7f3dd4071bf0 2024-04-26T20:14:40.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7087e00640 1 -- 172.21.15.16:0/1493715011 <== osd.1 v2:172.21.15.16:6800/1572811015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7068002de0 con 0x7f7070072790 2024-04-26T20:14:40.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 --> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0a0002de0 con 0x7ff0a8071af0 2024-04-26T20:14:40.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7f3dd4071bf0 msgr2=0x7f3dd4074030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7f3dd4071bf0 0x7f3dd4074030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f719f400640 1 -- 172.21.15.16:0/4256634134 <== osd.6 v2:172.21.15.192:6808/3572924654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7180002de0 con 0x7f7188071b50 2024-04-26T20:14:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 --> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c4c148390 con 0x7f0c2c071cf0 2024-04-26T20:14:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3dd4068480 msgr2=0x7f3dd406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3dd4068480 0x7f3dd406a940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3df406adf0 tx=0x7f3de0009040 comp rx=0 tx=0).stop 2024-04-26T20:14:40.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df41f92e0 msgr2=0x7f3df41eb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7f7070072790 msgr2=0x7f7070074c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 --2- 172.21.15.16:0/1512483703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df41f92e0 0x7f3df41eb690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3df4070300 tx=0x7f3dec00f530 comp rx=0 tx=0).stop 2024-04-26T20:14:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7f7070072790 0x7f7070074c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfa000640 1 -- 172.21.15.16:0/1512483703 reap_dead start 2024-04-26T20:14:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f7188071b50 msgr2=0x7f7188073f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71ad000640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f7188071b50 0x7f7188073f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 shutdown_connections 2024-04-26T20:14:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 >> 172.21.15.16:0/1512483703 conn(0x7f3df406d490 msgr2=0x7f3df40738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f70700683d0 msgr2=0x7f707006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f70700683d0 0x7f707006a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70800099b0 tx=0x7f7080009110 comp rx=0 tx=0).stop 2024-04-26T20:14:40.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f71880683d0 msgr2=0x7f718806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71ad000640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f71880683d0 0x7f718806a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f71a0001d20 tx=0x7f71a0007cb0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f709015a460 msgr2=0x7f709016a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 --2- 172.21.15.16:0/1493715011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f709015a460 0x7f709016a2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f708800cdf0 tx=0x7f708800a710 comp rx=0 tx=0).stop 2024-04-26T20:14:40.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7095200640 1 -- 172.21.15.16:0/1493715011 reap_dead start 2024-04-26T20:14:40.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80d1a10 msgr2=0x7f71a8151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71ad000640 1 --2- 172.21.15.16:0/4256634134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80d1a10 0x7f71a8151ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f719800e8a0 tx=0x7f719800ed60 comp rx=0 tx=0).stop 2024-04-26T20:14:40.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7ff0bea00640 1 -- 172.21.15.16:0/1297504046 <== osd.3 v2:172.21.15.16:6824/3915935540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0a0002de0 con 0x7ff0a8071af0 2024-04-26T20:14:40.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f71a7e00640 1 -- 172.21.15.16:0/4256634134 reap_dead start 2024-04-26T20:14:40.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 shutdown_connections 2024-04-26T20:14:40.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.066+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 >> 172.21.15.16:0/1493715011 conn(0x7f709006d490 msgr2=0x7f709015ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 shutdown_connections 2024-04-26T20:14:40.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 shutdown_connections 2024-04-26T20:14:40.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f7097200640 1 -- 172.21.15.16:0/1493715011 wait complete. 2024-04-26T20:14:40.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f3dfc000640 1 -- 172.21.15.16:0/1512483703 wait complete. 2024-04-26T20:14:40.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c42000640 1 -- 172.21.15.16:0/434532477 <== osd.7 v2:172.21.15.192:6824/3143162750 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0c4c148390 con 0x7f0c2c071cf0 2024-04-26T20:14:40.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 shutdown_connections 2024-04-26T20:14:40.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 >> 172.21.15.16:0/4256634134 conn(0x7f71a806d090 msgr2=0x7f71a815d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7ff0a8071af0 msgr2=0x7ff0a8073f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7ff0a8071af0 0x7ff0a8073f30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0a8068400 msgr2=0x7ff0a806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0a8068400 0x7ff0a806a8c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0c81f7d60 tx=0x7ff0b4009040 comp rx=0 tx=0).stop 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0c8073230 msgr2=0x7ff0c82053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 --2- 172.21.15.16:0/1297504046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0c8073230 0x7ff0c82053a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800e8a0 tx=0x7ff0b800ed60 comp rx=0 tx=0).stop 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0c7200640 1 -- 172.21.15.16:0/1297504046 reap_dead start 2024-04-26T20:14:40.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 shutdown_connections 2024-04-26T20:14:40.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f0c2c071cf0 msgr2=0x7f0c2c074130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c50c00640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f0c2c071cf0 0x7f0c2c074130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f71ad000640 1 -- 172.21.15.16:0/4256634134 wait complete. 2024-04-26T20:14:40.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c2c068580 msgr2=0x7f0c2c06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c50c00640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c2c068580 0x7f0c2c06aa40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009fd0 tx=0x7f0c4400d040 comp rx=0 tx=0).stop 2024-04-26T20:14:40.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c4c152000 msgr2=0x7f0c4c141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c50c00640 1 --2- 172.21.15.16:0/434532477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c4c152000 0x7f0c4c141a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c440 tx=0x7f0c3c00c900 comp rx=0 tx=0).stop 2024-04-26T20:14:40.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7f0c4a800640 1 -- 172.21.15.16:0/434532477 reap_dead start 2024-04-26T20:14:40.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 shutdown_connections 2024-04-26T20:14:40.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 >> 172.21.15.16:0/1297504046 conn(0x7ff0c80c9d10 msgr2=0x7ff0c80736a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 shutdown_connections 2024-04-26T20:14:40.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.070+0000 7ff0cd400640 1 -- 172.21.15.16:0/1297504046 wait complete. 2024-04-26T20:14:40.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.078+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 shutdown_connections 2024-04-26T20:14:40.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.078+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 >> 172.21.15.16:0/434532477 conn(0x7f0c4c0c9d10 msgr2=0x7f0c4c0c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.078+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 shutdown_connections 2024-04-26T20:14:40.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.078+0000 7f0c50c00640 1 -- 172.21.15.16:0/434532477 wait complete. 2024-04-26T20:14:40.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.082+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 --> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9630074100 con 0x7f9610071c00 2024-04-26T20:14:40.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.086+0000 7f9626a00640 1 -- 172.21.15.16:0/3299704540 <== osd.5 v2:172.21.15.192:6811/3980303039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9630074100 con 0x7f9610071c00 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.094+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f9610071c00 msgr2=0x7f9610074040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.094+0000 7f9635400640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f9610071c00 0x7f9610074040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.094+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9610068480 msgr2=0x7f961006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.094+0000 7f9635400640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9610068480 0x7f961006a940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96200091d0 tx=0x7f96200aa070 comp rx=0 tx=0).stop 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.094+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96300ca830 msgr2=0x7f963015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.094+0000 7f9635400640 1 --2- 172.21.15.16:0/3299704540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96300ca830 0x7f963015ae70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f962800c760 tx=0x7f962800cc20 comp rx=0 tx=0).stop 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.098+0000 7f962f200640 1 -- 172.21.15.16:0/3299704540 reap_dead start 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.102+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 shutdown_connections 2024-04-26T20:14:40.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.102+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 >> 172.21.15.16:0/3299704540 conn(0x7f96300c9d10 msgr2=0x7f96300ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.102+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 shutdown_connections 2024-04-26T20:14:40.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.102+0000 7f9635400640 1 -- 172.21.15.16:0/3299704540 wait complete. 2024-04-26T20:14:40.118 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:40.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T20:14:40.119 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:40.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T20:14:40.121 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:40.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T20:14:40.126 INFO:teuthology.orchestra.run.smithi016.stdout:60129542154 2024-04-26T20:14:40.126 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T20:14:40.130 INFO:teuthology.orchestra.run.smithi016.stdout:60129542153 2024-04-26T20:14:40.131 INFO:teuthology.orchestra.run.smithi016.stdout:60129542153 2024-04-26T20:14:40.131 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T20:14:40.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T20:14:40.138 INFO:teuthology.orchestra.run.smithi016.stdout:60129542154 2024-04-26T20:14:40.138 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:40.139 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T20:14:40.139 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T20:14:40.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.350+0000 7fd089c00640 1 Processor -- start 2024-04-26T20:14:40.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.350+0000 7fd089c00640 1 -- start start 2024-04-26T20:14:40.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd089c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd07c04cd30 0x7fd07c04d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd089c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c04db90 0x7fd07c0dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd089c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c04e8a0 con 0x7fd07c0d7070 2024-04-26T20:14:40.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd089c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd07c04eb60 con 0x7fd07c04cd30 2024-04-26T20:14:40.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd089c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd07c0e0270 con 0x7fd07c04db90 2024-04-26T20:14:40.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd083e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd07c0d7070 0x7fd07c04e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:45188/0 (socket says 172.21.15.16:45188) 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd083e00640 1 -- 172.21.15.16:0/709304959 learned_addr learned my addr 172.21.15.16:0/709304959 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd089200640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c04db90 0x7fd07c0dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5194129 0 0) 0x7fd07c04e8a0 con 0x7fd07c0d7070 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd06c003530 con 0x7fd07c0d7070 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3194542294 0 0) 0x7fd06c003530 con 0x7fd07c0d7070 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c04db90 msgr2=0x7fd07c0dcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c04db90 0x7fd07c0dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 >> v2:172.21.15.16:3300/0 conn(0x7fd07c04cd30 msgr2=0x7fd07c04d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 --2- 172.21.15.16:0/709304959 >> v2:172.21.15.16:3300/0 conn(0x7fd07c04cd30 0x7fd07c04d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c0e0550 con 0x7fd07c0d7070 2024-04-26T20:14:40.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fd070001660 con 0x7fd07c0d7070 2024-04-26T20:14:40.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 >> v1:172.21.15.192:6789/0 conn(0x7fd07c0d7070 legacy=0x7fd07c04e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd06c003a20 0x7fd06c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd06c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd06c0052f0 0x7fd06c00fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c04eb60 con 0x7fd06c004810 2024-04-26T20:14:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c0e0270 con 0x7fd06c003a20 2024-04-26T20:14:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c005d10 con 0x7fd06c0052f0 2024-04-26T20:14:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.354+0000 7fd083e00640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd06c003a20 0x7fd06c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7fd083400640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd06c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7fd083400640 1 -- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd06c0052f0 msgr2=0x7fd06c00fde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T20:14:40.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7fd083400640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd06c0052f0 0x7fd06c00fde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7fd083400640 1 -- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd06c003a20 msgr2=0x7fd06c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7fd083400640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd06c003a20 0x7fd06c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7fd083400640 1 -- 172.21.15.16:0/709304959 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c0e0550 con 0x7fd06c004810 2024-04-26T20:14:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7f25fe000640 1 Processor -- start 2024-04-26T20:14:40.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.358+0000 7f25fe000640 1 -- start start 2024-04-26T20:14:40.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25fe000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f8155fb0 0x7f25f815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fd083400640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd06c004c90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd08406b120 tx=0x7fd084099740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52654969a5d9901c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25fe000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25f806f460 0x7f25f806f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25fe000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f8072d60 con 0x7f25f8156390 2024-04-26T20:14:40.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25fe000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f25f8073c10 con 0x7f25f806f460 2024-04-26T20:14:40.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25fe000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f25f8160340 con 0x7f25f8155fb0 2024-04-26T20:14:40.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f8155fb0 0x7f25f815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f8155fb0 0x7f25f815fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42194/0 (socket says 172.21.15.16:42194) 2024-04-26T20:14:40.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084051660 con 0x7fd06c004810 2024-04-26T20:14:40.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7400640 1 -- 172.21.15.16:0/1977707504 learned_addr learned my addr 172.21.15.16:0/1977707504 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fb137e00640 1 Processor -- start 2024-04-26T20:14:40.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd084128470 con 0x7fd06c004810 2024-04-26T20:14:40.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fd082a00640 1 -- 172.21.15.16:0/709304959 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084051660 con 0x7fd06c004810 2024-04-26T20:14:40.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7e00640 1 --2- 172.21.15.16:0/1977707504 >> v2:172.21.15.192:3300/0 conn(0x7f25f806f460 0x7f25f806f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fb137e00640 1 -- start start 2024-04-26T20:14:40.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7400640 1 -- 172.21.15.16:0/1977707504 >> v2:172.21.15.192:3300/0 conn(0x7f25f806f460 msgr2=0x7f25f806f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7400640 1 --2- 172.21.15.16:0/1977707504 >> v2:172.21.15.192:3300/0 conn(0x7f25f806f460 0x7f25f806f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7400640 1 -- 172.21.15.16:0/1977707504 >> v1:172.21.15.192:6789/0 conn(0x7f25f8156390 legacy=0x7f25f8070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f6000640 1 -- 172.21.15.16:0/1977707504 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2591747519 0 0) 0x7f25f8072d60 con 0x7f25f8156390 2024-04-26T20:14:40.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7f25f7400640 1 -- 172.21.15.16:0/1977707504 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f8070880 con 0x7f25f8155fb0 2024-04-26T20:14:40.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fd089c00640 1 -- 172.21.15.16:0/709304959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 msgr2=0x7fd06c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fd089c00640 1 --2- 172.21.15.16:0/709304959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd06c004c90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd08406b120 tx=0x7fd084099740 comp rx=0 tx=0).stop 2024-04-26T20:14:40.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.362+0000 7fd089200640 1 -- 172.21.15.16:0/709304959 reap_dead start 2024-04-26T20:14:40.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fd089c00640 1 -- 172.21.15.16:0/709304959 shutdown_connections 2024-04-26T20:14:40.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fd089c00640 1 -- 172.21.15.16:0/709304959 >> 172.21.15.16:0/709304959 conn(0x7fd07c00e870 msgr2=0x7fd07c0523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fd089c00640 1 -- 172.21.15.16:0/709304959 shutdown_connections 2024-04-26T20:14:40.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb137e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1380c89d0 0x7fb1380c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7f581b200640 1 Processor -- start 2024-04-26T20:14:40.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7f581b200640 1 -- start start 2024-04-26T20:14:40.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb136a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1380c89d0 0x7fb1380c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb137400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb1380ca090 0x7fb138163a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41812/0 (socket says 172.21.15.16:41812) 2024-04-26T20:14:40.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb136a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1380c89d0 0x7fb1380c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37140/0 (socket says 172.21.15.16:37140) 2024-04-26T20:14:40.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb137400640 1 -- 172.21.15.16:0/1211563483 learned_addr learned my addr 172.21.15.16:0/1211563483 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:40.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1380c6e20 con 0x7fb1380ca090 2024-04-26T20:14:40.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1380c70b0 con 0x7fb1380c8db0 2024-04-26T20:14:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fd089c00640 1 -- 172.21.15.16:0/709304959 wait complete. 2024-04-26T20:14:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fd089c00640 1 Processor -- start 2024-04-26T20:14:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fb1380c6500 con 0x7fb1380c89d0 2024-04-26T20:14:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fb135600640 1 -- 172.21.15.16:0/1211563483 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204967779 0 0) 0x7fb1380c6e20 con 0x7fb1380ca090 2024-04-26T20:14:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.366+0000 7fd089c00640 1 -- start start 2024-04-26T20:14:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f25f7400640 1 --2- 172.21.15.16:0/1977707504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f8155fb0 0x7f25f815fe00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009870 tx=0x7f25e401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbc3fa3f4fb846c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fb135600640 1 -- 172.21.15.16:0/1211563483 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb11c003530 con 0x7fb1380ca090 2024-04-26T20:14:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f581b200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58140e2210 0x7f5814038810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fb135600640 1 -- 172.21.15.16:0/1211563483 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1751245698 0 0) 0x7fb1380c70b0 con 0x7fb1380c8db0 2024-04-26T20:14:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fb135600640 1 -- 172.21.15.16:0/1211563483 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1380c6e20 con 0x7fb1380c8db0 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58140e2210 0x7f5814038810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f581b200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58140e2210 0x7f5814038810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37148/0 (socket says 172.21.15.16:37148) 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5814050920 0x7f58140e25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41822/0 (socket says 172.21.15.16:41822) 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f581b200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581404f7c0 con 0x7f5814050920 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f581b200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f5814006dc0 con 0x7f58140e2210 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f581b200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f58140070a0 con 0x7f5814038d50 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819e00640 1 -- 172.21.15.16:0/3661476629 learned_addr learned my addr 172.21.15.16:0/3661476629 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f581a800640 1 --2- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd07c0ded10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c1857b0 0x7fd07c1815c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd07c037560 0x7fd07c0dbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819e00640 1 -- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 msgr2=0x7f58140e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c00aec0 con 0x7fd06c004810 2024-04-26T20:14:40.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819e00640 1 --2- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140e2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819e00640 1 -- 172.21.15.16:0/3661476629 >> v1:172.21.15.16:6789/0 conn(0x7f5814050920 legacy=0x7f58140e25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f5819e00640 1 -- 172.21.15.16:0/3661476629 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5814007380 con 0x7f58140e2210 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c0e0b10 con 0x7fd07c037560 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd07c037560 0x7fd07c0dbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd07c037560 0x7fd07c0dbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37162/0 (socket says 172.21.15.16:37162) 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089200640 1 -- 172.21.15.16:0/3272070613 learned_addr learned my addr 172.21.15.16:0/3272070613 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd083e00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd07c0ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd083400640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c1857b0 0x7fd07c1815c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd07c0dcdf0 con 0x7fd07c1857b0 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f25f6000640 1 -- 172.21.15.16:0/1977707504 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e40b5070 con 0x7f25f8155fb0 2024-04-26T20:14:40.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f25f6000640 1 -- 172.21.15.16:0/1977707504 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e40a8a50 con 0x7f25f8155fb0 2024-04-26T20:14:40.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fb136a00640 1 -- 172.21.15.16:0/1211563483 >> v1:172.21.15.192:6789/0 conn(0x7fb1380c8db0 legacy=0x7fb1380c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fb136a00640 1 -- 172.21.15.16:0/1211563483 >> v1:172.21.15.16:6789/0 conn(0x7fb1380ca090 legacy=0x7fb138163a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7fb136a00640 1 -- 172.21.15.16:0/1211563483 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1380cab80 con 0x7fb1380c89d0 2024-04-26T20:14:40.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd083400640 1 -- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd07c037560 msgr2=0x7fd07c0dbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd083400640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd07c037560 0x7fd07c0dbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd083400640 1 -- 172.21.15.16:0/3272070613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 msgr2=0x7fd07c0ded10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.370+0000 7f25f6000640 1 -- 172.21.15.16:0/1977707504 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e40a8e20 con 0x7f25f8155fb0 2024-04-26T20:14:40.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 -- 172.21.15.16:0/1977707504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f8155fb0 msgr2=0x7f25f815fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 --2- 172.21.15.16:0/1977707504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f8155fb0 0x7f25f815fe00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009870 tx=0x7f25e401ed50 comp rx=0 tx=0).stop 2024-04-26T20:14:40.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd083400640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd07c0ded10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 -- 172.21.15.16:0/1977707504 shutdown_connections 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 --2- 172.21.15.16:0/1977707504 >> v2:172.21.15.192:3300/0 conn(0x7f25f806f460 0x7f25f806f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 --2- 172.21.15.16:0/1977707504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f8155fb0 0x7f25f815fe00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 -- 172.21.15.16:0/1977707504 >> 172.21.15.16:0/1977707504 conn(0x7f25f80c9d10 msgr2=0x7f25f80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd083400640 1 -- 172.21.15.16:0/3272070613 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c0df3c0 con 0x7fd07c1857b0 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd089200640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd07c037560 0x7fd07c0dbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd083e00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd07c0ded10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd083400640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c1857b0 0x7fd07c1815c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd08406c040 tx=0x7fd06c005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 -- 172.21.15.16:0/1977707504 shutdown_connections 2024-04-26T20:14:40.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7f25fe000640 1 -- 172.21.15.16:0/1977707504 wait complete. 2024-04-26T20:14:40.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd077e00640 1 -- 172.21.15.16:0/3272070613 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084124070 con 0x7fd07c1857b0 2024-04-26T20:14:40.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fb136a00640 1 --2- 172.21.15.16:0/1211563483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380c89d0 0x7fb1380c68e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb130009d90 tx=0x7fb13001efe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=853728bcbbcc902d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd077e00640 1 -- 172.21.15.16:0/3272070613 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd084138070 con 0x7fd07c1857b0 2024-04-26T20:14:40.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd077e00640 1 -- 172.21.15.16:0/3272070613 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084131850 con 0x7fd07c1857b0 2024-04-26T20:14:40.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07c0df6a0 con 0x7fd07c1857b0 2024-04-26T20:14:40.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07c184fb0 con 0x7fd07c1857b0 2024-04-26T20:14:40.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.374+0000 7fb135600640 1 -- 172.21.15.16:0/1211563483 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1300b5070 con 0x7fb1380c89d0 2024-04-26T20:14:40.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb135600640 1 -- 172.21.15.16:0/1211563483 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1300a8bb0 con 0x7fb1380c89d0 2024-04-26T20:14:40.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 Processor -- start 2024-04-26T20:14:40.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f5819e00640 1 --2- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814038810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5808009870 tx=0x7f580801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6cc85d17fa2150 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 -- start start 2024-04-26T20:14:40.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f5818a00640 1 -- 172.21.15.16:0/3661476629 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58080b2070 con 0x7f58140e2210 2024-04-26T20:14:40.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f5818a00640 1 -- 172.21.15.16:0/3661476629 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58080ad640 con 0x7f58140e2210 2024-04-26T20:14:40.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f5818a00640 1 -- 172.21.15.16:0/3661476629 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58080ada10 con 0x7f58140e2210 2024-04-26T20:14:40.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb135600640 1 -- 172.21.15.16:0/1211563483 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1300b5070 con 0x7fb1380c89d0 2024-04-26T20:14:40.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07c184ae0 con 0x7fd07c1857b0 2024-04-26T20:14:40.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380c89d0 msgr2=0x7fb1380c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb137e00640 1 --2- 172.21.15.16:0/1211563483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380c89d0 0x7fb1380c68e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb130009d90 tx=0x7fb13001efe0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f806f460 0x7f25f814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 -- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 msgr2=0x7f5814038810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 --2- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814038810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5808009870 tx=0x7f580801c560 comp rx=0 tx=0).stop 2024-04-26T20:14:40.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f8155fb0 0x7f25f8147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 -- 172.21.15.16:0/3661476629 shutdown_connections 2024-04-26T20:14:40.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 shutdown_connections 2024-04-26T20:14:40.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb137e00640 1 --2- 172.21.15.16:0/1211563483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380c89d0 0x7fb1380c68e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 >> 172.21.15.16:0/1211563483 conn(0x7fb138068510 msgr2=0x7fb138068920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25f8156390 0x7f25f8148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 --2- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fd077e00640 1 -- 172.21.15.16:0/3272070613 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0841319f0 con 0x7fd07c1857b0 2024-04-26T20:14:40.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 --2- 172.21.15.16:0/3661476629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814038810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 -- 172.21.15.16:0/3661476629 >> 172.21.15.16:0/3661476629 conn(0x7f5814054530 msgr2=0x7f5814054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f655aa00640 1 Processor -- start 2024-04-26T20:14:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 shutdown_connections 2024-04-26T20:14:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 -- 172.21.15.16:0/3661476629 shutdown_connections 2024-04-26T20:14:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f806f460 0x7f25f814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f806f460 0x7f25f814aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42204/0 (socket says 172.21.15.16:42204) 2024-04-26T20:14:40.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25f80735c0 con 0x7f25f8155fb0 2024-04-26T20:14:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f655aa00640 1 -- start start 2024-04-26T20:14:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f25f80732e0 con 0x7f25f8156390 2024-04-26T20:14:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25fe000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f25f80738a0 con 0x7f25f806f460 2024-04-26T20:14:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 -- 172.21.15.16:0/978815362 learned_addr learned my addr 172.21.15.16:0/978815362 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7e00640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25f8156390 0x7f25f8148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 -- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25f8156390 msgr2=0x7f25f8148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f581b200640 1 -- 172.21.15.16:0/3661476629 wait complete. 2024-04-26T20:14:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25f8156390 0x7f25f8148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 -- 172.21.15.16:0/978815362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f8155fb0 msgr2=0x7f25f8147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f8155fb0 0x7f25f8147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7f25f7400640 1 -- 172.21.15.16:0/978815362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f814b160 con 0x7f25f806f460 2024-04-26T20:14:40.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.378+0000 7fb137e00640 1 -- 172.21.15.16:0/1211563483 wait complete. 2024-04-26T20:14:40.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f25f7400640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f806f460 0x7f25f814aa00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25e401d400 tx=0x7f25e401baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f655aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f655415a6a0 0x7f6554164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f655aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f65540c9020 0x7f65540707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f655aa00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f655415aa80 con 0x7f655406f460 2024-04-26T20:14:40.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f655aa00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f65540c9b10 con 0x7f65540c9020 2024-04-26T20:14:40.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f655aa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f65540705d0 con 0x7f655415a6a0 2024-04-26T20:14:40.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7fd077e00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd064068480 0x7fd06406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7fd077e00640 1 -- 172.21.15.16:0/3272070613 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd08419d890 con 0x7fd07c1857b0 2024-04-26T20:14:40.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f581b200640 1 Processor -- start 2024-04-26T20:14:40.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f655415a6a0 0x7f6554164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f655415a6a0 0x7f6554164230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37176/0 (socket says 172.21.15.16:37176) 2024-04-26T20:14:40.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553e00640 1 -- 172.21.15.16:0/1254741516 learned_addr learned my addr 172.21.15.16:0/1254741516 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7fb137e00640 1 Processor -- start 2024-04-26T20:14:40.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7fb137e00640 1 -- start start 2024-04-26T20:14:40.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553400640 1 --2- 172.21.15.16:0/1254741516 >> v2:172.21.15.16:3300/0 conn(0x7f65540c9020 0x7f65540707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7fd083e00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd064068480 0x7fd06406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f581b200640 1 -- start start 2024-04-26T20:14:40.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6552a00640 1 -- 172.21.15.16:0/1254741516 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049560245 0 0) 0x7f655415aa80 con 0x7f655406f460 2024-04-26T20:14:40.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6552a00640 1 -- 172.21.15.16:0/1254741516 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6538003530 con 0x7f655406f460 2024-04-26T20:14:40.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553400640 1 -- 172.21.15.16:0/1254741516 >> v2:172.21.15.192:3300/0 conn(0x7f655415a6a0 msgr2=0x7f6554164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553400640 1 --2- 172.21.15.16:0/1254741516 >> v2:172.21.15.192:3300/0 conn(0x7f655415a6a0 0x7f6554164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553400640 1 -- 172.21.15.16:0/1254741516 >> v1:172.21.15.16:6789/0 conn(0x7f655406f460 legacy=0x7f65540c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553400640 1 -- 172.21.15.16:0/1254741516 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6554070010 con 0x7f65540c9020 2024-04-26T20:14:40.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7f6553e00640 1 --2- 172.21.15.16:0/1254741516 >> v2:172.21.15.192:3300/0 conn(0x7f655415a6a0 0x7f6554164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:40.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.382+0000 7fd083e00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd064068480 0x7fd06406a940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd0700049e0 tx=0x7fd070007980 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1380c89d0 0x7fb1381e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581b200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581b200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5814050920 0x7f58140535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814053b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581b200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f58140d9390 con 0x7f5814050920 2024-04-26T20:14:40.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f58140d9210 con 0x7f58140e2210 2024-04-26T20:14:40.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581b200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f58140ebdc0 con 0x7f5814038d50 2024-04-26T20:14:40.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c8db0 0x7fb1381e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1380c89d0 0x7fb1381e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1380c89d0 0x7fb1381e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42214/0 (socket says 172.21.15.16:42214) 2024-04-26T20:14:40.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140dfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42228/0 (socket says 172.21.15.16:42228) 2024-04-26T20:14:40.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136a00640 1 -- 172.21.15.16:0/1283919987 learned_addr learned my addr 172.21.15.16:0/1283919987 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5814050920 0x7f58140535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5814050920 0x7f58140535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53738/0 (socket says 172.21.15.16:53738) 2024-04-26T20:14:40.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819400640 1 -- 172.21.15.16:0/3650901366 learned_addr learned my addr 172.21.15.16:0/3650901366 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581a800640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814053b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136000640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c8db0 0x7fb1381e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137e00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380ca090 0x7fb1381dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1380cb420 con 0x7fb1380c8db0 2024-04-26T20:14:40.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb1380cb140 con 0x7fb1380ca090 2024-04-26T20:14:40.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb1380cdad0 con 0x7fb1380c89d0 2024-04-26T20:14:40.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 -- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 msgr2=0x7f5814053b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137400640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380ca090 0x7fb1381dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814053b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 -- 172.21.15.16:0/3650901366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5814050920 msgr2=0x7f58140535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5814050920 0x7f58140535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 -- 172.21.15.16:0/3650901366 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58140da9b0 con 0x7f5814038d50 2024-04-26T20:14:40.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f581a800640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814053b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819400640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5814050920 0x7f58140535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f5819e00640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140dfcb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5814011e30 tx=0x7f5808019300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f3254a00640 1 Processor -- start 2024-04-26T20:14:40.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136000640 1 -- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1380c89d0 msgr2=0x7fb1381e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136000640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1380c89d0 0x7fb1381e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136000640 1 -- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380ca090 msgr2=0x7fb1381dcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136000640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380ca090 0x7fb1381dcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136000640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1381de660 con 0x7fb1380c8db0 2024-04-26T20:14:40.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb136000640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c8db0 0x7fb1381e3450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb1240011f0 tx=0x7fb12400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f3254a00640 1 -- start start 2024-04-26T20:14:40.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb12f400640 1 -- 172.21.15.16:0/1283919987 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124017070 con 0x7fb1380c8db0 2024-04-26T20:14:40.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb12f400640 1 -- 172.21.15.16:0/1283919987 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12400a7f0 con 0x7fb1380c8db0 2024-04-26T20:14:40.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7f6553400640 1 --2- 172.21.15.16:0/1254741516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65540c9020 0x7f65540707b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6554068e70 tx=0x7f654401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee641b4a22ea880e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb12f400640 1 -- 172.21.15.16:0/1283919987 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124005480 con 0x7fb1380c8db0 2024-04-26T20:14:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.386+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1381de940 con 0x7fb1380c8db0 2024-04-26T20:14:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1381def00 con 0x7fb1380c8db0 2024-04-26T20:14:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f6552a00640 1 -- 172.21.15.16:0/1254741516 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65440b0070 con 0x7f65540c9020 2024-04-26T20:14:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f6552a00640 1 -- 172.21.15.16:0/1254741516 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65440ab600 con 0x7f65540c9020 2024-04-26T20:14:40.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f6552a00640 1 -- 172.21.15.16:0/1254741516 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65440ab9d0 con 0x7f65540c9020 2024-04-26T20:14:40.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f3254a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f325006cd50 0x7f32500c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 -- 172.21.15.16:0/1254741516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65540c9020 msgr2=0x7f65540707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 --2- 172.21.15.16:0/1254741516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65540c9020 0x7f65540707b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6554068e70 tx=0x7f654401c3f0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1381e2bf0 con 0x7fb1380c8db0 2024-04-26T20:14:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f3254a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3250071540 con 0x7f3250070960 2024-04-26T20:14:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f3254a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3250071820 con 0x7f32500c9f90 2024-04-26T20:14:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f3254a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f32500c8bc0 con 0x7f325006cd50 2024-04-26T20:14:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f324de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f325006cd50 0x7f32500c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f324de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f325006cd50 0x7f32500c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53762/0 (socket says 172.21.15.16:53762) 2024-04-26T20:14:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f324de00640 1 -- 172.21.15.16:0/3080453190 learned_addr learned my addr 172.21.15.16:0/3080453190 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 -- 172.21.15.16:0/1254741516 shutdown_connections 2024-04-26T20:14:40.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 --2- 172.21.15.16:0/1254741516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65540c9020 0x7f65540707b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 --2- 172.21.15.16:0/1254741516 >> v2:172.21.15.192:3300/0 conn(0x7f655415a6a0 0x7f6554164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 -- 172.21.15.16:0/1254741516 >> 172.21.15.16:0/1254741516 conn(0x7f65540c9d10 msgr2=0x7f65540ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 -- 172.21.15.16:0/1254741516 shutdown_connections 2024-04-26T20:14:40.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f655aa00640 1 -- 172.21.15.16:0/1254741516 wait complete. 2024-04-26T20:14:40.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f324d400640 1 -- 172.21.15.16:0/3080453190 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980955369 0 0) 0x7f3250071540 con 0x7f3250070960 2024-04-26T20:14:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f324de00640 1 -- 172.21.15.16:0/3080453190 >> v1:172.21.15.192:6789/0 conn(0x7f32500c9f90 legacy=0x7f325015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f324de00640 1 -- 172.21.15.16:0/3080453190 >> v1:172.21.15.16:6789/0 conn(0x7f3250070960 legacy=0x7f32501666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7f324de00640 1 -- 172.21.15.16:0/3080453190 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3250071b00 con 0x7f325006cd50 2024-04-26T20:14:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.390+0000 7fb12f400640 1 -- 172.21.15.16:0/1283919987 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb12401a070 con 0x7fb1380c8db0 2024-04-26T20:14:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 Processor -- start 2024-04-26T20:14:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 -- start start 2024-04-26T20:14:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7fb12f400640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb118068450 0x7fb11806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f655406f460 0x7f65540cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540c9020 0x7f65540c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655415a6a0 0x7f65540c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f655416d3e0 con 0x7f655406f460 2024-04-26T20:14:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f655406fc80 con 0x7f655415a6a0 2024-04-26T20:14:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f655aa00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f655416d560 con 0x7f65540c9020 2024-04-26T20:14:40.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7fb12f400640 1 -- 172.21.15.16:0/1283919987 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb1240865f0 con 0x7fb1380c8db0 2024-04-26T20:14:40.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7fb136a00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb118068450 0x7fb11806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f25ef400640 1 -- 172.21.15.16:0/978815362 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e40b5070 con 0x7f25f806f460 2024-04-26T20:14:40.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f814b440 con 0x7f25f806f460 2024-04-26T20:14:40.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7fd077e00640 1 -- 172.21.15.16:0/3272070613 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd084141020 con 0x7fd07c1857b0 2024-04-26T20:14:40.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f814ba00 con 0x7f25f806f460 2024-04-26T20:14:40.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f25ef400640 1 -- 172.21.15.16:0/978815362 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e40b0de0 con 0x7f25f806f460 2024-04-26T20:14:40.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f25ef400640 1 -- 172.21.15.16:0/978815362 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e40b5070 con 0x7f25f806f460 2024-04-26T20:14:40.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f655406f460 0x7f65540cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f655406f460 0x7f65540cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53776/0 (socket says 172.21.15.16:53776) 2024-04-26T20:14:40.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 -- 172.21.15.16:0/1756651835 learned_addr learned my addr 172.21.15.16:0/1756651835 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6558a00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655415a6a0 0x7f65540c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553400640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540c9020 0x7f65540c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f5812000640 1 -- 172.21.15.16:0/3650901366 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58080b2040 con 0x7f5814038d50 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 -- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540c9020 msgr2=0x7f65540c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540c9020 0x7f65540c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 -- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655415a6a0 msgr2=0x7f65540c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655415a6a0 0x7f65540c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f6553e00640 1 -- 172.21.15.16:0/1756651835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65540c6c80 con 0x7f655406f460 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f6553e00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f655406f460 0x7f65540cc880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f653c00e810 tx=0x7f653c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f5812000640 1 -- 172.21.15.16:0/3650901366 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58080bb070 con 0x7f5814038d50 2024-04-26T20:14:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.394+0000 7f5812000640 1 -- 172.21.15.16:0/3650901366 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58080b6880 con 0x7f5814038d50 2024-04-26T20:14:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7fb136a00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb118068450 0x7fb11806a910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb13001cc10 tx=0x7fb1300aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58140dac90 con 0x7f5814038d50 2024-04-26T20:14:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f654be00640 1 -- 172.21.15.16:0/1756651835 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c00f040 con 0x7f655406f460 2024-04-26T20:14:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f654be00640 1 -- 172.21.15.16:0/1756651835 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653c004030 con 0x7f655406f460 2024-04-26T20:14:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f654be00640 1 -- 172.21.15.16:0/1756651835 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c004400 con 0x7f655406f460 2024-04-26T20:14:40.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f8077c20 con 0x7f25f806f460 2024-04-26T20:14:40.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655414b010 con 0x7f655406f460 2024-04-26T20:14:40.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58140db250 con 0x7f5814038d50 2024-04-26T20:14:40.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655414b5d0 con 0x7f655406f460 2024-04-26T20:14:40.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f324de00640 1 --2- 172.21.15.16:0/3080453190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325006cd50 0x7f32500c8360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3238009870 tx=0x7f323801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1ac47cb249d626 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f25ef400640 1 -- 172.21.15.16:0/978815362 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25e40c2060 con 0x7f25f806f460 2024-04-26T20:14:40.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.398+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6554077c20 con 0x7f655406f460 2024-04-26T20:14:40.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f25ef400640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25d8068580 0x7f25d806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f25ef400640 1 -- 172.21.15.16:0/978815362 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f25e4123ef0 con 0x7f25f806f460 2024-04-26T20:14:40.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f324d400640 1 -- 172.21.15.16:0/3080453190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380b5070 con 0x7f325006cd50 2024-04-26T20:14:40.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f324d400640 1 -- 172.21.15.16:0/3080453190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32380a8a10 con 0x7f325006cd50 2024-04-26T20:14:40.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f324d400640 1 -- 172.21.15.16:0/3080453190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380a8de0 con 0x7f325006cd50 2024-04-26T20:14:40.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f25f6a00640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25d8068580 0x7f25d806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f3254a00640 1 -- 172.21.15.16:0/3080453190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325006cd50 msgr2=0x7f32500c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f3254a00640 1 --2- 172.21.15.16:0/3080453190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325006cd50 0x7f32500c8360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3238009870 tx=0x7f323801ed10 comp rx=0 tx=0).stop 2024-04-26T20:14:40.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58140053a0 con 0x7f5814038d50 2024-04-26T20:14:40.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f5812000640 1 -- 172.21.15.16:0/3650901366 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58080b6a20 con 0x7f5814038d50 2024-04-26T20:14:40.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7fb12f400640 1 -- 172.21.15.16:0/1283919987 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb1381e2bf0 con 0x7fb1380c8db0 2024-04-26T20:14:40.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f25f6a00640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25d8068580 0x7f25d806aa40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25e8007fd0 tx=0x7f25e8007940 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f654be00640 1 -- 172.21.15.16:0/1756651835 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f653c009660 con 0x7f655406f460 2024-04-26T20:14:40.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f5812000640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57fc068400 0x7f57fc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f5812000640 1 -- 172.21.15.16:0/3650901366 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5808120830 con 0x7f5814038d50 2024-04-26T20:14:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.402+0000 7f654be00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65300683d0 0x7f653006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f654be00640 1 -- 172.21.15.16:0/1756651835 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f653c086bb0 con 0x7f655406f460 2024-04-26T20:14:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f3254a00640 1 -- 172.21.15.16:0/3080453190 shutdown_connections 2024-04-26T20:14:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f3254a00640 1 --2- 172.21.15.16:0/3080453190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325006cd50 0x7f32500c8360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f3254a00640 1 -- 172.21.15.16:0/3080453190 >> 172.21.15.16:0/3080453190 conn(0x7f32500ce220 msgr2=0x7f32500ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f6553400640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65300683d0 0x7f653006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f5819400640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57fc068400 0x7f57fc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f3254a00640 1 -- 172.21.15.16:0/3080453190 shutdown_connections 2024-04-26T20:14:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f3254a00640 1 -- 172.21.15.16:0/3080453190 wait complete. 2024-04-26T20:14:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f6553400640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65300683d0 0x7f653006a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f65440ad000 tx=0x7f6544008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.406+0000 7f5819400640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57fc068400 0x7f57fc06a8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58140d5b40 tx=0x7f580c007ef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 Processor -- start 2024-04-26T20:14:40.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 -- start start 2024-04-26T20:14:40.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f325006cd50 0x7f3250143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3250070960 0x7f325014a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32500c9f90 0x7f32501513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f325015cbe0 con 0x7f32500c9f90 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f32500c8e10 con 0x7f3250070960 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3254a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f325015cd60 con 0x7f325006cd50 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f324de00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f325006cd50 0x7f3250143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f324de00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f325006cd50 0x7f3250143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42252/0 (socket says 172.21.15.16:42252) 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f324de00640 1 -- 172.21.15.16:0/1819843473 learned_addr learned my addr 172.21.15.16:0/1819843473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3247e00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3250070960 0x7f325014a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f324e800640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32500c9f90 0x7f32501513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f654be00640 1 -- 172.21.15.16:0/1756651835 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f653c017020 con 0x7f655406f460 2024-04-26T20:14:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3247e00640 1 -- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f325006cd50 msgr2=0x7f3250143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.410+0000 7f3247e00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f325006cd50 0x7f3250143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3247e00640 1 -- 172.21.15.16:0/1819843473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32500c9f90 msgr2=0x7f32501513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3247e00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32500c9f90 0x7f32501513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3247e00640 1 -- 172.21.15.16:0/1819843473 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32501443f0 con 0x7f3250070960 2024-04-26T20:14:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f324e800640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32500c9f90 0x7f32501513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3247e00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3250070960 0x7f325014a330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32500c88a0 tx=0x7f324000c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f25ef400640 1 -- 172.21.15.16:0/978815362 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f25e40188b0 con 0x7f25f806f460 2024-04-26T20:14:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3246000640 1 -- 172.21.15.16:0/1819843473 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240011790 con 0x7f3250070960 2024-04-26T20:14:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3246000640 1 -- 172.21.15.16:0/1819843473 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3240017070 con 0x7f3250070960 2024-04-26T20:14:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3246000640 1 -- 172.21.15.16:0/1819843473 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240011bb0 con 0x7f3250070960 2024-04-26T20:14:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325014b160 con 0x7f3250070960 2024-04-26T20:14:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325014d330 con 0x7f3250070960 2024-04-26T20:14:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.414+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32500696e0 con 0x7f3250070960 2024-04-26T20:14:40.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.418+0000 7f3246000640 1 -- 172.21.15.16:0/1819843473 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3240038ab0 con 0x7f3250070960 2024-04-26T20:14:40.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.418+0000 7f3246000640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f322c0683b0 0x7f322c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.418+0000 7f3246000640 1 -- 172.21.15.16:0/1819843473 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3240086b70 con 0x7f3250070960 2024-04-26T20:14:40.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.418+0000 7f324de00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f322c0683b0 0x7f322c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.422+0000 7f324de00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f322c0683b0 0x7f322c06a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3238000c10 tx=0x7f32380aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.426+0000 7f5812000640 1 -- 172.21.15.16:0/3650901366 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5808016150 con 0x7f5814038d50 2024-04-26T20:14:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.426+0000 7fb932800640 1 Processor -- start 2024-04-26T20:14:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.426+0000 7fb932800640 1 -- start start 2024-04-26T20:14:40.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb932800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb92c15a530 0x7fb92c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb932800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c164350 0x7fb92c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb932800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c06e3e0 con 0x7fb92c0ccc10 2024-04-26T20:14:40.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb932800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb92c163ec0 con 0x7fb92c15a530 2024-04-26T20:14:40.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb932800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c06e6c0 con 0x7fb92c164350 2024-04-26T20:14:40.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7f3246000640 1 -- 172.21.15.16:0/1819843473 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3240056810 con 0x7f3250070960 2024-04-26T20:14:40.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb92aa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb92c0ccc10 0x7fb92c160070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:45220/0 (socket says 172.21.15.16:45220) 2024-04-26T20:14:40.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb92aa00640 1 -- 172.21.15.16:0/1194900812 learned_addr learned my addr 172.21.15.16:0/1194900812 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:40.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb92be00640 1 --2- 172.21.15.16:0/1194900812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c164350 0x7fb92c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fc3d5c00640 1 Processor -- start 2024-04-26T20:14:40.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb92a000640 1 -- 172.21.15.16:0/1194900812 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1042407554 0 0) 0x7fb92c06e3e0 con 0x7fb92c0ccc10 2024-04-26T20:14:40.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fb92a000640 1 -- 172.21.15.16:0/1194900812 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb910003530 con 0x7fb92c0ccc10 2024-04-26T20:14:40.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fb92be00640 1 -- 172.21.15.16:0/1194900812 >> v2:172.21.15.16:3300/0 conn(0x7fb92c15a530 msgr2=0x7fb92c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:40.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.430+0000 7fc3d5c00640 1 -- start start 2024-04-26T20:14:40.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3d5c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc3d015d8a0 0x7fc3d0165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3d5c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d00c49e0 con 0x7fc3d00c44a0 2024-04-26T20:14:40.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3d5c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d00caf80 con 0x7fc3d0157250 2024-04-26T20:14:40.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3d5c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d00cbb50 con 0x7fc3d015d8a0 2024-04-26T20:14:40.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3ce000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc3d00c44a0 0x7fc3d015d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41838/0 (socket says 172.21.15.16:41838) 2024-04-26T20:14:40.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3ce000640 1 -- 172.21.15.16:0/1408866361 learned_addr learned my addr 172.21.15.16:0/1408866361 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:40.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fb92be00640 1 --2- 172.21.15.16:0/1194900812 >> v2:172.21.15.16:3300/0 conn(0x7fb92c15a530 0x7fb92c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fb92be00640 1 -- 172.21.15.16:0/1194900812 >> v1:172.21.15.192:6789/0 conn(0x7fb92c0ccc10 legacy=0x7fb92c160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fb92be00640 1 -- 172.21.15.16:0/1194900812 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c163870 con 0x7fb92c164350 2024-04-26T20:14:40.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3cf400640 1 --2- 172.21.15.16:0/1408866361 >> v2:172.21.15.192:3300/0 conn(0x7fc3d015d8a0 0x7fc3d0165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289013312 0 0) 0x7fc3d00c49e0 con 0x7fc3d00c44a0 2024-04-26T20:14:40.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.434+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3b4003530 con 0x7fc3d00c44a0 2024-04-26T20:14:40.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654608456 0 0) 0x7fc3d00caf80 con 0x7fc3d0157250 2024-04-26T20:14:40.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d00c49e0 con 0x7fc3d0157250 2024-04-26T20:14:40.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fc3cf400640 1 -- 172.21.15.16:0/1408866361 >> v1:172.21.15.192:6789/0 conn(0x7fc3d0157250 legacy=0x7fc3d006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3079005997 0 0) 0x7fc3d00c49e0 con 0x7fc3d0157250 2024-04-26T20:14:40.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fc3cf400640 1 -- 172.21.15.16:0/1408866361 >> v1:172.21.15.16:6789/0 conn(0x7fc3d00c44a0 legacy=0x7fc3d015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fc3cf400640 1 -- 172.21.15.16:0/1408866361 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d00c6450 con 0x7fc3d015d8a0 2024-04-26T20:14:40.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fb92be00640 1 --2- 172.21.15.16:0/1194900812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c164350 0x7fb92c06ff00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92401f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b3ca39ae76ee71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fb92a000640 1 -- 172.21.15.16:0/1194900812 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9240b4070 con 0x7fb92c164350 2024-04-26T20:14:40.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fb92a000640 1 -- 172.21.15.16:0/1194900812 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9240af600 con 0x7fb92c164350 2024-04-26T20:14:40.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fb92a000640 1 -- 172.21.15.16:0/1194900812 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9240af9d0 con 0x7fb92c164350 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fb932800640 1 -- 172.21.15.16:0/1194900812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c164350 msgr2=0x7fb92c06ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.438+0000 7fb932800640 1 --2- 172.21.15.16:0/1194900812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c164350 0x7fb92c06ff00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92401f170 comp rx=0 tx=0).stop 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fb932800640 1 -- 172.21.15.16:0/1194900812 shutdown_connections 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fb932800640 1 --2- 172.21.15.16:0/1194900812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c164350 0x7fb92c06ff00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fb932800640 1 --2- 172.21.15.16:0/1194900812 >> v2:172.21.15.16:3300/0 conn(0x7fb92c15a530 0x7fb92c06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fb932800640 1 -- 172.21.15.16:0/1194900812 >> 172.21.15.16:0/1194900812 conn(0x7fb92c068140 msgr2=0x7fb92c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fb932800640 1 -- 172.21.15.16:0/1194900812 shutdown_connections 2024-04-26T20:14:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fb932800640 1 -- 172.21.15.16:0/1194900812 wait complete. 2024-04-26T20:14:40.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fc3cf400640 1 --2- 172.21.15.16:0/1408866361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d015d8a0 0x7fc3d0165440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00cbcd0 tx=0x7fc3bc01c1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4491acb05db6c64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0b0070 con 0x7fc3d015d8a0 2024-04-26T20:14:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3bc0ab400 con 0x7fc3d015d8a0 2024-04-26T20:14:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.442+0000 7fc3cd600640 1 -- 172.21.15.16:0/1408866361 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0001680 con 0x7fc3d015d8a0 2024-04-26T20:14:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 Processor -- start 2024-04-26T20:14:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fc3d5c00640 1 -- 172.21.15.16:0/1408866361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d015d8a0 msgr2=0x7fc3d0165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/1408866361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d015d8a0 0x7fc3d0165440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00cbcd0 tx=0x7fc3bc01c1f0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fc3d5c00640 1 -- 172.21.15.16:0/1408866361 shutdown_connections 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/1408866361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d015d8a0 0x7fc3d0165440 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fc3d5c00640 1 -- 172.21.15.16:0/1408866361 >> 172.21.15.16:0/1408866361 conn(0x7fc3d0068140 msgr2=0x7fc3d0068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 -- start start 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb92c0ccc10 0x7fb92c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c15a530 0x7fb92c15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb92c164350 0x7fb92c1e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c06dea0 con 0x7fb92c164350 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c0c9f10 con 0x7fb92c0ccc10 2024-04-26T20:14:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb932800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c06e020 con 0x7fb92c15a530 2024-04-26T20:14:40.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fc3d5c00640 1 -- 172.21.15.16:0/1408866361 shutdown_connections 2024-04-26T20:14:40.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fc3d5c00640 1 -- 172.21.15.16:0/1408866361 wait complete. 2024-04-26T20:14:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb92be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb92c164350 0x7fb92c1e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.446+0000 7fb92be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb92c164350 0x7fb92c1e9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53808/0 (socket says 172.21.15.16:53808) 2024-04-26T20:14:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92aa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c15a530 0x7fb92c15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb92c0ccc10 0x7fb92c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb92c0ccc10 0x7fb92c15fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37248/0 (socket says 172.21.15.16:37248) 2024-04-26T20:14:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 -- 172.21.15.16:0/2131369079 learned_addr learned my addr 172.21.15.16:0/2131369079 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 -- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c15a530 msgr2=0x7fb92c15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fc3d5c00640 1 Processor -- start 2024-04-26T20:14:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c15a530 0x7fb92c15f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 -- 172.21.15.16:0/2131369079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb92c164350 msgr2=0x7fb92c1e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb92c164350 0x7fb92c1e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 -- 172.21.15.16:0/2131369079 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c15aa00 con 0x7fb92c0ccc10 2024-04-26T20:14:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92aa00640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c15a530 0x7fb92c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fc3d5c00640 1 -- start start 2024-04-26T20:14:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92be00640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb92c164350 0x7fb92c1e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:40.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb92b400640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb92c0ccc10 0x7fb92c15fd00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00b5b0 tx=0x7fb91c00ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb923400640 1 -- 172.21.15.16:0/2131369079 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c014070 con 0x7fb92c0ccc10 2024-04-26T20:14:40.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb923400640 1 -- 172.21.15.16:0/2131369079 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c0108b0 con 0x7fb92c0ccc10 2024-04-26T20:14:40.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.450+0000 7fb923400640 1 -- 172.21.15.16:0/2131369079 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c010ca0 con 0x7fb92c0ccc10 2024-04-26T20:14:40.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3d5c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d00c44a0 0x7fc3d00b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c15ace0 con 0x7fb92c0ccc10 2024-04-26T20:14:40.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c1f6f30 con 0x7fb92c0ccc10 2024-04-26T20:14:40.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3d5c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d0157250 0x7fc3d0154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3d5c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3d015d8a0 0x7fc3d01554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3cea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d00c44a0 0x7fc3d00b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3d5c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d00b26c0 con 0x7fc3d00c44a0 2024-04-26T20:14:40.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c077c20 con 0x7fb92c0ccc10 2024-04-26T20:14:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3d5c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0157670 con 0x7fc3d0157250 2024-04-26T20:14:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3d5c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d00b2840 con 0x7fc3d015d8a0 2024-04-26T20:14:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3cf400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3d015d8a0 0x7fc3d01554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3cf400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3d015d8a0 0x7fc3d01554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42272/0 (socket says 172.21.15.16:42272) 2024-04-26T20:14:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.454+0000 7fc3cf400640 1 -- 172.21.15.16:0/738544846 learned_addr learned my addr 172.21.15.16:0/738544846 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3cf400640 1 -- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d0157250 msgr2=0x7fc3d0154f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:14:40.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3cf400640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d0157250 0x7fc3d0154f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3cf400640 1 -- 172.21.15.16:0/738544846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d00c44a0 msgr2=0x7fc3d00b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3cf400640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d00c44a0 0x7fc3d00b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3cf400640 1 -- 172.21.15.16:0/738544846 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d0153d70 con 0x7fc3d015d8a0 2024-04-26T20:14:40.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3cea00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d00c44a0 0x7fc3d00b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:40.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3cf400640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3d015d8a0 0x7fc3d01554a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc01c6d0 tx=0x7fc3bc01aa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fb923400640 1 -- 172.21.15.16:0/2131369079 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb91c017070 con 0x7fb92c0ccc10 2024-04-26T20:14:40.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3c6a00640 1 -- 172.21.15.16:0/738544846 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc0b0050 con 0x7fc3d015d8a0 2024-04-26T20:14:40.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3c6a00640 1 -- 172.21.15.16:0/738544846 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3bc0b1040 con 0x7fc3d015d8a0 2024-04-26T20:14:40.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3c6a00640 1 -- 172.21.15.16:0/738544846 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8001a20 con 0x7fc3d015d8a0 2024-04-26T20:14:40.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d0201ce0 con 0x7fc3d015d8a0 2024-04-26T20:14:40.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d02022a0 con 0x7fc3d015d8a0 2024-04-26T20:14:40.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fb923400640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb90c0683d0 0x7fb90c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.458+0000 7fb923400640 1 -- 172.21.15.16:0/2131369079 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb91c054750 con 0x7fb92c0ccc10 2024-04-26T20:14:40.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.462+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d0077c20 con 0x7fc3d015d8a0 2024-04-26T20:14:40.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.462+0000 7fb92aa00640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb90c0683d0 0x7fb90c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.462+0000 7fc3c6a00640 1 -- 172.21.15.16:0/738544846 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3bc0be020 con 0x7fc3d015d8a0 2024-04-26T20:14:40.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.462+0000 7fb92aa00640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb90c0683d0 0x7fb90c06a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb92c1f3ca0 tx=0x7fb918007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.466+0000 7fc3c6a00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3b0068380 0x7fc3b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:40.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.466+0000 7fc3c6a00640 1 -- 172.21.15.16:0/738544846 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3bc120a10 con 0x7fc3d015d8a0 2024-04-26T20:14:40.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.466+0000 7fc3cea00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3b0068380 0x7fc3b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:40.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.466+0000 7fc3cea00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3b0068380 0x7fc3b006a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8007fd0 tx=0x7fc3c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:40.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.474+0000 7fb923400640 1 -- 172.21.15.16:0/2131369079 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb91c0566b0 con 0x7fb92c0ccc10 2024-04-26T20:14:40.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.478+0000 7fc3c6a00640 1 -- 172.21.15.16:0/738544846 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc3bc015f30 con 0x7fc3d015d8a0 2024-04-26T20:14:40.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.742+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb1380506d0 con 0x7fb1380c8db0 2024-04-26T20:14:40.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.742+0000 7fb12f400640 1 -- 172.21.15.16:0/1283919987 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb124056200 con 0x7fb1380c8db0 2024-04-26T20:14:40.748 INFO:teuthology.orchestra.run.smithi016.stdout:60129542153 2024-04-26T20:14:40.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.742+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd07c005fb0 con 0x7fd07c1857b0 2024-04-26T20:14:40.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.742+0000 7fd077e00640 1 -- 172.21.15.16:0/3272070613 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd084062e20 con 0x7fd07c1857b0 2024-04-26T20:14:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb118068450 msgr2=0x7fb11806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb118068450 0x7fb11806a910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb13001cc10 tx=0x7fb1300aa070 comp rx=0 tx=0).stop 2024-04-26T20:14:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c8db0 msgr2=0x7fb1381e3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c8db0 0x7fb1381e3450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb1240011f0 tx=0x7fb12400cf50 comp rx=0 tx=0).stop 2024-04-26T20:14:40.751 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 shutdown_connections 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb118068450 0x7fb11806a910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1380ca090 0x7fb1381dcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c8db0 0x7fb1381e3450 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 --2- 172.21.15.16:0/1283919987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1380c89d0 0x7fb1381e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 >> 172.21.15.16:0/1283919987 conn(0x7fb138068510 msgr2=0x7fb1380d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 shutdown_connections 2024-04-26T20:14:40.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fb137e00640 1 -- 172.21.15.16:0/1283919987 wait complete. 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd064068480 msgr2=0x7fd06406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd064068480 0x7fd06406a940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd0700049e0 tx=0x7fd070007980 comp rx=0 tx=0).stop 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c1857b0 msgr2=0x7fd07c1815c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c1857b0 0x7fd07c1815c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd08406c040 tx=0x7fd06c005840 comp rx=0 tx=0).stop 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 shutdown_connections 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd064068480 0x7fd06406a940 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd0700049e0 tx=0x7fd070007980 comp rx=0 tx=0).stop 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd07c037560 0x7fd07c0dbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd07c1857b0 0x7fd07c1815c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 --2- 172.21.15.16:0/3272070613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd06c004810 0x7fd07c0ded10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 >> 172.21.15.16:0/3272070613 conn(0x7fd07c00e870 msgr2=0x7fd07c0daeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 shutdown_connections 2024-04-26T20:14:40.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.746+0000 7fd089c00640 1 -- 172.21.15.16:0/3272070613 wait complete. 2024-04-26T20:14:40.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.762+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6554073570 con 0x7f655406f460 2024-04-26T20:14:40.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.766+0000 7f654be00640 1 -- 172.21.15.16:0/1756651835 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f653c0568c0 con 0x7f655406f460 2024-04-26T20:14:40.771 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:40.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.766+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f58140504a0 con 0x7f5814038d50 2024-04-26T20:14:40.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.766+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f32500ccef0 con 0x7f3250070960 2024-04-26T20:14:40.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.766+0000 7f3246000640 1 -- 172.21.15.16:0/1819843473 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f324005ab10 con 0x7f3250070960 2024-04-26T20:14:40.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.766+0000 7f5812000640 1 -- 172.21.15.16:0/3650901366 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5808016150 con 0x7f5814038d50 2024-04-26T20:14:40.772 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-04-26T20:14:40.773 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:40.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f25f80cc200 con 0x7f25f806f460 2024-04-26T20:14:40.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65300683d0 msgr2=0x7f653006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65300683d0 0x7f653006a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f65440ad000 tx=0x7f6544008040 comp rx=0 tx=0).stop 2024-04-26T20:14:40.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f655406f460 msgr2=0x7f65540cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f655406f460 0x7f65540cc880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f653c00e810 tx=0x7f653c00ecd0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f25ef400640 1 -- 172.21.15.16:0/978815362 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25e40f4040 con 0x7f25f806f460 2024-04-26T20:14:40.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 shutdown_connections 2024-04-26T20:14:40.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65300683d0 0x7f653006a890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655415a6a0 0x7f65540c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540c9020 0x7f65540c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 --2- 172.21.15.16:0/1756651835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f655406f460 0x7f65540cc880 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 >> 172.21.15.16:0/1756651835 conn(0x7f65540c9d10 msgr2=0x7f6554150970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.776 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-04-26T20:14:40.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 shutdown_connections 2024-04-26T20:14:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f655aa00640 1 -- 172.21.15.16:0/1756651835 wait complete. 2024-04-26T20:14:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f322c0683b0 msgr2=0x7f322c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f322c0683b0 0x7f322c06a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3238000c10 tx=0x7f32380aa070 comp rx=0 tx=0).stop 2024-04-26T20:14:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3250070960 msgr2=0x7f325014a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3250070960 0x7f325014a330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32500c88a0 tx=0x7f324000c870 comp rx=0 tx=0).stop 2024-04-26T20:14:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 shutdown_connections 2024-04-26T20:14:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f322c0683b0 0x7f322c06a870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32500c9f90 0x7f32501513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3250070960 0x7f325014a330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 --2- 172.21.15.16:0/1819843473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f325006cd50 0x7f3250143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 >> 172.21.15.16:0/1819843473 conn(0x7f32500ce220 msgr2=0x7f32500c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57fc068400 msgr2=0x7f57fc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f581b200640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57fc068400 0x7f57fc06a8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58140d5b40 tx=0x7f580c007ef0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 msgr2=0x7f58140dfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f581b200640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140dfcb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5814011e30 tx=0x7f5808019300 comp rx=0 tx=0).stop 2024-04-26T20:14:40.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 shutdown_connections 2024-04-26T20:14:40.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.770+0000 7f3254a00640 1 -- 172.21.15.16:0/1819843473 wait complete. 2024-04-26T20:14:40.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 shutdown_connections 2024-04-26T20:14:40.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57fc068400 0x7f57fc06a8c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58140e2210 0x7f5814053b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5814050920 0x7f58140535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 --2- 172.21.15.16:0/3650901366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5814038d50 0x7f58140dfcb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 >> 172.21.15.16:0/3650901366 conn(0x7f5814054530 msgr2=0x7f58140061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 shutdown_connections 2024-04-26T20:14:40.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f581b200640 1 -- 172.21.15.16:0/3650901366 wait complete. 2024-04-26T20:14:40.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25d8068580 msgr2=0x7f25d806aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25d8068580 0x7f25d806aa40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25e8007fd0 tx=0x7f25e8007940 comp rx=0 tx=0).stop 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f806f460 msgr2=0x7f25f814aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f806f460 0x7f25f814aa00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25e401d400 tx=0x7f25e401baf0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 shutdown_connections 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f25d8068580 0x7f25d806aa40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25f8156390 0x7f25f8148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f8155fb0 0x7f25f8147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 --2- 172.21.15.16:0/978815362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25f806f460 0x7f25f814aa00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 >> 172.21.15.16:0/978815362 conn(0x7f25f80c9d10 msgr2=0x7f25f80c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 shutdown_connections 2024-04-26T20:14:40.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.774+0000 7f25fe000640 1 -- 172.21.15.16:0/978815362 wait complete. 2024-04-26T20:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.2 2024-04-26T20:14:40.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-04-26T20:14:40.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.3 2024-04-26T20:14:40.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.4 2024-04-26T20:14:40.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.1 2024-04-26T20:14:40.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2024-04-26T20:14:40.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.814+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb92c06eb10 con 0x7fb92c0ccc10 2024-04-26T20:14:40.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.814+0000 7fb923400640 1 -- 172.21.15.16:0/2131369079 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb91c05a9b0 con 0x7fb92c0ccc10 2024-04-26T20:14:40.820 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-04-26T20:14:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.814+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc3d015d310 con 0x7fc3d015d8a0 2024-04-26T20:14:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb90c0683d0 msgr2=0x7fb90c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb90c0683d0 0x7fb90c06a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb92c1f3ca0 tx=0x7fb918007d40 comp rx=0 tx=0).stop 2024-04-26T20:14:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb92c0ccc10 msgr2=0x7fb92c15fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb92c0ccc10 0x7fb92c15fd00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00b5b0 tx=0x7fb91c00ba70 comp rx=0 tx=0).stop 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 shutdown_connections 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb90c0683d0 0x7fb90c06a890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb92c164350 0x7fb92c1e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb92c15a530 0x7fb92c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 --2- 172.21.15.16:0/2131369079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb92c0ccc10 0x7fb92c15fd00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 >> 172.21.15.16:0/2131369079 conn(0x7fb92c068140 msgr2=0x7fb92c158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 shutdown_connections 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fb932800640 1 -- 172.21.15.16:0/2131369079 wait complete. 2024-04-26T20:14:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3c6a00640 1 -- 172.21.15.16:0/738544846 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3bc0f0c80 con 0x7fc3d015d8a0 2024-04-26T20:14:40.824 INFO:teuthology.orchestra.run.smithi016.stdout:60129542153 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3b0068380 msgr2=0x7fc3b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3b0068380 0x7fc3b006a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8007fd0 tx=0x7fc3c8009040 comp rx=0 tx=0).stop 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3d015d8a0 msgr2=0x7fc3d01554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3d015d8a0 0x7fc3d01554a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc01c6d0 tx=0x7fc3bc01aa30 comp rx=0 tx=0).stop 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 shutdown_connections 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3b0068380 0x7fc3b006a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3d015d8a0 0x7fc3d01554a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3d0157250 0x7fc3d0154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 --2- 172.21.15.16:0/738544846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3d00c44a0 0x7fc3d00b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 >> 172.21.15.16:0/738544846 conn(0x7fc3d0068140 msgr2=0x7fc3d00b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 shutdown_connections 2024-04-26T20:14:40.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:40.818+0000 7fc3d5c00640 1 -- 172.21.15.16:0/738544846 wait complete. 2024-04-26T20:14:40.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2024-04-26T20:14:40.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-04-26T20:14:41.793 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T20:14:41.793 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T20:14:41.814 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T20:14:41.816 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T20:14:41.818 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T20:14:41.818 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T20:14:41.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T20:14:41.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T20:14:42.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25c6200640 1 Processor -- start 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25c6200640 1 -- start start 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25c6200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c0158a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25c6200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f25c0070ff0 0x7f25c00c6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25c6200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c00cc330 con 0x7f25c00cbe60 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25c6200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f25c00cce60 con 0x7f25c0070ff0 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25c6200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f25c00cd140 con 0x7f25c0070500 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25bf400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c0158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25bf400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c0158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42284/0 (socket says 172.21.15.16:42284) 2024-04-26T20:14:42.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f25bf400640 1 -- 172.21.15.16:0/552916360 learned_addr learned my addr 172.21.15.16:0/552916360 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917e00640 1 Processor -- start 2024-04-26T20:14:42.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917e00640 1 -- start start 2024-04-26T20:14:42.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6918151c60 0x7f69180ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69180c85e0 0x7f69180c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691815be20 con 0x7f691815b9b0 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f69180c7f20 con 0x7f6918151c60 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f69180c8f50 con 0x7f69180c85e0 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69180c85e0 0x7f69180c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69180c85e0 0x7f69180c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42288/0 (socket says 172.21.15.16:42288) 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.006+0000 7f6917400640 1 -- 172.21.15.16:0/648843756 learned_addr learned my addr 172.21.15.16:0/648843756 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f25bf400640 1 -- 172.21.15.16:0/552916360 >> v2:172.21.15.16:3300/0 conn(0x7f25c0070ff0 msgr2=0x7f25c00c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f25bf400640 1 --2- 172.21.15.16:0/552916360 >> v2:172.21.15.16:3300/0 conn(0x7f25c0070ff0 0x7f25c00c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f25bf400640 1 -- 172.21.15.16:0/552916360 >> v1:172.21.15.16:6789/0 conn(0x7f25c00cbe60 legacy=0x7f25c00708e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T20:14:42.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f6916a00640 1 --2- 172.21.15.16:0/648843756 >> v2:172.21.15.16:3300/0 conn(0x7f6918151c60 0x7f69180ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f6917400640 1 -- 172.21.15.16:0/648843756 >> v2:172.21.15.16:3300/0 conn(0x7f6918151c60 msgr2=0x7f69180ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f6917400640 1 --2- 172.21.15.16:0/648843756 >> v2:172.21.15.16:3300/0 conn(0x7f6918151c60 0x7f69180ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f6917400640 1 -- 172.21.15.16:0/648843756 >> v1:172.21.15.16:6789/0 conn(0x7f691815b9b0 legacy=0x7f691806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f6917400640 1 -- 172.21.15.16:0/648843756 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6918072590 con 0x7f69180c85e0 2024-04-26T20:14:42.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.010+0000 7f25bf400640 1 -- 172.21.15.16:0/552916360 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c00c6470 con 0x7f25c0070500 2024-04-26T20:14:42.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f6917400640 1 --2- 172.21.15.16:0/648843756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69180c85e0 0x7f69180c8a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6908009870 tx=0x7f690801d750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961f9a1290fc6661 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f25bf400640 1 --2- 172.21.15.16:0/552916360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c0158a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25c00cc500 tx=0x7f25a801ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=522d80ea8a209e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f6915600640 1 -- 172.21.15.16:0/648843756 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080a76c0 con 0x7f69180c85e0 2024-04-26T20:14:42.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f6915600640 1 -- 172.21.15.16:0/648843756 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69080a7860 con 0x7f69180c85e0 2024-04-26T20:14:42.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f25be000640 1 -- 172.21.15.16:0/552916360 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a80b6070 con 0x7f25c0070500 2024-04-26T20:14:42.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f25be000640 1 -- 172.21.15.16:0/552916360 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25a80a9cf0 con 0x7f25c0070500 2024-04-26T20:14:42.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f25be000640 1 -- 172.21.15.16:0/552916360 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a80b1660 con 0x7f25c0070500 2024-04-26T20:14:42.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.014+0000 7f6915600640 1 -- 172.21.15.16:0/648843756 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080a7c30 con 0x7f69180c85e0 2024-04-26T20:14:42.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 -- 172.21.15.16:0/552916360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 msgr2=0x7f25c0158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 --2- 172.21.15.16:0/552916360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c0158a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f25c00cc500 tx=0x7f25a801ff20 comp rx=0 tx=0).stop 2024-04-26T20:14:42.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f6917e00640 1 -- 172.21.15.16:0/648843756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69180c85e0 msgr2=0x7f69180c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f6917e00640 1 --2- 172.21.15.16:0/648843756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69180c85e0 0x7f69180c8a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6908009870 tx=0x7f690801d750 comp rx=0 tx=0).stop 2024-04-26T20:14:42.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 -- 172.21.15.16:0/552916360 shutdown_connections 2024-04-26T20:14:42.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 --2- 172.21.15.16:0/552916360 >> v2:172.21.15.16:3300/0 conn(0x7f25c0070ff0 0x7f25c00c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 --2- 172.21.15.16:0/552916360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c0158a10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 -- 172.21.15.16:0/552916360 >> 172.21.15.16:0/552916360 conn(0x7f25c006c380 msgr2=0x7f25c006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 -- 172.21.15.16:0/552916360 shutdown_connections 2024-04-26T20:14:42.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.018+0000 7f25c6200640 1 -- 172.21.15.16:0/552916360 wait complete. 2024-04-26T20:14:42.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25c6200640 1 Processor -- start 2024-04-26T20:14:42.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25c6200640 1 -- start start 2024-04-26T20:14:42.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25c6200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c01535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25c6200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c0070ff0 0x7f25c014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25bf400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c01535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25bf400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c01535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42302/0 (socket says 172.21.15.16:42302) 2024-04-26T20:14:42.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25bf400640 1 -- 172.21.15.16:0/1645467421 learned_addr learned my addr 172.21.15.16:0/1645467421 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25c6200640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25c00cbe60 0x7f25c00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25c00c7050 con 0x7f25c0070ff0 2024-04-26T20:14:42.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.022+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f25c00c6ed0 con 0x7f25c00cbe60 2024-04-26T20:14:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bea00640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c0070ff0 0x7f25c014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bfe00640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25c00cbe60 0x7f25c00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f25c00c71d0 con 0x7f25c0070500 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bea00640 1 -- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 msgr2=0x7f25c01535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bea00640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c01535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bea00640 1 -- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25c00cbe60 msgr2=0x7f25c00c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bea00640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25c00cbe60 0x7f25c00c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bea00640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c0153c20 con 0x7f25c0070ff0 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25bea00640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c0070ff0 0x7f25c014f560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f25b000b410 tx=0x7f25b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25b7400640 1 -- 172.21.15.16:0/1645467421 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0015030 con 0x7f25c0070ff0 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c015ae80 con 0x7f25c0070ff0 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c015b420 con 0x7f25c0070ff0 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25b7400640 1 -- 172.21.15.16:0/1645467421 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b0004020 con 0x7f25c0070ff0 2024-04-26T20:14:42.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f25b7400640 1 -- 172.21.15.16:0/1645467421 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0015030 con 0x7f25c0070ff0 2024-04-26T20:14:42.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 -- 172.21.15.16:0/648843756 shutdown_connections 2024-04-26T20:14:42.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 --2- 172.21.15.16:0/648843756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69180c85e0 0x7f69180c8a10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 --2- 172.21.15.16:0/648843756 >> v2:172.21.15.16:3300/0 conn(0x7f6918151c60 0x7f69180ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 -- 172.21.15.16:0/648843756 >> 172.21.15.16:0/648843756 conn(0x7f691806e0a0 msgr2=0x7f691806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 -- 172.21.15.16:0/648843756 shutdown_connections 2024-04-26T20:14:42.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 -- 172.21.15.16:0/648843756 wait complete. 2024-04-26T20:14:42.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 Processor -- start 2024-04-26T20:14:42.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.026+0000 7f6917e00640 1 -- start start 2024-04-26T20:14:42.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.030+0000 7f6917e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69180c85e0 0x7f6918153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.030+0000 7f6917e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6918151c60 0x7f69182031c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.030+0000 7f6917e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f691815b9b0 0x7f6918203700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.030+0000 7f25b7400640 1 -- 172.21.15.16:0/1645467421 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f25b0018070 con 0x7f25c0070ff0 2024-04-26T20:14:42.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6918152040 con 0x7f691815b9b0 2024-04-26T20:14:42.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6918072830 con 0x7f69180c85e0 2024-04-26T20:14:42.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6918073840 con 0x7f6918151c60 2024-04-26T20:14:42.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25980052a0 con 0x7f25c0070ff0 2024-04-26T20:14:42.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f691815b9b0 0x7f6918203700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f691815b9b0 0x7f6918203700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53860/0 (socket says 172.21.15.16:53860) 2024-04-26T20:14:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917400640 1 -- 172.21.15.16:0/3282619700 learned_addr learned my addr 172.21.15.16:0/3282619700 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f25b7400640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f259c0687b0 0x7f259c06ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916a00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69180c85e0 0x7f6918153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916000640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6918151c60 0x7f69182031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916a00640 1 -- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6918151c60 msgr2=0x7f69182031c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916a00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6918151c60 0x7f69182031c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916a00640 1 -- 172.21.15.16:0/3282619700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f691815b9b0 msgr2=0x7f6918203700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916a00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f691815b9b0 0x7f6918203700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916a00640 1 -- 172.21.15.16:0/3282619700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6918154b10 con 0x7f69180c85e0 2024-04-26T20:14:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917400640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f691815b9b0 0x7f6918203700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f25bf400640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f259c0687b0 0x7f259c06ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f25b7400640 1 -- 172.21.15.16:0/1645467421 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f25b0016070 con 0x7f25c0070ff0 2024-04-26T20:14:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6916a00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69180c85e0 0x7f6918153e30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f690400c7f0 tx=0x7f690400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f690f400640 1 -- 172.21.15.16:0/3282619700 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6904015070 con 0x7f69180c85e0 2024-04-26T20:14:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6918154df0 con 0x7f69180c85e0 2024-04-26T20:14:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f690f400640 1 -- 172.21.15.16:0/3282619700 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6904004220 con 0x7f69180c85e0 2024-04-26T20:14:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f690f400640 1 -- 172.21.15.16:0/3282619700 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6904003620 con 0x7f69180c85e0 2024-04-26T20:14:42.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.034+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6918151510 con 0x7f69180c85e0 2024-04-26T20:14:42.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.042+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69180506d0 con 0x7f69180c85e0 2024-04-26T20:14:42.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.042+0000 7f25bf400640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f259c0687b0 0x7f259c06ac70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25a801ff60 tx=0x7f25a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.042+0000 7f690f400640 1 -- 172.21.15.16:0/3282619700 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69040039d0 con 0x7f69180c85e0 2024-04-26T20:14:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.042+0000 7f690f400640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f68f8068380 0x7f68f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.042+0000 7f690f400640 1 -- 172.21.15.16:0/3282619700 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6904086c30 con 0x7f69180c85e0 2024-04-26T20:14:42.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.046+0000 7f6916000640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f68f8068380 0x7f68f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.046+0000 7f6916000640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f68f8068380 0x7f68f806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69180ca540 tx=0x7f6910009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.046+0000 7f25b7400640 1 -- 172.21.15.16:0/1645467421 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f25b0055bc0 con 0x7f25c0070ff0 2024-04-26T20:14:42.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.062+0000 7f690f400640 1 -- 172.21.15.16:0/3282619700 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f69040568f0 con 0x7f69180c85e0 2024-04-26T20:14:42.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.094+0000 7f13d2200640 1 Processor -- start 2024-04-26T20:14:42.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13d2200640 1 -- start start 2024-04-26T20:14:42.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fd68b200640 1 Processor -- start 2024-04-26T20:14:42.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13d2200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f13cc070480 0x7f13cc072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13d2200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13cb400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f13cc152000 0x7f13cc1587c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:45228/0 (socket says 172.21.15.16:45228) 2024-04-26T20:14:42.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13d2200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13cc070a10 con 0x7f13cc152000 2024-04-26T20:14:42.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13d2200640 1 -- 172.21.15.16:0/2056448151 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f13cc0c85c0 con 0x7f13cc070480 2024-04-26T20:14:42.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13d2200640 1 -- 172.21.15.16:0/2056448151 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc0c7c90 con 0x7f13cc06f460 2024-04-26T20:14:42.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13cb400640 1 -- 172.21.15.16:0/2056448151 learned_addr learned my addr 172.21.15.16:0/2056448151 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:42.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7f13cbe00640 1 --2- 172.21.15.16:0/2056448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.102+0000 7f13caa00640 1 --2- 172.21.15.16:0/2056448151 >> v2:172.21.15.192:3300/0 conn(0x7f13cc070480 0x7f13cc072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.102+0000 7f13cbe00640 1 -- 172.21.15.16:0/2056448151 >> v2:172.21.15.192:3300/0 conn(0x7f13cc070480 msgr2=0x7f13cc072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.102+0000 7f13cbe00640 1 --2- 172.21.15.16:0/2056448151 >> v2:172.21.15.192:3300/0 conn(0x7f13cc070480 0x7f13cc072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.102+0000 7f13cbe00640 1 -- 172.21.15.16:0/2056448151 >> v1:172.21.15.192:6789/0 conn(0x7f13cc152000 legacy=0x7f13cc1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.102+0000 7f13cbe00640 1 -- 172.21.15.16:0/2056448151 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc0c7f70 con 0x7f13cc06f460 2024-04-26T20:14:42.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fa599c00640 1 Processor -- start 2024-04-26T20:14:42.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fa599c00640 1 -- start start 2024-04-26T20:14:42.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.102+0000 7fa592a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa594152000 0x7fa5941587c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41864/0 (socket says 172.21.15.16:41864) 2024-04-26T20:14:42.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.102+0000 7fa592a00640 1 -- 172.21.15.16:0/731109913 learned_addr learned my addr 172.21.15.16:0/731109913 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fd68b200640 1 -- start start 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fd68b200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c152c50 0x7fd68c0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fd68b200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68c153030 con 0x7fd68c159360 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fd68b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68c0c5830 con 0x7fd68c06e6f0 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.098+0000 7fd68b200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c1598c0 con 0x7fd68c152c50 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fd68a800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd68c06e6f0 0x7fd68c15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:45238/0 (socket says 172.21.15.16:45238) 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fd68a800640 1 -- 172.21.15.16:0/2174465342 learned_addr learned my addr 172.21.15.16:0/2174465342 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:42.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fd689e00640 1 --2- 172.21.15.16:0/2174465342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c152c50 0x7fd68c0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fd689e00640 1 -- 172.21.15.16:0/2174465342 >> v1:172.21.15.192:6789/0 conn(0x7fd68c06e6f0 legacy=0x7fd68c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa599c00640 1 --2- 172.21.15.16:0/731109913 >> v2:172.21.15.16:3300/0 conn(0x7fa594070480 0x7fa594072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fd689e00640 1 -- 172.21.15.16:0/2174465342 >> v1:172.21.15.16:6789/0 conn(0x7fd68c159360 legacy=0x7fd68c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fd689e00640 1 -- 172.21.15.16:0/2174465342 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c0c5b10 con 0x7fd68c152c50 2024-04-26T20:14:42.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7f13cbe00640 1 --2- 172.21.15.16:0/2056448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc06f8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009d90 tx=0x7f13c401f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a35777f8f9b77f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa592000640 1 --2- 172.21.15.16:0/731109913 >> v2:172.21.15.16:3300/0 conn(0x7fa594070480 0x7fa594072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa594070a10 con 0x7fa594152000 2024-04-26T20:14:42.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5940c7c90 con 0x7fa59406f460 2024-04-26T20:14:42.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa5940c85c0 con 0x7fa594070480 2024-04-26T20:14:42.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa591600640 1 -- 172.21.15.16:0/731109913 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463726911 0 0) 0x7fa594070a10 con 0x7fa594152000 2024-04-26T20:14:42.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa591600640 1 -- 172.21.15.16:0/731109913 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa578003530 con 0x7fa594152000 2024-04-26T20:14:42.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa592000640 1 -- 172.21.15.16:0/731109913 >> v1:172.21.15.192:6789/0 conn(0x7fa59406f460 legacy=0x7fa5941626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa592000640 1 -- 172.21.15.16:0/731109913 >> v1:172.21.15.16:6789/0 conn(0x7fa594152000 legacy=0x7fa5941587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.106+0000 7fa592000640 1 -- 172.21.15.16:0/731109913 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5940c7f70 con 0x7fa594070480 2024-04-26T20:14:42.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.110+0000 7fd689e00640 1 --2- 172.21.15.16:0/2174465342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c152c50 0x7fd68c0c8a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd684009dc0 tx=0x7fd68401f140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f361ac25555f773 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.110+0000 7fd688a00640 1 -- 172.21.15.16:0/2174465342 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840b4070 con 0x7fd68c152c50 2024-04-26T20:14:42.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.110+0000 7fd688a00640 1 -- 172.21.15.16:0/2174465342 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6840af600 con 0x7fd68c152c50 2024-04-26T20:14:42.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.110+0000 7fd688a00640 1 -- 172.21.15.16:0/2174465342 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840b4070 con 0x7fd68c152c50 2024-04-26T20:14:42.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.110+0000 7f13ca000640 1 -- 172.21.15.16:0/2056448151 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c40b4070 con 0x7f13cc06f460 2024-04-26T20:14:42.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.110+0000 7f13ca000640 1 -- 172.21.15.16:0/2056448151 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c40af600 con 0x7f13cc06f460 2024-04-26T20:14:42.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.110+0000 7f13ca000640 1 -- 172.21.15.16:0/2056448151 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c40af9d0 con 0x7f13cc06f460 2024-04-26T20:14:42.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fd68b200640 1 -- 172.21.15.16:0/2174465342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c152c50 msgr2=0x7fd68c0c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fd68b200640 1 --2- 172.21.15.16:0/2174465342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c152c50 0x7fd68c0c8a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd684009dc0 tx=0x7fd68401f140 comp rx=0 tx=0).stop 2024-04-26T20:14:42.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fd68b200640 1 -- 172.21.15.16:0/2174465342 shutdown_connections 2024-04-26T20:14:42.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fd68b200640 1 --2- 172.21.15.16:0/2174465342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c152c50 0x7fd68c0c8a90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fd68b200640 1 -- 172.21.15.16:0/2174465342 >> 172.21.15.16:0/2174465342 conn(0x7fd68c070ce0 msgr2=0x7fd68c0710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fa592000640 1 --2- 172.21.15.16:0/731109913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 0x7fa594072260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa5840071d0 tx=0x7fa584020dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376355e357aafa60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fa591600640 1 -- 172.21.15.16:0/731109913 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584008be0 con 0x7fa594070480 2024-04-26T20:14:42.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fa591600640 1 -- 172.21.15.16:0/731109913 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584008d80 con 0x7fa594070480 2024-04-26T20:14:42.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 msgr2=0x7fa594072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.114+0000 7fa599c00640 1 --2- 172.21.15.16:0/731109913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 0x7fa594072260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa5840071d0 tx=0x7fa584020dc0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fd68b200640 1 -- 172.21.15.16:0/2174465342 shutdown_connections 2024-04-26T20:14:42.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 -- 172.21.15.16:0/2056448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 msgr2=0x7f13cc06f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 --2- 172.21.15.16:0/2056448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc06f8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009d90 tx=0x7f13c401f170 comp rx=0 tx=0).stop 2024-04-26T20:14:42.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fd68b200640 1 -- 172.21.15.16:0/2174465342 wait complete. 2024-04-26T20:14:42.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 -- 172.21.15.16:0/2056448151 shutdown_connections 2024-04-26T20:14:42.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 --2- 172.21.15.16:0/2056448151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc06f8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 --2- 172.21.15.16:0/2056448151 >> v2:172.21.15.192:3300/0 conn(0x7f13cc070480 0x7f13cc072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 -- 172.21.15.16:0/2056448151 >> 172.21.15.16:0/2056448151 conn(0x7f13cc0c9d10 msgr2=0x7f13cc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 shutdown_connections 2024-04-26T20:14:42.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fa599c00640 1 --2- 172.21.15.16:0/731109913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 0x7fa594072260 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 >> 172.21.15.16:0/731109913 conn(0x7fa5940c9d10 msgr2=0x7fa5940ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 -- 172.21.15.16:0/2056448151 shutdown_connections 2024-04-26T20:14:42.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 -- 172.21.15.16:0/2056448151 wait complete. 2024-04-26T20:14:42.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fd68b200640 1 Processor -- start 2024-04-26T20:14:42.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 shutdown_connections 2024-04-26T20:14:42.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fa599c00640 1 -- 172.21.15.16:0/731109913 wait complete. 2024-04-26T20:14:42.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7fd68b200640 1 -- start start 2024-04-26T20:14:42.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.118+0000 7f13d2200640 1 Processor -- start 2024-04-26T20:14:42.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7f13d2200640 1 -- start start 2024-04-26T20:14:42.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fa599c00640 1 Processor -- start 2024-04-26T20:14:42.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7f13d2200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc1f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fa599c00640 1 -- start start 2024-04-26T20:14:42.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68b200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c06e6f0 0x7fd68c153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68b200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd68c152c50 0x7fd68c0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd68c159360 0x7fd68c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68b200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0c78e0 con 0x7fd68c152c50 2024-04-26T20:14:42.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c06dcf0 con 0x7fd68c159360 2024-04-26T20:14:42.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68b200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0c7a60 con 0x7fd68c06e6f0 2024-04-26T20:14:42.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7f13d2200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13cc070480 0x7f13cc1f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd68c159360 0x7fd68c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7f13cb400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc1f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd68c159360 0x7fd68c148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37298/0 (socket says 172.21.15.16:37298) 2024-04-26T20:14:42.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd68a800640 1 -- 172.21.15.16:0/1952587307 learned_addr learned my addr 172.21.15.16:0/1952587307 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7fd962a00640 1 Processor -- start 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa599c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa59406f460 0x7fa5941f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa599c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 0x7fa59415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa599c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa594152000 0x7fa5940cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa599c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940c8a50 con 0x7fa594070480 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa599c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940727a0 con 0x7fa59406f460 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa599c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa5940c8bd0 con 0x7fa594152000 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7f13caa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13cc070480 0x7f13cc1f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7f13caa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13cc070480 0x7f13cc1f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37310/0 (socket says 172.21.15.16:37310) 2024-04-26T20:14:42.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.122+0000 7f13caa00640 1 -- 172.21.15.16:0/338619784 learned_addr learned my addr 172.21.15.16:0/338619784 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13d2200640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13cc152000 0x7f13cc1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0c8a50 con 0x7f13cc152000 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0727a0 con 0x7f13cc070480 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc0c8bd0 con 0x7f13cc06f460 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fd68a800640 1 -- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c06e6f0 msgr2=0x7fd68c153610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fd68a800640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c06e6f0 0x7fd68c153610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fd68a800640 1 -- 172.21.15.16:0/1952587307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd68c152c50 msgr2=0x7fd68c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fd68a800640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd68c152c50 0x7fd68c0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fd68a800640 1 -- 172.21.15.16:0/1952587307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c155ac0 con 0x7fd68c159360 2024-04-26T20:14:42.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13cbe00640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13cc152000 0x7f13cc1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa594152000 0x7fa5940cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa594152000 0x7fa5940cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42362/0 (socket says 172.21.15.16:42362) 2024-04-26T20:14:42.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 -- 172.21.15.16:0/1433847562 learned_addr learned my addr 172.21.15.16:0/1433847562 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fd962a00640 1 -- start start 2024-04-26T20:14:42.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13caa00640 1 -- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 msgr2=0x7f13cc1f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13caa00640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc1f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13caa00640 1 -- 172.21.15.16:0/338619784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13cc152000 msgr2=0x7f13cc1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13caa00640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13cc152000 0x7f13cc1479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13caa00640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc1e1cb0 con 0x7f13cc070480 2024-04-26T20:14:42.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 -- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa59406f460 msgr2=0x7fa5941f54c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:14:42.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa59406f460 0x7fa5941f54c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 -- 172.21.15.16:0/1433847562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 msgr2=0x7fa59415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 0x7fa59415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fa593400640 1 -- 172.21.15.16:0/1433847562 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59415b640 con 0x7fa594152000 2024-04-26T20:14:42.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13caa00640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13cc070480 0x7f13cc1f05c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f13b800aeb0 tx=0x7f13b800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13c3400640 1 -- 172.21.15.16:0/338619784 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8015bd0 con 0x7f13cc070480 2024-04-26T20:14:42.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13c3400640 1 -- 172.21.15.16:0/338619784 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8015d70 con 0x7f13cc070480 2024-04-26T20:14:42.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13c3400640 1 -- 172.21.15.16:0/338619784 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8004240 con 0x7f13cc070480 2024-04-26T20:14:42.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc1556d0 con 0x7f13cc070480 2024-04-26T20:14:42.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc1ef2c0 con 0x7f13cc070480 2024-04-26T20:14:42.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.126+0000 7fd68a800640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd68c159360 0x7fd68c148080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c390 tx=0x7fd67800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540dd600 0x7fd95404df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd954048120 0x7fd95404e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9540462b0 0x7fd9540e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd954036d40 con 0x7fd954048120 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fd9540e3540 con 0x7fd9540462b0 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd9540e37e0 con 0x7fd9540dd600 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a40052a0 con 0x7f13cc070480 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd682000640 1 -- 172.21.15.16:0/1952587307 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678017070 con 0x7fd68c159360 2024-04-26T20:14:42.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd682000640 1 -- 172.21.15.16:0/1952587307 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd678005cf0 con 0x7fd68c159360 2024-04-26T20:14:42.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd682000640 1 -- 172.21.15.16:0/1952587307 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678007310 con 0x7fd68c159360 2024-04-26T20:14:42.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fa593400640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa594152000 0x7fa5940cc960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c740 tx=0x7fa58c00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fa58aa00640 1 -- 172.21.15.16:0/1433847562 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c016020 con 0x7fa594152000 2024-04-26T20:14:42.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fa58aa00640 1 -- 172.21.15.16:0/1433847562 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58c00ce50 con 0x7fa594152000 2024-04-26T20:14:42.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fa58aa00640 1 -- 172.21.15.16:0/1433847562 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c003980 con 0x7fa594152000 2024-04-26T20:14:42.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c154a20 con 0x7fd68c159360 2024-04-26T20:14:42.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fa599c00640 1 -- 172.21.15.16:0/1433847562 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59415bc10 con 0x7fa594152000 2024-04-26T20:14:42.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fa599c00640 1 -- 172.21.15.16:0/1433847562 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59415bed0 con 0x7fa594152000 2024-04-26T20:14:42.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa594077c20 con 0x7fa594152000 2024-04-26T20:14:42.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c154fe0 con 0x7fd68c159360 2024-04-26T20:14:42.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7f13c3400640 1 -- 172.21.15.16:0/338619784 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13b8003620 con 0x7f13cc070480 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7f13c3400640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f13ac068380 0x7f13ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7f13c3400640 1 -- 172.21.15.16:0/338619784 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f13b808ede0 con 0x7f13cc070480 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd961600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540dd600 0x7fd95404df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd960c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd954048120 0x7fd95404e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9540462b0 0x7fd9540e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9540462b0 0x7fd9540e6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37326/0 (socket says 172.21.15.16:37326) 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd962000640 1 -- 172.21.15.16:0/158709055 learned_addr learned my addr 172.21.15.16:0/158709055 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd960c00640 1 -- 172.21.15.16:0/158709055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540dd600 msgr2=0x7fd95404df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7f13cb400640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f13ac068380 0x7f13ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6640052a0 con 0x7fd68c159360 2024-04-26T20:14:42.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.130+0000 7fd961600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540dd600 0x7fd95404df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42372/0 (socket says 172.21.15.16:42372) 2024-04-26T20:14:42.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7f13cb400640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f13ac068380 0x7f13ac06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13bc000f70 tx=0x7f13bc007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd960c00640 1 --2- 172.21.15.16:0/158709055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540dd600 0x7fd95404df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd960c00640 1 -- 172.21.15.16:0/158709055 >> v2:172.21.15.192:3300/0 conn(0x7fd9540462b0 msgr2=0x7fd9540e6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd960c00640 1 --2- 172.21.15.16:0/158709055 >> v2:172.21.15.192:3300/0 conn(0x7fd9540462b0 0x7fd9540e6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd960c00640 1 -- 172.21.15.16:0/158709055 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9540e3aa0 con 0x7fd954048120 2024-04-26T20:14:42.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd961600640 1 --2- 172.21.15.16:0/158709055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540dd600 0x7fd95404df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:42.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fd962000640 1 --2- 172.21.15.16:0/158709055 >> v2:172.21.15.192:3300/0 conn(0x7fd9540462b0 0x7fd9540e6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:42.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.134+0000 7fa58aa00640 1 -- 172.21.15.16:0/1433847562 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa58c003b20 con 0x7fa594152000 2024-04-26T20:14:42.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fa58aa00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa574068380 0x7fa57406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fa58aa00640 1 -- 172.21.15.16:0/1433847562 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa58c0869d0 con 0x7fa594152000 2024-04-26T20:14:42.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fd682000640 1 -- 172.21.15.16:0/1952587307 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd67801a070 con 0x7fd68c159360 2024-04-26T20:14:42.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fd682000640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd66c0683d0 0x7fd66c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fa592a00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa574068380 0x7fa57406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fd689e00640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd66c0683d0 0x7fd66c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fd960c00640 1 --2- 172.21.15.16:0/158709055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd954048120 0x7fd95404e4b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd95404ce20 tx=0x7fd94801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ae2b341075d7ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fd95be00640 1 -- 172.21.15.16:0/158709055 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9480b5070 con 0x7fd954048120 2024-04-26T20:14:42.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fd95be00640 1 -- 172.21.15.16:0/158709055 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9480a8830 con 0x7fd954048120 2024-04-26T20:14:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.138+0000 7fd95be00640 1 -- 172.21.15.16:0/158709055 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9480a8c00 con 0x7fd954048120 2024-04-26T20:14:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd689e00640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd66c0683d0 0x7fd66c06a890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6840b1000 tx=0x7fd6840aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fa592a00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa574068380 0x7fa57406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa580007fd0 tx=0x7fa580007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 -- 172.21.15.16:0/158709055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd954048120 msgr2=0x7fd95404e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 --2- 172.21.15.16:0/158709055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd954048120 0x7fd95404e4b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd95404ce20 tx=0x7fd94801ecb0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 -- 172.21.15.16:0/158709055 shutdown_connections 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 --2- 172.21.15.16:0/158709055 >> v2:172.21.15.192:3300/0 conn(0x7fd9540462b0 0x7fd9540e6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 --2- 172.21.15.16:0/158709055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd954048120 0x7fd95404e4b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 --2- 172.21.15.16:0/158709055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540dd600 0x7fd95404df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 -- 172.21.15.16:0/158709055 >> 172.21.15.16:0/158709055 conn(0x7fd95400d190 msgr2=0x7fd95400d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 -- 172.21.15.16:0/158709055 shutdown_connections 2024-04-26T20:14:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.142+0000 7fd962a00640 1 -- 172.21.15.16:0/158709055 wait complete. 2024-04-26T20:14:42.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd962a00640 1 Processor -- start 2024-04-26T20:14:42.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd682000640 1 -- 172.21.15.16:0/1952587307 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd678053cb0 con 0x7fd68c159360 2024-04-26T20:14:42.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7f13c3400640 1 -- 172.21.15.16:0/338619784 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f13cc1e1cb0 con 0x7f13cc070480 2024-04-26T20:14:42.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd962a00640 1 -- start start 2024-04-26T20:14:42.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd962a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9540462b0 0x7fd95416d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd961600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9540462b0 0x7fd95416d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd962a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd954048120 0x7fd95417cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd961600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9540462b0 0x7fd95416d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53910/0 (socket says 172.21.15.16:53910) 2024-04-26T20:14:42.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd961600640 1 -- 172.21.15.16:0/2372781138 learned_addr learned my addr 172.21.15.16:0/2372781138 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd962a00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540dd600 0x7fd954007e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd960c00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd954048120 0x7fd95417cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd962000640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540dd600 0x7fd954007e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.146+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540dd9e0 con 0x7fd9540462b0 2024-04-26T20:14:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540e4060 con 0x7fd9540dd600 2024-04-26T20:14:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd95404d8a0 con 0x7fd954048120 2024-04-26T20:14:42.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd960c00640 1 -- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540dd600 msgr2=0x7fd954007e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd960c00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540dd600 0x7fd954007e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd960c00640 1 -- 172.21.15.16:0/2372781138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9540462b0 msgr2=0x7fd95416d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd960c00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9540462b0 0x7fd95416d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd960c00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95417d460 con 0x7fd954048120 2024-04-26T20:14:42.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd961600640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9540462b0 0x7fd95416d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:42.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd960c00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd954048120 0x7fd95417cf20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9480af000 tx=0x7fd94801ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fa58aa00640 1 -- 172.21.15.16:0/1433847562 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa58c020020 con 0x7fa594152000 2024-04-26T20:14:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd959600640 1 -- 172.21.15.16:0/2372781138 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9480bf070 con 0x7fd954048120 2024-04-26T20:14:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd959600640 1 -- 172.21.15.16:0/2372781138 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9480b0720 con 0x7fd954048120 2024-04-26T20:14:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.150+0000 7fd959600640 1 -- 172.21.15.16:0/2372781138 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9480b5040 con 0x7fd954048120 2024-04-26T20:14:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.158+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9540e2eb0 con 0x7fd954048120 2024-04-26T20:14:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.158+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95404f4e0 con 0x7fd954048120 2024-04-26T20:14:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.158+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9540053a0 con 0x7fd954048120 2024-04-26T20:14:42.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.158+0000 7fd682000640 1 -- 172.21.15.16:0/1952587307 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd678056310 con 0x7fd68c159360 2024-04-26T20:14:42.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.162+0000 7fd959600640 1 -- 172.21.15.16:0/2372781138 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9480b0b10 con 0x7fd954048120 2024-04-26T20:14:42.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.162+0000 7fd959600640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd93c068380 0x7fd93c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.162+0000 7fd959600640 1 -- 172.21.15.16:0/2372781138 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd948123990 con 0x7fd954048120 2024-04-26T20:14:42.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.162+0000 7fd961600640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd93c068380 0x7fd93c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.166+0000 7fd961600640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd93c068380 0x7fd93c06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd950006fd0 tx=0x7fd950008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.174+0000 7fa7b3600640 1 Processor -- start 2024-04-26T20:14:42.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.174+0000 7fd959600640 1 -- 172.21.15.16:0/2372781138 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd9480c8020 con 0x7fd954048120 2024-04-26T20:14:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.174+0000 7fa7b3600640 1 -- start start 2024-04-26T20:14:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.178+0000 7fa7b3600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa7ac0d1830 0x7fa7ac0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.178+0000 7fa7b3600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa7ac0cd790 0x7fa7ac0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.178+0000 7fa7b3600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac0ce780 con 0x7fa7ac0d1c10 2024-04-26T20:14:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.178+0000 7fa7b3600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa7ac06d6a0 con 0x7fa7ac0d1830 2024-04-26T20:14:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.178+0000 7fa7b3600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fa7ac0cc9e0 con 0x7fa7ac0cd790 2024-04-26T20:14:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.182+0000 7fa7b0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa7ac0d1830 0x7fa7ac0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.182+0000 7fa7b0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa7ac0d1830 0x7fa7ac0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53926/0 (socket says 172.21.15.16:53926) 2024-04-26T20:14:42.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.182+0000 7fa7b0c00640 1 -- 172.21.15.16:0/534517279 learned_addr learned my addr 172.21.15.16:0/534517279 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.182+0000 7fa7b0c00640 1 -- 172.21.15.16:0/534517279 >> v2:172.21.15.192:3300/0 conn(0x7fa7ac0cd790 msgr2=0x7fa7ac0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:42.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.182+0000 7fa7b0c00640 1 --2- 172.21.15.16:0/534517279 >> v2:172.21.15.192:3300/0 conn(0x7fa7ac0cd790 0x7fa7ac0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.182+0000 7fa7b0c00640 1 -- 172.21.15.16:0/534517279 >> v1:172.21.15.16:6789/0 conn(0x7fa7ac0d1c10 legacy=0x7fa7ac160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.182+0000 7fa7b0c00640 1 -- 172.21.15.16:0/534517279 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac0ce9f0 con 0x7fa7ac0d1830 2024-04-26T20:14:42.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.194+0000 7fa7b0c00640 1 --2- 172.21.15.16:0/534517279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c8e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b4640 tx=0x7fa79c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a2b662d25e16ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.194+0000 7fa7ab400640 1 -- 172.21.15.16:0/534517279 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0a9620 con 0x7fa7ac0d1830 2024-04-26T20:14:42.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.194+0000 7fa7ab400640 1 -- 172.21.15.16:0/534517279 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c0a97c0 con 0x7fa7ac0d1830 2024-04-26T20:14:42.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.194+0000 7fa7b3600640 1 -- 172.21.15.16:0/534517279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 msgr2=0x7fa7ac0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.194+0000 7fa7b3600640 1 --2- 172.21.15.16:0/534517279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c8e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0b4640 tx=0x7fa79c01c560 comp rx=0 tx=0).stop 2024-04-26T20:14:42.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7fa7b3600640 1 -- 172.21.15.16:0/534517279 shutdown_connections 2024-04-26T20:14:42.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f856b000640 1 Processor -- start 2024-04-26T20:14:42.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7fa7b3600640 1 --2- 172.21.15.16:0/534517279 >> v2:172.21.15.192:3300/0 conn(0x7fa7ac0cd790 0x7fa7ac0c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7fa7b3600640 1 --2- 172.21.15.16:0/534517279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c8e00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7fa7b3600640 1 -- 172.21.15.16:0/534517279 >> 172.21.15.16:0/534517279 conn(0x7fa7ac06d0d0 msgr2=0x7fa7ac06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7fa7b3600640 1 -- 172.21.15.16:0/534517279 shutdown_connections 2024-04-26T20:14:42.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7fa7b3600640 1 -- 172.21.15.16:0/534517279 wait complete. 2024-04-26T20:14:42.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f856b000640 1 -- start start 2024-04-26T20:14:42.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f856b000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f856406c5e0 0x7f85640ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f856b000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564072db0 con 0x7f8564155920 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f856b000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f856415ba80 con 0x7f856406c9c0 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f856b000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8564073050 con 0x7f856406c5e0 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f8569200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f856406c9c0 0x7f85640c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:45248/0 (socket says 172.21.15.16:45248) 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f8569200640 1 -- 172.21.15.16:0/4190731103 learned_addr learned my addr 172.21.15.16:0/4190731103 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7f8569c00640 1 --2- 172.21.15.16:0/4190731103 >> v2:172.21.15.16:3300/0 conn(0x7f856406c5e0 0x7f85640ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.202+0000 7f8563e00640 1 -- 172.21.15.16:0/4190731103 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078523269 0 0) 0x7f856415ba80 con 0x7f856406c9c0 2024-04-26T20:14:42.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.202+0000 7f8563e00640 1 -- 172.21.15.16:0/4190731103 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f854c003530 con 0x7f856406c9c0 2024-04-26T20:14:42.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.198+0000 7fa7b3600640 1 Processor -- start 2024-04-26T20:14:42.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.202+0000 7fa7b3600640 1 -- start start 2024-04-26T20:14:42.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.202+0000 7f8569c00640 1 -- 172.21.15.16:0/4190731103 >> v1:172.21.15.192:6789/0 conn(0x7f856406c9c0 legacy=0x7f85640c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.202+0000 7f8569c00640 1 -- 172.21.15.16:0/4190731103 >> v1:172.21.15.16:6789/0 conn(0x7f8564155920 legacy=0x7f856415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.202+0000 7f8569c00640 1 -- 172.21.15.16:0/4190731103 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8564073310 con 0x7f856406c5e0 2024-04-26T20:14:42.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7ac0cd790 0x7fa7ac1f9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7ac0d1c10 0x7fa7ac1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac16d4d0 con 0x7fa7ac0d1830 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1612a0 con 0x7fa7ac0cd790 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa7ac16d650 con 0x7fa7ac0d1c10 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7abe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7abe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53942/0 (socket says 172.21.15.16:53942) 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7abe00640 1 -- 172.21.15.16:0/513534125 learned_addr learned my addr 172.21.15.16:0/513534125 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b0c00640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7ac0cd790 0x7fa7ac1f9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b1600640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7ac0d1c10 0x7fa7ac1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b0c00640 1 -- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7ac0d1c10 msgr2=0x7fa7ac1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b0c00640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7ac0d1c10 0x7fa7ac1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b0c00640 1 -- 172.21.15.16:0/513534125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 msgr2=0x7fa7ac0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b0c00640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b0c00640 1 -- 172.21.15.16:0/513534125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac0c5160 con 0x7fa7ac0cd790 2024-04-26T20:14:42.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b0c00640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7ac0cd790 0x7fa7ac1f9fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0aa000 tx=0x7fa79c01ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7a8c00640 1 -- 172.21.15.16:0/513534125 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0a9b70 con 0x7fa7ac0cd790 2024-04-26T20:14:42.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac0c59d0 con 0x7fa7ac0cd790 2024-04-26T20:14:42.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7a8c00640 1 -- 172.21.15.16:0/513534125 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c0a9d10 con 0x7fa7ac0cd790 2024-04-26T20:14:42.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac0c5400 con 0x7fa7ac0cd790 2024-04-26T20:14:42.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.206+0000 7fa7a8c00640 1 -- 172.21.15.16:0/513534125 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c003860 con 0x7fa7ac0cd790 2024-04-26T20:14:42.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f8569c00640 1 --2- 172.21.15.16:0/4190731103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c5e0 0x7f85640ca510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85580097c0 tx=0x7f855801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6667b37aae4a07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac077c20 con 0x7fa7ac0cd790 2024-04-26T20:14:42.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f8563e00640 1 -- 172.21.15.16:0/4190731103 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85580b2070 con 0x7f856406c5e0 2024-04-26T20:14:42.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f8563e00640 1 -- 172.21.15.16:0/4190731103 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85580a9070 con 0x7f856406c5e0 2024-04-26T20:14:42.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f8563e00640 1 -- 172.21.15.16:0/4190731103 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85580ad880 con 0x7f856406c5e0 2024-04-26T20:14:42.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7fa7a8c00640 1 -- 172.21.15.16:0/513534125 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa79c003a00 con 0x7fa7ac0cd790 2024-04-26T20:14:42.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f856b000640 1 -- 172.21.15.16:0/4190731103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c5e0 msgr2=0x7f85640ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f856b000640 1 --2- 172.21.15.16:0/4190731103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c5e0 0x7f85640ca510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85580097c0 tx=0x7f855801c3e0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f856b000640 1 -- 172.21.15.16:0/4190731103 shutdown_connections 2024-04-26T20:14:42.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f856b000640 1 --2- 172.21.15.16:0/4190731103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c5e0 0x7f85640ca510 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.210+0000 7f856b000640 1 -- 172.21.15.16:0/4190731103 >> 172.21.15.16:0/4190731103 conn(0x7f856406e0a0 msgr2=0x7f856406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.214+0000 7f856b000640 1 -- 172.21.15.16:0/4190731103 shutdown_connections 2024-04-26T20:14:42.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.214+0000 7f856b000640 1 -- 172.21.15.16:0/4190731103 wait complete. 2024-04-26T20:14:42.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.214+0000 7f856b000640 1 Processor -- start 2024-04-26T20:14:42.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.214+0000 7f856b000640 1 -- start start 2024-04-26T20:14:42.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7fa7a8c00640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa78c068380 0x7fa78c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7fa7a8c00640 1 -- 172.21.15.16:0/513534125 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa79c120e50 con 0x7fa7ac0cd790 2024-04-26T20:14:42.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f856b000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856406c5e0 0x7f856414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7fa7abe00640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa78c068380 0x7fa78c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f856b000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c9c0 0x7f8564159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f8569c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856406c5e0 0x7f856414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f8569c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856406c5e0 0x7f856414a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42406/0 (socket says 172.21.15.16:42406) 2024-04-26T20:14:42.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f8569200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c9c0 0x7f8564159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f8569200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c9c0 0x7f8564159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53944/0 (socket says 172.21.15.16:53944) 2024-04-26T20:14:42.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f8569c00640 1 -- 172.21.15.16:0/4254126768 learned_addr learned my addr 172.21.15.16:0/4254126768 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f856b000640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8564155920 0x7f856415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7fa7abe00640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa78c068380 0x7fa78c06a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0c8510 tx=0x7fa798009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f856b000640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85640722d0 con 0x7f856406c9c0 2024-04-26T20:14:42.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f856a600640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8564155920 0x7f856415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f856b000640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f85640738d0 con 0x7f8564155920 2024-04-26T20:14:42.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.218+0000 7f856b000640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f856415c690 con 0x7f856406c5e0 2024-04-26T20:14:42.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.222+0000 7f856a600640 1 -- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856406c5e0 msgr2=0x7f856414a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.222+0000 7f856a600640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856406c5e0 0x7f856414a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.222+0000 7f856a600640 1 -- 172.21.15.16:0/4254126768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c9c0 msgr2=0x7f8564159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.222+0000 7f856a600640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c9c0 0x7f8564159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.222+0000 7f856a600640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856415b4e0 con 0x7f8564155920 2024-04-26T20:14:42.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.222+0000 7f856a600640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8564155920 0x7f856415a2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f855c00efa0 tx=0x7f855c00c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.222+0000 7f8569c00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856406c5e0 0x7f856414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:42.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.226+0000 7f8561600640 1 -- 172.21.15.16:0/4254126768 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c018020 con 0x7f8564155920 2024-04-26T20:14:42.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.226+0000 7f856b000640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85640c5de0 con 0x7f8564155920 2024-04-26T20:14:42.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.226+0000 7f8561600640 1 -- 172.21.15.16:0/4254126768 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c014620 con 0x7f8564155920 2024-04-26T20:14:42.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.226+0000 7f856b000640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85640c63a0 con 0x7f8564155920 2024-04-26T20:14:42.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.226+0000 7f8561600640 1 -- 172.21.15.16:0/4254126768 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c018020 con 0x7f8564155920 2024-04-26T20:14:42.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.230+0000 7fa7a8c00640 1 -- 172.21.15.16:0/513534125 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa79c0ad020 con 0x7fa7ac0cd790 2024-04-26T20:14:42.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.230+0000 7f8561600640 1 -- 172.21.15.16:0/4254126768 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f855c01b020 con 0x7f8564155920 2024-04-26T20:14:42.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.230+0000 7f8561600640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8544068580 0x7f854406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.230+0000 7f8561600640 1 -- 172.21.15.16:0/4254126768 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f855c0894b0 con 0x7f8564155920 2024-04-26T20:14:42.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.234+0000 7f8569c00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8544068580 0x7f854406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.234+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85380052a0 con 0x7f8564155920 2024-04-26T20:14:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.238+0000 7f8569c00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8544068580 0x7f854406aa40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8558000c10 tx=0x7f8558008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.250+0000 7f8561600640 1 -- 172.21.15.16:0/4254126768 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f855c022020 con 0x7f8564155920 2024-04-26T20:14:42.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.438+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2598005860 con 0x7f25c0070ff0 2024-04-26T20:14:42.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.450+0000 7f25b7400640 1 -- 172.21.15.16:0/1645467421 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25b0059ec0 con 0x7f25c0070ff0 2024-04-26T20:14:42.457 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f259c0687b0 msgr2=0x7f259c06ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f259c0687b0 0x7f259c06ac70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25a801ff60 tx=0x7f25a8009040 comp rx=0 tx=0).stop 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c0070ff0 msgr2=0x7f25c014f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c0070ff0 0x7f25c014f560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f25b000b410 tx=0x7f25b000b8d0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 shutdown_connections 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f259c0687b0 0x7f259c06ac70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25c00cbe60 0x7f25c00c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25c0070ff0 0x7f25c014f560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 --2- 172.21.15.16:0/1645467421 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0070500 0x7f25c01535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 >> 172.21.15.16:0/1645467421 conn(0x7f25c006c380 msgr2=0x7f25c0150330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 shutdown_connections 2024-04-26T20:14:42.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.462+0000 7f25c6200640 1 -- 172.21.15.16:0/1645467421 wait complete. 2024-04-26T20:14:42.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.506+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f69181552d0 con 0x7f69180c85e0 2024-04-26T20:14:42.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.506+0000 7f690f400640 1 -- 172.21.15.16:0/3282619700 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f690405abf0 con 0x7f69180c85e0 2024-04-26T20:14:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.510+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f13a4005590 con 0x7f13cc070480 2024-04-26T20:14:42.514 INFO:teuthology.orchestra.run.smithi016.stdout:60129542154 2024-04-26T20:14:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.510+0000 7f13c3400640 1 -- 172.21.15.16:0/338619784 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13b805e970 con 0x7f13cc070480 2024-04-26T20:14:42.515 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f68f8068380 msgr2=0x7f68f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f68f8068380 0x7f68f806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69180ca540 tx=0x7f6910009040 comp rx=0 tx=0).stop 2024-04-26T20:14:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69180c85e0 msgr2=0x7f6918153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69180c85e0 0x7f6918153e30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f690400c7f0 tx=0x7f690400ccb0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 shutdown_connections 2024-04-26T20:14:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f68f8068380 0x7f68f806a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f691815b9b0 0x7f6918203700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6918151c60 0x7f69182031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 --2- 172.21.15.16:0/3282619700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69180c85e0 0x7f6918153e30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 >> 172.21.15.16:0/3282619700 conn(0x7f691806e0a0 msgr2=0x7f691806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 shutdown_connections 2024-04-26T20:14:42.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f6917e00640 1 -- 172.21.15.16:0/3282619700 wait complete. 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f13ac068380 msgr2=0x7f13ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f13ac068380 0x7f13ac06a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13bc000f70 tx=0x7f13bc007e90 comp rx=0 tx=0).stop 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13cc070480 msgr2=0x7f13cc1f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13cc070480 0x7f13cc1f05c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f13b800aeb0 tx=0x7f13b800cbf0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 shutdown_connections 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f13ac068380 0x7f13ac06a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13cc152000 0x7f13cc1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13cc070480 0x7f13cc1f05c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 --2- 172.21.15.16:0/338619784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f13cc06f460 0x7f13cc1f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 >> 172.21.15.16:0/338619784 conn(0x7f13cc0c9d10 msgr2=0x7f13cc073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 shutdown_connections 2024-04-26T20:14:42.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.514+0000 7f13d2200640 1 -- 172.21.15.16:0/338619784 wait complete. 2024-04-26T20:14:42.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.2 2024-04-26T20:14:42.528 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.522+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd664005590 con 0x7fd68c159360 2024-04-26T20:14:42.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.526+0000 7fd682000640 1 -- 172.21.15.16:0/1952587307 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd678055c10 con 0x7fd68c159360 2024-04-26T20:14:42.531 INFO:teuthology.orchestra.run.smithi016.stdout:60129542153 2024-04-26T20:14:42.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa594074100 con 0x7fa594152000 2024-04-26T20:14:42.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd66c0683d0 msgr2=0x7fd66c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd66c0683d0 0x7fd66c06a890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6840b1000 tx=0x7fd6840aa000 comp rx=0 tx=0).stop 2024-04-26T20:14:42.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd68c159360 msgr2=0x7fd68c148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd68c159360 0x7fd68c148080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c390 tx=0x7fd67800c850 comp rx=0 tx=0).stop 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 shutdown_connections 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd66c0683d0 0x7fd66c06a890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd68c159360 0x7fd68c148080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd68c152c50 0x7fd68c0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 --2- 172.21.15.16:0/1952587307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68c06e6f0 0x7fd68c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 >> 172.21.15.16:0/1952587307 conn(0x7fd68c070ce0 msgr2=0x7fd68c0710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 shutdown_connections 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fd68b200640 1 -- 172.21.15.16:0/1952587307 wait complete. 2024-04-26T20:14:42.537 INFO:teuthology.orchestra.run.smithi016.stdout:60129542153 2024-04-26T20:14:42.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.530+0000 7fa58aa00640 1 -- 172.21.15.16:0/1433847562 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa58c019310 con 0x7fa594152000 2024-04-26T20:14:42.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.534+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa574068380 msgr2=0x7fa57406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.534+0000 7fa57fe00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa574068380 0x7fa57406a840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa580007fd0 tx=0x7fa580007900 comp rx=0 tx=0).stop 2024-04-26T20:14:42.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.534+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa594152000 msgr2=0x7fa5940cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.534+0000 7fa57fe00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa594152000 0x7fa5940cc960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c740 tx=0x7fa58c00cc00 comp rx=0 tx=0).stop 2024-04-26T20:14:42.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 shutdown_connections 2024-04-26T20:14:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa574068380 0x7fa57406a840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa594152000 0x7fa5940cc960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa594070480 0x7fa59415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 --2- 172.21.15.16:0/1433847562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa59406f460 0x7fa5941f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 >> 172.21.15.16:0/1433847562 conn(0x7fa5940c9d10 msgr2=0x7fa5940c6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 shutdown_connections 2024-04-26T20:14:42.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fa57fe00640 1 -- 172.21.15.16:0/1433847562 wait complete. 2024-04-26T20:14:42.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.538+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd954036380 con 0x7fd954048120 2024-04-26T20:14:42.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.542+0000 7fd959600640 1 -- 172.21.15.16:0/2372781138 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd948018810 con 0x7fd954048120 2024-04-26T20:14:42.556 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:42.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd93c068380 msgr2=0x7fd93c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd93c068380 0x7fd93c06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd950006fd0 tx=0x7fd950008040 comp rx=0 tx=0).stop 2024-04-26T20:14:42.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd954048120 msgr2=0x7fd95417cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd954048120 0x7fd95417cf20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9480af000 tx=0x7fd94801ba50 comp rx=0 tx=0).stop 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 shutdown_connections 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd93c068380 0x7fd93c06a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540dd600 0x7fd954007e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd954048120 0x7fd95417cf20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 --2- 172.21.15.16:0/2372781138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9540462b0 0x7fd95416d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.550+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 >> 172.21.15.16:0/2372781138 conn(0x7fd95400d190 msgr2=0x7fd95400d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.554+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 shutdown_connections 2024-04-26T20:14:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.554+0000 7fd962a00640 1 -- 172.21.15.16:0/2372781138 wait complete. 2024-04-26T20:14:42.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2024-04-26T20:14:42.561 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2024-04-26T20:14:42.566 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.3 2024-04-26T20:14:42.574 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2024-04-26T20:14:42.575 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.582+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa7ac0ce560 con 0x7fa7ac0cd790 2024-04-26T20:14:42.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.582+0000 7fa7a8c00640 1 -- 172.21.15.16:0/513534125 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa79c122020 con 0x7fa7ac0cd790 2024-04-26T20:14:42.587 INFO:teuthology.orchestra.run.smithi016.stdout:60129542154 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa78c068380 msgr2=0x7fa78c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa78c068380 0x7fa78c06a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0c8510 tx=0x7fa798009040 comp rx=0 tx=0).stop 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7ac0cd790 msgr2=0x7fa7ac1f9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7ac0cd790 0x7fa7ac1f9fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0aa000 tx=0x7fa79c01ada0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 shutdown_connections 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa78c068380 0x7fa78c06a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7ac0d1c10 0x7fa7ac1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7ac0d1830 0x7fa7ac0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 --2- 172.21.15.16:0/513534125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7ac0cd790 0x7fa7ac1f9fd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 >> 172.21.15.16:0/513534125 conn(0x7fa7ac06d0d0 msgr2=0x7fa7ac0b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 shutdown_connections 2024-04-26T20:14:42.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.586+0000 7fa7b3600640 1 -- 172.21.15.16:0/513534125 wait complete. 2024-04-26T20:14:42.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-04-26T20:14:42.592 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2024-04-26T20:14:42.611 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.606+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8538005590 con 0x7f8564155920 2024-04-26T20:14:42.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.606+0000 7f8561600640 1 -- 172.21.15.16:0/4254126768 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f855c022020 con 0x7f8564155920 2024-04-26T20:14:42.612 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8544068580 msgr2=0x7f854406aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8544068580 0x7f854406aa40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8558000c10 tx=0x7f8558008040 comp rx=0 tx=0).stop 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8564155920 msgr2=0x7f856415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8564155920 0x7f856415a2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f855c00efa0 tx=0x7f855c00c4f0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 shutdown_connections 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8544068580 0x7f854406aa40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8564155920 0x7f856415a2c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f856406c9c0 0x7f8564159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 --2- 172.21.15.16:0/4254126768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f856406c5e0 0x7f856414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 >> 172.21.15.16:0/4254126768 conn(0x7f856406e0a0 msgr2=0x7f85641549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 shutdown_connections 2024-04-26T20:14:42.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.610+0000 7f8556a00640 1 -- 172.21.15.16:0/4254126768 wait complete. 2024-04-26T20:14:42.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-04-26T20:14:42.635 DEBUG:teuthology.parallel:result is None 2024-04-26T20:14:42.635 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T20:14:42.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:14:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.810+0000 7f5644e00640 1 Processor -- start 2024-04-26T20:14:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.810+0000 7f5644e00640 1 -- start start 2024-04-26T20:14:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5644e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56400c6340 0x7f564015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5644e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56400cfb50 con 0x7f56400b1d80 2024-04-26T20:14:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5644e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56400cfe10 con 0x7f56400c9e80 2024-04-26T20:14:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5644e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f56400cce10 con 0x7f56400c6340 2024-04-26T20:14:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5635400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56400c6340 0x7f564015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5635400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56400c6340 0x7f564015c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53954/0 (socket says 172.21.15.16:53954) 2024-04-26T20:14:42.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5635400640 1 -- 172.21.15.16:0/2311480193 learned_addr learned my addr 172.21.15.16:0/2311480193 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5635400640 1 -- 172.21.15.16:0/2311480193 >> v1:172.21.15.192:6789/0 conn(0x7f56400c9e80 legacy=0x7f5640166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5635400640 1 -- 172.21.15.16:0/2311480193 >> v1:172.21.15.16:6789/0 conn(0x7f56400b1d80 legacy=0x7f564006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f563d400640 1 -- 172.21.15.16:0/2311480193 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987928994 0 0) 0x7f56400cfb50 con 0x7f56400b1d80 2024-04-26T20:14:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.814+0000 7f5635400640 1 -- 172.21.15.16:0/2311480193 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564006d650 con 0x7f56400c6340 2024-04-26T20:14:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5635400640 1 --2- 172.21.15.16:0/2311480193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400c6340 0x7f564015c0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5628009e50 tx=0x7f562801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5a1a7379978c3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f563d400640 1 -- 172.21.15.16:0/2311480193 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280a5920 con 0x7f56400c6340 2024-04-26T20:14:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f563d400640 1 -- 172.21.15.16:0/2311480193 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56280a5ac0 con 0x7f56400c6340 2024-04-26T20:14:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f563d400640 1 -- 172.21.15.16:0/2311480193 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280ad3f0 con 0x7f56400c6340 2024-04-26T20:14:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 -- 172.21.15.16:0/2311480193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400c6340 msgr2=0x7f564015c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 --2- 172.21.15.16:0/2311480193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400c6340 0x7f564015c0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5628009e50 tx=0x7f562801ca30 comp rx=0 tx=0).stop 2024-04-26T20:14:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 -- 172.21.15.16:0/2311480193 shutdown_connections 2024-04-26T20:14:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 --2- 172.21.15.16:0/2311480193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400c6340 0x7f564015c0d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 -- 172.21.15.16:0/2311480193 >> 172.21.15.16:0/2311480193 conn(0x7f5640071160 msgr2=0x7f5640068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 -- 172.21.15.16:0/2311480193 shutdown_connections 2024-04-26T20:14:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 -- 172.21.15.16:0/2311480193 wait complete. 2024-04-26T20:14:42.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 Processor -- start 2024-04-26T20:14:42.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.818+0000 7f5644e00640 1 -- start start 2024-04-26T20:14:42.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400b1d80 0x7f56401f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56400c6340 0x7f5640159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56400c9e80 0x7f56400c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5640071970 con 0x7f56400b1d80 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56400b2160 con 0x7f56400c9e80 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f56400705c0 con 0x7f56400c6340 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400b1d80 0x7f56401f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400b1d80 0x7f56401f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53970/0 (socket says 172.21.15.16:53970) 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 -- 172.21.15.16:0/3008040642 learned_addr learned my addr 172.21.15.16:0/3008040642 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5635400640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56400c6340 0x7f5640159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563e800640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56400c9e80 0x7f56400c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 -- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56400c6340 msgr2=0x7f5640159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56400c6340 0x7f5640159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 -- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56400c9e80 msgr2=0x7f56400c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56400c9e80 0x7f56400c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 -- 172.21.15.16:0/3008040642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56400c8e60 con 0x7f56400b1d80 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f563de00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400b1d80 0x7f56401f5380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f563000c410 tx=0x7f563000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5636a00640 1 -- 172.21.15.16:0/3008040642 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630017070 con 0x7f56400b1d80 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5636a00640 1 -- 172.21.15.16:0/3008040642 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630003600 con 0x7f56400b1d80 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5636a00640 1 -- 172.21.15.16:0/3008040642 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300039f0 con 0x7f56400b1d80 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56400c9140 con 0x7f56400b1d80 2024-04-26T20:14:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56400c9700 con 0x7f56400b1d80 2024-04-26T20:14:42.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.822+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5640077c20 con 0x7f56400b1d80 2024-04-26T20:14:42.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.826+0000 7f5636a00640 1 -- 172.21.15.16:0/3008040642 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f563001a070 con 0x7f56400b1d80 2024-04-26T20:14:42.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.826+0000 7f5636a00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f561c068380 0x7f561c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:42.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.826+0000 7f5636a00640 1 -- 172.21.15.16:0/3008040642 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5630086100 con 0x7f56400b1d80 2024-04-26T20:14:42.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.826+0000 7f5635400640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f561c068380 0x7f561c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:42.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.826+0000 7f5635400640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f561c068380 0x7f561c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56280ae000 tx=0x7f56280a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:42.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.830+0000 7f5636a00640 1 -- 172.21.15.16:0/3008040642 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5630056380 con 0x7f56400b1d80 2024-04-26T20:14:42.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:42.990+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5640076f90 con 0x7f561c068380 2024-04-26T20:14:43.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.014+0000 7f5636a00640 1 -- 172.21.15.16:0/3008040642 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332761 (secure 0 0 0) 0x7f5640076f90 con 0x7f561c068380 2024-04-26T20:14:43.022 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:43.024 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:14:43.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f561c068380 msgr2=0x7f561c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f561c068380 0x7f561c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56280ae000 tx=0x7f56280a7070 comp rx=0 tx=0).stop 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400b1d80 msgr2=0x7f56401f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400b1d80 0x7f56401f5380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f563000c410 tx=0x7f563000c8d0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 shutdown_connections 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f561c068380 0x7f561c06a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56400c9e80 0x7f56400c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56400c6340 0x7f5640159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 --2- 172.21.15.16:0/3008040642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56400b1d80 0x7f56401f5380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 >> 172.21.15.16:0/3008040642 conn(0x7f5640071160 msgr2=0x7f56400c5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 shutdown_connections 2024-04-26T20:14:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.018+0000 7f5644e00640 1 -- 172.21.15.16:0/3008040642 wait complete. 2024-04-26T20:14:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-26T20:14:42.959260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222576,"kb_used_data":2288,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752144,"statfs":{"total":773094113280,"available":772866195456,"internally_reserved":0,"allocated":2342912,"data_stored":2021300,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3187,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005299"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885563+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:14:19.885563+0000","last_peered":"2024-04-26T20:14:19.885563+0000","last_clean":"2024-04-26T20:14:19.885563+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:14:19.885563+0000","last_undegraded":"2024-04-26T20:14:19.885563+0000","last_fullsized":"2024-04-26T20:14:19.885563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547330+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:14:20.547330+0000","last_peered":"2024-04-26T20:14:20.547330+0000","last_clean":"2024-04-26T20:14:20.547330+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:14:20.547330+0000","last_undegraded":"2024-04-26T20:14:20.547330+0000","last_fullsized":"2024-04-26T20:14:20.547330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547016+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:14:20.547016+0000","last_peered":"2024-04-26T20:14:20.547016+0000","last_clean":"2024-04-26T20:14:20.547016+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:14:20.547016+0000","last_undegraded":"2024-04-26T20:14:20.547016+0000","last_fullsized":"2024-04-26T20:14:20.547016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547682+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:14:20.547682+0000","last_peered":"2024-04-26T20:14:20.547682+0000","last_clean":"2024-04-26T20:14:20.547682+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:14:20.547682+0000","last_undegraded":"2024-04-26T20:14:20.547682+0000","last_fullsized":"2024-04-26T20:14:20.547682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885447+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:14:19.885447+0000","last_peered":"2024-04-26T20:14:19.885447+0000","last_clean":"2024-04-26T20:14:19.885447+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:14:19.885447+0000","last_undegraded":"2024-04-26T20:14:19.885447+0000","last_fullsized":"2024-04-26T20:14:19.885447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507611+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:14:19.507611+0000","last_peered":"2024-04-26T20:14:19.507611+0000","last_clean":"2024-04-26T20:14:19.507611+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:14:19.507611+0000","last_undegraded":"2024-04-26T20:14:19.507611+0000","last_fullsized":"2024-04-26T20:14:19.507611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340700+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:14:20.340700+0000","last_peered":"2024-04-26T20:14:20.340700+0000","last_clean":"2024-04-26T20:14:20.340700+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:14:20.340700+0000","last_undegraded":"2024-04-26T20:14:20.340700+0000","last_fullsized":"2024-04-26T20:14:20.340700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551492+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:14:20.551492+0000","last_peered":"2024-04-26T20:14:20.551492+0000","last_clean":"2024-04-26T20:14:20.551492+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:14:20.551492+0000","last_undegraded":"2024-04-26T20:14:20.551492+0000","last_fullsized":"2024-04-26T20:14:20.551492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507856+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:14:19.507856+0000","last_peered":"2024-04-26T20:14:19.507856+0000","last_clean":"2024-04-26T20:14:19.507856+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:14:19.507856+0000","last_undegraded":"2024-04-26T20:14:19.507856+0000","last_fullsized":"2024-04-26T20:14:19.507856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340190+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:14:20.340190+0000","last_peered":"2024-04-26T20:14:20.340190+0000","last_clean":"2024-04-26T20:14:20.340190+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:14:20.340190+0000","last_undegraded":"2024-04-26T20:14:20.340190+0000","last_fullsized":"2024-04-26T20:14:20.340190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551323+0000","last_change":"2024-04-26T20:14:14.499292+0000","last_active":"2024-04-26T20:14:20.551323+0000","last_peered":"2024-04-26T20:14:20.551323+0000","last_clean":"2024-04-26T20:14:20.551323+0000","last_became_active":"2024-04-26T20:14:14.498610+0000","last_became_peered":"2024-04-26T20:14:14.498610+0000","last_unstale":"2024-04-26T20:14:20.551323+0000","last_undegraded":"2024-04-26T20:14:20.551323+0000","last_fullsized":"2024-04-26T20:14:20.551323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:44.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508054+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:14:19.508054+0000","last_peered":"2024-04-26T20:14:19.508054+0000","last_clean":"2024-04-26T20:14:19.508054+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:14:19.508054+0000","last_undegraded":"2024-04-26T20:14:19.508054+0000","last_fullsized":"2024-04-26T20:14:19.508054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504675+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:14:19.504675+0000","last_peered":"2024-04-26T20:14:19.504675+0000","last_clean":"2024-04-26T20:14:19.504675+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:14:19.504675+0000","last_undegraded":"2024-04-26T20:14:19.504675+0000","last_fullsized":"2024-04-26T20:14:19.504675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.087410+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:14:40.087410+0000","last_peered":"2024-04-26T20:14:40.087410+0000","last_clean":"2024-04-26T20:14:40.087410+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:14:40.087410+0000","last_undegraded":"2024-04-26T20:14:40.087410+0000","last_fullsized":"2024-04-26T20:14:40.087410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509512+0000","last_change":"2024-04-26T20:14:18.527474+0000","last_active":"2024-04-26T20:14:19.509512+0000","last_peered":"2024-04-26T20:14:19.509512+0000","last_clean":"2024-04-26T20:14:19.509512+0000","last_became_active":"2024-04-26T20:14:18.526374+0000","last_became_peered":"2024-04-26T20:14:18.526374+0000","last_unstale":"2024-04-26T20:14:19.509512+0000","last_undegraded":"2024-04-26T20:14:19.509512+0000","last_fullsized":"2024-04-26T20:14:19.509512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:31.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547337+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:14:20.547337+0000","last_peered":"2024-04-26T20:14:20.547337+0000","last_clean":"2024-04-26T20:14:20.547337+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:14:20.547337+0000","last_undegraded":"2024-04-26T20:14:20.547337+0000","last_fullsized":"2024-04-26T20:14:20.547337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537855+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:14:20.537855+0000","last_peered":"2024-04-26T20:14:20.537855+0000","last_clean":"2024-04-26T20:14:20.537855+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:14:20.537855+0000","last_undegraded":"2024-04-26T20:14:20.537855+0000","last_fullsized":"2024-04-26T20:14:20.537855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509176+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:14:19.509176+0000","last_peered":"2024-04-26T20:14:19.509176+0000","last_clean":"2024-04-26T20:14:19.509176+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:14:19.509176+0000","last_undegraded":"2024-04-26T20:14:19.509176+0000","last_fullsized":"2024-04-26T20:14:19.509176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547119+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:14:20.547119+0000","last_peered":"2024-04-26T20:14:20.547119+0000","last_clean":"2024-04-26T20:14:20.547119+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:14:20.547119+0000","last_undegraded":"2024-04-26T20:14:20.547119+0000","last_fullsized":"2024-04-26T20:14:20.547119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.099897+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:14:40.099897+0000","last_peered":"2024-04-26T20:14:40.099897+0000","last_clean":"2024-04-26T20:14:40.099897+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:14:40.099897+0000","last_undegraded":"2024-04-26T20:14:40.099897+0000","last_fullsized":"2024-04-26T20:14:40.099897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508115+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:14:19.508115+0000","last_peered":"2024-04-26T20:14:19.508115+0000","last_clean":"2024-04-26T20:14:19.508115+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:14:19.508115+0000","last_undegraded":"2024-04-26T20:14:19.508115+0000","last_fullsized":"2024-04-26T20:14:19.508115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.090799+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:14:40.090799+0000","last_peered":"2024-04-26T20:14:40.090799+0000","last_clean":"2024-04-26T20:14:40.090799+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:14:40.090799+0000","last_undegraded":"2024-04-26T20:14:40.090799+0000","last_fullsized":"2024-04-26T20:14:40.090799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509417+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:14:19.509417+0000","last_peered":"2024-04-26T20:14:19.509417+0000","last_clean":"2024-04-26T20:14:19.509417+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:14:19.509417+0000","last_undegraded":"2024-04-26T20:14:19.509417+0000","last_fullsized":"2024-04-26T20:14:19.509417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885352+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:14:19.885352+0000","last_peered":"2024-04-26T20:14:19.885352+0000","last_clean":"2024-04-26T20:14:19.885352+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:14:19.885352+0000","last_undegraded":"2024-04-26T20:14:19.885352+0000","last_fullsized":"2024-04-26T20:14:19.885352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.091154+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:14:40.091154+0000","last_peered":"2024-04-26T20:14:40.091154+0000","last_clean":"2024-04-26T20:14:40.091154+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:14:40.091154+0000","last_undegraded":"2024-04-26T20:14:40.091154+0000","last_fullsized":"2024-04-26T20:14:40.091154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507739+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:14:19.507739+0000","last_peered":"2024-04-26T20:14:19.507739+0000","last_clean":"2024-04-26T20:14:19.507739+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:14:19.507739+0000","last_undegraded":"2024-04-26T20:14:19.507739+0000","last_fullsized":"2024-04-26T20:14:19.507739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547916+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:14:20.547916+0000","last_peered":"2024-04-26T20:14:20.547916+0000","last_clean":"2024-04-26T20:14:20.547916+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:14:20.547916+0000","last_undegraded":"2024-04-26T20:14:20.547916+0000","last_fullsized":"2024-04-26T20:14:20.547916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538299+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:14:20.538299+0000","last_peered":"2024-04-26T20:14:20.538299+0000","last_clean":"2024-04-26T20:14:20.538299+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:14:20.538299+0000","last_undegraded":"2024-04-26T20:14:20.538299+0000","last_fullsized":"2024-04-26T20:14:20.538299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546922+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:14:20.546922+0000","last_peered":"2024-04-26T20:14:20.546922+0000","last_clean":"2024-04-26T20:14:20.546922+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:14:20.546922+0000","last_undegraded":"2024-04-26T20:14:20.546922+0000","last_fullsized":"2024-04-26T20:14:20.546922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538010+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:14:20.538010+0000","last_peered":"2024-04-26T20:14:20.538010+0000","last_clean":"2024-04-26T20:14:20.538010+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:14:20.538010+0000","last_undegraded":"2024-04-26T20:14:20.538010+0000","last_fullsized":"2024-04-26T20:14:20.538010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341065+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:14:20.341065+0000","last_peered":"2024-04-26T20:14:20.341065+0000","last_clean":"2024-04-26T20:14:20.341065+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:14:20.341065+0000","last_undegraded":"2024-04-26T20:14:20.341065+0000","last_fullsized":"2024-04-26T20:14:20.341065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885059+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:14:19.885059+0000","last_peered":"2024-04-26T20:14:19.885059+0000","last_clean":"2024-04-26T20:14:19.885059+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:14:19.885059+0000","last_undegraded":"2024-04-26T20:14:19.885059+0000","last_fullsized":"2024-04-26T20:14:19.885059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551624+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:14:20.551624+0000","last_peered":"2024-04-26T20:14:20.551624+0000","last_clean":"2024-04-26T20:14:20.551624+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:14:20.551624+0000","last_undegraded":"2024-04-26T20:14:20.551624+0000","last_fullsized":"2024-04-26T20:14:20.551624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538130+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:14:20.538130+0000","last_peered":"2024-04-26T20:14:20.538130+0000","last_clean":"2024-04-26T20:14:20.538130+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:14:20.538130+0000","last_undegraded":"2024-04-26T20:14:20.538130+0000","last_fullsized":"2024-04-26T20:14:20.538130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537670+0000","last_change":"2024-04-26T20:14:18.532352+0000","last_active":"2024-04-26T20:14:20.537670+0000","last_peered":"2024-04-26T20:14:20.537670+0000","last_clean":"2024-04-26T20:14:20.537670+0000","last_became_active":"2024-04-26T20:14:18.531948+0000","last_became_peered":"2024-04-26T20:14:18.531948+0000","last_unstale":"2024-04-26T20:14:20.537670+0000","last_undegraded":"2024-04-26T20:14:20.537670+0000","last_fullsized":"2024-04-26T20:14:20.537670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:07.005152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508466+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:14:19.508466+0000","last_peered":"2024-04-26T20:14:19.508466+0000","last_clean":"2024-04-26T20:14:19.508466+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:14:19.508466+0000","last_undegraded":"2024-04-26T20:14:19.508466+0000","last_fullsized":"2024-04-26T20:14:19.508466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551200+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:14:20.551200+0000","last_peered":"2024-04-26T20:14:20.551200+0000","last_clean":"2024-04-26T20:14:20.551200+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:14:20.551200+0000","last_undegraded":"2024-04-26T20:14:20.551200+0000","last_fullsized":"2024-04-26T20:14:20.551200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538131+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:14:20.538131+0000","last_peered":"2024-04-26T20:14:20.538131+0000","last_clean":"2024-04-26T20:14:20.538131+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:14:20.538131+0000","last_undegraded":"2024-04-26T20:14:20.538131+0000","last_fullsized":"2024-04-26T20:14:20.538131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537632+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:14:20.537632+0000","last_peered":"2024-04-26T20:14:20.537632+0000","last_clean":"2024-04-26T20:14:20.537632+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:14:20.537632+0000","last_undegraded":"2024-04-26T20:14:20.537632+0000","last_fullsized":"2024-04-26T20:14:20.537632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496596+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:14:19.496596+0000","last_peered":"2024-04-26T20:14:19.496596+0000","last_clean":"2024-04-26T20:14:19.496596+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:14:19.496596+0000","last_undegraded":"2024-04-26T20:14:19.496596+0000","last_fullsized":"2024-04-26T20:14:19.496596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884667+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:14:19.884667+0000","last_peered":"2024-04-26T20:14:19.884667+0000","last_clean":"2024-04-26T20:14:19.884667+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:14:19.884667+0000","last_undegraded":"2024-04-26T20:14:19.884667+0000","last_fullsized":"2024-04-26T20:14:19.884667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339723+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:14:20.339723+0000","last_peered":"2024-04-26T20:14:20.339723+0000","last_clean":"2024-04-26T20:14:20.339723+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:14:20.339723+0000","last_undegraded":"2024-04-26T20:14:20.339723+0000","last_fullsized":"2024-04-26T20:14:20.339723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885284+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:14:19.885284+0000","last_peered":"2024-04-26T20:14:19.885284+0000","last_clean":"2024-04-26T20:14:19.885284+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:14:19.885284+0000","last_undegraded":"2024-04-26T20:14:19.885284+0000","last_fullsized":"2024-04-26T20:14:19.885284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547171+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:14:20.547171+0000","last_peered":"2024-04-26T20:14:20.547171+0000","last_clean":"2024-04-26T20:14:20.547171+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:14:20.547171+0000","last_undegraded":"2024-04-26T20:14:20.547171+0000","last_fullsized":"2024-04-26T20:14:20.547171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.098692+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:14:40.098692+0000","last_peered":"2024-04-26T20:14:40.098692+0000","last_clean":"2024-04-26T20:14:40.098692+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:14:40.098692+0000","last_undegraded":"2024-04-26T20:14:40.098692+0000","last_fullsized":"2024-04-26T20:14:40.098692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339797+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:14:20.339797+0000","last_peered":"2024-04-26T20:14:20.339797+0000","last_clean":"2024-04-26T20:14:20.339797+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:14:20.339797+0000","last_undegraded":"2024-04-26T20:14:20.339797+0000","last_fullsized":"2024-04-26T20:14:20.339797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505934+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:14:19.505934+0000","last_peered":"2024-04-26T20:14:19.505934+0000","last_clean":"2024-04-26T20:14:19.505934+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:14:19.505934+0000","last_undegraded":"2024-04-26T20:14:19.505934+0000","last_fullsized":"2024-04-26T20:14:19.505934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340425+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:14:20.340425+0000","last_peered":"2024-04-26T20:14:20.340425+0000","last_clean":"2024-04-26T20:14:20.340425+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:14:20.340425+0000","last_undegraded":"2024-04-26T20:14:20.340425+0000","last_fullsized":"2024-04-26T20:14:20.340425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496906+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:14:19.496906+0000","last_peered":"2024-04-26T20:14:19.496906+0000","last_clean":"2024-04-26T20:14:19.496906+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:14:19.496906+0000","last_undegraded":"2024-04-26T20:14:19.496906+0000","last_fullsized":"2024-04-26T20:14:19.496906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504513+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:14:19.504513+0000","last_peered":"2024-04-26T20:14:19.504513+0000","last_clean":"2024-04-26T20:14:19.504513+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:14:19.504513+0000","last_undegraded":"2024-04-26T20:14:19.504513+0000","last_fullsized":"2024-04-26T20:14:19.504513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551589+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:14:20.551589+0000","last_peered":"2024-04-26T20:14:20.551589+0000","last_clean":"2024-04-26T20:14:20.551589+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:14:20.551589+0000","last_undegraded":"2024-04-26T20:14:20.551589+0000","last_fullsized":"2024-04-26T20:14:20.551589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538251+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:14:20.538251+0000","last_peered":"2024-04-26T20:14:20.538251+0000","last_clean":"2024-04-26T20:14:20.538251+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:14:20.538251+0000","last_undegraded":"2024-04-26T20:14:20.538251+0000","last_fullsized":"2024-04-26T20:14:20.538251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885149+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:14:19.885149+0000","last_peered":"2024-04-26T20:14:19.885149+0000","last_clean":"2024-04-26T20:14:19.885149+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:14:19.885149+0000","last_undegraded":"2024-04-26T20:14:19.885149+0000","last_fullsized":"2024-04-26T20:14:19.885149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341171+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:14:20.341171+0000","last_peered":"2024-04-26T20:14:20.341171+0000","last_clean":"2024-04-26T20:14:20.341171+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:14:20.341171+0000","last_undegraded":"2024-04-26T20:14:20.341171+0000","last_fullsized":"2024-04-26T20:14:20.341171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.497025+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:14:19.497025+0000","last_peered":"2024-04-26T20:14:19.497025+0000","last_clean":"2024-04-26T20:14:19.497025+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:14:19.497025+0000","last_undegraded":"2024-04-26T20:14:19.497025+0000","last_fullsized":"2024-04-26T20:14:19.497025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550272+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:14:20.550272+0000","last_peered":"2024-04-26T20:14:20.550272+0000","last_clean":"2024-04-26T20:14:20.550272+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:14:20.550272+0000","last_undegraded":"2024-04-26T20:14:20.550272+0000","last_fullsized":"2024-04-26T20:14:20.550272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341179+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:14:20.341179+0000","last_peered":"2024-04-26T20:14:20.341179+0000","last_clean":"2024-04-26T20:14:20.341179+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:14:20.341179+0000","last_undegraded":"2024-04-26T20:14:20.341179+0000","last_fullsized":"2024-04-26T20:14:20.341179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509614+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:14:19.509614+0000","last_peered":"2024-04-26T20:14:19.509614+0000","last_clean":"2024-04-26T20:14:19.509614+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:14:19.509614+0000","last_undegraded":"2024-04-26T20:14:19.509614+0000","last_fullsized":"2024-04-26T20:14:19.509614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507544+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:14:19.507544+0000","last_peered":"2024-04-26T20:14:19.507544+0000","last_clean":"2024-04-26T20:14:19.507544+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:14:19.507544+0000","last_undegraded":"2024-04-26T20:14:19.507544+0000","last_fullsized":"2024-04-26T20:14:19.507544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340080+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:14:20.340080+0000","last_peered":"2024-04-26T20:14:20.340080+0000","last_clean":"2024-04-26T20:14:20.340080+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:14:20.340080+0000","last_undegraded":"2024-04-26T20:14:20.340080+0000","last_fullsized":"2024-04-26T20:14:20.340080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.097282+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:14:40.097282+0000","last_peered":"2024-04-26T20:14:40.097282+0000","last_clean":"2024-04-26T20:14:40.097282+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:14:40.097282+0000","last_undegraded":"2024-04-26T20:14:40.097282+0000","last_fullsized":"2024-04-26T20:14:40.097282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885253+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:14:19.885253+0000","last_peered":"2024-04-26T20:14:19.885253+0000","last_clean":"2024-04-26T20:14:19.885253+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:14:19.885253+0000","last_undegraded":"2024-04-26T20:14:19.885253+0000","last_fullsized":"2024-04-26T20:14:19.885253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504382+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:14:19.504382+0000","last_peered":"2024-04-26T20:14:19.504382+0000","last_clean":"2024-04-26T20:14:19.504382+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:14:19.504382+0000","last_undegraded":"2024-04-26T20:14:19.504382+0000","last_fullsized":"2024-04-26T20:14:19.504382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504483+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:14:19.504483+0000","last_peered":"2024-04-26T20:14:19.504483+0000","last_clean":"2024-04-26T20:14:19.504483+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:14:19.504483+0000","last_undegraded":"2024-04-26T20:14:19.504483+0000","last_fullsized":"2024-04-26T20:14:19.504483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547904+0000","last_change":"2024-04-26T20:14:18.642156+0000","last_active":"2024-04-26T20:14:20.547904+0000","last_peered":"2024-04-26T20:14:20.547904+0000","last_clean":"2024-04-26T20:14:20.547904+0000","last_became_active":"2024-04-26T20:14:18.641452+0000","last_became_peered":"2024-04-26T20:14:18.641452+0000","last_unstale":"2024-04-26T20:14:20.547904+0000","last_undegraded":"2024-04-26T20:14:20.547904+0000","last_fullsized":"2024-04-26T20:14:20.547904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:30.242536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340685+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:14:20.340685+0000","last_peered":"2024-04-26T20:14:20.340685+0000","last_clean":"2024-04-26T20:14:20.340685+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:14:20.340685+0000","last_undegraded":"2024-04-26T20:14:20.340685+0000","last_fullsized":"2024-04-26T20:14:20.340685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.093099+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:14:40.093099+0000","last_peered":"2024-04-26T20:14:40.093099+0000","last_clean":"2024-04-26T20:14:40.093099+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:14:40.093099+0000","last_undegraded":"2024-04-26T20:14:40.093099+0000","last_fullsized":"2024-04-26T20:14:40.093099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547744+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:14:20.547744+0000","last_peered":"2024-04-26T20:14:20.547744+0000","last_clean":"2024-04-26T20:14:20.547744+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:14:20.547744+0000","last_undegraded":"2024-04-26T20:14:20.547744+0000","last_fullsized":"2024-04-26T20:14:20.547744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884892+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:14:19.884892+0000","last_peered":"2024-04-26T20:14:19.884892+0000","last_clean":"2024-04-26T20:14:19.884892+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:14:19.884892+0000","last_undegraded":"2024-04-26T20:14:19.884892+0000","last_fullsized":"2024-04-26T20:14:19.884892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.098764+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:14:40.098764+0000","last_peered":"2024-04-26T20:14:40.098764+0000","last_clean":"2024-04-26T20:14:40.098764+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:14:40.098764+0000","last_undegraded":"2024-04-26T20:14:40.098764+0000","last_fullsized":"2024-04-26T20:14:40.098764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551667+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:14:20.551667+0000","last_peered":"2024-04-26T20:14:20.551667+0000","last_clean":"2024-04-26T20:14:20.551667+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:14:20.551667+0000","last_undegraded":"2024-04-26T20:14:20.551667+0000","last_fullsized":"2024-04-26T20:14:20.551667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340243+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:14:20.340243+0000","last_peered":"2024-04-26T20:14:20.340243+0000","last_clean":"2024-04-26T20:14:20.340243+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:14:20.340243+0000","last_undegraded":"2024-04-26T20:14:20.340243+0000","last_fullsized":"2024-04-26T20:14:20.340243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.086670+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:14:40.086670+0000","last_peered":"2024-04-26T20:14:40.086670+0000","last_clean":"2024-04-26T20:14:40.086670+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:14:40.086670+0000","last_undegraded":"2024-04-26T20:14:40.086670+0000","last_fullsized":"2024-04-26T20:14:40.086670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537725+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:14:20.537725+0000","last_peered":"2024-04-26T20:14:20.537725+0000","last_clean":"2024-04-26T20:14:20.537725+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:14:20.537725+0000","last_undegraded":"2024-04-26T20:14:20.537725+0000","last_fullsized":"2024-04-26T20:14:20.537725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509332+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:14:19.509332+0000","last_peered":"2024-04-26T20:14:19.509332+0000","last_clean":"2024-04-26T20:14:19.509332+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:14:19.509332+0000","last_undegraded":"2024-04-26T20:14:19.509332+0000","last_fullsized":"2024-04-26T20:14:19.509332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538197+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:14:20.538197+0000","last_peered":"2024-04-26T20:14:20.538197+0000","last_clean":"2024-04-26T20:14:20.538197+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:14:20.538197+0000","last_undegraded":"2024-04-26T20:14:20.538197+0000","last_fullsized":"2024-04-26T20:14:20.538197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508332+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:14:19.508332+0000","last_peered":"2024-04-26T20:14:19.508332+0000","last_clean":"2024-04-26T20:14:19.508332+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:14:19.508332+0000","last_undegraded":"2024-04-26T20:14:19.508332+0000","last_fullsized":"2024-04-26T20:14:19.508332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885496+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:14:19.885496+0000","last_peered":"2024-04-26T20:14:19.885496+0000","last_clean":"2024-04-26T20:14:19.885496+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:14:19.885496+0000","last_undegraded":"2024-04-26T20:14:19.885496+0000","last_fullsized":"2024-04-26T20:14:19.885496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.097720+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:14:40.097720+0000","last_peered":"2024-04-26T20:14:40.097720+0000","last_clean":"2024-04-26T20:14:40.097720+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:14:40.097720+0000","last_undegraded":"2024-04-26T20:14:40.097720+0000","last_fullsized":"2024-04-26T20:14:40.097720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547103+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:14:20.547103+0000","last_peered":"2024-04-26T20:14:20.547103+0000","last_clean":"2024-04-26T20:14:20.547103+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:14:20.547103+0000","last_undegraded":"2024-04-26T20:14:20.547103+0000","last_fullsized":"2024-04-26T20:14:20.547103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551023+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:14:20.551023+0000","last_peered":"2024-04-26T20:14:20.551023+0000","last_clean":"2024-04-26T20:14:20.551023+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:14:20.551023+0000","last_undegraded":"2024-04-26T20:14:20.551023+0000","last_fullsized":"2024-04-26T20:14:20.551023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.092533+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:14:40.092533+0000","last_peered":"2024-04-26T20:14:40.092533+0000","last_clean":"2024-04-26T20:14:40.092533+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:14:40.092533+0000","last_undegraded":"2024-04-26T20:14:40.092533+0000","last_fullsized":"2024-04-26T20:14:40.092533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547062+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:14:20.547062+0000","last_peered":"2024-04-26T20:14:20.547062+0000","last_clean":"2024-04-26T20:14:20.547062+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:14:20.547062+0000","last_undegraded":"2024-04-26T20:14:20.547062+0000","last_fullsized":"2024-04-26T20:14:20.547062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885190+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:14:19.885190+0000","last_peered":"2024-04-26T20:14:19.885190+0000","last_clean":"2024-04-26T20:14:19.885190+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:14:19.885190+0000","last_undegraded":"2024-04-26T20:14:19.885190+0000","last_fullsized":"2024-04-26T20:14:19.885190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537488+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:14:20.537488+0000","last_peered":"2024-04-26T20:14:20.537488+0000","last_clean":"2024-04-26T20:14:20.537488+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:14:20.537488+0000","last_undegraded":"2024-04-26T20:14:20.537488+0000","last_fullsized":"2024-04-26T20:14:20.537488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550778+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:14:20.550778+0000","last_peered":"2024-04-26T20:14:20.550778+0000","last_clean":"2024-04-26T20:14:20.550778+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:14:20.550778+0000","last_undegraded":"2024-04-26T20:14:20.550778+0000","last_fullsized":"2024-04-26T20:14:20.550778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506621+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:14:19.506621+0000","last_peered":"2024-04-26T20:14:19.506621+0000","last_clean":"2024-04-26T20:14:19.506621+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:14:19.506621+0000","last_undegraded":"2024-04-26T20:14:19.506621+0000","last_fullsized":"2024-04-26T20:14:19.506621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547012+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:14:20.547012+0000","last_peered":"2024-04-26T20:14:20.547012+0000","last_clean":"2024-04-26T20:14:20.547012+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:14:20.547012+0000","last_undegraded":"2024-04-26T20:14:20.547012+0000","last_fullsized":"2024-04-26T20:14:20.547012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547247+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:14:20.547247+0000","last_peered":"2024-04-26T20:14:20.547247+0000","last_clean":"2024-04-26T20:14:20.547247+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:14:20.547247+0000","last_undegraded":"2024-04-26T20:14:20.547247+0000","last_fullsized":"2024-04-26T20:14:20.547247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505171+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:14:19.505171+0000","last_peered":"2024-04-26T20:14:19.505171+0000","last_clean":"2024-04-26T20:14:19.505171+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:14:19.505171+0000","last_undegraded":"2024-04-26T20:14:19.505171+0000","last_fullsized":"2024-04-26T20:14:19.505171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885205+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:14:19.885205+0000","last_peered":"2024-04-26T20:14:19.885205+0000","last_clean":"2024-04-26T20:14:19.885205+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:14:19.885205+0000","last_undegraded":"2024-04-26T20:14:19.885205+0000","last_fullsized":"2024-04-26T20:14:19.885205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496841+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:14:19.496841+0000","last_peered":"2024-04-26T20:14:19.496841+0000","last_clean":"2024-04-26T20:14:19.496841+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:14:19.496841+0000","last_undegraded":"2024-04-26T20:14:19.496841+0000","last_fullsized":"2024-04-26T20:14:19.496841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.094285+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:14:40.094285+0000","last_peered":"2024-04-26T20:14:40.094285+0000","last_clean":"2024-04-26T20:14:40.094285+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:14:40.094285+0000","last_undegraded":"2024-04-26T20:14:40.094285+0000","last_fullsized":"2024-04-26T20:14:40.094285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508517+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:14:19.508517+0000","last_peered":"2024-04-26T20:14:19.508517+0000","last_clean":"2024-04-26T20:14:19.508517+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:14:19.508517+0000","last_undegraded":"2024-04-26T20:14:19.508517+0000","last_fullsized":"2024-04-26T20:14:19.508517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547503+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:14:20.547503+0000","last_peered":"2024-04-26T20:14:20.547503+0000","last_clean":"2024-04-26T20:14:20.547503+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:14:20.547503+0000","last_undegraded":"2024-04-26T20:14:20.547503+0000","last_fullsized":"2024-04-26T20:14:20.547503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504099+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:14:19.504099+0000","last_peered":"2024-04-26T20:14:19.504099+0000","last_clean":"2024-04-26T20:14:19.504099+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:14:19.504099+0000","last_undegraded":"2024-04-26T20:14:19.504099+0000","last_fullsized":"2024-04-26T20:14:19.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496540+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:14:19.496540+0000","last_peered":"2024-04-26T20:14:19.496540+0000","last_clean":"2024-04-26T20:14:19.496540+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:14:19.496540+0000","last_undegraded":"2024-04-26T20:14:19.496540+0000","last_fullsized":"2024-04-26T20:14:19.496540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550979+0000","last_change":"2024-04-26T20:14:14.482803+0000","last_active":"2024-04-26T20:14:20.550979+0000","last_peered":"2024-04-26T20:14:20.550979+0000","last_clean":"2024-04-26T20:14:20.550979+0000","last_became_active":"2024-04-26T20:14:14.482022+0000","last_became_peered":"2024-04-26T20:14:14.482022+0000","last_unstale":"2024-04-26T20:14:20.550979+0000","last_undegraded":"2024-04-26T20:14:20.550979+0000","last_fullsized":"2024-04-26T20:14:20.550979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885112+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:14:19.885112+0000","last_peered":"2024-04-26T20:14:19.885112+0000","last_clean":"2024-04-26T20:14:19.885112+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:14:19.885112+0000","last_undegraded":"2024-04-26T20:14:19.885112+0000","last_fullsized":"2024-04-26T20:14:19.885112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547807+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:14:20.547807+0000","last_peered":"2024-04-26T20:14:20.547807+0000","last_clean":"2024-04-26T20:14:20.547807+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:14:20.547807+0000","last_undegraded":"2024-04-26T20:14:20.547807+0000","last_fullsized":"2024-04-26T20:14:20.547807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537992+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:14:20.537992+0000","last_peered":"2024-04-26T20:14:20.537992+0000","last_clean":"2024-04-26T20:14:20.537992+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:14:20.537992+0000","last_undegraded":"2024-04-26T20:14:20.537992+0000","last_fullsized":"2024-04-26T20:14:20.537992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506318+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:14:19.506318+0000","last_peered":"2024-04-26T20:14:19.506318+0000","last_clean":"2024-04-26T20:14:19.506318+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:14:19.506318+0000","last_undegraded":"2024-04-26T20:14:19.506318+0000","last_fullsized":"2024-04-26T20:14:19.506318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547804+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:14:20.547804+0000","last_peered":"2024-04-26T20:14:20.547804+0000","last_clean":"2024-04-26T20:14:20.547804+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:14:20.547804+0000","last_undegraded":"2024-04-26T20:14:20.547804+0000","last_fullsized":"2024-04-26T20:14:20.547804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550486+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:14:20.550486+0000","last_peered":"2024-04-26T20:14:20.550486+0000","last_clean":"2024-04-26T20:14:20.550486+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:14:20.550486+0000","last_undegraded":"2024-04-26T20:14:20.550486+0000","last_fullsized":"2024-04-26T20:14:20.550486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547253+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:14:20.547253+0000","last_peered":"2024-04-26T20:14:20.547253+0000","last_clean":"2024-04-26T20:14:20.547253+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:14:20.547253+0000","last_undegraded":"2024-04-26T20:14:20.547253+0000","last_fullsized":"2024-04-26T20:14:20.547253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550633+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:14:20.550633+0000","last_peered":"2024-04-26T20:14:20.550633+0000","last_clean":"2024-04-26T20:14:20.550633+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:14:20.550633+0000","last_undegraded":"2024-04-26T20:14:20.550633+0000","last_fullsized":"2024-04-26T20:14:20.550633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884953+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:14:19.884953+0000","last_peered":"2024-04-26T20:14:19.884953+0000","last_clean":"2024-04-26T20:14:19.884953+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:14:19.884953+0000","last_undegraded":"2024-04-26T20:14:19.884953+0000","last_fullsized":"2024-04-26T20:14:19.884953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505625+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:14:19.505625+0000","last_peered":"2024-04-26T20:14:19.505625+0000","last_clean":"2024-04-26T20:14:19.505625+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:14:19.505625+0000","last_undegraded":"2024-04-26T20:14:19.505625+0000","last_fullsized":"2024-04-26T20:14:19.505625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340721+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:14:20.340721+0000","last_peered":"2024-04-26T20:14:20.340721+0000","last_clean":"2024-04-26T20:14:20.340721+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:14:20.340721+0000","last_undegraded":"2024-04-26T20:14:20.340721+0000","last_fullsized":"2024-04-26T20:14:20.340721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496988+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:14:19.496988+0000","last_peered":"2024-04-26T20:14:19.496988+0000","last_clean":"2024-04-26T20:14:19.496988+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:14:19.496988+0000","last_undegraded":"2024-04-26T20:14:19.496988+0000","last_fullsized":"2024-04-26T20:14:19.496988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551847+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:14:20.551847+0000","last_peered":"2024-04-26T20:14:20.551847+0000","last_clean":"2024-04-26T20:14:20.551847+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:14:20.551847+0000","last_undegraded":"2024-04-26T20:14:20.551847+0000","last_fullsized":"2024-04-26T20:14:20.551847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550171+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:14:20.550171+0000","last_peered":"2024-04-26T20:14:20.550171+0000","last_clean":"2024-04-26T20:14:20.550171+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:14:20.550171+0000","last_undegraded":"2024-04-26T20:14:20.550171+0000","last_fullsized":"2024-04-26T20:14:20.550171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537556+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:14:20.537556+0000","last_peered":"2024-04-26T20:14:20.537556+0000","last_clean":"2024-04-26T20:14:20.537556+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:14:20.537556+0000","last_undegraded":"2024-04-26T20:14:20.537556+0000","last_fullsized":"2024-04-26T20:14:20.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884895+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:14:19.884895+0000","last_peered":"2024-04-26T20:14:19.884895+0000","last_clean":"2024-04-26T20:14:19.884895+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:14:19.884895+0000","last_undegraded":"2024-04-26T20:14:19.884895+0000","last_fullsized":"2024-04-26T20:14:19.884895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547283+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:14:20.547283+0000","last_peered":"2024-04-26T20:14:20.547283+0000","last_clean":"2024-04-26T20:14:20.547283+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:14:20.547283+0000","last_undegraded":"2024-04-26T20:14:20.547283+0000","last_fullsized":"2024-04-26T20:14:20.547283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509243+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:14:19.509243+0000","last_peered":"2024-04-26T20:14:19.509243+0000","last_clean":"2024-04-26T20:14:19.509243+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:14:19.509243+0000","last_undegraded":"2024-04-26T20:14:19.509243+0000","last_fullsized":"2024-04-26T20:14:19.509243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505396+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:14:19.505396+0000","last_peered":"2024-04-26T20:14:19.505396+0000","last_clean":"2024-04-26T20:14:19.505396+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:14:19.505396+0000","last_undegraded":"2024-04-26T20:14:19.505396+0000","last_fullsized":"2024-04-26T20:14:19.505396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506202+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:14:19.506202+0000","last_peered":"2024-04-26T20:14:19.506202+0000","last_clean":"2024-04-26T20:14:19.506202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:14:19.506202+0000","last_undegraded":"2024-04-26T20:14:19.506202+0000","last_fullsized":"2024-04-26T20:14:19.506202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341083+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:14:20.341083+0000","last_peered":"2024-04-26T20:14:20.341083+0000","last_clean":"2024-04-26T20:14:20.341083+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:14:20.341083+0000","last_undegraded":"2024-04-26T20:14:20.341083+0000","last_fullsized":"2024-04-26T20:14:20.341083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546910+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:14:20.546910+0000","last_peered":"2024-04-26T20:14:20.546910+0000","last_clean":"2024-04-26T20:14:20.546910+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:14:20.546910+0000","last_undegraded":"2024-04-26T20:14:20.546910+0000","last_fullsized":"2024-04-26T20:14:20.546910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339971+0000","last_change":"2024-04-26T20:14:14.463139+0000","last_active":"2024-04-26T20:14:20.339971+0000","last_peered":"2024-04-26T20:14:20.339971+0000","last_clean":"2024-04-26T20:14:20.339971+0000","last_became_active":"2024-04-26T20:14:14.462083+0000","last_became_peered":"2024-04-26T20:14:14.462083+0000","last_unstale":"2024-04-26T20:14:20.339971+0000","last_undegraded":"2024-04-26T20:14:20.339971+0000","last_fullsized":"2024-04-26T20:14:20.339971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:28.615893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550418+0000","last_change":"2024-04-26T20:14:14.475535+0000","last_active":"2024-04-26T20:14:20.550418+0000","last_peered":"2024-04-26T20:14:20.550418+0000","last_clean":"2024-04-26T20:14:20.550418+0000","last_became_active":"2024-04-26T20:14:14.474445+0000","last_became_peered":"2024-04-26T20:14:14.474445+0000","last_unstale":"2024-04-26T20:14:20.550418+0000","last_undegraded":"2024-04-26T20:14:20.550418+0000","last_fullsized":"2024-04-26T20:14:20.550418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:51.715142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339972+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:14:20.339972+0000","last_peered":"2024-04-26T20:14:20.339972+0000","last_clean":"2024-04-26T20:14:20.339972+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:14:20.339972+0000","last_undegraded":"2024-04-26T20:14:20.339972+0000","last_fullsized":"2024-04-26T20:14:20.339972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551012+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:14:20.551012+0000","last_peered":"2024-04-26T20:14:20.551012+0000","last_clean":"2024-04-26T20:14:20.551012+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:14:20.551012+0000","last_undegraded":"2024-04-26T20:14:20.551012+0000","last_fullsized":"2024-04-26T20:14:20.551012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885153+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:14:19.885153+0000","last_peered":"2024-04-26T20:14:19.885153+0000","last_clean":"2024-04-26T20:14:19.885153+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:14:19.885153+0000","last_undegraded":"2024-04-26T20:14:19.885153+0000","last_fullsized":"2024-04-26T20:14:19.885153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538165+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:14:20.538165+0000","last_peered":"2024-04-26T20:14:20.538165+0000","last_clean":"2024-04-26T20:14:20.538165+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:14:20.538165+0000","last_undegraded":"2024-04-26T20:14:20.538165+0000","last_fullsized":"2024-04-26T20:14:20.538165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340878+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:14:20.340878+0000","last_peered":"2024-04-26T20:14:20.340878+0000","last_clean":"2024-04-26T20:14:20.340878+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:14:20.340878+0000","last_undegraded":"2024-04-26T20:14:20.340878+0000","last_fullsized":"2024-04-26T20:14:20.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":695243,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":344064,"data_stored":694587,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:14:43.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:14:43.054 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-26T20:14:43.050+0000 7f31e9800640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T20:14:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.190+0000 7f88bc800640 1 Processor -- start 2024-04-26T20:14:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.190+0000 7f88bc800640 1 -- start start 2024-04-26T20:14:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88bc800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b40c6340 0x7f88b406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88bc800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88b40c9e80 0x7f88b40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88bc800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88b406d610 con 0x7f88b415da80 2024-04-26T20:14:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88bc800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f88b41608d0 con 0x7f88b40c9e80 2024-04-26T20:14:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88bc800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88b406d8f0 con 0x7f88b40c6340 2024-04-26T20:14:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88b9400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b40c6340 0x7f88b406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88ba800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88b40c9e80 0x7f88b40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88b9400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b40c6340 0x7f88b406feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42428/0 (socket says 172.21.15.16:42428) 2024-04-26T20:14:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88b9400640 1 -- 172.21.15.16:0/653217929 learned_addr learned my addr 172.21.15.16:0/653217929 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88ba800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88b40c9e80 0x7f88b40703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37388/0 (socket says 172.21.15.16:37388) 2024-04-26T20:14:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88b9400640 1 -- 172.21.15.16:0/653217929 >> v2:172.21.15.192:3300/0 conn(0x7f88b40c9e80 msgr2=0x7f88b40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88b9400640 1 --2- 172.21.15.16:0/653217929 >> v2:172.21.15.192:3300/0 conn(0x7f88b40c9e80 0x7f88b40703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88b9400640 1 -- 172.21.15.16:0/653217929 >> v1:172.21.15.192:6789/0 conn(0x7f88b415da80 legacy=0x7f88b4160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.194+0000 7f88b9400640 1 -- 172.21.15.16:0/653217929 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b406dbd0 con 0x7f88b40c6340 2024-04-26T20:14:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88b9400640 1 --2- 172.21.15.16:0/653217929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b40c6340 0x7f88b406feb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009870 tx=0x7f88a401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab5e226534d25d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88b8a00640 1 -- 172.21.15.16:0/653217929 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a40b5070 con 0x7f88b40c6340 2024-04-26T20:14:43.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88b8a00640 1 -- 172.21.15.16:0/653217929 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a40a8a50 con 0x7f88b40c6340 2024-04-26T20:14:43.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88b8a00640 1 -- 172.21.15.16:0/653217929 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a40a8e20 con 0x7f88b40c6340 2024-04-26T20:14:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 -- 172.21.15.16:0/653217929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b40c6340 msgr2=0x7f88b406feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 --2- 172.21.15.16:0/653217929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b40c6340 0x7f88b406feb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009870 tx=0x7f88a401ed50 comp rx=0 tx=0).stop 2024-04-26T20:14:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 -- 172.21.15.16:0/653217929 shutdown_connections 2024-04-26T20:14:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 --2- 172.21.15.16:0/653217929 >> v2:172.21.15.192:3300/0 conn(0x7f88b40c9e80 0x7f88b40703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 --2- 172.21.15.16:0/653217929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b40c6340 0x7f88b406feb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 -- 172.21.15.16:0/653217929 >> 172.21.15.16:0/653217929 conn(0x7f88b4071160 msgr2=0x7f88b4068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 -- 172.21.15.16:0/653217929 shutdown_connections 2024-04-26T20:14:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 -- 172.21.15.16:0/653217929 wait complete. 2024-04-26T20:14:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 Processor -- start 2024-04-26T20:14:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.198+0000 7f88bc800640 1 -- start start 2024-04-26T20:14:43.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b40c6340 0x7f88b41f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b40c9e80 0x7f88b41f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b415da80 0x7f88b41597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f88b406deb0 con 0x7f88b40c6340 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f88b40cf410 con 0x7f88b40c9e80 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88b4071970 con 0x7f88b415da80 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b40c6340 0x7f88b41f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b40c6340 0x7f88b41f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53986/0 (socket says 172.21.15.16:53986) 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 -- 172.21.15.16:0/2564968859 learned_addr learned my addr 172.21.15.16:0/2564968859 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9400640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b40c9e80 0x7f88b41f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88ba800640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b415da80 0x7f88b41597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 -- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b415da80 msgr2=0x7f88b41597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b415da80 0x7f88b41597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 -- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b40c9e80 msgr2=0x7f88b41f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b40c9e80 0x7f88b41f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 -- 172.21.15.16:0/2564968859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b40c8d40 con 0x7f88b40c6340 2024-04-26T20:14:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88b9e00640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b40c6340 0x7f88b41f6150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c3a0 tx=0x7f88a800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88ae000640 1 -- 172.21.15.16:0/2564968859 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a80052d0 con 0x7f88b40c6340 2024-04-26T20:14:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88ae000640 1 -- 172.21.15.16:0/2564968859 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a8005470 con 0x7f88b40c6340 2024-04-26T20:14:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88ae000640 1 -- 172.21.15.16:0/2564968859 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a8007260 con 0x7f88b40c6340 2024-04-26T20:14:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b40c9020 con 0x7f88b40c6340 2024-04-26T20:14:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b40c95e0 con 0x7f88b40c6340 2024-04-26T20:14:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b4077c20 con 0x7f88b40c6340 2024-04-26T20:14:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.202+0000 7f88ae000640 1 -- 172.21.15.16:0/2564968859 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88a8007400 con 0x7f88b40c6340 2024-04-26T20:14:43.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.206+0000 7f88ae000640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8898068380 0x7f889806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.206+0000 7f88ae000640 1 -- 172.21.15.16:0/2564968859 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88a8086100 con 0x7f88b40c6340 2024-04-26T20:14:43.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.206+0000 7f88b9400640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8898068380 0x7f889806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.206+0000 7f88b9400640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8898068380 0x7f889806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f88a40b2000 tx=0x7f88a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.210+0000 7f88ae000640 1 -- 172.21.15.16:0/2564968859 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f88a8055d30 con 0x7f88b40c6340 2024-04-26T20:14:43.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.370+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88b40d0210 con 0x7f8898068380 2024-04-26T20:14:43.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.394+0000 7f88ae000640 1 -- 172.21.15.16:0/2564968859 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332761 (secure 0 0 0) 0x7f88b40d0210 con 0x7f8898068380 2024-04-26T20:14:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:14:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8898068380 msgr2=0x7f889806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8898068380 0x7f889806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f88a40b2000 tx=0x7f88a4009040 comp rx=0 tx=0).stop 2024-04-26T20:14:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b40c6340 msgr2=0x7f88b41f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b40c6340 0x7f88b41f6150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c3a0 tx=0x7f88a800c860 comp rx=0 tx=0).stop 2024-04-26T20:14:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 shutdown_connections 2024-04-26T20:14:43.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8898068380 0x7f889806a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b415da80 0x7f88b41597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b40c9e80 0x7f88b41f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 --2- 172.21.15.16:0/2564968859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88b40c6340 0x7f88b41f6150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 >> 172.21.15.16:0/2564968859 conn(0x7f88b4071160 msgr2=0x7f88b40c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 shutdown_connections 2024-04-26T20:14:43.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.398+0000 7f88bc800640 1 -- 172.21.15.16:0/2564968859 wait complete. 2024-04-26T20:14:43.423 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-26T20:14:42.959260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":246,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222576,"kb_used_data":2288,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752144,"statfs":{"total":773094113280,"available":772866195456,"internally_reserved":0,"allocated":2342912,"data_stored":2021300,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3187,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005299"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885563+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:14:19.885563+0000","last_peered":"2024-04-26T20:14:19.885563+0000","last_clean":"2024-04-26T20:14:19.885563+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:14:19.885563+0000","last_undegraded":"2024-04-26T20:14:19.885563+0000","last_fullsized":"2024-04-26T20:14:19.885563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547330+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:14:20.547330+0000","last_peered":"2024-04-26T20:14:20.547330+0000","last_clean":"2024-04-26T20:14:20.547330+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:14:20.547330+0000","last_undegraded":"2024-04-26T20:14:20.547330+0000","last_fullsized":"2024-04-26T20:14:20.547330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547016+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:14:20.547016+0000","last_peered":"2024-04-26T20:14:20.547016+0000","last_clean":"2024-04-26T20:14:20.547016+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:14:20.547016+0000","last_undegraded":"2024-04-26T20:14:20.547016+0000","last_fullsized":"2024-04-26T20:14:20.547016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547682+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:14:20.547682+0000","last_peered":"2024-04-26T20:14:20.547682+0000","last_clean":"2024-04-26T20:14:20.547682+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:14:20.547682+0000","last_undegraded":"2024-04-26T20:14:20.547682+0000","last_fullsized":"2024-04-26T20:14:20.547682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885447+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:14:19.885447+0000","last_peered":"2024-04-26T20:14:19.885447+0000","last_clean":"2024-04-26T20:14:19.885447+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:14:19.885447+0000","last_undegraded":"2024-04-26T20:14:19.885447+0000","last_fullsized":"2024-04-26T20:14:19.885447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507611+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:14:19.507611+0000","last_peered":"2024-04-26T20:14:19.507611+0000","last_clean":"2024-04-26T20:14:19.507611+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:14:19.507611+0000","last_undegraded":"2024-04-26T20:14:19.507611+0000","last_fullsized":"2024-04-26T20:14:19.507611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340700+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:14:20.340700+0000","last_peered":"2024-04-26T20:14:20.340700+0000","last_clean":"2024-04-26T20:14:20.340700+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:14:20.340700+0000","last_undegraded":"2024-04-26T20:14:20.340700+0000","last_fullsized":"2024-04-26T20:14:20.340700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551492+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:14:20.551492+0000","last_peered":"2024-04-26T20:14:20.551492+0000","last_clean":"2024-04-26T20:14:20.551492+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:14:20.551492+0000","last_undegraded":"2024-04-26T20:14:20.551492+0000","last_fullsized":"2024-04-26T20:14:20.551492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507856+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:14:19.507856+0000","last_peered":"2024-04-26T20:14:19.507856+0000","last_clean":"2024-04-26T20:14:19.507856+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:14:19.507856+0000","last_undegraded":"2024-04-26T20:14:19.507856+0000","last_fullsized":"2024-04-26T20:14:19.507856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340190+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:14:20.340190+0000","last_peered":"2024-04-26T20:14:20.340190+0000","last_clean":"2024-04-26T20:14:20.340190+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:14:20.340190+0000","last_undegraded":"2024-04-26T20:14:20.340190+0000","last_fullsized":"2024-04-26T20:14:20.340190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551323+0000","last_change":"2024-04-26T20:14:14.499292+0000","last_active":"2024-04-26T20:14:20.551323+0000","last_peered":"2024-04-26T20:14:20.551323+0000","last_clean":"2024-04-26T20:14:20.551323+0000","last_became_active":"2024-04-26T20:14:14.498610+0000","last_became_peered":"2024-04-26T20:14:14.498610+0000","last_unstale":"2024-04-26T20:14:20.551323+0000","last_undegraded":"2024-04-26T20:14:20.551323+0000","last_fullsized":"2024-04-26T20:14:20.551323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:44.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508054+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:14:19.508054+0000","last_peered":"2024-04-26T20:14:19.508054+0000","last_clean":"2024-04-26T20:14:19.508054+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:14:19.508054+0000","last_undegraded":"2024-04-26T20:14:19.508054+0000","last_fullsized":"2024-04-26T20:14:19.508054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504675+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:14:19.504675+0000","last_peered":"2024-04-26T20:14:19.504675+0000","last_clean":"2024-04-26T20:14:19.504675+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:14:19.504675+0000","last_undegraded":"2024-04-26T20:14:19.504675+0000","last_fullsized":"2024-04-26T20:14:19.504675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.087410+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:14:40.087410+0000","last_peered":"2024-04-26T20:14:40.087410+0000","last_clean":"2024-04-26T20:14:40.087410+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:14:40.087410+0000","last_undegraded":"2024-04-26T20:14:40.087410+0000","last_fullsized":"2024-04-26T20:14:40.087410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509512+0000","last_change":"2024-04-26T20:14:18.527474+0000","last_active":"2024-04-26T20:14:19.509512+0000","last_peered":"2024-04-26T20:14:19.509512+0000","last_clean":"2024-04-26T20:14:19.509512+0000","last_became_active":"2024-04-26T20:14:18.526374+0000","last_became_peered":"2024-04-26T20:14:18.526374+0000","last_unstale":"2024-04-26T20:14:19.509512+0000","last_undegraded":"2024-04-26T20:14:19.509512+0000","last_fullsized":"2024-04-26T20:14:19.509512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:31.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547337+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:14:20.547337+0000","last_peered":"2024-04-26T20:14:20.547337+0000","last_clean":"2024-04-26T20:14:20.547337+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:14:20.547337+0000","last_undegraded":"2024-04-26T20:14:20.547337+0000","last_fullsized":"2024-04-26T20:14:20.547337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537855+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:14:20.537855+0000","last_peered":"2024-04-26T20:14:20.537855+0000","last_clean":"2024-04-26T20:14:20.537855+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:14:20.537855+0000","last_undegraded":"2024-04-26T20:14:20.537855+0000","last_fullsized":"2024-04-26T20:14:20.537855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509176+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:14:19.509176+0000","last_peered":"2024-04-26T20:14:19.509176+0000","last_clean":"2024-04-26T20:14:19.509176+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:14:19.509176+0000","last_undegraded":"2024-04-26T20:14:19.509176+0000","last_fullsized":"2024-04-26T20:14:19.509176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547119+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:14:20.547119+0000","last_peered":"2024-04-26T20:14:20.547119+0000","last_clean":"2024-04-26T20:14:20.547119+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:14:20.547119+0000","last_undegraded":"2024-04-26T20:14:20.547119+0000","last_fullsized":"2024-04-26T20:14:20.547119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.099897+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:14:40.099897+0000","last_peered":"2024-04-26T20:14:40.099897+0000","last_clean":"2024-04-26T20:14:40.099897+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:14:40.099897+0000","last_undegraded":"2024-04-26T20:14:40.099897+0000","last_fullsized":"2024-04-26T20:14:40.099897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508115+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:14:19.508115+0000","last_peered":"2024-04-26T20:14:19.508115+0000","last_clean":"2024-04-26T20:14:19.508115+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:14:19.508115+0000","last_undegraded":"2024-04-26T20:14:19.508115+0000","last_fullsized":"2024-04-26T20:14:19.508115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.090799+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:14:40.090799+0000","last_peered":"2024-04-26T20:14:40.090799+0000","last_clean":"2024-04-26T20:14:40.090799+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:14:40.090799+0000","last_undegraded":"2024-04-26T20:14:40.090799+0000","last_fullsized":"2024-04-26T20:14:40.090799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509417+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:14:19.509417+0000","last_peered":"2024-04-26T20:14:19.509417+0000","last_clean":"2024-04-26T20:14:19.509417+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:14:19.509417+0000","last_undegraded":"2024-04-26T20:14:19.509417+0000","last_fullsized":"2024-04-26T20:14:19.509417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885352+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:14:19.885352+0000","last_peered":"2024-04-26T20:14:19.885352+0000","last_clean":"2024-04-26T20:14:19.885352+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:14:19.885352+0000","last_undegraded":"2024-04-26T20:14:19.885352+0000","last_fullsized":"2024-04-26T20:14:19.885352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.091154+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:14:40.091154+0000","last_peered":"2024-04-26T20:14:40.091154+0000","last_clean":"2024-04-26T20:14:40.091154+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:14:40.091154+0000","last_undegraded":"2024-04-26T20:14:40.091154+0000","last_fullsized":"2024-04-26T20:14:40.091154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507739+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:14:19.507739+0000","last_peered":"2024-04-26T20:14:19.507739+0000","last_clean":"2024-04-26T20:14:19.507739+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:14:19.507739+0000","last_undegraded":"2024-04-26T20:14:19.507739+0000","last_fullsized":"2024-04-26T20:14:19.507739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547916+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:14:20.547916+0000","last_peered":"2024-04-26T20:14:20.547916+0000","last_clean":"2024-04-26T20:14:20.547916+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:14:20.547916+0000","last_undegraded":"2024-04-26T20:14:20.547916+0000","last_fullsized":"2024-04-26T20:14:20.547916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538299+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:14:20.538299+0000","last_peered":"2024-04-26T20:14:20.538299+0000","last_clean":"2024-04-26T20:14:20.538299+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:14:20.538299+0000","last_undegraded":"2024-04-26T20:14:20.538299+0000","last_fullsized":"2024-04-26T20:14:20.538299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546922+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:14:20.546922+0000","last_peered":"2024-04-26T20:14:20.546922+0000","last_clean":"2024-04-26T20:14:20.546922+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:14:20.546922+0000","last_undegraded":"2024-04-26T20:14:20.546922+0000","last_fullsized":"2024-04-26T20:14:20.546922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538010+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:14:20.538010+0000","last_peered":"2024-04-26T20:14:20.538010+0000","last_clean":"2024-04-26T20:14:20.538010+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:14:20.538010+0000","last_undegraded":"2024-04-26T20:14:20.538010+0000","last_fullsized":"2024-04-26T20:14:20.538010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341065+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:14:20.341065+0000","last_peered":"2024-04-26T20:14:20.341065+0000","last_clean":"2024-04-26T20:14:20.341065+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:14:20.341065+0000","last_undegraded":"2024-04-26T20:14:20.341065+0000","last_fullsized":"2024-04-26T20:14:20.341065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885059+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:14:19.885059+0000","last_peered":"2024-04-26T20:14:19.885059+0000","last_clean":"2024-04-26T20:14:19.885059+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:14:19.885059+0000","last_undegraded":"2024-04-26T20:14:19.885059+0000","last_fullsized":"2024-04-26T20:14:19.885059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551624+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:14:20.551624+0000","last_peered":"2024-04-26T20:14:20.551624+0000","last_clean":"2024-04-26T20:14:20.551624+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:14:20.551624+0000","last_undegraded":"2024-04-26T20:14:20.551624+0000","last_fullsized":"2024-04-26T20:14:20.551624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538130+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:14:20.538130+0000","last_peered":"2024-04-26T20:14:20.538130+0000","last_clean":"2024-04-26T20:14:20.538130+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:14:20.538130+0000","last_undegraded":"2024-04-26T20:14:20.538130+0000","last_fullsized":"2024-04-26T20:14:20.538130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537670+0000","last_change":"2024-04-26T20:14:18.532352+0000","last_active":"2024-04-26T20:14:20.537670+0000","last_peered":"2024-04-26T20:14:20.537670+0000","last_clean":"2024-04-26T20:14:20.537670+0000","last_became_active":"2024-04-26T20:14:18.531948+0000","last_became_peered":"2024-04-26T20:14:18.531948+0000","last_unstale":"2024-04-26T20:14:20.537670+0000","last_undegraded":"2024-04-26T20:14:20.537670+0000","last_fullsized":"2024-04-26T20:14:20.537670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:07.005152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508466+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:14:19.508466+0000","last_peered":"2024-04-26T20:14:19.508466+0000","last_clean":"2024-04-26T20:14:19.508466+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:14:19.508466+0000","last_undegraded":"2024-04-26T20:14:19.508466+0000","last_fullsized":"2024-04-26T20:14:19.508466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551200+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:14:20.551200+0000","last_peered":"2024-04-26T20:14:20.551200+0000","last_clean":"2024-04-26T20:14:20.551200+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:14:20.551200+0000","last_undegraded":"2024-04-26T20:14:20.551200+0000","last_fullsized":"2024-04-26T20:14:20.551200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538131+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:14:20.538131+0000","last_peered":"2024-04-26T20:14:20.538131+0000","last_clean":"2024-04-26T20:14:20.538131+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:14:20.538131+0000","last_undegraded":"2024-04-26T20:14:20.538131+0000","last_fullsized":"2024-04-26T20:14:20.538131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537632+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:14:20.537632+0000","last_peered":"2024-04-26T20:14:20.537632+0000","last_clean":"2024-04-26T20:14:20.537632+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:14:20.537632+0000","last_undegraded":"2024-04-26T20:14:20.537632+0000","last_fullsized":"2024-04-26T20:14:20.537632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496596+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:14:19.496596+0000","last_peered":"2024-04-26T20:14:19.496596+0000","last_clean":"2024-04-26T20:14:19.496596+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:14:19.496596+0000","last_undegraded":"2024-04-26T20:14:19.496596+0000","last_fullsized":"2024-04-26T20:14:19.496596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884667+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:14:19.884667+0000","last_peered":"2024-04-26T20:14:19.884667+0000","last_clean":"2024-04-26T20:14:19.884667+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:14:19.884667+0000","last_undegraded":"2024-04-26T20:14:19.884667+0000","last_fullsized":"2024-04-26T20:14:19.884667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339723+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:14:20.339723+0000","last_peered":"2024-04-26T20:14:20.339723+0000","last_clean":"2024-04-26T20:14:20.339723+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:14:20.339723+0000","last_undegraded":"2024-04-26T20:14:20.339723+0000","last_fullsized":"2024-04-26T20:14:20.339723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885284+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:14:19.885284+0000","last_peered":"2024-04-26T20:14:19.885284+0000","last_clean":"2024-04-26T20:14:19.885284+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:14:19.885284+0000","last_undegraded":"2024-04-26T20:14:19.885284+0000","last_fullsized":"2024-04-26T20:14:19.885284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547171+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:14:20.547171+0000","last_peered":"2024-04-26T20:14:20.547171+0000","last_clean":"2024-04-26T20:14:20.547171+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:14:20.547171+0000","last_undegraded":"2024-04-26T20:14:20.547171+0000","last_fullsized":"2024-04-26T20:14:20.547171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.098692+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:14:40.098692+0000","last_peered":"2024-04-26T20:14:40.098692+0000","last_clean":"2024-04-26T20:14:40.098692+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:14:40.098692+0000","last_undegraded":"2024-04-26T20:14:40.098692+0000","last_fullsized":"2024-04-26T20:14:40.098692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339797+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:14:20.339797+0000","last_peered":"2024-04-26T20:14:20.339797+0000","last_clean":"2024-04-26T20:14:20.339797+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:14:20.339797+0000","last_undegraded":"2024-04-26T20:14:20.339797+0000","last_fullsized":"2024-04-26T20:14:20.339797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505934+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:14:19.505934+0000","last_peered":"2024-04-26T20:14:19.505934+0000","last_clean":"2024-04-26T20:14:19.505934+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:14:19.505934+0000","last_undegraded":"2024-04-26T20:14:19.505934+0000","last_fullsized":"2024-04-26T20:14:19.505934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340425+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:14:20.340425+0000","last_peered":"2024-04-26T20:14:20.340425+0000","last_clean":"2024-04-26T20:14:20.340425+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:14:20.340425+0000","last_undegraded":"2024-04-26T20:14:20.340425+0000","last_fullsized":"2024-04-26T20:14:20.340425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496906+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:14:19.496906+0000","last_peered":"2024-04-26T20:14:19.496906+0000","last_clean":"2024-04-26T20:14:19.496906+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:14:19.496906+0000","last_undegraded":"2024-04-26T20:14:19.496906+0000","last_fullsized":"2024-04-26T20:14:19.496906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504513+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:14:19.504513+0000","last_peered":"2024-04-26T20:14:19.504513+0000","last_clean":"2024-04-26T20:14:19.504513+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:14:19.504513+0000","last_undegraded":"2024-04-26T20:14:19.504513+0000","last_fullsized":"2024-04-26T20:14:19.504513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551589+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:14:20.551589+0000","last_peered":"2024-04-26T20:14:20.551589+0000","last_clean":"2024-04-26T20:14:20.551589+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:14:20.551589+0000","last_undegraded":"2024-04-26T20:14:20.551589+0000","last_fullsized":"2024-04-26T20:14:20.551589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538251+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:14:20.538251+0000","last_peered":"2024-04-26T20:14:20.538251+0000","last_clean":"2024-04-26T20:14:20.538251+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:14:20.538251+0000","last_undegraded":"2024-04-26T20:14:20.538251+0000","last_fullsized":"2024-04-26T20:14:20.538251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885149+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:14:19.885149+0000","last_peered":"2024-04-26T20:14:19.885149+0000","last_clean":"2024-04-26T20:14:19.885149+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:14:19.885149+0000","last_undegraded":"2024-04-26T20:14:19.885149+0000","last_fullsized":"2024-04-26T20:14:19.885149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341171+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:14:20.341171+0000","last_peered":"2024-04-26T20:14:20.341171+0000","last_clean":"2024-04-26T20:14:20.341171+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:14:20.341171+0000","last_undegraded":"2024-04-26T20:14:20.341171+0000","last_fullsized":"2024-04-26T20:14:20.341171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.497025+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:14:19.497025+0000","last_peered":"2024-04-26T20:14:19.497025+0000","last_clean":"2024-04-26T20:14:19.497025+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:14:19.497025+0000","last_undegraded":"2024-04-26T20:14:19.497025+0000","last_fullsized":"2024-04-26T20:14:19.497025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550272+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:14:20.550272+0000","last_peered":"2024-04-26T20:14:20.550272+0000","last_clean":"2024-04-26T20:14:20.550272+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:14:20.550272+0000","last_undegraded":"2024-04-26T20:14:20.550272+0000","last_fullsized":"2024-04-26T20:14:20.550272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341179+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:14:20.341179+0000","last_peered":"2024-04-26T20:14:20.341179+0000","last_clean":"2024-04-26T20:14:20.341179+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:14:20.341179+0000","last_undegraded":"2024-04-26T20:14:20.341179+0000","last_fullsized":"2024-04-26T20:14:20.341179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509614+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:14:19.509614+0000","last_peered":"2024-04-26T20:14:19.509614+0000","last_clean":"2024-04-26T20:14:19.509614+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:14:19.509614+0000","last_undegraded":"2024-04-26T20:14:19.509614+0000","last_fullsized":"2024-04-26T20:14:19.509614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507544+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:14:19.507544+0000","last_peered":"2024-04-26T20:14:19.507544+0000","last_clean":"2024-04-26T20:14:19.507544+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:14:19.507544+0000","last_undegraded":"2024-04-26T20:14:19.507544+0000","last_fullsized":"2024-04-26T20:14:19.507544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340080+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:14:20.340080+0000","last_peered":"2024-04-26T20:14:20.340080+0000","last_clean":"2024-04-26T20:14:20.340080+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:14:20.340080+0000","last_undegraded":"2024-04-26T20:14:20.340080+0000","last_fullsized":"2024-04-26T20:14:20.340080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.097282+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:14:40.097282+0000","last_peered":"2024-04-26T20:14:40.097282+0000","last_clean":"2024-04-26T20:14:40.097282+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:14:40.097282+0000","last_undegraded":"2024-04-26T20:14:40.097282+0000","last_fullsized":"2024-04-26T20:14:40.097282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885253+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:14:19.885253+0000","last_peered":"2024-04-26T20:14:19.885253+0000","last_clean":"2024-04-26T20:14:19.885253+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:14:19.885253+0000","last_undegraded":"2024-04-26T20:14:19.885253+0000","last_fullsized":"2024-04-26T20:14:19.885253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504382+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:14:19.504382+0000","last_peered":"2024-04-26T20:14:19.504382+0000","last_clean":"2024-04-26T20:14:19.504382+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:14:19.504382+0000","last_undegraded":"2024-04-26T20:14:19.504382+0000","last_fullsized":"2024-04-26T20:14:19.504382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504483+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:14:19.504483+0000","last_peered":"2024-04-26T20:14:19.504483+0000","last_clean":"2024-04-26T20:14:19.504483+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:14:19.504483+0000","last_undegraded":"2024-04-26T20:14:19.504483+0000","last_fullsized":"2024-04-26T20:14:19.504483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547904+0000","last_change":"2024-04-26T20:14:18.642156+0000","last_active":"2024-04-26T20:14:20.547904+0000","last_peered":"2024-04-26T20:14:20.547904+0000","last_clean":"2024-04-26T20:14:20.547904+0000","last_became_active":"2024-04-26T20:14:18.641452+0000","last_became_peered":"2024-04-26T20:14:18.641452+0000","last_unstale":"2024-04-26T20:14:20.547904+0000","last_undegraded":"2024-04-26T20:14:20.547904+0000","last_fullsized":"2024-04-26T20:14:20.547904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:30.242536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340685+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:14:20.340685+0000","last_peered":"2024-04-26T20:14:20.340685+0000","last_clean":"2024-04-26T20:14:20.340685+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:14:20.340685+0000","last_undegraded":"2024-04-26T20:14:20.340685+0000","last_fullsized":"2024-04-26T20:14:20.340685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.093099+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:14:40.093099+0000","last_peered":"2024-04-26T20:14:40.093099+0000","last_clean":"2024-04-26T20:14:40.093099+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:14:40.093099+0000","last_undegraded":"2024-04-26T20:14:40.093099+0000","last_fullsized":"2024-04-26T20:14:40.093099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547744+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:14:20.547744+0000","last_peered":"2024-04-26T20:14:20.547744+0000","last_clean":"2024-04-26T20:14:20.547744+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:14:20.547744+0000","last_undegraded":"2024-04-26T20:14:20.547744+0000","last_fullsized":"2024-04-26T20:14:20.547744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884892+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:14:19.884892+0000","last_peered":"2024-04-26T20:14:19.884892+0000","last_clean":"2024-04-26T20:14:19.884892+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:14:19.884892+0000","last_undegraded":"2024-04-26T20:14:19.884892+0000","last_fullsized":"2024-04-26T20:14:19.884892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.098764+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:14:40.098764+0000","last_peered":"2024-04-26T20:14:40.098764+0000","last_clean":"2024-04-26T20:14:40.098764+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:14:40.098764+0000","last_undegraded":"2024-04-26T20:14:40.098764+0000","last_fullsized":"2024-04-26T20:14:40.098764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551667+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:14:20.551667+0000","last_peered":"2024-04-26T20:14:20.551667+0000","last_clean":"2024-04-26T20:14:20.551667+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:14:20.551667+0000","last_undegraded":"2024-04-26T20:14:20.551667+0000","last_fullsized":"2024-04-26T20:14:20.551667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340243+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:14:20.340243+0000","last_peered":"2024-04-26T20:14:20.340243+0000","last_clean":"2024-04-26T20:14:20.340243+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:14:20.340243+0000","last_undegraded":"2024-04-26T20:14:20.340243+0000","last_fullsized":"2024-04-26T20:14:20.340243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.086670+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:14:40.086670+0000","last_peered":"2024-04-26T20:14:40.086670+0000","last_clean":"2024-04-26T20:14:40.086670+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:14:40.086670+0000","last_undegraded":"2024-04-26T20:14:40.086670+0000","last_fullsized":"2024-04-26T20:14:40.086670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537725+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:14:20.537725+0000","last_peered":"2024-04-26T20:14:20.537725+0000","last_clean":"2024-04-26T20:14:20.537725+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:14:20.537725+0000","last_undegraded":"2024-04-26T20:14:20.537725+0000","last_fullsized":"2024-04-26T20:14:20.537725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509332+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:14:19.509332+0000","last_peered":"2024-04-26T20:14:19.509332+0000","last_clean":"2024-04-26T20:14:19.509332+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:14:19.509332+0000","last_undegraded":"2024-04-26T20:14:19.509332+0000","last_fullsized":"2024-04-26T20:14:19.509332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538197+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:14:20.538197+0000","last_peered":"2024-04-26T20:14:20.538197+0000","last_clean":"2024-04-26T20:14:20.538197+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:14:20.538197+0000","last_undegraded":"2024-04-26T20:14:20.538197+0000","last_fullsized":"2024-04-26T20:14:20.538197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508332+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:14:19.508332+0000","last_peered":"2024-04-26T20:14:19.508332+0000","last_clean":"2024-04-26T20:14:19.508332+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:14:19.508332+0000","last_undegraded":"2024-04-26T20:14:19.508332+0000","last_fullsized":"2024-04-26T20:14:19.508332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885496+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:14:19.885496+0000","last_peered":"2024-04-26T20:14:19.885496+0000","last_clean":"2024-04-26T20:14:19.885496+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:14:19.885496+0000","last_undegraded":"2024-04-26T20:14:19.885496+0000","last_fullsized":"2024-04-26T20:14:19.885496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.097720+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:14:40.097720+0000","last_peered":"2024-04-26T20:14:40.097720+0000","last_clean":"2024-04-26T20:14:40.097720+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:14:40.097720+0000","last_undegraded":"2024-04-26T20:14:40.097720+0000","last_fullsized":"2024-04-26T20:14:40.097720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547103+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:14:20.547103+0000","last_peered":"2024-04-26T20:14:20.547103+0000","last_clean":"2024-04-26T20:14:20.547103+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:14:20.547103+0000","last_undegraded":"2024-04-26T20:14:20.547103+0000","last_fullsized":"2024-04-26T20:14:20.547103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551023+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:14:20.551023+0000","last_peered":"2024-04-26T20:14:20.551023+0000","last_clean":"2024-04-26T20:14:20.551023+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:14:20.551023+0000","last_undegraded":"2024-04-26T20:14:20.551023+0000","last_fullsized":"2024-04-26T20:14:20.551023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.092533+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:14:40.092533+0000","last_peered":"2024-04-26T20:14:40.092533+0000","last_clean":"2024-04-26T20:14:40.092533+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:14:40.092533+0000","last_undegraded":"2024-04-26T20:14:40.092533+0000","last_fullsized":"2024-04-26T20:14:40.092533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547062+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:14:20.547062+0000","last_peered":"2024-04-26T20:14:20.547062+0000","last_clean":"2024-04-26T20:14:20.547062+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:14:20.547062+0000","last_undegraded":"2024-04-26T20:14:20.547062+0000","last_fullsized":"2024-04-26T20:14:20.547062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885190+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:14:19.885190+0000","last_peered":"2024-04-26T20:14:19.885190+0000","last_clean":"2024-04-26T20:14:19.885190+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:14:19.885190+0000","last_undegraded":"2024-04-26T20:14:19.885190+0000","last_fullsized":"2024-04-26T20:14:19.885190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537488+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:14:20.537488+0000","last_peered":"2024-04-26T20:14:20.537488+0000","last_clean":"2024-04-26T20:14:20.537488+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:14:20.537488+0000","last_undegraded":"2024-04-26T20:14:20.537488+0000","last_fullsized":"2024-04-26T20:14:20.537488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550778+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:14:20.550778+0000","last_peered":"2024-04-26T20:14:20.550778+0000","last_clean":"2024-04-26T20:14:20.550778+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:14:20.550778+0000","last_undegraded":"2024-04-26T20:14:20.550778+0000","last_fullsized":"2024-04-26T20:14:20.550778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506621+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:14:19.506621+0000","last_peered":"2024-04-26T20:14:19.506621+0000","last_clean":"2024-04-26T20:14:19.506621+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:14:19.506621+0000","last_undegraded":"2024-04-26T20:14:19.506621+0000","last_fullsized":"2024-04-26T20:14:19.506621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547012+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:14:20.547012+0000","last_peered":"2024-04-26T20:14:20.547012+0000","last_clean":"2024-04-26T20:14:20.547012+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:14:20.547012+0000","last_undegraded":"2024-04-26T20:14:20.547012+0000","last_fullsized":"2024-04-26T20:14:20.547012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547247+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:14:20.547247+0000","last_peered":"2024-04-26T20:14:20.547247+0000","last_clean":"2024-04-26T20:14:20.547247+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:14:20.547247+0000","last_undegraded":"2024-04-26T20:14:20.547247+0000","last_fullsized":"2024-04-26T20:14:20.547247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505171+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:14:19.505171+0000","last_peered":"2024-04-26T20:14:19.505171+0000","last_clean":"2024-04-26T20:14:19.505171+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:14:19.505171+0000","last_undegraded":"2024-04-26T20:14:19.505171+0000","last_fullsized":"2024-04-26T20:14:19.505171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885205+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:14:19.885205+0000","last_peered":"2024-04-26T20:14:19.885205+0000","last_clean":"2024-04-26T20:14:19.885205+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:14:19.885205+0000","last_undegraded":"2024-04-26T20:14:19.885205+0000","last_fullsized":"2024-04-26T20:14:19.885205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496841+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:14:19.496841+0000","last_peered":"2024-04-26T20:14:19.496841+0000","last_clean":"2024-04-26T20:14:19.496841+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:14:19.496841+0000","last_undegraded":"2024-04-26T20:14:19.496841+0000","last_fullsized":"2024-04-26T20:14:19.496841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.094285+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:14:40.094285+0000","last_peered":"2024-04-26T20:14:40.094285+0000","last_clean":"2024-04-26T20:14:40.094285+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:14:40.094285+0000","last_undegraded":"2024-04-26T20:14:40.094285+0000","last_fullsized":"2024-04-26T20:14:40.094285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508517+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:14:19.508517+0000","last_peered":"2024-04-26T20:14:19.508517+0000","last_clean":"2024-04-26T20:14:19.508517+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:14:19.508517+0000","last_undegraded":"2024-04-26T20:14:19.508517+0000","last_fullsized":"2024-04-26T20:14:19.508517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547503+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:14:20.547503+0000","last_peered":"2024-04-26T20:14:20.547503+0000","last_clean":"2024-04-26T20:14:20.547503+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:14:20.547503+0000","last_undegraded":"2024-04-26T20:14:20.547503+0000","last_fullsized":"2024-04-26T20:14:20.547503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504099+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:14:19.504099+0000","last_peered":"2024-04-26T20:14:19.504099+0000","last_clean":"2024-04-26T20:14:19.504099+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:14:19.504099+0000","last_undegraded":"2024-04-26T20:14:19.504099+0000","last_fullsized":"2024-04-26T20:14:19.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496540+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:14:19.496540+0000","last_peered":"2024-04-26T20:14:19.496540+0000","last_clean":"2024-04-26T20:14:19.496540+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:14:19.496540+0000","last_undegraded":"2024-04-26T20:14:19.496540+0000","last_fullsized":"2024-04-26T20:14:19.496540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550979+0000","last_change":"2024-04-26T20:14:14.482803+0000","last_active":"2024-04-26T20:14:20.550979+0000","last_peered":"2024-04-26T20:14:20.550979+0000","last_clean":"2024-04-26T20:14:20.550979+0000","last_became_active":"2024-04-26T20:14:14.482022+0000","last_became_peered":"2024-04-26T20:14:14.482022+0000","last_unstale":"2024-04-26T20:14:20.550979+0000","last_undegraded":"2024-04-26T20:14:20.550979+0000","last_fullsized":"2024-04-26T20:14:20.550979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885112+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:14:19.885112+0000","last_peered":"2024-04-26T20:14:19.885112+0000","last_clean":"2024-04-26T20:14:19.885112+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:14:19.885112+0000","last_undegraded":"2024-04-26T20:14:19.885112+0000","last_fullsized":"2024-04-26T20:14:19.885112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547807+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:14:20.547807+0000","last_peered":"2024-04-26T20:14:20.547807+0000","last_clean":"2024-04-26T20:14:20.547807+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:14:20.547807+0000","last_undegraded":"2024-04-26T20:14:20.547807+0000","last_fullsized":"2024-04-26T20:14:20.547807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537992+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:14:20.537992+0000","last_peered":"2024-04-26T20:14:20.537992+0000","last_clean":"2024-04-26T20:14:20.537992+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:14:20.537992+0000","last_undegraded":"2024-04-26T20:14:20.537992+0000","last_fullsized":"2024-04-26T20:14:20.537992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506318+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:14:19.506318+0000","last_peered":"2024-04-26T20:14:19.506318+0000","last_clean":"2024-04-26T20:14:19.506318+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:14:19.506318+0000","last_undegraded":"2024-04-26T20:14:19.506318+0000","last_fullsized":"2024-04-26T20:14:19.506318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547804+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:14:20.547804+0000","last_peered":"2024-04-26T20:14:20.547804+0000","last_clean":"2024-04-26T20:14:20.547804+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:14:20.547804+0000","last_undegraded":"2024-04-26T20:14:20.547804+0000","last_fullsized":"2024-04-26T20:14:20.547804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550486+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:14:20.550486+0000","last_peered":"2024-04-26T20:14:20.550486+0000","last_clean":"2024-04-26T20:14:20.550486+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:14:20.550486+0000","last_undegraded":"2024-04-26T20:14:20.550486+0000","last_fullsized":"2024-04-26T20:14:20.550486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547253+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:14:20.547253+0000","last_peered":"2024-04-26T20:14:20.547253+0000","last_clean":"2024-04-26T20:14:20.547253+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:14:20.547253+0000","last_undegraded":"2024-04-26T20:14:20.547253+0000","last_fullsized":"2024-04-26T20:14:20.547253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550633+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:14:20.550633+0000","last_peered":"2024-04-26T20:14:20.550633+0000","last_clean":"2024-04-26T20:14:20.550633+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:14:20.550633+0000","last_undegraded":"2024-04-26T20:14:20.550633+0000","last_fullsized":"2024-04-26T20:14:20.550633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884953+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:14:19.884953+0000","last_peered":"2024-04-26T20:14:19.884953+0000","last_clean":"2024-04-26T20:14:19.884953+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:14:19.884953+0000","last_undegraded":"2024-04-26T20:14:19.884953+0000","last_fullsized":"2024-04-26T20:14:19.884953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505625+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:14:19.505625+0000","last_peered":"2024-04-26T20:14:19.505625+0000","last_clean":"2024-04-26T20:14:19.505625+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:14:19.505625+0000","last_undegraded":"2024-04-26T20:14:19.505625+0000","last_fullsized":"2024-04-26T20:14:19.505625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340721+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:14:20.340721+0000","last_peered":"2024-04-26T20:14:20.340721+0000","last_clean":"2024-04-26T20:14:20.340721+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:14:20.340721+0000","last_undegraded":"2024-04-26T20:14:20.340721+0000","last_fullsized":"2024-04-26T20:14:20.340721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496988+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:14:19.496988+0000","last_peered":"2024-04-26T20:14:19.496988+0000","last_clean":"2024-04-26T20:14:19.496988+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:14:19.496988+0000","last_undegraded":"2024-04-26T20:14:19.496988+0000","last_fullsized":"2024-04-26T20:14:19.496988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551847+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:14:20.551847+0000","last_peered":"2024-04-26T20:14:20.551847+0000","last_clean":"2024-04-26T20:14:20.551847+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:14:20.551847+0000","last_undegraded":"2024-04-26T20:14:20.551847+0000","last_fullsized":"2024-04-26T20:14:20.551847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550171+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:14:20.550171+0000","last_peered":"2024-04-26T20:14:20.550171+0000","last_clean":"2024-04-26T20:14:20.550171+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:14:20.550171+0000","last_undegraded":"2024-04-26T20:14:20.550171+0000","last_fullsized":"2024-04-26T20:14:20.550171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537556+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:14:20.537556+0000","last_peered":"2024-04-26T20:14:20.537556+0000","last_clean":"2024-04-26T20:14:20.537556+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:14:20.537556+0000","last_undegraded":"2024-04-26T20:14:20.537556+0000","last_fullsized":"2024-04-26T20:14:20.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884895+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:14:19.884895+0000","last_peered":"2024-04-26T20:14:19.884895+0000","last_clean":"2024-04-26T20:14:19.884895+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:14:19.884895+0000","last_undegraded":"2024-04-26T20:14:19.884895+0000","last_fullsized":"2024-04-26T20:14:19.884895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547283+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:14:20.547283+0000","last_peered":"2024-04-26T20:14:20.547283+0000","last_clean":"2024-04-26T20:14:20.547283+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:14:20.547283+0000","last_undegraded":"2024-04-26T20:14:20.547283+0000","last_fullsized":"2024-04-26T20:14:20.547283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509243+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:14:19.509243+0000","last_peered":"2024-04-26T20:14:19.509243+0000","last_clean":"2024-04-26T20:14:19.509243+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:14:19.509243+0000","last_undegraded":"2024-04-26T20:14:19.509243+0000","last_fullsized":"2024-04-26T20:14:19.509243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505396+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:14:19.505396+0000","last_peered":"2024-04-26T20:14:19.505396+0000","last_clean":"2024-04-26T20:14:19.505396+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:14:19.505396+0000","last_undegraded":"2024-04-26T20:14:19.505396+0000","last_fullsized":"2024-04-26T20:14:19.505396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506202+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:14:19.506202+0000","last_peered":"2024-04-26T20:14:19.506202+0000","last_clean":"2024-04-26T20:14:19.506202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:14:19.506202+0000","last_undegraded":"2024-04-26T20:14:19.506202+0000","last_fullsized":"2024-04-26T20:14:19.506202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341083+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:14:20.341083+0000","last_peered":"2024-04-26T20:14:20.341083+0000","last_clean":"2024-04-26T20:14:20.341083+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:14:20.341083+0000","last_undegraded":"2024-04-26T20:14:20.341083+0000","last_fullsized":"2024-04-26T20:14:20.341083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546910+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:14:20.546910+0000","last_peered":"2024-04-26T20:14:20.546910+0000","last_clean":"2024-04-26T20:14:20.546910+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:14:20.546910+0000","last_undegraded":"2024-04-26T20:14:20.546910+0000","last_fullsized":"2024-04-26T20:14:20.546910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339971+0000","last_change":"2024-04-26T20:14:14.463139+0000","last_active":"2024-04-26T20:14:20.339971+0000","last_peered":"2024-04-26T20:14:20.339971+0000","last_clean":"2024-04-26T20:14:20.339971+0000","last_became_active":"2024-04-26T20:14:14.462083+0000","last_became_peered":"2024-04-26T20:14:14.462083+0000","last_unstale":"2024-04-26T20:14:20.339971+0000","last_undegraded":"2024-04-26T20:14:20.339971+0000","last_fullsized":"2024-04-26T20:14:20.339971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:28.615893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550418+0000","last_change":"2024-04-26T20:14:14.475535+0000","last_active":"2024-04-26T20:14:20.550418+0000","last_peered":"2024-04-26T20:14:20.550418+0000","last_clean":"2024-04-26T20:14:20.550418+0000","last_became_active":"2024-04-26T20:14:14.474445+0000","last_became_peered":"2024-04-26T20:14:14.474445+0000","last_unstale":"2024-04-26T20:14:20.550418+0000","last_undegraded":"2024-04-26T20:14:20.550418+0000","last_fullsized":"2024-04-26T20:14:20.550418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:51.715142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339972+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:14:20.339972+0000","last_peered":"2024-04-26T20:14:20.339972+0000","last_clean":"2024-04-26T20:14:20.339972+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:14:20.339972+0000","last_undegraded":"2024-04-26T20:14:20.339972+0000","last_fullsized":"2024-04-26T20:14:20.339972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551012+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:14:20.551012+0000","last_peered":"2024-04-26T20:14:20.551012+0000","last_clean":"2024-04-26T20:14:20.551012+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:14:20.551012+0000","last_undegraded":"2024-04-26T20:14:20.551012+0000","last_fullsized":"2024-04-26T20:14:20.551012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885153+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:14:19.885153+0000","last_peered":"2024-04-26T20:14:19.885153+0000","last_clean":"2024-04-26T20:14:19.885153+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:14:19.885153+0000","last_undegraded":"2024-04-26T20:14:19.885153+0000","last_fullsized":"2024-04-26T20:14:19.885153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538165+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:14:20.538165+0000","last_peered":"2024-04-26T20:14:20.538165+0000","last_clean":"2024-04-26T20:14:20.538165+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:14:20.538165+0000","last_undegraded":"2024-04-26T20:14:20.538165+0000","last_fullsized":"2024-04-26T20:14:20.538165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340878+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:14:20.340878+0000","last_peered":"2024-04-26T20:14:20.340878+0000","last_clean":"2024-04-26T20:14:20.340878+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:14:20.340878+0000","last_undegraded":"2024-04-26T20:14:20.340878+0000","last_fullsized":"2024-04-26T20:14:20.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":695243,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":344064,"data_stored":694587,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:14:43.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T20:14:43.428 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T20:14:43.429 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T20:14:43.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T20:14:43.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.598+0000 7f114cc00640 1 Processor -- start 2024-04-26T20:14:43.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.598+0000 7f114cc00640 1 -- start start 2024-04-26T20:14:43.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f114cc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f114815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f114cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1148161350 0x7f1148163740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f114cc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114814f910 con 0x7f11480c2b70 2024-04-26T20:14:43.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f114cc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f11481589e0 con 0x7f1148161350 2024-04-26T20:14:43.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f114cc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1148072c40 con 0x7f114814f530 2024-04-26T20:14:43.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1146800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1148161350 0x7f1148163740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1146800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1148161350 0x7f1148163740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54002/0 (socket says 172.21.15.16:54002) 2024-04-26T20:14:43.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1146800640 1 -- 172.21.15.16:0/1256951005 learned_addr learned my addr 172.21.15.16:0/1256951005 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:43.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1145e00640 1 --2- 172.21.15.16:0/1256951005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f114815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1146800640 1 -- 172.21.15.16:0/1256951005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 msgr2=0x7f114815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:43.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1146800640 1 --2- 172.21.15.16:0/1256951005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f114815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1146800640 1 -- 172.21.15.16:0/1256951005 >> v1:172.21.15.192:6789/0 conn(0x7f11480c2b70 legacy=0x7f11480c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1146800640 1 -- 172.21.15.16:0/1256951005 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1148158ca0 con 0x7f1148161350 2024-04-26T20:14:43.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.602+0000 7f1145e00640 1 --2- 172.21.15.16:0/1256951005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f114815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:43.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1146800640 1 --2- 172.21.15.16:0/1256951005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148163740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1140009e50 tx=0x7f114001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e33fb1974865b28 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1144a00640 1 -- 172.21.15.16:0/1256951005 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400a5810 con 0x7f1148161350 2024-04-26T20:14:43.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1144a00640 1 -- 172.21.15.16:0/1256951005 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11400a59b0 con 0x7f1148161350 2024-04-26T20:14:43.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1144a00640 1 -- 172.21.15.16:0/1256951005 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400a5d80 con 0x7f1148161350 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- 172.21.15.16:0/1256951005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 msgr2=0x7f1148163740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 --2- 172.21.15.16:0/1256951005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148163740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1140009e50 tx=0x7f114001ca30 comp rx=0 tx=0).stop 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- 172.21.15.16:0/1256951005 shutdown_connections 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 --2- 172.21.15.16:0/1256951005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148163740 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 --2- 172.21.15.16:0/1256951005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f114815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- 172.21.15.16:0/1256951005 >> 172.21.15.16:0/1256951005 conn(0x7f114806c380 msgr2=0x7f114806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- 172.21.15.16:0/1256951005 shutdown_connections 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- 172.21.15.16:0/1256951005 wait complete. 2024-04-26T20:14:43.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 Processor -- start 2024-04-26T20:14:43.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- start start 2024-04-26T20:14:43.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11480c2b70 0x7f11480ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f1148140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11480684d0 con 0x7f1148161350 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1148152f90 con 0x7f11480c2b70 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f114cc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1148150aa0 con 0x7f114814f530 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1146800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1146800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54006/0 (socket says 172.21.15.16:54006) 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1146800640 1 -- 172.21.15.16:0/3350810222 learned_addr learned my addr 172.21.15.16:0/3350810222 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1145e00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11480c2b70 0x7f11480ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.606+0000 7f1145400640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f1148140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f1146800640 1 -- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 msgr2=0x7f1148140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f1146800640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f1148140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f1146800640 1 -- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11480c2b70 msgr2=0x7f11480ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f1146800640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11480c2b70 0x7f11480ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f1146800640 1 -- 172.21.15.16:0/3350810222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1148150cf0 con 0x7f1148161350 2024-04-26T20:14:43.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f1145e00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11480c2b70 0x7f11480ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:43.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f1146800640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148151f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f114001a660 tx=0x7f11400197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f113e000640 1 -- 172.21.15.16:0/3350810222 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400b8470 con 0x7f1148161350 2024-04-26T20:14:43.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f113e000640 1 -- 172.21.15.16:0/3350810222 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11400b8650 con 0x7f1148161350 2024-04-26T20:14:43.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f113e000640 1 -- 172.21.15.16:0/3350810222 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400b8a40 con 0x7f1148161350 2024-04-26T20:14:43.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1148150fd0 con 0x7f1148161350 2024-04-26T20:14:43.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1148151590 con 0x7f1148161350 2024-04-26T20:14:43.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11480696e0 con 0x7f1148161350 2024-04-26T20:14:43.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f113e000640 1 -- 172.21.15.16:0/3350810222 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11400c0030 con 0x7f1148161350 2024-04-26T20:14:43.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f113e000640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f11280683b0 0x7f112806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.610+0000 7f113e000640 1 -- 172.21.15.16:0/3350810222 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f11401214c0 con 0x7f1148161350 2024-04-26T20:14:43.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.614+0000 7f1145e00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f11280683b0 0x7f112806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.614+0000 7f1145e00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f11280683b0 0x7f112806a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f113800b990 tx=0x7f1138008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.618+0000 7f113e000640 1 -- 172.21.15.16:0/3350810222 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1140016620 con 0x7f1148161350 2024-04-26T20:14:43.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.818+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f11480cadd0 con 0x7f1148161350 2024-04-26T20:14:43.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.818+0000 7f113e000640 1 -- 172.21.15.16:0/3350810222 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f11400f1730 con 0x7f1148161350 2024-04-26T20:14:43.825 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f11280683b0 msgr2=0x7f112806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f11280683b0 0x7f112806a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f113800b990 tx=0x7f1138008040 comp rx=0 tx=0).stop 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 msgr2=0x7f1148151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148151f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f114001a660 tx=0x7f11400197d0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 shutdown_connections 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f11280683b0 0x7f112806a870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1148161350 0x7f1148151f00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f114814f530 0x7f1148140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 --2- 172.21.15.16:0/3350810222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11480c2b70 0x7f11480ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 >> 172.21.15.16:0/3350810222 conn(0x7f114806c380 msgr2=0x7f11481577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 shutdown_connections 2024-04-26T20:14:43.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.822+0000 7f114cc00640 1 -- 172.21.15.16:0/3350810222 wait complete. 2024-04-26T20:14:43.845 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T20:14:43.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:43.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 Processor -- start 2024-04-26T20:14:43.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 -- start start 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d401540b0 0x7f2d400cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d400c4710 0x7f2d40071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d400c4b60 0x7f2d40072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2d400cca20 con 0x7f2d400c4710 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f2d400c6660 con 0x7f2d401540b0 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d45000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2d400cc740 con 0x7f2d400c4b60 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d400c4710 0x7f2d40071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d400c4710 0x7f2d40071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54012/0 (socket says 172.21.15.16:54012) 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 -- 172.21.15.16:0/3074884409 learned_addr learned my addr 172.21.15.16:0/3074884409 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d3e800640 1 --2- 172.21.15.16:0/3074884409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d400c4b60 0x7f2d40072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d3de00640 1 --2- 172.21.15.16:0/3074884409 >> v2:172.21.15.192:3300/0 conn(0x7f2d401540b0 0x7f2d400cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 -- 172.21.15.16:0/3074884409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d400c4b60 msgr2=0x7f2d40072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 --2- 172.21.15.16:0/3074884409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d400c4b60 0x7f2d40072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 -- 172.21.15.16:0/3074884409 >> v2:172.21.15.192:3300/0 conn(0x7f2d401540b0 msgr2=0x7f2d400cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 --2- 172.21.15.16:0/3074884409 >> v2:172.21.15.192:3300/0 conn(0x7f2d401540b0 0x7f2d400cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.982+0000 7f2d35400640 1 -- 172.21.15.16:0/3074884409 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d400cb580 con 0x7f2d400c4710 2024-04-26T20:14:43.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d35400640 1 --2- 172.21.15.16:0/3074884409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40071f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d400b50d0 tx=0x7f2d2801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50def594f81f959f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d3d400640 1 -- 172.21.15.16:0/3074884409 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d280b4070 con 0x7f2d400c4710 2024-04-26T20:14:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d3d400640 1 -- 172.21.15.16:0/3074884409 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d280af400 con 0x7f2d400c4710 2024-04-26T20:14:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d3d400640 1 -- 172.21.15.16:0/3074884409 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d280af7d0 con 0x7f2d400c4710 2024-04-26T20:14:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 -- 172.21.15.16:0/3074884409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 msgr2=0x7f2d40071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 --2- 172.21.15.16:0/3074884409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40071f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d400b50d0 tx=0x7f2d2801f1e0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 -- 172.21.15.16:0/3074884409 shutdown_connections 2024-04-26T20:14:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 --2- 172.21.15.16:0/3074884409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d400c4b60 0x7f2d40072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 --2- 172.21.15.16:0/3074884409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40071f40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 --2- 172.21.15.16:0/3074884409 >> v2:172.21.15.192:3300/0 conn(0x7f2d401540b0 0x7f2d400cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 -- 172.21.15.16:0/3074884409 >> 172.21.15.16:0/3074884409 conn(0x7f2d40070570 msgr2=0x7f2d4006f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 -- 172.21.15.16:0/3074884409 shutdown_connections 2024-04-26T20:14:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.986+0000 7f2d45000640 1 -- 172.21.15.16:0/3074884409 wait complete. 2024-04-26T20:14:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 Processor -- start 2024-04-26T20:14:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 -- start start 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d400c4b60 0x7f2d4014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d4015c0c0 0x7f2d40142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4015d460 con 0x7f2d400c4710 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400cbb40 con 0x7f2d400c4b60 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4015d5e0 con 0x7f2d4015c0c0 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54018/0 (socket says 172.21.15.16:54018) 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 -- 172.21.15.16:0/565369704 learned_addr learned my addr 172.21.15.16:0/565369704 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:43.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d35400640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d400c4b60 0x7f2d4014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3e800640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d4015c0c0 0x7f2d40142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 -- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d4015c0c0 msgr2=0x7f2d40142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d4015c0c0 0x7f2d40142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 -- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d400c4b60 msgr2=0x7f2d4014ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d400c4b60 0x7f2d4014ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 -- 172.21.15.16:0/565369704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d40150a60 con 0x7f2d400c4710 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d3de00640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40144c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000d620 tx=0x7f2d3000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d36a00640 1 -- 172.21.15.16:0/565369704 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d300125f0 con 0x7f2d400c4710 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d36a00640 1 -- 172.21.15.16:0/565369704 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d30019070 con 0x7f2d400c4710 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d36a00640 1 -- 172.21.15.16:0/565369704 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d300129b0 con 0x7f2d400c4710 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d401f4fe0 con 0x7f2d400c4710 2024-04-26T20:14:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d40150cd0 con 0x7f2d400c4710 2024-04-26T20:14:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.990+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d40077c20 con 0x7f2d400c4710 2024-04-26T20:14:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.994+0000 7f2d36a00640 1 -- 172.21.15.16:0/565369704 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d30012b50 con 0x7f2d400c4710 2024-04-26T20:14:43.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.994+0000 7f2d36a00640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d1c068380 0x7f2d1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:43.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.994+0000 7f2d36a00640 1 -- 172.21.15.16:0/565369704 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d300870b0 con 0x7f2d400c4710 2024-04-26T20:14:43.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.994+0000 7f2d35400640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d1c068380 0x7f2d1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.994+0000 7f2d35400640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d1c068380 0x7f2d1c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d280b1000 tx=0x7f2d280aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:44.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:43.998+0000 7f2d36a00640 1 -- 172.21.15.16:0/565369704 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2d30057290 con 0x7f2d400c4710 2024-04-26T20:14:44.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d401534c0 con 0x7f2d400c4710 2024-04-26T20:14:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d36a00640 1 -- 172.21.15.16:0/565369704 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f2d30056b90 con 0x7f2d400c4710 2024-04-26T20:14:44.171 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:44.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d1c068380 msgr2=0x7f2d1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d1c068380 0x7f2d1c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d280b1000 tx=0x7f2d280aa000 comp rx=0 tx=0).stop 2024-04-26T20:14:44.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 msgr2=0x7f2d40144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40144c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000d620 tx=0x7f2d3000dae0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 shutdown_connections 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2d1c068380 0x7f2d1c06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d4015c0c0 0x7f2d40142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d400c4b60 0x7f2d4014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 --2- 172.21.15.16:0/565369704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d400c4710 0x7f2d40144c40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 >> 172.21.15.16:0/565369704 conn(0x7f2d40070570 msgr2=0x7f2d40071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 shutdown_connections 2024-04-26T20:14:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.166+0000 7f2d45000640 1 -- 172.21.15.16:0/565369704 wait complete. 2024-04-26T20:14:44.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:14:44.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:14:44.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 Processor -- start 2024-04-26T20:14:44.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 -- start start 2024-04-26T20:14:44.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f88d8155e80 0x7f88d815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88d80ccc10 0x7f88d806ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f88d81601b0 con 0x7f88d8155e80 2024-04-26T20:14:44.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f88d806d610 con 0x7f88d80ccc10 2024-04-26T20:14:44.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.330+0000 7f88e0000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88d815f3f0 con 0x7f88d80b1f60 2024-04-26T20:14:44.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f88d8155e80 0x7f88d815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f88d8155e80 0x7f88d815bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54032/0 (socket says 172.21.15.16:54032) 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 -- 172.21.15.16:0/740598465 learned_addr learned my addr 172.21.15.16:0/740598465 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dcc00640 1 --2- 172.21.15.16:0/740598465 >> v2:172.21.15.192:3300/0 conn(0x7f88d80ccc10 0x7f88d806ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88de000640 1 --2- 172.21.15.16:0/740598465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 -- 172.21.15.16:0/740598465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 msgr2=0x7f88d8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 --2- 172.21.15.16:0/740598465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 -- 172.21.15.16:0/740598465 >> v2:172.21.15.192:3300/0 conn(0x7f88d80ccc10 msgr2=0x7f88d806ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 --2- 172.21.15.16:0/740598465 >> v2:172.21.15.192:3300/0 conn(0x7f88d80ccc10 0x7f88d806ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 -- 172.21.15.16:0/740598465 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d815f6d0 con 0x7f88d8155e80 2024-04-26T20:14:44.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dcc00640 1 --2- 172.21.15.16:0/740598465 >> v2:172.21.15.192:3300/0 conn(0x7f88d80ccc10 0x7f88d806ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:44.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.334+0000 7f88dd600640 1 --2- 172.21.15.16:0/740598465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d815bc60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009870 tx=0x7f88cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ca1b256c50b574 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:44.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88d7e00640 1 -- 172.21.15.16:0/740598465 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0b0070 con 0x7f88d8155e80 2024-04-26T20:14:44.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88d7e00640 1 -- 172.21.15.16:0/740598465 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc0ab600 con 0x7f88d8155e80 2024-04-26T20:14:44.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88d7e00640 1 -- 172.21.15.16:0/740598465 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0ab9d0 con 0x7f88d8155e80 2024-04-26T20:14:44.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- 172.21.15.16:0/740598465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 msgr2=0x7f88d815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 --2- 172.21.15.16:0/740598465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d815bc60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009870 tx=0x7f88cc01c490 comp rx=0 tx=0).stop 2024-04-26T20:14:44.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- 172.21.15.16:0/740598465 shutdown_connections 2024-04-26T20:14:44.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 --2- 172.21.15.16:0/740598465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 --2- 172.21.15.16:0/740598465 >> v2:172.21.15.192:3300/0 conn(0x7f88d80ccc10 0x7f88d806ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 --2- 172.21.15.16:0/740598465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d815bc60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- 172.21.15.16:0/740598465 >> 172.21.15.16:0/740598465 conn(0x7f88d8068140 msgr2=0x7f88d8068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:44.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- 172.21.15.16:0/740598465 shutdown_connections 2024-04-26T20:14:44.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- 172.21.15.16:0/740598465 wait complete. 2024-04-26T20:14:44.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 Processor -- start 2024-04-26T20:14:44.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- start start 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d80ccc10 0x7f88d81f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d81f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80cfda0 con 0x7f88d8155e80 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80cfc20 con 0x7f88d80ccc10 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88e0000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88d80cff20 con 0x7f88d80b1f60 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88de000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d81f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88de000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d81f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54046/0 (socket says 172.21.15.16:54046) 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88de000640 1 -- 172.21.15.16:0/2544762820 learned_addr learned my addr 172.21.15.16:0/2544762820 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88dd600640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.338+0000 7f88dcc00640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d80ccc10 0x7f88d81f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88de000640 1 -- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 msgr2=0x7f88d8158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88de000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88de000640 1 -- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d80ccc10 msgr2=0x7f88d81f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88de000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d80ccc10 0x7f88d81f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88de000640 1 -- 172.21.15.16:0/2544762820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d815d3f0 con 0x7f88d8155e80 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88dcc00640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d80ccc10 0x7f88d81f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88de000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d81f5750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007e60 tx=0x7f88d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88d5600640 1 -- 172.21.15.16:0/2544762820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0014620 con 0x7f88d8155e80 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88d5600640 1 -- 172.21.15.16:0/2544762820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0019070 con 0x7f88d8155e80 2024-04-26T20:14:44.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88d5600640 1 -- 172.21.15.16:0/2544762820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0014a20 con 0x7f88d8155e80 2024-04-26T20:14:44.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d815dea0 con 0x7f88d8155e80 2024-04-26T20:14:44.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d815d970 con 0x7f88d8155e80 2024-04-26T20:14:44.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d8077c20 con 0x7f88d8155e80 2024-04-26T20:14:44.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88d5600640 1 -- 172.21.15.16:0/2544762820 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88d0014bc0 con 0x7f88d8155e80 2024-04-26T20:14:44.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88d5600640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f88b8068380 0x7f88b806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.342+0000 7f88d5600640 1 -- 172.21.15.16:0/2544762820 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88d00874e0 con 0x7f88d8155e80 2024-04-26T20:14:44.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.346+0000 7f88dd600640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f88b8068380 0x7f88b806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.346+0000 7f88dd600640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f88b8068380 0x7f88b806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0ad000 tx=0x7f88cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:44.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.346+0000 7f88d5600640 1 -- 172.21.15.16:0/2544762820 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f88d0057750 con 0x7f88d8155e80 2024-04-26T20:14:44.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88d8159680 con 0x7f88d8155e80 2024-04-26T20:14:44.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88d5600640 1 -- 172.21.15.16:0/2544762820 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f88d0057050 con 0x7f88d8155e80 2024-04-26T20:14:44.518 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:14:44.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f88b8068380 msgr2=0x7f88b806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f88b8068380 0x7f88b806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0ad000 tx=0x7f88cc008040 comp rx=0 tx=0).stop 2024-04-26T20:14:44.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 msgr2=0x7f88d81f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d81f5750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007e60 tx=0x7f88d000e4b0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 shutdown_connections 2024-04-26T20:14:44.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f88b8068380 0x7f88b806a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88d8155e80 0x7f88d81f5750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d80ccc10 0x7f88d81f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 --2- 172.21.15.16:0/2544762820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d80b1f60 0x7f88d8158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 >> 172.21.15.16:0/2544762820 conn(0x7f88d8068140 msgr2=0x7f88d81535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 shutdown_connections 2024-04-26T20:14:44.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.514+0000 7f88e0000640 1 -- 172.21.15.16:0/2544762820 wait complete. 2024-04-26T20:14:44.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:14:44.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2323800640 1 Processor -- start 2024-04-26T20:14:44.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2323800640 1 -- start start 2024-04-26T20:14:44.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2323800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f231c0c8cc0 0x7f231c073c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2323800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c074170 0x7f231c15d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2323800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f231c0cadc0 con 0x7f231c153f70 2024-04-26T20:14:44.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2323800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f231c071130 con 0x7f231c0c8cc0 2024-04-26T20:14:44.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2323800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f231c0713d0 con 0x7f231c074170 2024-04-26T20:14:44.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f231c0c8cc0 0x7f231c073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f231c0c8cc0 0x7f231c073c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54050/0 (socket says 172.21.15.16:54050) 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2320e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f231c153f70 0x7f231c0cb760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41920/0 (socket says 172.21.15.16:41920) 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231be00640 1 -- 172.21.15.16:0/1801152188 learned_addr learned my addr 172.21.15.16:0/1801152188 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f2321800640 1 --2- 172.21.15.16:0/1801152188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c074170 0x7f231c15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231be00640 1 -- 172.21.15.16:0/1801152188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c074170 msgr2=0x7f231c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231be00640 1 --2- 172.21.15.16:0/1801152188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c074170 0x7f231c15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231be00640 1 -- 172.21.15.16:0/1801152188 >> v1:172.21.15.16:6789/0 conn(0x7f231c153f70 legacy=0x7f231c0cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231be00640 1 -- 172.21.15.16:0/1801152188 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c0716b0 con 0x7f231c0c8cc0 2024-04-26T20:14:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.678+0000 7f231b400640 1 -- 172.21.15.16:0/1801152188 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109222168 0 0) 0x7f231c0cadc0 con 0x7f231c153f70 2024-04-26T20:14:44.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f231be00640 1 --2- 172.21.15.16:0/1801152188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c0c8cc0 0x7f231c073c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca3d82e3efdbefa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f231b400640 1 -- 172.21.15.16:0/1801152188 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080a7070 con 0x7f231c0c8cc0 2024-04-26T20:14:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f231b400640 1 -- 172.21.15.16:0/1801152188 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23080b0070 con 0x7f231c0c8cc0 2024-04-26T20:14:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f231b400640 1 -- 172.21.15.16:0/1801152188 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080ab890 con 0x7f231c0c8cc0 2024-04-26T20:14:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 -- 172.21.15.16:0/1801152188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c0c8cc0 msgr2=0x7f231c073c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 --2- 172.21.15.16:0/1801152188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c0c8cc0 0x7f231c073c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230801c560 comp rx=0 tx=0).stop 2024-04-26T20:14:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 -- 172.21.15.16:0/1801152188 shutdown_connections 2024-04-26T20:14:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 --2- 172.21.15.16:0/1801152188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c074170 0x7f231c15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 --2- 172.21.15.16:0/1801152188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c0c8cc0 0x7f231c073c30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 -- 172.21.15.16:0/1801152188 >> 172.21.15.16:0/1801152188 conn(0x7f231c06d490 msgr2=0x7f231c06d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 -- 172.21.15.16:0/1801152188 shutdown_connections 2024-04-26T20:14:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.682+0000 7f2323800640 1 -- 172.21.15.16:0/1801152188 wait complete. 2024-04-26T20:14:44.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 Processor -- start 2024-04-26T20:14:44.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 -- start start 2024-04-26T20:14:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f231c074170 0x7f231c14ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c0c8cc0 0x7f231c146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c153f70 0x7f231c1f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f231c166ce0 con 0x7f231c153f70 2024-04-26T20:14:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f231c0c9420 con 0x7f231c074170 2024-04-26T20:14:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f231c166e60 con 0x7f231c0c8cc0 2024-04-26T20:14:44.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c153f70 0x7f231c1f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c153f70 0x7f231c1f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54058/0 (socket says 172.21.15.16:54058) 2024-04-26T20:14:44.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 -- 172.21.15.16:0/1674985360 learned_addr learned my addr 172.21.15.16:0/1674985360 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:44.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2320e00640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f231c074170 0x7f231c14ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f231be00640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c0c8cc0 0x7f231c146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 -- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c0c8cc0 msgr2=0x7f231c146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c0c8cc0 0x7f231c146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 -- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f231c074170 msgr2=0x7f231c14ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f231c074170 0x7f231c14ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 -- 172.21.15.16:0/1674985360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c145bc0 con 0x7f231c153f70 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2321800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c153f70 0x7f231c1f61d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2314009dd0 tx=0x7f231400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2318c00640 1 -- 172.21.15.16:0/1674985360 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314018020 con 0x7f231c153f70 2024-04-26T20:14:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2318c00640 1 -- 172.21.15.16:0/1674985360 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314014480 con 0x7f231c153f70 2024-04-26T20:14:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2318c00640 1 -- 172.21.15.16:0/1674985360 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314014870 con 0x7f231c153f70 2024-04-26T20:14:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c145e60 con 0x7f231c153f70 2024-04-26T20:14:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.686+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c146420 con 0x7f231c153f70 2024-04-26T20:14:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.690+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231c077c20 con 0x7f231c153f70 2024-04-26T20:14:44.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.690+0000 7f2318c00640 1 -- 172.21.15.16:0/1674985360 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f231401b020 con 0x7f231c153f70 2024-04-26T20:14:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.690+0000 7f2318c00640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f22fc068380 0x7f22fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.690+0000 7f2318c00640 1 -- 172.21.15.16:0/1674985360 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2314087b90 con 0x7f231c153f70 2024-04-26T20:14:44.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.690+0000 7f2320e00640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f22fc068380 0x7f22fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:44.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.690+0000 7f2320e00640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f22fc068380 0x7f22fc06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2310000f70 tx=0x7f2310007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:44.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.694+0000 7f2318c00640 1 -- 172.21.15.16:0/1674985360 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2314022020 con 0x7f231c153f70 2024-04-26T20:14:44.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f231c070de0 con 0x7f231c153f70 2024-04-26T20:14:44.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2318c00640 1 -- 172.21.15.16:0/1674985360 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f2314010040 con 0x7f231c153f70 2024-04-26T20:14:44.863 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:44.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f22fc068380 msgr2=0x7f22fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f22fc068380 0x7f22fc06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2310000f70 tx=0x7f2310007c10 comp rx=0 tx=0).stop 2024-04-26T20:14:44.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c153f70 msgr2=0x7f231c1f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:44.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c153f70 0x7f231c1f61d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2314009dd0 tx=0x7f231400c490 comp rx=0 tx=0).stop 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 shutdown_connections 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f22fc068380 0x7f22fc06a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f231c153f70 0x7f231c1f61d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f231c0c8cc0 0x7f231c146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 --2- 172.21.15.16:0/1674985360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f231c074170 0x7f231c14ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 >> 172.21.15.16:0/1674985360 conn(0x7f231c06d490 msgr2=0x7f231c15c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 shutdown_connections 2024-04-26T20:14:44.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:44.858+0000 7f2323800640 1 -- 172.21.15.16:0/1674985360 wait complete. 2024-04-26T20:14:44.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:14:45.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.022+0000 7f6295800640 1 Processor -- start 2024-04-26T20:14:45.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.022+0000 7f6295800640 1 -- start start 2024-04-26T20:14:45.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.022+0000 7f6295800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290071650 0x7f62900b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.022+0000 7f6295800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f62900cac70 0x7f629015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.022+0000 7f6295800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629015ff20 con 0x7f6290155ff0 2024-04-26T20:14:45.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.022+0000 7f6295800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f6290160200 con 0x7f62900cac70 2024-04-26T20:14:45.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.022+0000 7f6295800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f62900ca6a0 con 0x7f6290071650 2024-04-26T20:14:45.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6287e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290071650 0x7f62900b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6294e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f62900cac70 0x7f629015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6294e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f62900cac70 0x7f629015bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:37474/0 (socket says 172.21.15.16:37474) 2024-04-26T20:14:45.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6294e00640 1 -- 172.21.15.16:0/1264772244 learned_addr learned my addr 172.21.15.16:0/1264772244 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:45.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6287e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290071650 0x7f62900b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:42526/0 (socket says 172.21.15.16:42526) 2024-04-26T20:14:45.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6294e00640 1 -- 172.21.15.16:0/1264772244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290071650 msgr2=0x7f62900b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:45.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6294e00640 1 --2- 172.21.15.16:0/1264772244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290071650 0x7f62900b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6294e00640 1 -- 172.21.15.16:0/1264772244 >> v1:172.21.15.192:6789/0 conn(0x7f6290155ff0 legacy=0x7f629006d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.026+0000 7f6294e00640 1 -- 172.21.15.16:0/1264772244 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62900ca980 con 0x7f62900cac70 2024-04-26T20:14:45.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6294e00640 1 --2- 172.21.15.16:0/1264772244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62900cac70 0x7f629015bdb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6288009e80 tx=0x7f628801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b0540e69fbc6c26 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f628f400640 1 -- 172.21.15.16:0/1264772244 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62880a57d0 con 0x7f62900cac70 2024-04-26T20:14:45.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f628f400640 1 -- 172.21.15.16:0/1264772244 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62880a5970 con 0x7f62900cac70 2024-04-26T20:14:45.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f628f400640 1 -- 172.21.15.16:0/1264772244 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62880a5d40 con 0x7f62900cac70 2024-04-26T20:14:45.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 -- 172.21.15.16:0/1264772244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62900cac70 msgr2=0x7f629015bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 --2- 172.21.15.16:0/1264772244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62900cac70 0x7f629015bdb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6288009e80 tx=0x7f628801ca10 comp rx=0 tx=0).stop 2024-04-26T20:14:45.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 -- 172.21.15.16:0/1264772244 shutdown_connections 2024-04-26T20:14:45.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 --2- 172.21.15.16:0/1264772244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62900cac70 0x7f629015bdb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 --2- 172.21.15.16:0/1264772244 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290071650 0x7f62900b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 -- 172.21.15.16:0/1264772244 >> 172.21.15.16:0/1264772244 conn(0x7f629006c980 msgr2=0x7f6290068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:45.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 -- 172.21.15.16:0/1264772244 shutdown_connections 2024-04-26T20:14:45.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 -- 172.21.15.16:0/1264772244 wait complete. 2024-04-26T20:14:45.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 Processor -- start 2024-04-26T20:14:45.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.030+0000 7f6295800640 1 -- start start 2024-04-26T20:14:45.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6290071650 0x7f6290159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62900cac70 0x7f629015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290155ff0 0x7f629014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f629006dd20 con 0x7f62900cac70 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f629006dba0 con 0x7f6290071650 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f62901563d0 con 0x7f6290155ff0 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62900cac70 0x7f629015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62900cac70 0x7f629015eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54068/0 (socket says 172.21.15.16:54068) 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 -- 172.21.15.16:0/1844050181 learned_addr learned my addr 172.21.15.16:0/1844050181 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f628fe00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6290071650 0x7f6290159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6294e00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290155ff0 0x7f629014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 -- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290155ff0 msgr2=0x7f629014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290155ff0 0x7f629014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 -- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6290071650 msgr2=0x7f6290159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6290071650 0x7f6290159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 -- 172.21.15.16:0/1844050181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62901522e0 con 0x7f62900cac70 2024-04-26T20:14:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6287e00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62900cac70 0x7f629015eaa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f627800e8a0 tx=0x7f627800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f628cc00640 1 -- 172.21.15.16:0/1844050181 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278017070 con 0x7f62900cac70 2024-04-26T20:14:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f628cc00640 1 -- 172.21.15.16:0/1844050181 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627800c940 con 0x7f62900cac70 2024-04-26T20:14:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62901f89f0 con 0x7f62900cac70 2024-04-26T20:14:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f628cc00640 1 -- 172.21.15.16:0/1844050181 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627800ccf0 con 0x7f62900cac70 2024-04-26T20:14:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62901592c0 con 0x7f62900cac70 2024-04-26T20:14:45.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.034+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62900506d0 con 0x7f62900cac70 2024-04-26T20:14:45.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.038+0000 7f628cc00640 1 -- 172.21.15.16:0/1844050181 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f627801a070 con 0x7f62900cac70 2024-04-26T20:14:45.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.038+0000 7f628cc00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f626c068380 0x7f626c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.038+0000 7f628cc00640 1 -- 172.21.15.16:0/1844050181 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6278086bb0 con 0x7f62900cac70 2024-04-26T20:14:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.038+0000 7f628fe00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f626c068380 0x7f626c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.038+0000 7f628fe00640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f626c068380 0x7f626c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6280001810 tx=0x7f6280009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.042+0000 7f628cc00640 1 -- 172.21.15.16:0/1844050181 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6278056750 con 0x7f62900cac70 2024-04-26T20:14:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f62900b4880 con 0x7f62900cac70 2024-04-26T20:14:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f628cc00640 1 -- 172.21.15.16:0/1844050181 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f627805aa50 con 0x7f62900cac70 2024-04-26T20:14:45.215 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f626c068380 msgr2=0x7f626c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f626c068380 0x7f626c06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6280001810 tx=0x7f6280009040 comp rx=0 tx=0).stop 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62900cac70 msgr2=0x7f629015eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62900cac70 0x7f629015eaa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f627800e8a0 tx=0x7f627800eca0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 shutdown_connections 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f626c068380 0x7f626c06a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6290155ff0 0x7f629014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62900cac70 0x7f629015eaa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 --2- 172.21.15.16:0/1844050181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6290071650 0x7f6290159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 >> 172.21.15.16:0/1844050181 conn(0x7f629006c980 msgr2=0x7f629006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 shutdown_connections 2024-04-26T20:14:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.210+0000 7f6295800640 1 -- 172.21.15.16:0/1844050181 wait complete. 2024-04-26T20:14:45.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:14:45.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.374+0000 7f611c600640 1 Processor -- start 2024-04-26T20:14:45.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.374+0000 7f611c600640 1 -- start start 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611c600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6114157250 0x7f611406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611c600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f611415d8a0 0x7f6114070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611c600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61140c49e0 con 0x7f61140c44a0 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611c600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f61140cbb50 con 0x7f611415d8a0 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611c600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61140caf80 con 0x7f6114157250 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f6119c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6114157250 0x7f611406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611a600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f611415d8a0 0x7f6114070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611a600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f611415d8a0 0x7f6114070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:60516/0 (socket says 172.21.15.16:60516) 2024-04-26T20:14:45.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f6119c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6114157250 0x7f611406ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:48874/0 (socket says 172.21.15.16:48874) 2024-04-26T20:14:45.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f611a600640 1 -- 172.21.15.16:0/2502025016 learned_addr learned my addr 172.21.15.16:0/2502025016 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:45.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f6119c00640 1 -- 172.21.15.16:0/2502025016 >> v2:172.21.15.192:3300/0 conn(0x7f611415d8a0 msgr2=0x7f6114070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:45.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f6119c00640 1 --2- 172.21.15.16:0/2502025016 >> v2:172.21.15.192:3300/0 conn(0x7f611415d8a0 0x7f6114070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f6119c00640 1 -- 172.21.15.16:0/2502025016 >> v1:172.21.15.192:6789/0 conn(0x7f61140c44a0 legacy=0x7f611415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.378+0000 7f6119c00640 1 -- 172.21.15.16:0/2502025016 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61140c6450 con 0x7f6114157250 2024-04-26T20:14:45.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f6119c00640 1 --2- 172.21.15.16:0/2502025016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6114157250 0x7f611406ff00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61080097c0 tx=0x7f610801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba775597f74e5265 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f6113e00640 1 -- 172.21.15.16:0/2502025016 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080b0070 con 0x7f6114157250 2024-04-26T20:14:45.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f6113e00640 1 -- 172.21.15.16:0/2502025016 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61080ab600 con 0x7f6114157250 2024-04-26T20:14:45.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f6113e00640 1 -- 172.21.15.16:0/2502025016 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080ab9d0 con 0x7f6114157250 2024-04-26T20:14:45.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 -- 172.21.15.16:0/2502025016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6114157250 msgr2=0x7f611406ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 --2- 172.21.15.16:0/2502025016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6114157250 0x7f611406ff00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61080097c0 tx=0x7f610801c410 comp rx=0 tx=0).stop 2024-04-26T20:14:45.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 -- 172.21.15.16:0/2502025016 shutdown_connections 2024-04-26T20:14:45.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 --2- 172.21.15.16:0/2502025016 >> v2:172.21.15.192:3300/0 conn(0x7f611415d8a0 0x7f6114070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 --2- 172.21.15.16:0/2502025016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6114157250 0x7f611406ff00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 -- 172.21.15.16:0/2502025016 >> 172.21.15.16:0/2502025016 conn(0x7f6114068140 msgr2=0x7f6114068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:45.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 -- 172.21.15.16:0/2502025016 shutdown_connections 2024-04-26T20:14:45.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 -- 172.21.15.16:0/2502025016 wait complete. 2024-04-26T20:14:45.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 Processor -- start 2024-04-26T20:14:45.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.382+0000 7f611c600640 1 -- start start 2024-04-26T20:14:45.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61140c44a0 0x7f61141f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114157250 0x7f6114154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611415d8a0 0x7f6114155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61140b26c0 con 0x7f61140c44a0 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6114157630 con 0x7f6114157250 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61140b2840 con 0x7f611415d8a0 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61140c44a0 0x7f61141f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61140c44a0 0x7f61141f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39804/0 (socket says 172.21.15.16:39804) 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 -- 172.21.15.16:0/3814443468 learned_addr learned my addr 172.21.15.16:0/3814443468 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611a600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611415d8a0 0x7f6114155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119200640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114157250 0x7f6114154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 -- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611415d8a0 msgr2=0x7f6114155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611415d8a0 0x7f6114155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 -- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114157250 msgr2=0x7f6114154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114157250 0x7f6114154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 -- 172.21.15.16:0/3814443468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61141f8ec0 con 0x7f61140c44a0 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611a600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611415d8a0 0x7f6114155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6119c00640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61140c44a0 0x7f61141f8440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f61080ae040 tx=0x7f61080191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6111600640 1 -- 172.21.15.16:0/3814443468 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080b0040 con 0x7f61140c44a0 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6111600640 1 -- 172.21.15.16:0/3814443468 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61080ab400 con 0x7f61140c44a0 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f6111600640 1 -- 172.21.15.16:0/3814443468 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080b4670 con 0x7f61140c44a0 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61141548d0 con 0x7f61140c44a0 2024-04-26T20:14:45.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61140b42c0 con 0x7f61140c44a0 2024-04-26T20:14:45.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.386+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6114077c20 con 0x7f61140c44a0 2024-04-26T20:14:45.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.390+0000 7f6111600640 1 -- 172.21.15.16:0/3814443468 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61080bb020 con 0x7f61140c44a0 2024-04-26T20:14:45.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.390+0000 7f6111600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60f40683b0 0x7f60f406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.390+0000 7f6111600640 1 -- 172.21.15.16:0/3814443468 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6108120130 con 0x7f61140c44a0 2024-04-26T20:14:45.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.390+0000 7f6119200640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60f40683b0 0x7f60f406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.390+0000 7f6119200640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60f40683b0 0x7f60f406a870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61140b07c0 tx=0x7f6100009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.394+0000 7f6111600640 1 -- 172.21.15.16:0/3814443468 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f61080c2020 con 0x7f61140c44a0 2024-04-26T20:14:45.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.562+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f61140ca540 con 0x7f61140c44a0 2024-04-26T20:14:45.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.562+0000 7f6111600640 1 -- 172.21.15.16:0/3814443468 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f6108016090 con 0x7f61140c44a0 2024-04-26T20:14:45.568 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:45.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60f40683b0 msgr2=0x7f60f406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60f40683b0 0x7f60f406a870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61140b07c0 tx=0x7f6100009040 comp rx=0 tx=0).stop 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61140c44a0 msgr2=0x7f61141f8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61140c44a0 0x7f61141f8440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f61080ae040 tx=0x7f61080191b0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 shutdown_connections 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60f40683b0 0x7f60f406a870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611415d8a0 0x7f6114155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114157250 0x7f6114154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 --2- 172.21.15.16:0/3814443468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61140c44a0 0x7f61141f8440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 >> 172.21.15.16:0/3814443468 conn(0x7f6114068140 msgr2=0x7f611406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 shutdown_connections 2024-04-26T20:14:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.566+0000 7f611c600640 1 -- 172.21.15.16:0/3814443468 wait complete. 2024-04-26T20:14:45.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:45.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcad7000640 1 Processor -- start 2024-04-26T20:14:45.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcad7000640 1 -- start start 2024-04-26T20:14:45.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcad7000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcad00722a0 0x7fcad0073550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcad7000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad00c7e40 con 0x7fcad0155f20 2024-04-26T20:14:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcad7000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad00c8120 con 0x7fcad006fb60 2024-04-26T20:14:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcad7000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fcad0156300 con 0x7fcad00722a0 2024-04-26T20:14:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcacfe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcad0155f20 0x7fcad015c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42168/0 (socket says 172.21.15.16:42168) 2024-04-26T20:14:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcacfe00640 1 -- 172.21.15.16:0/4103267130 learned_addr learned my addr 172.21.15.16:0/4103267130 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:45.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcac7e00640 1 --2- 172.21.15.16:0/4103267130 >> v2:172.21.15.192:3300/0 conn(0x7fcad00722a0 0x7fcad0073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcacf400640 1 -- 172.21.15.16:0/4103267130 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722794181 0 0) 0x7fcad00c7e40 con 0x7fcad0155f20 2024-04-26T20:14:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcacf400640 1 -- 172.21.15.16:0/4103267130 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcab4003530 con 0x7fcad0155f20 2024-04-26T20:14:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcacf400640 1 -- 172.21.15.16:0/4103267130 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 874012186 0 0) 0x7fcab4003530 con 0x7fcad0155f20 2024-04-26T20:14:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcac7e00640 1 -- 172.21.15.16:0/4103267130 >> v1:172.21.15.192:6789/0 conn(0x7fcad006fb60 legacy=0x7fcad01664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcac7e00640 1 -- 172.21.15.16:0/4103267130 >> v1:172.21.15.16:6789/0 conn(0x7fcad0155f20 legacy=0x7fcad015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.726+0000 7fcac7e00640 1 -- 172.21.15.16:0/4103267130 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad0072d50 con 0x7fcad00722a0 2024-04-26T20:14:45.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcac7e00640 1 --2- 172.21.15.16:0/4103267130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad00722a0 0x7fcad0073550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcab80097c0 tx=0x7fcab801ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbd5702a041bbe98 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcacf400640 1 -- 172.21.15.16:0/4103267130 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80b5070 con 0x7fcad00722a0 2024-04-26T20:14:45.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcacf400640 1 -- 172.21.15.16:0/4103267130 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab80a8630 con 0x7fcad00722a0 2024-04-26T20:14:45.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcacf400640 1 -- 172.21.15.16:0/4103267130 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0001680 con 0x7fcad00722a0 2024-04-26T20:14:45.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- 172.21.15.16:0/4103267130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad00722a0 msgr2=0x7fcad0073550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 --2- 172.21.15.16:0/4103267130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad00722a0 0x7fcad0073550 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcab80097c0 tx=0x7fcab801ebb0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- 172.21.15.16:0/4103267130 shutdown_connections 2024-04-26T20:14:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 --2- 172.21.15.16:0/4103267130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad00722a0 0x7fcad0073550 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- 172.21.15.16:0/4103267130 >> 172.21.15.16:0/4103267130 conn(0x7fcad006c380 msgr2=0x7fcad006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- 172.21.15.16:0/4103267130 shutdown_connections 2024-04-26T20:14:45.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- 172.21.15.16:0/4103267130 wait complete. 2024-04-26T20:14:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 Processor -- start 2024-04-26T20:14:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- start start 2024-04-26T20:14:45.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad006fb60 0x7fcad0143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcad00722a0 0x7fcad01446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcad0155f20 0x7fcad0150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0073c10 con 0x7fcad00722a0 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0073a90 con 0x7fcad006fb60 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.734+0000 7fcad7000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcad00c51e0 con 0x7fcad0155f20 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcad00722a0 0x7fcad01446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcad00722a0 0x7fcad01446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39814/0 (socket says 172.21.15.16:39814) 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 -- 172.21.15.16:0/1082934665 learned_addr learned my addr 172.21.15.16:0/1082934665 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcad5000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcad0155f20 0x7fcad0150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcacfe00640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad006fb60 0x7fcad0143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 -- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcad0155f20 msgr2=0x7fcad0150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcad0155f20 0x7fcad0150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 -- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad006fb60 msgr2=0x7fcad0143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad006fb60 0x7fcad0143c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 -- 172.21.15.16:0/1082934665 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad0145530 con 0x7fcad00722a0 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcad5000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcad0155f20 0x7fcad0150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcac7e00640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcad00722a0 0x7fcad01446a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcab801b7c0 tx=0x7fcab801b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcaccc00640 1 -- 172.21.15.16:0/1082934665 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80b5040 con 0x7fcad00722a0 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcaccc00640 1 -- 172.21.15.16:0/1082934665 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab80c0070 con 0x7fcad00722a0 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcaccc00640 1 -- 172.21.15.16:0/1082934665 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab80a9cf0 con 0x7fcad00722a0 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad0145250 con 0x7fcad00722a0 2024-04-26T20:14:45.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad01f2200 con 0x7fcad00722a0 2024-04-26T20:14:45.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad0077c20 con 0x7fcad00722a0 2024-04-26T20:14:45.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.738+0000 7fcaccc00640 1 -- 172.21.15.16:0/1082934665 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcab8003620 con 0x7fcad00722a0 2024-04-26T20:14:45.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.742+0000 7fcaccc00640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcaac068380 0x7fcaac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:45.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.742+0000 7fcaccc00640 1 -- 172.21.15.16:0/1082934665 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcab8123f90 con 0x7fcad00722a0 2024-04-26T20:14:45.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.742+0000 7fcacfe00640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcaac068380 0x7fcaac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:45.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.742+0000 7fcacfe00640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcaac068380 0x7fcaac06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005890 tx=0x7fcac0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:45.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.746+0000 7fcaccc00640 1 -- 172.21.15.16:0/1082934665 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcab8018710 con 0x7fcad00722a0 2024-04-26T20:14:45.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:14:45.837 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:14:45.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.942+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcad00c6db0 con 0x7fcad00722a0 2024-04-26T20:14:45.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcaccc00640 1 -- 172.21.15.16:0/1082934665 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6874 (secure 0 0 0) 0x7fcab80f4320 con 0x7fcad00722a0 2024-04-26T20:14:45.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:45.950 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:41.103520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:14:45.950 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcaac068380 msgr2=0x7fcaac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcaac068380 0x7fcaac06a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005890 tx=0x7fcac0009040 comp rx=0 tx=0).stop 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcad00722a0 msgr2=0x7fcad01446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcad00722a0 0x7fcad01446a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcab801b7c0 tx=0x7fcab801b950 comp rx=0 tx=0).stop 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 shutdown_connections 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcaac068380 0x7fcaac06a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcad0155f20 0x7fcad0150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcad00722a0 0x7fcad01446a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 --2- 172.21.15.16:0/1082934665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcad006fb60 0x7fcad0143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:45.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 >> 172.21.15.16:0/1082934665 conn(0x7fcad006c380 msgr2=0x7fcad006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:45.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 shutdown_connections 2024-04-26T20:14:45.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:45.946+0000 7fcad7000640 1 -- 172.21.15.16:0/1082934665 wait complete. 2024-04-26T20:14:45.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:46.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 Processor -- start 2024-04-26T20:14:46.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 -- start start 2024-04-26T20:14:46.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f178015a570 0x7f1780163ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 0x7f17800c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17800c7ca0 0x7f17800c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f17800c8270 con 0x7f178015a570 2024-04-26T20:14:46.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f17801603c0 con 0x7f17800c7ca0 2024-04-26T20:14:46.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1786c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f17801606a0 con 0x7f17800c72c0 2024-04-26T20:14:46.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1784c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17800c7ca0 0x7f17800c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1784c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17800c7ca0 0x7f17800c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:60556/0 (socket says 172.21.15.16:60556) 2024-04-26T20:14:46.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f1784c00640 1 -- 172.21.15.16:0/1112758899 learned_addr learned my addr 172.21.15.16:0/1112758899 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:46.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.114+0000 7f177fe00640 1 --2- 172.21.15.16:0/1112758899 >> v2:172.21.15.16:3300/0 conn(0x7f178015a570 0x7f1780163ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.118+0000 7f177fe00640 1 -- 172.21.15.16:0/1112758899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 msgr2=0x7f17800c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.118+0000 7f177fe00640 1 --2- 172.21.15.16:0/1112758899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 0x7f17800c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.118+0000 7f177fe00640 1 -- 172.21.15.16:0/1112758899 >> v2:172.21.15.192:3300/0 conn(0x7f17800c7ca0 msgr2=0x7f17800c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.118+0000 7f177fe00640 1 --2- 172.21.15.16:0/1112758899 >> v2:172.21.15.192:3300/0 conn(0x7f17800c7ca0 0x7f17800c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.118+0000 7f177fe00640 1 -- 172.21.15.16:0/1112758899 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1780160980 con 0x7f178015a570 2024-04-26T20:14:46.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f177fe00640 1 --2- 172.21.15.16:0/1112758899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f1780163ff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f17800747d0 tx=0x7f176c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce46daede28f2ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f177ea00640 1 -- 172.21.15.16:0/1112758899 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0b0070 con 0x7f178015a570 2024-04-26T20:14:46.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f177ea00640 1 -- 172.21.15.16:0/1112758899 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0ab600 con 0x7f178015a570 2024-04-26T20:14:46.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f177ea00640 1 -- 172.21.15.16:0/1112758899 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0ab9d0 con 0x7f178015a570 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 -- 172.21.15.16:0/1112758899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 msgr2=0x7f1780163ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 --2- 172.21.15.16:0/1112758899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f1780163ff0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f17800747d0 tx=0x7f176c01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 -- 172.21.15.16:0/1112758899 shutdown_connections 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 --2- 172.21.15.16:0/1112758899 >> v2:172.21.15.192:3300/0 conn(0x7f17800c7ca0 0x7f17800c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 --2- 172.21.15.16:0/1112758899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 0x7f17800c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 --2- 172.21.15.16:0/1112758899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f1780163ff0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 -- 172.21.15.16:0/1112758899 >> 172.21.15.16:0/1112758899 conn(0x7f178006c380 msgr2=0x7f178006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 -- 172.21.15.16:0/1112758899 shutdown_connections 2024-04-26T20:14:46.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.122+0000 7f1786c00640 1 -- 172.21.15.16:0/1112758899 wait complete. 2024-04-26T20:14:46.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 Processor -- start 2024-04-26T20:14:46.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 -- start start 2024-04-26T20:14:46.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 0x7f178015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17800c7ca0 0x7f1780162690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f17800cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f178006fef0 con 0x7f178015a570 2024-04-26T20:14:46.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f178006fd70 con 0x7f17800c7ca0 2024-04-26T20:14:46.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1780070070 con 0x7f17800c72c0 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f17800cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f17800cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39832/0 (socket says 172.21.15.16:39832) 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 -- 172.21.15.16:0/1710828014 learned_addr learned my addr 172.21.15.16:0/1710828014 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f177fe00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 0x7f178015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f177f400640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17800c7ca0 0x7f1780162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 -- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 msgr2=0x7f178015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 0x7f178015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 -- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17800c7ca0 msgr2=0x7f1780162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17800c7ca0 0x7f1780162690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 -- 172.21.15.16:0/1710828014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178015f850 con 0x7f178015a570 2024-04-26T20:14:46.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1784c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f17800cd640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f177800e880 tx=0x7f177800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1777e00640 1 -- 172.21.15.16:0/1710828014 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778017070 con 0x7f178015a570 2024-04-26T20:14:46.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1777e00640 1 -- 172.21.15.16:0/1710828014 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177800c940 con 0x7f178015a570 2024-04-26T20:14:46.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178015b6d0 con 0x7f178015a570 2024-04-26T20:14:46.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1777e00640 1 -- 172.21.15.16:0/1710828014 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177800cd30 con 0x7f178015a570 2024-04-26T20:14:46.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.126+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178015bc90 con 0x7f178015a570 2024-04-26T20:14:46.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.130+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1780077c20 con 0x7f178015a570 2024-04-26T20:14:46.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.130+0000 7f1777e00640 1 -- 172.21.15.16:0/1710828014 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f177801a070 con 0x7f178015a570 2024-04-26T20:14:46.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.130+0000 7f1777e00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f17600683d0 0x7f176006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.130+0000 7f1777e00640 1 -- 172.21.15.16:0/1710828014 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1778086bb0 con 0x7f178015a570 2024-04-26T20:14:46.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.130+0000 7f177fe00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f17600683d0 0x7f176006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.130+0000 7f177fe00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f17600683d0 0x7f176006a890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f176c0ad000 tx=0x7f176c0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.134+0000 7f1777e00640 1 -- 172.21.15.16:0/1710828014 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1778056850 con 0x7f178015a570 2024-04-26T20:14:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.302+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17800c8800 con 0x7f178015a570 2024-04-26T20:14:46.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.302+0000 7f1777e00640 1 -- 172.21.15.16:0/1710828014 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f177805ab50 con 0x7f178015a570 2024-04-26T20:14:46.307 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:46.307 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.302+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f17600683d0 msgr2=0x7f176006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.302+0000 7f1786c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f17600683d0 0x7f176006a890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f176c0ad000 tx=0x7f176c0a6000 comp rx=0 tx=0).stop 2024-04-26T20:14:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.302+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 msgr2=0x7f17800cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.302+0000 7f1786c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f17800cd640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f177800e880 tx=0x7f177800ed40 comp rx=0 tx=0).stop 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 shutdown_connections 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f17600683d0 0x7f176006a890 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f178015a570 0x7f17800cd640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17800c7ca0 0x7f1780162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 --2- 172.21.15.16:0/1710828014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17800c72c0 0x7f178015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 >> 172.21.15.16:0/1710828014 conn(0x7f178006c380 msgr2=0x7f17800c8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 shutdown_connections 2024-04-26T20:14:46.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.306+0000 7f1786c00640 1 -- 172.21.15.16:0/1710828014 wait complete. 2024-04-26T20:14:46.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:14:46.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:14:46.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5aa2800640 1 Processor -- start 2024-04-26T20:14:46.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5aa2800640 1 -- start start 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5aa2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5a9c159450 0x7f5a9c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5aa2800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 0x7f5a9c166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5aa2800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a9c1602d0 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5aa2800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5a9c0c6320 con 0x7f5a9c159450 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5aa2800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9c0c6040 con 0x7f5a9c15c3b0 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5a9c159450 0x7f5a9c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5a9c159450 0x7f5a9c15be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39838/0 (socket says 172.21.15.16:39838) 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9b400640 1 -- 172.21.15.16:0/2874581259 learned_addr learned my addr 172.21.15.16:0/2874581259 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:46.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9be00640 1 --2- 172.21.15.16:0/2874581259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 0x7f5a9c166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9b400640 1 -- 172.21.15.16:0/2874581259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 msgr2=0x7f5a9c166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:46.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9b400640 1 --2- 172.21.15.16:0/2874581259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 0x7f5a9c166710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9b400640 1 -- 172.21.15.16:0/2874581259 >> v1:172.21.15.192:6789/0 conn(0x7f5a9c0c9f60 legacy=0x7f5a9c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.470+0000 7f5a9b400640 1 -- 172.21.15.16:0/2874581259 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9c15f510 con 0x7f5a9c159450 2024-04-26T20:14:46.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5a9b400640 1 --2- 172.21.15.16:0/2874581259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c159450 0x7f5a9c15be70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009870 tx=0x7f5a8c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28d07b187b77645 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5a9aa00640 1 -- 172.21.15.16:0/2874581259 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0b1070 con 0x7f5a9c159450 2024-04-26T20:14:46.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5a9aa00640 1 -- 172.21.15.16:0/2874581259 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a8c0ac620 con 0x7f5a9c159450 2024-04-26T20:14:46.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5a9aa00640 1 -- 172.21.15.16:0/2874581259 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0ac9f0 con 0x7f5a9c159450 2024-04-26T20:14:46.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 -- 172.21.15.16:0/2874581259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c159450 msgr2=0x7f5a9c15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2874581259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c159450 0x7f5a9c15be70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009870 tx=0x7f5a8c01c4d0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 -- 172.21.15.16:0/2874581259 shutdown_connections 2024-04-26T20:14:46.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2874581259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 0x7f5a9c166710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2874581259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c159450 0x7f5a9c15be70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 -- 172.21.15.16:0/2874581259 >> 172.21.15.16:0/2874581259 conn(0x7f5a9c0704d0 msgr2=0x7f5a9c0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:46.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 -- 172.21.15.16:0/2874581259 shutdown_connections 2024-04-26T20:14:46.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.474+0000 7f5aa2800640 1 -- 172.21.15.16:0/2874581259 wait complete. 2024-04-26T20:14:46.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 Processor -- start 2024-04-26T20:14:46.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 -- start start 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c0c9f60 0x7f5a9c1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9c159450 0x7f5a9c1ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 0x7f5a9c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c072950 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c0ca400 con 0x7f5a9c159450 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9c072ad0 con 0x7f5a9c15c3b0 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c0c9f60 0x7f5a9c1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c0c9f60 0x7f5a9c1f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39850/0 (socket says 172.21.15.16:39850) 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 -- 172.21.15.16:0/2299612928 learned_addr learned my addr 172.21.15.16:0/2299612928 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:46.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a93e00640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9c159450 0x7f5a9c1ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 -- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 msgr2=0x7f5a9c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 0x7f5a9c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 -- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9c159450 msgr2=0x7f5a9c1ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9c159450 0x7f5a9c1ee180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 -- 172.21.15.16:0/2299612928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9c15e6b0 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a9b400640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c0c9f60 0x7f5a9c1f5700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c01a100 tx=0x7f5a8c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a93400640 1 -- 172.21.15.16:0/2299612928 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0b1040 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a93400640 1 -- 172.21.15.16:0/2299612928 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a8c0ba070 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9c153f80 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5a93400640 1 -- 172.21.15.16:0/2299612928 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c0b5660 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.478+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9c154530 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.482+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9c077c20 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.482+0000 7f5a93400640 1 -- 172.21.15.16:0/2299612928 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5a8c0b5800 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.482+0000 7f5a93400640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5a78068400 0x7f5a7806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.482+0000 7f5a93400640 1 -- 172.21.15.16:0/2299612928 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5a8c120a00 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.482+0000 7f5a93e00640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5a78068400 0x7f5a7806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.482+0000 7f5a93e00640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5a78068400 0x7f5a7806a8c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0747d0 tx=0x7f5a84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.486+0000 7f5a93400640 1 -- 172.21.15.16:0/2299612928 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5a8c016150 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.650+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5a9c0ca710 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.650+0000 7f5a93400640 1 -- 172.21.15.16:0/2299612928 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f5a8c0f0c60 con 0x7f5a9c0c9f60 2024-04-26T20:14:46.656 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:14:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5a78068400 msgr2=0x7f5a7806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5a78068400 0x7f5a7806a8c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0747d0 tx=0x7f5a84009040 comp rx=0 tx=0).stop 2024-04-26T20:14:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c0c9f60 msgr2=0x7f5a9c1f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c0c9f60 0x7f5a9c1f5700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c01a100 tx=0x7f5a8c019270 comp rx=0 tx=0).stop 2024-04-26T20:14:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 shutdown_connections 2024-04-26T20:14:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5a78068400 0x7f5a7806a8c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a9c15c3b0 0x7f5a9c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9c159450 0x7f5a9c1ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 --2- 172.21.15.16:0/2299612928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a9c0c9f60 0x7f5a9c1f5700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 >> 172.21.15.16:0/2299612928 conn(0x7f5a9c0704d0 msgr2=0x7f5a9c157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:46.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 shutdown_connections 2024-04-26T20:14:46.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.654+0000 7f5aa2800640 1 -- 172.21.15.16:0/2299612928 wait complete. 2024-04-26T20:14:46.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:14:46.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.818+0000 7f77d7800640 1 Processor -- start 2024-04-26T20:14:46.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.818+0000 7f77d7800640 1 -- start start 2024-04-26T20:14:46.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77d7800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0153eb0 0x7f77d015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77d7800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d00c96a0 con 0x7f77d006ff50 2024-04-26T20:14:46.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77d7800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d00c9980 con 0x7f77d006f460 2024-04-26T20:14:46.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77d7800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f77d015ac00 con 0x7f77d0153eb0 2024-04-26T20:14:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77d5800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f77d006ff50 0x7f77d00c5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42184/0 (socket says 172.21.15.16:42184) 2024-04-26T20:14:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77d5800640 1 -- 172.21.15.16:0/988691826 learned_addr learned my addr 172.21.15.16:0/988691826 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:46.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77cfe00640 1 --2- 172.21.15.16:0/988691826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0153eb0 0x7f77d015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77cf400640 1 -- 172.21.15.16:0/988691826 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673136382 0 0) 0x7f77d00c96a0 con 0x7f77d006ff50 2024-04-26T20:14:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77cf400640 1 -- 172.21.15.16:0/988691826 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b8003530 con 0x7f77d006ff50 2024-04-26T20:14:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77cf400640 1 -- 172.21.15.16:0/988691826 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698969119 0 0) 0x7f77d00c9980 con 0x7f77d006f460 2024-04-26T20:14:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77cfe00640 1 -- 172.21.15.16:0/988691826 >> v1:172.21.15.192:6789/0 conn(0x7f77d006f460 legacy=0x7f77d006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77cfe00640 1 -- 172.21.15.16:0/988691826 >> v1:172.21.15.16:6789/0 conn(0x7f77d006ff50 legacy=0x7f77d00c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.822+0000 7f77cfe00640 1 -- 172.21.15.16:0/988691826 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d0070610 con 0x7f77d0153eb0 2024-04-26T20:14:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77cfe00640 1 --2- 172.21.15.16:0/988691826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0153eb0 0x7f77d015a6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0097f0 tx=0x7f77bc01eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbcbb9c088f400f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77cf400640 1 -- 172.21.15.16:0/988691826 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0b5070 con 0x7f77d0153eb0 2024-04-26T20:14:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77cf400640 1 -- 172.21.15.16:0/988691826 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77bc0a85d0 con 0x7f77d0153eb0 2024-04-26T20:14:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77cf400640 1 -- 172.21.15.16:0/988691826 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8001a00 con 0x7f77d0153eb0 2024-04-26T20:14:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 -- 172.21.15.16:0/988691826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0153eb0 msgr2=0x7f77d015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 --2- 172.21.15.16:0/988691826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0153eb0 0x7f77d015a6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0097f0 tx=0x7f77bc01eb10 comp rx=0 tx=0).stop 2024-04-26T20:14:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 -- 172.21.15.16:0/988691826 shutdown_connections 2024-04-26T20:14:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 --2- 172.21.15.16:0/988691826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d0153eb0 0x7f77d015a6c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 -- 172.21.15.16:0/988691826 >> 172.21.15.16:0/988691826 conn(0x7f77d00c9d10 msgr2=0x7f77d00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 -- 172.21.15.16:0/988691826 shutdown_connections 2024-04-26T20:14:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 -- 172.21.15.16:0/988691826 wait complete. 2024-04-26T20:14:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 Processor -- start 2024-04-26T20:14:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.826+0000 7f77d7800640 1 -- start start 2024-04-26T20:14:46.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d006f460 0x7f77d0158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d006ff50 0x7f77d01f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d014e9c0 0x7f77d0073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00c4d70 con 0x7f77d014e9c0 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00c5120 con 0x7f77d006f460 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f77d00c4ef0 con 0x7f77d006ff50 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d014e9c0 0x7f77d0073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d014e9c0 0x7f77d0073a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39852/0 (socket says 172.21.15.16:39852) 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 -- 172.21.15.16:0/3011300139 learned_addr learned my addr 172.21.15.16:0/3011300139 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77cfe00640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d006ff50 0x7f77d01f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d4e00640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d006f460 0x7f77d0158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 -- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d006ff50 msgr2=0x7f77d01f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d006ff50 0x7f77d01f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 -- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d006f460 msgr2=0x7f77d0158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d006f460 0x7f77d0158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:46.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 -- 172.21.15.16:0/3011300139 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d01542a0 con 0x7f77d014e9c0 2024-04-26T20:14:46.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d5800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d014e9c0 0x7f77d0073a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77c800cb30 tx=0x7f77c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77ccc00640 1 -- 172.21.15.16:0/3011300139 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8018070 con 0x7f77d014e9c0 2024-04-26T20:14:46.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77ccc00640 1 -- 172.21.15.16:0/3011300139 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c800a830 con 0x7f77d014e9c0 2024-04-26T20:14:46.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77ccc00640 1 -- 172.21.15.16:0/3011300139 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c800abe0 con 0x7f77d014e9c0 2024-04-26T20:14:46.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d006fd80 con 0x7f77d014e9c0 2024-04-26T20:14:46.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d01f1d10 con 0x7f77d014e9c0 2024-04-26T20:14:46.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d0077c20 con 0x7f77d014e9c0 2024-04-26T20:14:46.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.830+0000 7f77ccc00640 1 -- 172.21.15.16:0/3011300139 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f77c801b070 con 0x7f77d014e9c0 2024-04-26T20:14:46.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.834+0000 7f77ccc00640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f77b00683b0 0x7f77b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:46.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.834+0000 7f77ccc00640 1 -- 172.21.15.16:0/3011300139 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f77c8086750 con 0x7f77d014e9c0 2024-04-26T20:14:46.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.834+0000 7f77d4e00640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f77b00683b0 0x7f77b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:46.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.834+0000 7f77d4e00640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f77b00683b0 0x7f77b006a870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f70 tx=0x7f77c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:46.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:46.838+0000 7f77ccc00640 1 -- 172.21.15.16:0/3011300139 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f77c80562e0 con 0x7f77d014e9c0 2024-04-26T20:14:47.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f77d01f1ff0 con 0x7f77d014e9c0 2024-04-26T20:14:47.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77ccc00640 1 -- 172.21.15.16:0/3011300139 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f77c805a5e0 con 0x7f77d014e9c0 2024-04-26T20:14:47.007 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f77b00683b0 msgr2=0x7f77b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f77b00683b0 0x7f77b006a870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f70 tx=0x7f77c4009040 comp rx=0 tx=0).stop 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d014e9c0 msgr2=0x7f77d0073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d014e9c0 0x7f77d0073a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77c800cb30 tx=0x7f77c800a060 comp rx=0 tx=0).stop 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 shutdown_connections 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f77b00683b0 0x7f77b006a870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d014e9c0 0x7f77d0073a20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77d006ff50 0x7f77d01f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 --2- 172.21.15.16:0/3011300139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77d006f460 0x7f77d0158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 >> 172.21.15.16:0/3011300139 conn(0x7f77d00c9d10 msgr2=0x7f77d0152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:47.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 shutdown_connections 2024-04-26T20:14:47.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.002+0000 7f77d7800640 1 -- 172.21.15.16:0/3011300139 wait complete. 2024-04-26T20:14:47.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:14:47.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce7200640 1 Processor -- start 2024-04-26T20:14:47.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce7200640 1 -- start start 2024-04-26T20:14:47.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce7200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ce015ca20 0x7f4ce00cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce7200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce00ca5a0 con 0x7f4ce0071630 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce7200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce00ca880 con 0x7f4ce0159320 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce7200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce00cab60 con 0x7f4ce015ca20 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce5400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ce015ca20 0x7f4ce00cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce6800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4ce0071630 0x7f4ce00cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42186/0 (socket says 172.21.15.16:42186) 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.178+0000 7f4ce6800640 1 -- 172.21.15.16:0/1471750183 learned_addr learned my addr 172.21.15.16:0/1471750183 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce5400640 1 -- 172.21.15.16:0/1471750183 >> v1:172.21.15.192:6789/0 conn(0x7f4ce0159320 legacy=0x7f4ce015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce5400640 1 -- 172.21.15.16:0/1471750183 >> v1:172.21.15.16:6789/0 conn(0x7f4ce0071630 legacy=0x7f4ce00cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce5400640 1 -- 172.21.15.16:0/1471750183 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce0159700 con 0x7f4ce015ca20 2024-04-26T20:14:47.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce4a00640 1 -- 172.21.15.16:0/1471750183 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232643415 0 0) 0x7f4ce00ca5a0 con 0x7f4ce0071630 2024-04-26T20:14:47.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce5400640 1 --2- 172.21.15.16:0/1471750183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce015ca20 0x7f4ce00cf220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00097c0 tx=0x7f4cd001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fb0b23c947161a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce4a00640 1 -- 172.21.15.16:0/1471750183 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00b1070 con 0x7f4ce015ca20 2024-04-26T20:14:47.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce4a00640 1 -- 172.21.15.16:0/1471750183 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd00ac410 con 0x7f4ce015ca20 2024-04-26T20:14:47.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.182+0000 7f4ce4a00640 1 -- 172.21.15.16:0/1471750183 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00ac7e0 con 0x7f4ce015ca20 2024-04-26T20:14:47.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 -- 172.21.15.16:0/1471750183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce015ca20 msgr2=0x7f4ce00cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 --2- 172.21.15.16:0/1471750183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce015ca20 0x7f4ce00cf220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00097c0 tx=0x7f4cd001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 -- 172.21.15.16:0/1471750183 shutdown_connections 2024-04-26T20:14:47.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 --2- 172.21.15.16:0/1471750183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce015ca20 0x7f4ce00cf220 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 -- 172.21.15.16:0/1471750183 >> 172.21.15.16:0/1471750183 conn(0x7f4ce006c980 msgr2=0x7f4ce0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:47.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 -- 172.21.15.16:0/1471750183 shutdown_connections 2024-04-26T20:14:47.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 -- 172.21.15.16:0/1471750183 wait complete. 2024-04-26T20:14:47.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 Processor -- start 2024-04-26T20:14:47.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.186+0000 7f4ce7200640 1 -- start start 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce0071630 0x7f4ce01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce0159320 0x7f4ce0155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce015ca20 0x7f4ce0156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce0169f70 con 0x7f4ce0071630 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce0169df0 con 0x7f4ce015ca20 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce016a0f0 con 0x7f4ce0159320 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce0071630 0x7f4ce01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce0071630 0x7f4ce01519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39878/0 (socket says 172.21.15.16:39878) 2024-04-26T20:14:47.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 -- 172.21.15.16:0/3565383118 learned_addr learned my addr 172.21.15.16:0/3565383118 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5400640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce0159320 0x7f4ce0155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce6800640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce015ca20 0x7f4ce0156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 -- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce0159320 msgr2=0x7f4ce0155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce0159320 0x7f4ce0155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 -- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce015ca20 msgr2=0x7f4ce0156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce015ca20 0x7f4ce0156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 -- 172.21.15.16:0/3565383118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce01f5410 con 0x7f4ce0071630 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce6800640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce015ca20 0x7f4ce0156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:47.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce5e00640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce0071630 0x7f4ce01519e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c3c0 tx=0x7f4cd400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4cda000640 1 -- 172.21.15.16:0/3565383118 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4017070 con 0x7f4ce0071630 2024-04-26T20:14:47.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4cda000640 1 -- 172.21.15.16:0/3565383118 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd40052d0 con 0x7f4ce0071630 2024-04-26T20:14:47.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4cda000640 1 -- 172.21.15.16:0/3565383118 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4003840 con 0x7f4ce0071630 2024-04-26T20:14:47.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce01f5130 con 0x7f4ce0071630 2024-04-26T20:14:47.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce0156290 con 0x7f4ce0071630 2024-04-26T20:14:47.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.190+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce00506d0 con 0x7f4ce0071630 2024-04-26T20:14:47.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.194+0000 7f4cda000640 1 -- 172.21.15.16:0/3565383118 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cd401a070 con 0x7f4ce0071630 2024-04-26T20:14:47.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.194+0000 7f4cda000640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4cc4068400 0x7f4cc406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.194+0000 7f4cda000640 1 -- 172.21.15.16:0/3565383118 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4cd4085fe0 con 0x7f4ce0071630 2024-04-26T20:14:47.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.194+0000 7f4ce5400640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4cc4068400 0x7f4cc406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.194+0000 7f4ce5400640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4cc4068400 0x7f4cc406a8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00ae000 tx=0x7f4cd00a6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.198+0000 7f4cda000640 1 -- 172.21.15.16:0/3565383118 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4cd4005480 con 0x7f4ce0071630 2024-04-26T20:14:47.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.362+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4ce0071410 con 0x7f4ce0071630 2024-04-26T20:14:47.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.362+0000 7f4cda000640 1 -- 172.21.15.16:0/3565383118 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f4cd4055bf0 con 0x7f4ce0071630 2024-04-26T20:14:47.367 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4cc4068400 msgr2=0x7f4cc406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4cc4068400 0x7f4cc406a8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00ae000 tx=0x7f4cd00a6040 comp rx=0 tx=0).stop 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce0071630 msgr2=0x7f4ce01519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce0071630 0x7f4ce01519e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400c3c0 tx=0x7f4cd400c880 comp rx=0 tx=0).stop 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 shutdown_connections 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4cc4068400 0x7f4cc406a8c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ce015ca20 0x7f4ce0156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ce0159320 0x7f4ce0155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 --2- 172.21.15.16:0/3565383118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce0071630 0x7f4ce01519e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 >> 172.21.15.16:0/3565383118 conn(0x7f4ce006c980 msgr2=0x7f4ce015c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 shutdown_connections 2024-04-26T20:14:47.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.366+0000 7f4ce7200640 1 -- 172.21.15.16:0/3565383118 wait complete. 2024-04-26T20:14:47.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:14:47.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.526+0000 7f79e9800640 1 Processor -- start 2024-04-26T20:14:47.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.526+0000 7f79e9800640 1 -- start start 2024-04-26T20:14:47.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e9800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f79e40c44a0 0x7f79e415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e9800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79e40c9e80 0x7f79e415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e9800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e40c49e0 con 0x7f79e4157250 2024-04-26T20:14:47.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e9800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f79e40cbb50 con 0x7f79e40c9e80 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e9800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f79e40caf80 con 0x7f79e40c44a0 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79e40c9e80 0x7f79e415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79e40c9e80 0x7f79e415d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39892/0 (socket says 172.21.15.16:39892) 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e3400640 1 -- 172.21.15.16:0/3530072907 learned_addr learned my addr 172.21.15.16:0/3530072907 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79da000640 1 --2- 172.21.15.16:0/3530072907 >> v2:172.21.15.192:3300/0 conn(0x7f79e40c44a0 0x7f79e415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e3400640 1 -- 172.21.15.16:0/3530072907 >> v2:172.21.15.192:3300/0 conn(0x7f79e40c44a0 msgr2=0x7f79e415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e3400640 1 --2- 172.21.15.16:0/3530072907 >> v2:172.21.15.192:3300/0 conn(0x7f79e40c44a0 0x7f79e415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e3400640 1 -- 172.21.15.16:0/3530072907 >> v1:172.21.15.192:6789/0 conn(0x7f79e4157250 legacy=0x7f79e406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.530+0000 7f79e3400640 1 -- 172.21.15.16:0/3530072907 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e40c6450 con 0x7f79e40c9e80 2024-04-26T20:14:47.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e3400640 1 --2- 172.21.15.16:0/3530072907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e415d6d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f79e40c4bb0 tx=0x7f79dc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb14bb158fd8002 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e2000640 1 -- 172.21.15.16:0/3530072907 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0a5730 con 0x7f79e40c9e80 2024-04-26T20:14:47.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e2000640 1 -- 172.21.15.16:0/3530072907 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc0a58d0 con 0x7f79e40c9e80 2024-04-26T20:14:47.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e2000640 1 -- 172.21.15.16:0/3530072907 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0a5ca0 con 0x7f79e40c9e80 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- 172.21.15.16:0/3530072907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 msgr2=0x7f79e415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 --2- 172.21.15.16:0/3530072907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e415d6d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f79e40c4bb0 tx=0x7f79dc01c960 comp rx=0 tx=0).stop 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- 172.21.15.16:0/3530072907 shutdown_connections 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 --2- 172.21.15.16:0/3530072907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e415d6d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 --2- 172.21.15.16:0/3530072907 >> v2:172.21.15.192:3300/0 conn(0x7f79e40c44a0 0x7f79e415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- 172.21.15.16:0/3530072907 >> 172.21.15.16:0/3530072907 conn(0x7f79e4068140 msgr2=0x7f79e4068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- 172.21.15.16:0/3530072907 shutdown_connections 2024-04-26T20:14:47.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- 172.21.15.16:0/3530072907 wait complete. 2024-04-26T20:14:47.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 Processor -- start 2024-04-26T20:14:47.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- start start 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79e40c44a0 0x7f79e4142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79e4157250 0x7f79e40c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79e40b26c0 con 0x7f79e40c9e80 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4157630 con 0x7f79e4157250 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.534+0000 7f79e9800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f79e40b2840 con 0x7f79e40c44a0 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e40c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39902/0 (socket says 172.21.15.16:39902) 2024-04-26T20:14:47.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 -- 172.21.15.16:0/1475789544 learned_addr learned my addr 172.21.15.16:0/1475789544 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79e2a00640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79e40c44a0 0x7f79e4142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79e3400640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79e4157250 0x7f79e40c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 -- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79e40c44a0 msgr2=0x7f79e4142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79e40c44a0 0x7f79e4142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 -- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79e4157250 msgr2=0x7f79e40c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79e4157250 0x7f79e40c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 -- 172.21.15.16:0/1475789544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e41581c0 con 0x7f79e40c9e80 2024-04-26T20:14:47.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79da000640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e40c7f40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9b0 tx=0x7f79cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79db400640 1 -- 172.21.15.16:0/1475789544 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc017070 con 0x7f79e40c9e80 2024-04-26T20:14:47.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79db400640 1 -- 172.21.15.16:0/1475789544 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79cc00c9a0 con 0x7f79e40c9e80 2024-04-26T20:14:47.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79db400640 1 -- 172.21.15.16:0/1475789544 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00cd70 con 0x7f79e40c9e80 2024-04-26T20:14:47.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e414b080 con 0x7f79e40c9e80 2024-04-26T20:14:47.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e4157dc0 con 0x7f79e40c9e80 2024-04-26T20:14:47.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e4077c20 con 0x7f79e40c9e80 2024-04-26T20:14:47.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.538+0000 7f79db400640 1 -- 172.21.15.16:0/1475789544 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79cc01a070 con 0x7f79e40c9e80 2024-04-26T20:14:47.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.542+0000 7f79db400640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f79c0068380 0x7f79c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.542+0000 7f79db400640 1 -- 172.21.15.16:0/1475789544 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f79cc086fc0 con 0x7f79e40c9e80 2024-04-26T20:14:47.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.542+0000 7f79e2a00640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f79c0068380 0x7f79c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.542+0000 7f79e2a00640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f79c0068380 0x7f79c006a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001770 tx=0x7f79d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.546+0000 7f79db400640 1 -- 172.21.15.16:0/1475789544 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f79e41581c0 con 0x7f79e40c9e80 2024-04-26T20:14:47.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.706+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f79e40c8480 con 0x7f79e40c9e80 2024-04-26T20:14:47.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.706+0000 7f79db400640 1 -- 172.21.15.16:0/1475789544 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f79cc056be0 con 0x7f79e40c9e80 2024-04-26T20:14:47.712 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f79c0068380 msgr2=0x7f79c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f79c0068380 0x7f79c006a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f79d4001770 tx=0x7f79d4009040 comp rx=0 tx=0).stop 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 msgr2=0x7f79e40c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e40c7f40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9b0 tx=0x7f79cc00ee70 comp rx=0 tx=0).stop 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 shutdown_connections 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f79c0068380 0x7f79c006a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79e4157250 0x7f79e40c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79e40c9e80 0x7f79e40c7f40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 --2- 172.21.15.16:0/1475789544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79e40c44a0 0x7f79e4142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 >> 172.21.15.16:0/1475789544 conn(0x7f79e4068140 msgr2=0x7f79e40b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:47.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 shutdown_connections 2024-04-26T20:14:47.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.710+0000 7f79e9800640 1 -- 172.21.15.16:0/1475789544 wait complete. 2024-04-26T20:14:47.734 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:47.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce9ba00640 1 Processor -- start 2024-04-26T20:14:47.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce9ba00640 1 -- start start 2024-04-26T20:14:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce9ba00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fce94155e20 0x7fce9406c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce9ba00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fce94156200 0x7fce94074040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce9ba00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9415be00 con 0x7fce940ce430 2024-04-26T20:14:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce9ba00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fce9415c9d0 con 0x7fce94156200 2024-04-26T20:14:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce9ba00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fce9415c0a0 con 0x7fce94155e20 2024-04-26T20:14:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fce94156200 0x7fce94074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fce94156200 0x7fce94074040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39904/0 (socket says 172.21.15.16:39904) 2024-04-26T20:14:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93e00640 1 -- 172.21.15.16:0/1059221735 learned_addr learned my addr 172.21.15.16:0/1059221735 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce99a00640 1 --1- 172.21.15.16:0/1059221735 >> v1:172.21.15.16:6789/0 conn(0x7fce940ce430 0x7fce940caf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42194/0 (socket says 172.21.15.16:42194) 2024-04-26T20:14:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce99000640 1 --2- 172.21.15.16:0/1059221735 >> v2:172.21.15.192:3300/0 conn(0x7fce94155e20 0x7fce9406c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93e00640 1 -- 172.21.15.16:0/1059221735 >> v2:172.21.15.192:3300/0 conn(0x7fce94155e20 msgr2=0x7fce9406c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93e00640 1 --2- 172.21.15.16:0/1059221735 >> v2:172.21.15.192:3300/0 conn(0x7fce94155e20 0x7fce9406c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93e00640 1 -- 172.21.15.16:0/1059221735 >> v1:172.21.15.16:6789/0 conn(0x7fce940ce430 legacy=0x7fce940caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93400640 1 -- 172.21.15.16:0/1059221735 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994346874 0 0) 0x7fce9415be00 con 0x7fce940ce430 2024-04-26T20:14:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.870+0000 7fce93e00640 1 -- 172.21.15.16:0/1059221735 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9415c380 con 0x7fce94156200 2024-04-26T20:14:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.874+0000 7fce93e00640 1 --2- 172.21.15.16:0/1059221735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94156200 0x7fce94074040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fce9406e200 tx=0x7fce8001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567f595c2b9cb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.874+0000 7fce93400640 1 -- 172.21.15.16:0/1059221735 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce800b5070 con 0x7fce94156200 2024-04-26T20:14:47.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.874+0000 7fce93400640 1 -- 172.21.15.16:0/1059221735 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce800a8a10 con 0x7fce94156200 2024-04-26T20:14:47.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.874+0000 7fce93400640 1 -- 172.21.15.16:0/1059221735 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce800a8de0 con 0x7fce94156200 2024-04-26T20:14:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- 172.21.15.16:0/1059221735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94156200 msgr2=0x7fce94074040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1059221735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94156200 0x7fce94074040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fce9406e200 tx=0x7fce8001ed10 comp rx=0 tx=0).stop 2024-04-26T20:14:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- 172.21.15.16:0/1059221735 shutdown_connections 2024-04-26T20:14:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1059221735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94156200 0x7fce94074040 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1059221735 >> v2:172.21.15.192:3300/0 conn(0x7fce94155e20 0x7fce9406c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- 172.21.15.16:0/1059221735 >> 172.21.15.16:0/1059221735 conn(0x7fce9406d490 msgr2=0x7fce9406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:47.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- 172.21.15.16:0/1059221735 shutdown_connections 2024-04-26T20:14:47.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- 172.21.15.16:0/1059221735 wait complete. 2024-04-26T20:14:47.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 Processor -- start 2024-04-26T20:14:47.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- start start 2024-04-26T20:14:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce940ce430 0x7fce941f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94155e20 0x7fce94157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce94156200 0x7fce94153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fce94074580 con 0x7fce94155e20 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce9406cef0 con 0x7fce940ce430 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce9ba00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fce94074700 con 0x7fce94156200 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94155e20 0x7fce94157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94155e20 0x7fce94157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39918/0 (socket says 172.21.15.16:39918) 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 -- 172.21.15.16:0/1181565268 learned_addr learned my addr 172.21.15.16:0/1181565268 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce99a00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce94156200 0x7fce94153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce99000640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce940ce430 0x7fce941f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 -- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce94156200 msgr2=0x7fce94153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce94156200 0x7fce94153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 -- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce940ce430 msgr2=0x7fce941f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce940ce430 0x7fce941f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 -- 172.21.15.16:0/1181565268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce941e8830 con 0x7fce94155e20 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce99a00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce94156200 0x7fce94153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.878+0000 7fce93e00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94155e20 0x7fce94157560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce8001b920 tx=0x7fce8001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce90c00640 1 -- 172.21.15.16:0/1181565268 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce800b5070 con 0x7fce94155e20 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce90c00640 1 -- 172.21.15.16:0/1181565268 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce800b0ab0 con 0x7fce94155e20 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce90c00640 1 -- 172.21.15.16:0/1181565268 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce800bb410 con 0x7fce94155e20 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce94159bf0 con 0x7fce94155e20 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce94157aa0 con 0x7fce94155e20 2024-04-26T20:14:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9415a110 con 0x7fce94155e20 2024-04-26T20:14:47.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce90c00640 1 -- 172.21.15.16:0/1181565268 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce800c2060 con 0x7fce94155e20 2024-04-26T20:14:47.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce90c00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fce74068380 0x7fce7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:47.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.882+0000 7fce90c00640 1 -- 172.21.15.16:0/1181565268 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fce801242f0 con 0x7fce94155e20 2024-04-26T20:14:47.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.886+0000 7fce99000640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fce74068380 0x7fce7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:47.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.886+0000 7fce99000640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fce74068380 0x7fce7406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce88009af0 tx=0x7fce88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:47.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:47.886+0000 7fce90c00640 1 -- 172.21.15.16:0/1181565268 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fce9415a110 con 0x7fce94155e20 2024-04-26T20:14:48.054 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-26T20:14:48.050+0000 7f31e9800640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T20:14:48.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.086+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce94077c20 con 0x7fce94155e20 2024-04-26T20:14:48.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.086+0000 7fce90c00640 1 -- 172.21.15.16:0/1181565268 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fce80018870 con 0x7fce94155e20 2024-04-26T20:14:48.093 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:48.093 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:14:48.093 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:14:48.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fce74068380 msgr2=0x7fce7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fce74068380 0x7fce7406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce88009af0 tx=0x7fce88008040 comp rx=0 tx=0).stop 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94155e20 msgr2=0x7fce94157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94155e20 0x7fce94157560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fce8001b920 tx=0x7fce8001bab0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 shutdown_connections 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fce74068380 0x7fce7406a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce94156200 0x7fce94153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce94155e20 0x7fce94157560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 --2- 172.21.15.16:0/1181565268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce940ce430 0x7fce941f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 >> 172.21.15.16:0/1181565268 conn(0x7fce9406d490 msgr2=0x7fce94075a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 shutdown_connections 2024-04-26T20:14:48.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.090+0000 7fce9ba00640 1 -- 172.21.15.16:0/1181565268 wait complete. 2024-04-26T20:14:48.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.250+0000 7fbf0c800640 1 Processor -- start 2024-04-26T20:14:48.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.250+0000 7fbf0c800640 1 -- start start 2024-04-26T20:14:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.250+0000 7fbf0c800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbf041574b0 0x7fbf040ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.250+0000 7fbf0c800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040b47e0 0x7fbf0406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.250+0000 7fbf0c800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf040cb7f0 con 0x7fbf040c63f0 2024-04-26T20:14:48.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.250+0000 7fbf0c800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbf040c9e80 con 0x7fbf041574b0 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.250+0000 7fbf0c800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbf040ca0d0 con 0x7fbf040b47e0 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbf041574b0 0x7fbf040ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbf041574b0 0x7fbf040ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39920/0 (socket says 172.21.15.16:39920) 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 -- 172.21.15.16:0/4026626981 learned_addr learned my addr 172.21.15.16:0/4026626981 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09400640 1 --2- 172.21.15.16:0/4026626981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040b47e0 0x7fbf0406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 -- 172.21.15.16:0/4026626981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040b47e0 msgr2=0x7fbf0406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 --2- 172.21.15.16:0/4026626981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040b47e0 0x7fbf0406feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 -- 172.21.15.16:0/4026626981 >> v1:172.21.15.192:6789/0 conn(0x7fbf040c63f0 legacy=0x7fbf040cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 -- 172.21.15.16:0/4026626981 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf040cba90 con 0x7fbf041574b0 2024-04-26T20:14:48.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf09e00640 1 --2- 172.21.15.16:0/4026626981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041574b0 0x7fbf040ca730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009870 tx=0x7fbef801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2ebfbf87a5390c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:48.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf08a00640 1 -- 172.21.15.16:0/4026626981 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80ab650 con 0x7fbf041574b0 2024-04-26T20:14:48.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf08a00640 1 -- 172.21.15.16:0/4026626981 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef80b0070 con 0x7fbf041574b0 2024-04-26T20:14:48.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.254+0000 7fbf08a00640 1 -- 172.21.15.16:0/4026626981 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80aba10 con 0x7fbf041574b0 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- 172.21.15.16:0/4026626981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041574b0 msgr2=0x7fbf040ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 --2- 172.21.15.16:0/4026626981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041574b0 0x7fbf040ca730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009870 tx=0x7fbef801c560 comp rx=0 tx=0).stop 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- 172.21.15.16:0/4026626981 shutdown_connections 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 --2- 172.21.15.16:0/4026626981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040b47e0 0x7fbf0406feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 --2- 172.21.15.16:0/4026626981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041574b0 0x7fbf040ca730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- 172.21.15.16:0/4026626981 >> 172.21.15.16:0/4026626981 conn(0x7fbf04071160 msgr2=0x7fbf04068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- 172.21.15.16:0/4026626981 shutdown_connections 2024-04-26T20:14:48.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- 172.21.15.16:0/4026626981 wait complete. 2024-04-26T20:14:48.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 Processor -- start 2024-04-26T20:14:48.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- start start 2024-04-26T20:14:48.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf040b47e0 0x7fbf040b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040c63f0 0x7fbf040cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf041574b0 0x7fbf041f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbf040703f0 con 0x7fbf040b47e0 2024-04-26T20:14:48.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf040ccc90 con 0x7fbf041574b0 2024-04-26T20:14:48.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0c800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbf04070570 con 0x7fbf040c63f0 2024-04-26T20:14:48.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf040b47e0 0x7fbf040b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf040b47e0 0x7fbf040b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39930/0 (socket says 172.21.15.16:39930) 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 -- 172.21.15.16:0/2299746631 learned_addr learned my addr 172.21.15.16:0/2299746631 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09400640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040c63f0 0x7fbf040cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf0a800640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf041574b0 0x7fbf041f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 -- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040c63f0 msgr2=0x7fbf040cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040c63f0 0x7fbf040cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 -- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf041574b0 msgr2=0x7fbf041f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf041574b0 0x7fbf041f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.258+0000 7fbf09e00640 1 -- 172.21.15.16:0/2299746631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0414ddf0 con 0x7fbf040b47e0 2024-04-26T20:14:48.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbf09e00640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf040b47e0 0x7fbf040b07b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbef80ad040 tx=0x7fbef801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbefe000640 1 -- 172.21.15.16:0/2299746631 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80be5f0 con 0x7fbf040b47e0 2024-04-26T20:14:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbefe000640 1 -- 172.21.15.16:0/2299746631 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef80be790 con 0x7fbf040b47e0 2024-04-26T20:14:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf04147780 con 0x7fbf040b47e0 2024-04-26T20:14:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbefe000640 1 -- 172.21.15.16:0/2299746631 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80beb80 con 0x7fbf040b47e0 2024-04-26T20:14:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf04146120 con 0x7fbf040b47e0 2024-04-26T20:14:48.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf04077c20 con 0x7fbf040b47e0 2024-04-26T20:14:48.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbefe000640 1 -- 172.21.15.16:0/2299746631 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbef80b43f0 con 0x7fbf040b47e0 2024-04-26T20:14:48.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbefe000640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbee8068380 0x7fbee806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.262+0000 7fbefe000640 1 -- 172.21.15.16:0/2299746631 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbef8121c70 con 0x7fbf040b47e0 2024-04-26T20:14:48.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.266+0000 7fbf09400640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbee8068380 0x7fbee806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.266+0000 7fbf09400640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbee8068380 0x7fbee806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf04147d90 tx=0x7fbef4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:48.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.266+0000 7fbefe000640 1 -- 172.21.15.16:0/2299746631 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbef80c4060 con 0x7fbf040b47e0 2024-04-26T20:14:48.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.430+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf040ca900 con 0x7fbf040b47e0 2024-04-26T20:14:48.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbefe000640 1 -- 172.21.15.16:0/2299746631 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fbef8016150 con 0x7fbf040b47e0 2024-04-26T20:14:48.439 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:48.439 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbee8068380 msgr2=0x7fbee806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbee8068380 0x7fbee806a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf04147d90 tx=0x7fbef4009190 comp rx=0 tx=0).stop 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf040b47e0 msgr2=0x7fbf040b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf040b47e0 0x7fbf040b07b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbef80ad040 tx=0x7fbef801ada0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 shutdown_connections 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbee8068380 0x7fbee806a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf041574b0 0x7fbf041f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf040c63f0 0x7fbf040cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 --2- 172.21.15.16:0/2299746631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf040b47e0 0x7fbf040b07b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 >> 172.21.15.16:0/2299746631 conn(0x7fbf04071160 msgr2=0x7fbf040cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:48.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 shutdown_connections 2024-04-26T20:14:48.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.434+0000 7fbf0c800640 1 -- 172.21.15.16:0/2299746631 wait complete. 2024-04-26T20:14:48.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:48.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.594+0000 7fb3f8c00640 1 Processor -- start 2024-04-26T20:14:48.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.594+0000 7fb3f8c00640 1 -- start start 2024-04-26T20:14:48.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f8c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f4155ee0 0x7fb3f415c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f8c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f40cb3e0 con 0x7fb3f40ccb10 2024-04-26T20:14:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f8c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f40cbc60 con 0x7fb3f4155b00 2024-04-26T20:14:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f8c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f40cb6a0 con 0x7fb3f4155ee0 2024-04-26T20:14:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f3e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb3f40ccb10 0x7fb3f4166400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42200/0 (socket says 172.21.15.16:42200) 2024-04-26T20:14:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f3e00640 1 -- 172.21.15.16:0/1904697450 learned_addr learned my addr 172.21.15.16:0/1904697450 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:48.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3eaa00640 1 --2- 172.21.15.16:0/1904697450 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f4155ee0 0x7fb3f415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f2a00640 1 -- 172.21.15.16:0/1904697450 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709578028 0 0) 0x7fb3f40cb3e0 con 0x7fb3f40ccb10 2024-04-26T20:14:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f2a00640 1 -- 172.21.15.16:0/1904697450 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3d8003530 con 0x7fb3f40ccb10 2024-04-26T20:14:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f2a00640 1 -- 172.21.15.16:0/1904697450 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835657024 0 0) 0x7fb3f40cbc60 con 0x7fb3f4155b00 2024-04-26T20:14:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3f2a00640 1 -- 172.21.15.16:0/1904697450 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3f40cb3e0 con 0x7fb3f4155b00 2024-04-26T20:14:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3eaa00640 1 -- 172.21.15.16:0/1904697450 >> v1:172.21.15.192:6789/0 conn(0x7fb3f4155b00 legacy=0x7fb3f406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3eaa00640 1 -- 172.21.15.16:0/1904697450 >> v1:172.21.15.16:6789/0 conn(0x7fb3f40ccb10 legacy=0x7fb3f4166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.598+0000 7fb3eaa00640 1 -- 172.21.15.16:0/1904697450 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f40cb980 con 0x7fb3f4155ee0 2024-04-26T20:14:48.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3eaa00640 1 --2- 172.21.15.16:0/1904697450 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f4155ee0 0x7fb3f415c690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009dc0 tx=0x7fb3dc01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c2f84d2d6d3305 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:48.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f2a00640 1 -- 172.21.15.16:0/1904697450 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b4070 con 0x7fb3f4155ee0 2024-04-26T20:14:48.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f2a00640 1 -- 172.21.15.16:0/1904697450 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0af600 con 0x7fb3f4155ee0 2024-04-26T20:14:48.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f2a00640 1 -- 172.21.15.16:0/1904697450 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0af9b0 con 0x7fb3f4155ee0 2024-04-26T20:14:48.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f8c00640 1 -- 172.21.15.16:0/1904697450 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f4155ee0 msgr2=0x7fb3f415c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/1904697450 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f4155ee0 0x7fb3f415c690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009dc0 tx=0x7fb3dc01f170 comp rx=0 tx=0).stop 2024-04-26T20:14:48.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f8c00640 1 -- 172.21.15.16:0/1904697450 shutdown_connections 2024-04-26T20:14:48.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/1904697450 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f4155ee0 0x7fb3f415c690 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f8c00640 1 -- 172.21.15.16:0/1904697450 >> 172.21.15.16:0/1904697450 conn(0x7fb3f4068140 msgr2=0x7fb3f4068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:48.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f8c00640 1 -- 172.21.15.16:0/1904697450 shutdown_connections 2024-04-26T20:14:48.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.602+0000 7fb3f8c00640 1 -- 172.21.15.16:0/1904697450 wait complete. 2024-04-26T20:14:48.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 Processor -- start 2024-04-26T20:14:48.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 -- start start 2024-04-26T20:14:48.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40ccb10 0x7fb3f40c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f4155b00 0x7fb3f4158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3f4155ee0 0x7fb3f4158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f415c170 con 0x7fb3f4155ee0 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f415be90 con 0x7fb3f4155b00 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f40cb060 con 0x7fb3f40ccb10 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3f4155ee0 0x7fb3f4158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3f4155ee0 0x7fb3f4158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39938/0 (socket says 172.21.15.16:39938) 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 -- 172.21.15.16:0/3416346475 learned_addr learned my addr 172.21.15.16:0/3416346475 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3400640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40ccb10 0x7fb3f40c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3eaa00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f4155b00 0x7fb3f4158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 -- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40ccb10 msgr2=0x7fb3f40c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40ccb10 0x7fb3f40c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 -- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f4155b00 msgr2=0x7fb3f4158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f4155b00 0x7fb3f4158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 -- 172.21.15.16:0/3416346475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f41f2750 con 0x7fb3f4155ee0 2024-04-26T20:14:48.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f3e00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3f4155ee0 0x7fb3f4158ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00c3c0 tx=0x7fb3ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:48.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3ebe00640 1 -- 172.21.15.16:0/3416346475 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec017070 con 0x7fb3f4155ee0 2024-04-26T20:14:48.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3ebe00640 1 -- 172.21.15.16:0/3416346475 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ec005db0 con 0x7fb3f4155ee0 2024-04-26T20:14:48.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f4157fd0 con 0x7fb3f4155ee0 2024-04-26T20:14:48.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3ebe00640 1 -- 172.21.15.16:0/3416346475 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec007310 con 0x7fb3f4155ee0 2024-04-26T20:14:48.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f4158590 con 0x7fb3f4155ee0 2024-04-26T20:14:48.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.606+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f4158790 con 0x7fb3f4155ee0 2024-04-26T20:14:48.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.610+0000 7fb3ebe00640 1 -- 172.21.15.16:0/3416346475 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3ec01a070 con 0x7fb3f4155ee0 2024-04-26T20:14:48.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.610+0000 7fb3ebe00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3d0068380 0x7fb3d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:48.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.610+0000 7fb3ebe00640 1 -- 172.21.15.16:0/3416346475 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb3ec086190 con 0x7fb3f4155ee0 2024-04-26T20:14:48.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.610+0000 7fb3f3400640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3d0068380 0x7fb3d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:48.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.610+0000 7fb3f3400640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3d0068380 0x7fb3d006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40011f0 tx=0x7fb3e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:48.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.618+0000 7fb3ebe00640 1 -- 172.21.15.16:0/3416346475 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb3ec055c10 con 0x7fb3f4155ee0 2024-04-26T20:14:48.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.814+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3f40506d0 con 0x7fb3f4155ee0 2024-04-26T20:14:48.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.814+0000 7fb3ebe00640 1 -- 172.21.15.16:0/3416346475 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7fb3ec059f10 con 0x7fb3f4155ee0 2024-04-26T20:14:48.821 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:48.821 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:14:48.822 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:14:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3d0068380 msgr2=0x7fb3d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3d0068380 0x7fb3d006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40011f0 tx=0x7fb3e4009040 comp rx=0 tx=0).stop 2024-04-26T20:14:48.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3f4155ee0 msgr2=0x7fb3f4158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3f4155ee0 0x7fb3f4158ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00c3c0 tx=0x7fb3ec00c880 comp rx=0 tx=0).stop 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 shutdown_connections 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3d0068380 0x7fb3d006a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3f4155ee0 0x7fb3f4158ff0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f4155b00 0x7fb3f4158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 --2- 172.21.15.16:0/3416346475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40ccb10 0x7fb3f40c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 >> 172.21.15.16:0/3416346475 conn(0x7fb3f4068140 msgr2=0x7fb3f406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 shutdown_connections 2024-04-26T20:14:48.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:48.818+0000 7fb3f8c00640 1 -- 172.21.15.16:0/3416346475 wait complete. 2024-04-26T20:14:49.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T20:14:13.851430+0000', 'modified': '2024-04-26T20:14:47.129019+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4279, 'mds_1': 4276, 'mds_2': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.16:6833/3670477050', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 3670477050}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 3670477050}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.16:6836/1882507975', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6834', 'nonce': 1882507975}, {'type': 'v1', 'addr': '172.21.15.16:6836', 'nonce': 1882507975}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4279': {'gid': 4279, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.16:6837/1962586875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6835', 'nonce': 1962586875}, {'type': 'v1', 'addr': '172.21.15.16:6837', 'nonce': 1962586875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4267, 4276, 4279]} 2024-04-26T20:14:49.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T20:14:49.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T20:14:49.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6123e00640 1 Processor -- start 2024-04-26T20:14:49.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6123e00640 1 -- start start 2024-04-26T20:14:49.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6123e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f611c157250 0x7f611c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6123e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f611c15d8a0 0x7f611c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6123e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f611c0c49e0 con 0x7f611c0c44a0 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6123e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f611c0cbb50 con 0x7f611c15d8a0 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6123e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f611c0caf80 con 0x7f611c157250 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6120a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f611c0c44a0 0x7f611c15d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42212/0 (socket says 172.21.15.16:42212) 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6120a00640 1 -- 172.21.15.16:0/1505905702 learned_addr learned my addr 172.21.15.16:0/1505905702 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6121e00640 1 --2- 172.21.15.16:0/1505905702 >> v2:172.21.15.16:3300/0 conn(0x7f611c15d8a0 0x7f611c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6121400640 1 --2- 172.21.15.16:0/1505905702 >> v2:172.21.15.192:3300/0 conn(0x7f611c157250 0x7f611c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6121e00640 1 -- 172.21.15.16:0/1505905702 >> v2:172.21.15.192:3300/0 conn(0x7f611c157250 msgr2=0x7f611c06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6121e00640 1 --2- 172.21.15.16:0/1505905702 >> v2:172.21.15.192:3300/0 conn(0x7f611c157250 0x7f611c06ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6121e00640 1 -- 172.21.15.16:0/1505905702 >> v1:172.21.15.16:6789/0 conn(0x7f611c0c44a0 legacy=0x7f611c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f6121e00640 1 -- 172.21.15.16:0/1505905702 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c0c6450 con 0x7f611c15d8a0 2024-04-26T20:14:49.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.582+0000 7f611be00640 1 -- 172.21.15.16:0/1505905702 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92741463 0 0) 0x7f611c0c49e0 con 0x7f611c0c44a0 2024-04-26T20:14:49.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6121e00640 1 --2- 172.21.15.16:0/1505905702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c15d8a0 0x7f611c070440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f611c0c4bb0 tx=0x7f611401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a589bb8fd4cd5cf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:49.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f611be00640 1 -- 172.21.15.16:0/1505905702 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140b2070 con 0x7f611c15d8a0 2024-04-26T20:14:49.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f611be00640 1 -- 172.21.15.16:0/1505905702 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61140a5850 con 0x7f611c15d8a0 2024-04-26T20:14:49.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f611be00640 1 -- 172.21.15.16:0/1505905702 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140a5c20 con 0x7f611c15d8a0 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 -- 172.21.15.16:0/1505905702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c15d8a0 msgr2=0x7f611c070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 --2- 172.21.15.16:0/1505905702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c15d8a0 0x7f611c070440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f611c0c4bb0 tx=0x7f611401c8a0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 -- 172.21.15.16:0/1505905702 shutdown_connections 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 --2- 172.21.15.16:0/1505905702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c15d8a0 0x7f611c070440 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 --2- 172.21.15.16:0/1505905702 >> v2:172.21.15.192:3300/0 conn(0x7f611c157250 0x7f611c06ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 -- 172.21.15.16:0/1505905702 >> 172.21.15.16:0/1505905702 conn(0x7f611c068140 msgr2=0x7f611c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 -- 172.21.15.16:0/1505905702 shutdown_connections 2024-04-26T20:14:49.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.586+0000 7f6123e00640 1 -- 172.21.15.16:0/1505905702 wait complete. 2024-04-26T20:14:49.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 Processor -- start 2024-04-26T20:14:49.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 -- start start 2024-04-26T20:14:49.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c0c44a0 0x7f611c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f611c157250 0x7f611c06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611c15d8a0 0x7f611c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f611c0b26c0 con 0x7f611c0c44a0 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f611c157630 con 0x7f611c157250 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f611c0b2840 con 0x7f611c15d8a0 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c0c44a0 0x7f611c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c0c44a0 0x7f611c0cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39952/0 (socket says 172.21.15.16:39952) 2024-04-26T20:14:49.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 -- 172.21.15.16:0/713347921 learned_addr learned my addr 172.21.15.16:0/713347921 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6120a00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f611c157250 0x7f611c06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121e00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611c15d8a0 0x7f611c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 -- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611c15d8a0 msgr2=0x7f611c0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611c15d8a0 0x7f611c0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 -- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f611c157250 msgr2=0x7f611c06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f611c157250 0x7f611c06ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 -- 172.21.15.16:0/713347921 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c0c8f70 con 0x7f611c0c44a0 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6121400640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c0c44a0 0x7f611c0cf680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f611000d830 tx=0x7f611000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6119600640 1 -- 172.21.15.16:0/713347921 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611000b6c0 con 0x7f611c0c44a0 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6119600640 1 -- 172.21.15.16:0/713347921 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6110019070 con 0x7f611c0c44a0 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6119600640 1 -- 172.21.15.16:0/713347921 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611000ba60 con 0x7f611c0c44a0 2024-04-26T20:14:49.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611c06d530 con 0x7f611c0c44a0 2024-04-26T20:14:49.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.590+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611c0c8b00 con 0x7f611c0c44a0 2024-04-26T20:14:49.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.594+0000 7f6119600640 1 -- 172.21.15.16:0/713347921 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f611001e460 con 0x7f611c0c44a0 2024-04-26T20:14:49.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.594+0000 7f6119600640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60fc068380 0x7f60fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.594+0000 7f6119600640 1 -- 172.21.15.16:0/713347921 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f61100873d0 con 0x7f611c0c44a0 2024-04-26T20:14:49.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.594+0000 7f6120a00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60fc068380 0x7f60fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.594+0000 7f6120a00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60fc068380 0x7f60fc06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f611c068900 tx=0x7f6108007b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:49.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.594+0000 7f6127275000 1 Processor -- start 2024-04-26T20:14:49.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- start start 2024-04-26T20:14:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac19a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555fac054140 con 0x555fac19a940 2024-04-26T20:14:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555fabfe9e00 con 0x555fac199700 2024-04-26T20:14:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x555fabfa2a00 con 0x555fac19a020 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39960/0 (socket says 172.21.15.16:39960) 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 -- 172.21.15.16:0/1143787679 learned_addr learned my addr 172.21.15.16:0/1143787679 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121400640 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6120a00640 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 -- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 msgr2=0x555fac19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 -- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 msgr2=0x555fac199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 -- 172.21.15.16:0/1143787679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fabfa70e0 con 0x555fac19a940 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121400640 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6121e00640 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e7890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f611401cd80 tx=0x7f6114004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90a24a44db1e21c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f610e000640 1 -- 172.21.15.16:0/1143787679 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140b2040 con 0x555fac19a940 2024-04-26T20:14:49.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f610e000640 1 -- 172.21.15.16:0/1143787679 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61140a58f0 con 0x555fac19a940 2024-04-26T20:14:49.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f610e000640 1 -- 172.21.15.16:0/1143787679 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140a5ce0 con 0x555fac19a940 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- 172.21.15.16:0/1143787679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 msgr2=0x555fac1e7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e7890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f611401cd80 tx=0x7f6114004ac0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- 172.21.15.16:0/1143787679 shutdown_connections 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e7890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 --2- 172.21.15.16:0/1143787679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- 172.21.15.16:0/1143787679 >> 172.21.15.16:0/1143787679 conn(0x555fac1db5f0 msgr2=0x555fac1dd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- 172.21.15.16:0/1143787679 shutdown_connections 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.598+0000 7f6127275000 1 -- 172.21.15.16:0/1143787679 wait complete. 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 -- start start 2024-04-26T20:14:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 Processor -- start 2024-04-26T20:14:49.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1da910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555fabff7200 con 0x555fac19a940 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555fabf8de80 con 0x555fac19a020 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x555fabfe4ae0 con 0x555fac199700 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6127275000 10 client.0 _ll_register_callbacks cb 0x555fabff6da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39964/0 (socket says 172.21.15.16:39964) 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 -- 172.21.15.16:0/4108257215 learned_addr learned my addr 172.21.15.16:0/4108257215 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6120a00640 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1da910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121400640 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 -- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 msgr2=0x555fac1da3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1da3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 -- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 msgr2=0x555fac1da910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1da910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 -- 172.21.15.16:0/4108257215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fabf894e0 con 0x555fac19a940 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6121e00640 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e5c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61140194b0 tx=0x7f611401b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71f8a1f12cf9995 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.602+0000 7f6102a00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6102a00640 1 -- 172.21.15.16:0/4108257215 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140c5070 con 0x555fac19a940 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61140a58f0 con 0x555fac19a940 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6102a00640 1 -- 172.21.15.16:0/4108257215 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6114003ba0 con 0x555fac19a940 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6102a00640 1 -- 172.21.15.16:0/4108257215 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f61140d0050 con 0x555fac19a940 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 10 client.4791 fetch_fsmap learned FSMap version 14 2024-04-26T20:14:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x555fabf6fe80 con 0x555fac19a940 2024-04-26T20:14:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6102a00640 1 -- 172.21.15.16:0/4108257215 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61140a58f0 con 0x555fac19a940 2024-04-26T20:14:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6102a00640 1 -- 172.21.15.16:0/4108257215 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f61140cb730 con 0x555fac19a940 2024-04-26T20:14:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 10 client.4791 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T20:14:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 10 client.4791 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T20:14:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 20 client.4791 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1e68a0 0x555fac1e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 4 client.4791 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:14:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 --> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fabf82bc0 con 0x555fac1e68a0 2024-04-26T20:14:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6121400640 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1e68a0 0x555fac1e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6121400640 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1e68a0 0x555fac1e6c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c771d91ce90f31d server_cookie=17ba5b13387bb56 in_seq=0 out_seq=0 2024-04-26T20:14:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:49.606+0000 7f6102a00640 10 client.4791 ms_handle_connect on v2:172.21.15.16:6832/3670477050 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.138+0000 7f6102a00640 1 -- 172.21.15.16:0/4108257215 <== mds.2 v2:172.21.15.16:6832/3670477050 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555fabf82bc0 con 0x555fac1e68a0 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.138+0000 7f6102a00640 10 client.4791 handle_command_reply: tid=0 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 client.4791 shutdown 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 msgr2=0x555fac1e5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e5c80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61140194b0 tx=0x7f611401b0e0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 shutdown_connections 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1e68a0 0x555fac1e6c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1e5c80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1da910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 --2- 172.21.15.16:0/4108257215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1da3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 >> 172.21.15.16:0/4108257215 conn(0x555fac1db5f0 msgr2=0x555fac198e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6102a00640 0 client.4791 ms_handle_reset on v2:172.21.15.16:6832/3670477050 2024-04-26T20:14:52.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 shutdown_connections 2024-04-26T20:14:52.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 1 -- 172.21.15.16:0/4108257215 wait complete. 2024-04-26T20:14:52.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.142+0000 7f6127275000 20 client.4791 trim_cache size 0 max 16384 2024-04-26T20:14:52.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.158+0000 7f6127275000 1 Processor -- start 2024-04-26T20:14:52.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- start start 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac1da870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac1986f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac198c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f611c200ee0 con 0x555fac19a940 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555fabf7f7b0 con 0x555fac199700 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x555fabfe9110 con 0x555fac19a020 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39980/0 (socket says 172.21.15.16:39980) 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 -- 172.21.15.16:0/3339986298 learned_addr learned my addr 172.21.15.16:0/3339986298 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6120a00640 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac1986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121400640 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac1da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 -- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 msgr2=0x555fac1986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac1986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 -- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 msgr2=0x555fac1da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac1da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 -- 172.21.15.16:0/3339986298 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fac19f990 con 0x555fac19a940 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6121e00640 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac198c30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f611401c8e0 tx=0x7f61140b0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3e2393c02e7836 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f610d600640 1 -- 172.21.15.16:0/3339986298 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140c5040 con 0x555fac19a940 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f610d600640 1 -- 172.21.15.16:0/3339986298 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6114003be0 con 0x555fac19a940 2024-04-26T20:14:52.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f610d600640 1 -- 172.21.15.16:0/3339986298 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140b2070 con 0x555fac19a940 2024-04-26T20:14:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- 172.21.15.16:0/3339986298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 msgr2=0x555fac198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac198c30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f611401c8e0 tx=0x7f61140b0040 comp rx=0 tx=0).stop 2024-04-26T20:14:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- 172.21.15.16:0/3339986298 shutdown_connections 2024-04-26T20:14:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac198c30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac19a020 0x555fac1986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 --2- 172.21.15.16:0/3339986298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac199700 0x555fac1da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- 172.21.15.16:0/3339986298 >> 172.21.15.16:0/3339986298 conn(0x555fac1db5f0 msgr2=0x555fac1f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- 172.21.15.16:0/3339986298 shutdown_connections 2024-04-26T20:14:52.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- 172.21.15.16:0/3339986298 wait complete. 2024-04-26T20:14:52.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 -- start start 2024-04-26T20:14:52.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.162+0000 7f6127275000 1 Processor -- start 2024-04-26T20:14:52.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1eb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555fabff60a0 con 0x555fac19a940 2024-04-26T20:14:52.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555fabfee430 con 0x555fac19a020 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x555fac1a5860 con 0x555fac199700 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 10 client.0 _ll_register_callbacks cb 0x7f6114009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1eb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1eb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39994/0 (socket says 172.21.15.16:39994) 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 -- 172.21.15.16:0/2729952177 learned_addr learned my addr 172.21.15.16:0/2729952177 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6120a00640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121400640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 -- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 msgr2=0x555fac1ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1ee6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 -- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 msgr2=0x555fac1eabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1eabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 -- 172.21.15.16:0/2729952177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fabfa2c50 con 0x555fac19a940 2024-04-26T20:14:52.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6120a00640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121e00640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1eb130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f611401a4d0 tx=0x7f61140a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e38a5cd996aeaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 1 -- 172.21.15.16:0/2729952177 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61140c5070 con 0x555fac19a940 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 1 -- 172.21.15.16:0/2729952177 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f61140a5850 con 0x555fac19a940 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6114003be0 con 0x555fac19a940 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 1 -- 172.21.15.16:0/2729952177 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f61140d6e60 con 0x555fac19a940 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 10 client.4797 fetch_fsmap learned FSMap version 14 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x555fac06c160 con 0x555fac19a940 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 1 -- 172.21.15.16:0/2729952177 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6114003be0 con 0x555fac19a940 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 1 -- 172.21.15.16:0/2729952177 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f61140a5a70 con 0x555fac19a940 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 10 client.4797 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 10 client.4797 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 20 client.4797 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:52.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1eb670 0x555fac1eba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 4 client.4797 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 --> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] -- command(tid 0: {"prefix": "status"}) -- 0x555fabff7a10 con 0x555fac1eb670 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121400640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1eb670 0x555fac1eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6121400640 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1eb670 0x555fac1eba50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b6cb8e4500b1fce server_cookie=182412816fe5f859 in_seq=0 out_seq=0 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 10 client.4797 ms_handle_connect on v2:172.21.15.16:6832/3670477050 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 1 -- 172.21.15.16:0/2729952177 <== mds.2 v2:172.21.15.16:6832/3670477050 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555fabff7a10 con 0x555fac1eb670 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 10 client.4797 handle_command_reply: tid=0 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 client.4797 shutdown 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 msgr2=0x555fac1eb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1eb130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f611401a4d0 tx=0x7f61140a7070 comp rx=0 tx=0).stop 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 shutdown_connections 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:6832/3670477050,v1:172.21.15.16:6833/3670477050] conn(0x555fac1eb670 0x555fac1eba50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555fac19a940 0x555fac1eb130 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555fac19a020 0x555fac1eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 --2- 172.21.15.16:0/2729952177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555fac199700 0x555fac1ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6102a00640 0 client.4797 ms_handle_reset on v2:172.21.15.16:6832/3670477050 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 >> 172.21.15.16:0/2729952177 conn(0x555fac1db5f0 msgr2=0x555fac1f7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.166+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 shutdown_connections 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6127275000 1 -- 172.21.15.16:0/2729952177 wait complete. 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6127275000 20 client.4797 trim_cache size 0 max 16384 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "fae48009-e478-45bc-aae9-8a365e3cb2e9", 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 2, 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4267, 2024-04-26T20:14:52.177 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 11.060999402, 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 14, 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 25, 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 25, 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 45.129286028999999 2024-04-26T20:14:52.178 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60fc068380 msgr2=0x7f60fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60fc068380 0x7f60fc06a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f611c068900 tx=0x7f6108007b80 comp rx=0 tx=0).stop 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c0c44a0 msgr2=0x7f611c0cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c0c44a0 0x7f611c0cf680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f611000d830 tx=0x7f611000dcf0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 shutdown_connections 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f60fc068380 0x7f60fc06a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f611c15d8a0 0x7f611c0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f611c157250 0x7f611c06ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 --2- 172.21.15.16:0/713347921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f611c0c44a0 0x7f611c0cf680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 >> 172.21.15.16:0/713347921 conn(0x7f611c068140 msgr2=0x7f611c15af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 shutdown_connections 2024-04-26T20:14:52.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.170+0000 7f6123e00640 1 -- 172.21.15.16:0/713347921 wait complete. 2024-04-26T20:14:52.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T20:14:52.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff90b200640 1 Processor -- start 2024-04-26T20:14:52.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff90b200640 1 -- start start 2024-04-26T20:14:52.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff90b200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff904152560 0x7ff9040c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff90b200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040c96b0 con 0x7ff90406ff50 2024-04-26T20:14:52.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff90b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040c93d0 con 0x7ff904070330 2024-04-26T20:14:52.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff90b200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7ff9040c84e0 con 0x7ff904152560 2024-04-26T20:14:52.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff90406ff50 0x7ff904158d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42218/0 (socket says 172.21.15.16:42218) 2024-04-26T20:14:52.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903e00640 1 -- 172.21.15.16:0/307212506 learned_addr learned my addr 172.21.15.16:0/307212506 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:52.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff909200640 1 --2- 172.21.15.16:0/307212506 >> v2:172.21.15.192:3300/0 conn(0x7ff904152560 0x7ff9040c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1088849738 0 0) 0x7ff9040c96b0 con 0x7ff90406ff50 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e8003450 con 0x7ff90406ff50 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2670365998 0 0) 0x7ff8e8003450 con 0x7ff90406ff50 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 >> v2:172.21.15.192:3300/0 conn(0x7ff904152560 msgr2=0x7ff9040c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 --2- 172.21.15.16:0/307212506 >> v2:172.21.15.192:3300/0 conn(0x7ff904152560 0x7ff9040c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 >> v1:172.21.15.192:6789/0 conn(0x7ff904070330 legacy=0x7ff904151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040c7bb0 con 0x7ff90406ff50 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7ff8f4001680 con 0x7ff90406ff50 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 >> v1:172.21.15.16:6789/0 conn(0x7ff90406ff50 legacy=0x7ff904158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e8003ae0 0x7ff8e8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e80088b0 0x7ff8e800ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.330+0000 7ff903400640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e800b500 0x7ff8e800d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040c84e0 con 0x7ff8e800b500 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e800e290 con 0x7ff8e80088b0 2024-04-26T20:14:52.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e800e490 con 0x7ff8e8003ae0 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e800b500 0x7ff8e800d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff903e00640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e8003ae0 0x7ff8e8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e80088b0 0x7ff8e800ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 -- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e8003ae0 msgr2=0x7ff8e8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e8003ae0 0x7ff8e8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 -- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e80088b0 msgr2=0x7ff8e800ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e80088b0 0x7ff8e800ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 -- 172.21.15.16:0/307212506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e8003450 con 0x7ff8e800b500 2024-04-26T20:14:52.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8e80088b0 0x7ff8e800ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:52.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 -- 172.21.15.16:0/307212506 reap_dead start 2024-04-26T20:14:52.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff909200640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e800b500 0x7ff8e800d9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff9040cb0c0 tx=0x7ff8fc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d32000446781777 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0b2070 con 0x7ff8e800b500 2024-04-26T20:14:52.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0a5c70 con 0x7ff8e800b500 2024-04-26T20:14:52.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.334+0000 7ff903400640 1 -- 172.21.15.16:0/307212506 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc009c10 con 0x7ff8e800b500 2024-04-26T20:14:52.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- 172.21.15.16:0/307212506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e800b500 msgr2=0x7ff8e800d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e800b500 0x7ff8e800d9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff9040cb0c0 tx=0x7ff8fc01cc60 comp rx=0 tx=0).stop 2024-04-26T20:14:52.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- 172.21.15.16:0/307212506 shutdown_connections 2024-04-26T20:14:52.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 --2- 172.21.15.16:0/307212506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e800b500 0x7ff8e800d9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- 172.21.15.16:0/307212506 >> 172.21.15.16:0/307212506 conn(0x7ff9040c9d10 msgr2=0x7ff9040ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- 172.21.15.16:0/307212506 shutdown_connections 2024-04-26T20:14:52.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- 172.21.15.16:0/307212506 wait complete. 2024-04-26T20:14:52.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 Processor -- start 2024-04-26T20:14:52.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- start start 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e800b500 0x7ff90414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9041f5500 0x7ff9041f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff904147190 0x7ff9040732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040c8fd0 con 0x7ff9041f5500 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040c8170 con 0x7ff904147190 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff90b200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff9040c9150 con 0x7ff8e800b500 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9041f5500 0x7ff9041f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9041f5500 0x7ff9041f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40018/0 (socket says 172.21.15.16:40018) 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 -- 172.21.15.16:0/442032527 learned_addr learned my addr 172.21.15.16:0/442032527 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff909200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff904147190 0x7ff9040732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff903e00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e800b500 0x7ff90414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 -- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e800b500 msgr2=0x7ff90414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e800b500 0x7ff90414cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 -- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff904147190 msgr2=0x7ff9040732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff904147190 0x7ff9040732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 -- 172.21.15.16:0/442032527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040c4070 con 0x7ff9041f5500 2024-04-26T20:14:52.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff903e00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e800b500 0x7ff90414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:52.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff909200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff904147190 0x7ff9040732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:52.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.338+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9041f5500 0x7ff9041f1e20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d5c0 tx=0x7ff8ec00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff900c00640 1 -- 172.21.15.16:0/442032527 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec005480 con 0x7ff9041f5500 2024-04-26T20:14:52.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff900c00640 1 -- 172.21.15.16:0/442032527 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec017070 con 0x7ff9041f5500 2024-04-26T20:14:52.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90414b330 con 0x7ff9041f5500 2024-04-26T20:14:52.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff900c00640 1 -- 172.21.15.16:0/442032527 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003860 con 0x7ff9041f5500 2024-04-26T20:14:52.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9040c3d90 con 0x7ff9041f5500 2024-04-26T20:14:52.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff900c00640 1 -- 172.21.15.16:0/442032527 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8ec003a00 con 0x7ff9041f5500 2024-04-26T20:14:52.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff900c00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff8e00683b0 0x7ff8e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff900c00640 1 -- 172.21.15.16:0/442032527 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff8ec086b00 con 0x7ff9041f5500 2024-04-26T20:14:52.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff90e639000 1 Processor -- start 2024-04-26T20:14:52.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff903e00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff8e00683b0 0x7ff8e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.342+0000 7ff90e639000 1 -- start start 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff8e00683b0 0x7ff8e006a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4001060 tx=0x7ff8f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369887700 0x556369887ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x556369888400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556369742140 con 0x556369887700 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563696d7e00 con 0x556369888020 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x556369690a00 con 0x556369888940 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369887700 0x556369887ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369887700 0x556369887ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40022/0 (socket says 172.21.15.16:40022) 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 -- 172.21.15.16:0/797257419 learned_addr learned my addr 172.21.15.16:0/797257419 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff909200640 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x556369888400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 -- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 msgr2=0x5563698d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 -- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 msgr2=0x556369888400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x556369888400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 -- 172.21.15.16:0/797257419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563696950e0 con 0x556369887700 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff903e00640 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369887700 0x556369887ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4004b10 tx=0x7ff8f400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0efa4fa66c5e18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff8f8c00640 1 -- 172.21.15.16:0/797257419 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4027070 con 0x556369887700 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff8f8c00640 1 -- 172.21.15.16:0/797257419 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f4005050 con 0x556369887700 2024-04-26T20:14:52.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff8f8c00640 1 -- 172.21.15.16:0/797257419 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4005440 con 0x556369887700 2024-04-26T20:14:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- 172.21.15.16:0/797257419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369887700 msgr2=0x556369887ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369887700 0x556369887ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4004b10 tx=0x7ff8f400e000 comp rx=0 tx=0).stop 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- 172.21.15.16:0/797257419 shutdown_connections 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x556369888400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 --2- 172.21.15.16:0/797257419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369887700 0x556369887ae0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- 172.21.15.16:0/797257419 >> 172.21.15.16:0/797257419 conn(0x5563698c95f0 msgr2=0x5563698cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- 172.21.15.16:0/797257419 shutdown_connections 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- 172.21.15.16:0/797257419 wait complete. 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 -- start start 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.346+0000 7ff90e639000 1 Processor -- start 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888020 0x5563698c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563696e5200 con 0x556369888020 2024-04-26T20:14:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55636967be80 con 0x556369887700 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5563696d2ae0 con 0x556369888940 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 10 client.0 _ll_register_callbacks cb 0x5563696e4da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888020 0x5563698c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888020 0x5563698c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40038/0 (socket says 172.21.15.16:40038) 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 -- 172.21.15.16:0/2577560815 learned_addr learned my addr 172.21.15.16:0/2577560815 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff903e00640 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff909200640 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 -- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 msgr2=0x5563698d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 -- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 msgr2=0x5563698c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 -- 172.21.15.16:0/2577560815 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563696774e0 con 0x556369888020 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888020 0x5563698c8910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d590 tx=0x7ff8ec0193d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c2a37465eaf3cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 1 -- 172.21.15.16:0/2577560815 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec05aa20 con 0x556369888020 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 1 -- 172.21.15.16:0/2577560815 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff8ec05bbb0 con 0x556369888020 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8f4005050 con 0x556369888020 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 1 -- 172.21.15.16:0/2577560815 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff8ec075050 con 0x556369888020 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 10 client.4809 fetch_fsmap learned FSMap version 14 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55636965de80 con 0x556369888020 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 1 -- 172.21.15.16:0/2577560815 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f4005050 con 0x556369888020 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 1 -- 172.21.15.16:0/2577560815 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ff8ec055ac0 con 0x556369888020 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 10 client.4809 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 10 client.4809 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 20 client.4809 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698d4910 0x5563698d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 4 client.4809 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:14:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 --> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556369670bc0 con 0x5563698d4910 2024-04-26T20:14:52.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff903e00640 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698d4910 0x5563698d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff903e00640 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698d4910 0x5563698d4cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=829bd0ed7cf63eab server_cookie=65ab7a2623147184 in_seq=0 out_seq=0 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 10 client.4809 ms_handle_connect on v2:172.21.15.16:6834/1882507975 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 1 -- 172.21.15.16:0/2577560815 <== mds.1 v2:172.21.15.16:6834/1882507975 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556369670bc0 con 0x5563698d4910 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 10 client.4809 handle_command_reply: tid=0 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 client.4809 shutdown 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888020 msgr2=0x5563698c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888020 0x5563698c8910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d590 tx=0x7ff8ec0193d0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 shutdown_connections 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888940 0x5563698d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698d4910 0x5563698d4cf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888020 0x5563698c8910 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 --2- 172.21.15.16:0/2577560815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 >> 172.21.15.16:0/2577560815 conn(0x5563698c95f0 msgr2=0x556369886e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff8f1600640 0 client.4809 ms_handle_reset on v2:172.21.15.16:6834/1882507975 2024-04-26T20:14:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 shutdown_connections 2024-04-26T20:14:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.350+0000 7ff90e639000 1 -- 172.21.15.16:0/2577560815 wait complete. 2024-04-26T20:14:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.354+0000 7ff90e639000 20 client.4809 trim_cache size 0 max 16384 2024-04-26T20:14:52.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 Processor -- start 2024-04-26T20:14:52.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 -- start start 2024-04-26T20:14:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369887700 0x5563698d5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x5563698d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff9041fe0b0 con 0x556369888940 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff9041fe5e0 con 0x556369888020 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55636966d7b0 con 0x556369887700 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40048/0 (socket says 172.21.15.16:40048) 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 -- 172.21.15.16:0/3305652113 learned_addr learned my addr 172.21.15.16:0/3305652113 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff903e00640 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369887700 0x5563698d5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x5563698d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 -- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369887700 msgr2=0x5563698d5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369887700 0x5563698d5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 -- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 msgr2=0x5563698d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x5563698d6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 -- 172.21.15.16:0/3305652113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556369690c50 con 0x556369888940 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.370+0000 7ff909200640 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698c7230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a7010 tx=0x7ff8fc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bebf24e2f344f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8f3e00640 1 -- 172.21.15.16:0/3305652113 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0bc030 con 0x556369888940 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8f3e00640 1 -- 172.21.15.16:0/3305652113 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0a5a70 con 0x556369888940 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8f3e00640 1 -- 172.21.15.16:0/3305652113 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0b2040 con 0x556369888940 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- 172.21.15.16:0/3305652113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 msgr2=0x5563698c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698c7230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a7010 tx=0x7ff8fc004ac0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- 172.21.15.16:0/3305652113 shutdown_connections 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698c7230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369888020 0x5563698d6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 --2- 172.21.15.16:0/3305652113 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369887700 0x5563698d5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- 172.21.15.16:0/3305652113 >> 172.21.15.16:0/3305652113 conn(0x5563698c95f0 msgr2=0x5563698e5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- 172.21.15.16:0/3305652113 shutdown_connections 2024-04-26T20:14:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- 172.21.15.16:0/3305652113 wait complete. 2024-04-26T20:14:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- start start 2024-04-26T20:14:52.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 Processor -- start 2024-04-26T20:14:52.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698d9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888020 0x5563698d9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698d9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5563696dc430 con 0x556369888940 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563696d7110 con 0x556369887700 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5563696e40a0 con 0x556369888020 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 10 client.0 _ll_register_callbacks cb 0x7ff8ec001130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698d9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698d9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40050/0 (socket says 172.21.15.16:40050) 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 -- 172.21.15.16:0/1232607422 learned_addr learned my addr 172.21.15.16:0/1232607422 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8fbe00640 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888020 0x5563698d9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff903e00640 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 -- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888020 msgr2=0x5563698d9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888020 0x5563698d9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 -- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 msgr2=0x5563698d9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698d9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 -- 172.21.15.16:0/1232607422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55636975a160 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff909200640 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698d9aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a7010 tx=0x7ff8e8003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333ad1e468695166 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8f1600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8f1600640 1 -- 172.21.15.16:0/1232607422 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0c9060 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8f1600640 1 -- 172.21.15.16:0/1232607422 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff8fc0b8940 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8fc0a5a70 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff8f1600640 1 -- 172.21.15.16:0/1232607422 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff8fc0cf050 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 10 client.4815 fetch_fsmap learned FSMap version 14 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.374+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5563693910c0 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff8f1600640 1 -- 172.21.15.16:0/1232607422 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0a5a70 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff8f1600640 1 -- 172.21.15.16:0/1232607422 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ff8fc0d2020 con 0x556369888940 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 10 client.4815 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T20:14:52.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 10 client.4815 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 20 client.4815 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698da460 0x556369946c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 4 client.4815 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 --> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] -- command(tid 0: {"prefix": "status"}) -- 0x5563696e5a10 con 0x5563698da460 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff903e00640 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698da460 0x556369946c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff8f1600640 10 client.4815 ms_handle_connect on v2:172.21.15.16:6834/1882507975 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff903e00640 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698da460 0x556369946c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56d5021819a9567 server_cookie=3433c2659370daaf in_seq=0 out_seq=0 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff8f1600640 1 -- 172.21.15.16:0/1232607422 <== mds.1 v2:172.21.15.16:6834/1882507975 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5563696e5a10 con 0x5563698da460 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff8f1600640 10 client.4815 handle_command_reply: tid=0 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 client.4815 shutdown 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 msgr2=0x5563698d9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698d9aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0a7010 tx=0x7ff8e8003740 comp rx=0 tx=0).stop 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 shutdown_connections 2024-04-26T20:14:52.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:6834/1882507975,v1:172.21.15.16:6836/1882507975] conn(0x5563698da460 0x556369946c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556369888940 0x5563698d9aa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x556369888020 0x5563698d9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff8f1600640 0 client.4815 ms_handle_reset on v2:172.21.15.16:6834/1882507975 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 --2- 172.21.15.16:0/1232607422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556369887700 0x5563698d9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 >> 172.21.15.16:0/1232607422 conn(0x5563698c95f0 msgr2=0x5563698e5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 shutdown_connections 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 1 -- 172.21.15.16:0/1232607422 wait complete. 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90e639000 20 client.4815 trim_cache size 0 max 16384 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "fae48009-e478-45bc-aae9-8a365e3cb2e9", 2024-04-26T20:14:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 1, 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4276, 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 17.316270861, 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 14, 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 25, 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 25, 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 45.325534732999998 2024-04-26T20:14:52.388 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff8e00683b0 msgr2=0x7ff8e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff8e00683b0 0x7ff8e006a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4001060 tx=0x7ff8f4009040 comp rx=0 tx=0).stop 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9041f5500 msgr2=0x7ff9041f1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9041f5500 0x7ff9041f1e20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d5c0 tx=0x7ff8ec00da80 comp rx=0 tx=0).stop 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 shutdown_connections 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff8e00683b0 0x7ff8e006a870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff904147190 0x7ff9040732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9041f5500 0x7ff9041f1e20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 --2- 172.21.15.16:0/442032527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8e800b500 0x7ff90414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 >> 172.21.15.16:0/442032527 conn(0x7ff9040c9d10 msgr2=0x7ff90414f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 shutdown_connections 2024-04-26T20:14:52.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.378+0000 7ff90b200640 1 -- 172.21.15.16:0/442032527 wait complete. 2024-04-26T20:14:52.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-26T20:14:52.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb75a400640 1 Processor -- start 2024-04-26T20:14:52.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb75a400640 1 -- start start 2024-04-26T20:14:52.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb75a400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb754156040 0x7fb754070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb75a400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7540706c0 con 0x7fb754073760 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb75a400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7540709a0 con 0x7fb7540c7b10 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb75a400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb754070c80 con 0x7fb754156040 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb753400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb754156040 0x7fb754070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb753e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb754073760 0x7fb75406f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42228/0 (socket says 172.21.15.16:42228) 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb753e00640 1 -- 172.21.15.16:0/3180508908 learned_addr learned my addr 172.21.15.16:0/3180508908 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb753400640 1 -- 172.21.15.16:0/3180508908 >> v1:172.21.15.192:6789/0 conn(0x7fb7540c7b10 legacy=0x7fb75415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb753400640 1 -- 172.21.15.16:0/3180508908 >> v1:172.21.15.16:6789/0 conn(0x7fb754073760 legacy=0x7fb75406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.542+0000 7fb753400640 1 -- 172.21.15.16:0/3180508908 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb754072c80 con 0x7fb754156040 2024-04-26T20:14:52.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb753400640 1 --2- 172.21.15.16:0/3180508908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb754070010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097c0 tx=0x7fb74401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a06fcb0995607b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb752a00640 1 -- 172.21.15.16:0/3180508908 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a7070 con 0x7fb754156040 2024-04-26T20:14:52.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb752a00640 1 -- 172.21.15.16:0/3180508908 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440b0070 con 0x7fb754156040 2024-04-26T20:14:52.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb752a00640 1 -- 172.21.15.16:0/3180508908 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440ab890 con 0x7fb754156040 2024-04-26T20:14:52.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 -- 172.21.15.16:0/3180508908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 msgr2=0x7fb754070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 --2- 172.21.15.16:0/3180508908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb754070010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097c0 tx=0x7fb74401c470 comp rx=0 tx=0).stop 2024-04-26T20:14:52.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 -- 172.21.15.16:0/3180508908 shutdown_connections 2024-04-26T20:14:52.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 --2- 172.21.15.16:0/3180508908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb754070010 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 -- 172.21.15.16:0/3180508908 >> 172.21.15.16:0/3180508908 conn(0x7fb7540c9d10 msgr2=0x7fb7540ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 -- 172.21.15.16:0/3180508908 shutdown_connections 2024-04-26T20:14:52.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 -- 172.21.15.16:0/3180508908 wait complete. 2024-04-26T20:14:52.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 Processor -- start 2024-04-26T20:14:52.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.546+0000 7fb75a400640 1 -- start start 2024-04-26T20:14:52.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb754073760 0x7fb75415e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7540c7b10 0x7fb754146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb7541f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb7540c94b0 con 0x7fb754156040 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7540c9330 con 0x7fb7540c7b10 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb75406fb70 con 0x7fb754073760 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb7541f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb7541f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40066/0 (socket says 172.21.15.16:40066) 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 -- 172.21.15.16:0/2615242481 learned_addr learned my addr 172.21.15.16:0/2615242481 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb754073760 0x7fb75415e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb74be00640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7540c7b10 0x7fb754146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 -- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb754073760 msgr2=0x7fb75415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb754073760 0x7fb75415e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 -- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7540c7b10 msgr2=0x7fb754146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7540c7b10 0x7fb754146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 -- 172.21.15.16:0/2615242481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75414cfd0 con 0x7fb754156040 2024-04-26T20:14:52.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb753e00640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb7541f6180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00cbc0 tx=0x7fb74c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb74b400640 1 -- 172.21.15.16:0/2615242481 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c017070 con 0x7fb754156040 2024-04-26T20:14:52.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb74b400640 1 -- 172.21.15.16:0/2615242481 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74c00ad40 con 0x7fb754156040 2024-04-26T20:14:52.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb74b400640 1 -- 172.21.15.16:0/2615242481 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c012600 con 0x7fb754156040 2024-04-26T20:14:52.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75415da40 con 0x7fb754156040 2024-04-26T20:14:52.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb75415fbc0 con 0x7fb754156040 2024-04-26T20:14:52.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.550+0000 7fb74b400640 1 -- 172.21.15.16:0/2615242481 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb74c01a070 con 0x7fb754156040 2024-04-26T20:14:52.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb74b400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb730068380 0x7fb73006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb74b400640 1 -- 172.21.15.16:0/2615242481 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb74c0869c0 con 0x7fb754156040 2024-04-26T20:14:52.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb730068380 0x7fb73006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 Processor -- start 2024-04-26T20:14:52.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 -- start start 2024-04-26T20:14:52.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb730068380 0x7fb73006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7440af000 tx=0x7fb7440a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aac700 0x561507aacae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad940 0x561507afa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561507967140 con 0x561507aac700 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5615078fce00 con 0x561507aad020 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5615078b5a00 con 0x561507aad940 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aac700 0x561507aacae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aac700 0x561507aacae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40076/0 (socket says 172.21.15.16:40076) 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 -- 172.21.15.16:0/1353141645 learned_addr learned my addr 172.21.15.16:0/1353141645 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753e00640 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad940 0x561507afa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb74be00640 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 -- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad940 msgr2=0x561507afa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad940 0x561507afa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 -- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 msgr2=0x561507aad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 -- 172.21.15.16:0/1353141645 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615078ba0e0 con 0x561507aac700 2024-04-26T20:14:52.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb753400640 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aac700 0x561507aacae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb744097f40 tx=0x7fb744004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549be8e13d3e1312 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb743e00640 1 -- 172.21.15.16:0/1353141645 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440bb070 con 0x561507aac700 2024-04-26T20:14:52.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb743e00640 1 -- 172.21.15.16:0/1353141645 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440b0040 con 0x561507aac700 2024-04-26T20:14:52.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.554+0000 7fb743e00640 1 -- 172.21.15.16:0/1353141645 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440c08d0 con 0x561507aac700 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/1353141645 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aac700 msgr2=0x561507aacae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aac700 0x561507aacae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb744097f40 tx=0x7fb744004740 comp rx=0 tx=0).stop 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/1353141645 shutdown_connections 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad940 0x561507afa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1353141645 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aac700 0x561507aacae0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/1353141645 >> 172.21.15.16:0/1353141645 conn(0x561507aee5f0 msgr2=0x561507af09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/1353141645 shutdown_connections 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/1353141645 wait complete. 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- start start 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 Processor -- start 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507aed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aed910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad940 0x561507af8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56150790a200 con 0x561507aad940 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5615078a0e80 con 0x561507aad020 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5615078f7ae0 con 0x561507aac700 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 10 client.0 _ll_register_callbacks cb 0x561507909da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad940 0x561507af8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad940 0x561507af8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40078/0 (socket says 172.21.15.16:40078) 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 -- 172.21.15.16:0/3962739503 learned_addr learned my addr 172.21.15.16:0/3962739503 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753400640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507aed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb74be00640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 -- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 msgr2=0x561507aed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507aed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 -- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 msgr2=0x561507aed910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aed910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 -- 172.21.15.16:0/3962739503 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56150789c4e0 con 0x561507aad940 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb74be00640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb753e00640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad940 0x561507af8c80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0012f0 tx=0x7fb74c05a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df6ab76030cab26 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb740c00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb740c00640 1 -- 172.21.15.16:0/3962739503 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c054910 con 0x561507aad940 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb740c00640 1 -- 172.21.15.16:0/3962739503 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb74c004b70 con 0x561507aad940 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7440b0040 con 0x561507aad940 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb740c00640 1 -- 172.21.15.16:0/3962739503 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb74c07fe60 con 0x561507aad940 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 10 client.4830 fetch_fsmap learned FSMap version 14 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x561507882e80 con 0x561507aad940 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb740c00640 1 -- 172.21.15.16:0/3962739503 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440b0040 con 0x561507aad940 2024-04-26T20:14:52.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb740c00640 1 -- 172.21.15.16:0/3962739503 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fb74c0559a0 con 0x561507aad940 2024-04-26T20:14:52.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 10 client.4830 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T20:14:52.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 10 client.4830 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-26T20:14:52.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 20 client.4830 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:52.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507af99b0 0x561507af9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 4 client.4830 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T20:14:52.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.558+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 --> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561507895bc0 con 0x561507af99b0 2024-04-26T20:14:52.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb753400640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507af99b0 0x561507af9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb753400640 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507af99b0 0x561507af9d90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47fb4f97e8611a5f server_cookie=7b927bdfadc007f in_seq=0 out_seq=0 2024-04-26T20:14:52.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb740c00640 10 client.4830 ms_handle_connect on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:52.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb740c00640 1 -- 172.21.15.16:0/3962739503 <== mds.0 v2:172.21.15.16:6835/1962586875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561507895bc0 con 0x561507af99b0 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb740c00640 10 client.4830 handle_command_reply: tid=0 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 client.4830 shutdown 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad940 msgr2=0x561507af8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad940 0x561507af8c80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0012f0 tx=0x7fb74c05a910 comp rx=0 tx=0).stop 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 shutdown_connections 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507af99b0 0x561507af9d90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad940 0x561507af8c80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aad020 0x561507aed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 --2- 172.21.15.16:0/3962739503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507aed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb740c00640 0 client.4830 ms_handle_reset on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 >> 172.21.15.16:0/3962739503 conn(0x561507aee5f0 msgr2=0x561507aabe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 shutdown_connections 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 1 -- 172.21.15.16:0/3962739503 wait complete. 2024-04-26T20:14:52.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.562+0000 7fb75d81e000 20 client.4830 trim_cache size 0 max 16384 2024-04-26T20:14:52.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 Processor -- start 2024-04-26T20:14:52.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- start start 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aee5f0 0x561507afada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aac700 0x561507afb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad020 0x561507aec230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb7541f8ba0 con 0x561507aee5f0 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5615078927b0 con 0x561507aac700 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5615078fc110 con 0x561507aad020 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aee5f0 0x561507afada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aee5f0 0x561507afada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40086/0 (socket says 172.21.15.16:40086) 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 -- 172.21.15.16:0/1299702222 learned_addr learned my addr 172.21.15.16:0/1299702222 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753e00640 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad020 0x561507aec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb74be00640 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aac700 0x561507afb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 -- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad020 msgr2=0x561507aec230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad020 0x561507aec230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 -- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aac700 msgr2=0x561507afb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aac700 0x561507afb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 -- 172.21.15.16:0/1299702222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615078b5c50 con 0x561507aee5f0 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb74be00640 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aac700 0x561507afb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb753400640 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aee5f0 0x561507afada0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ad010 tx=0x7fb744008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c50b7fe1d93ee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb743400640 1 -- 172.21.15.16:0/1299702222 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440bb040 con 0x561507aee5f0 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb743400640 1 -- 172.21.15.16:0/1299702222 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440b0040 con 0x561507aee5f0 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb743400640 1 -- 172.21.15.16:0/1299702222 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440c0d50 con 0x561507aee5f0 2024-04-26T20:14:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- 172.21.15.16:0/1299702222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aee5f0 msgr2=0x561507afada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aee5f0 0x561507afada0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ad010 tx=0x7fb744008040 comp rx=0 tx=0).stop 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- 172.21.15.16:0/1299702222 shutdown_connections 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aad020 0x561507aec230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aac700 0x561507afb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1299702222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aee5f0 0x561507afada0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- 172.21.15.16:0/1299702222 >> 172.21.15.16:0/1299702222 conn(0x561507ab2300 msgr2=0x561507b0a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- 172.21.15.16:0/1299702222 shutdown_connections 2024-04-26T20:14:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- 172.21.15.16:0/1299702222 wait complete. 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 -- start start 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.582+0000 7fb75d81e000 1 Processor -- start 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507afe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad020 0x561507afe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aee5f0 0x561507afeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5615079090a0 con 0x561507aad020 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561507901430 con 0x561507aee5f0 2024-04-26T20:14:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5615078af8f0 con 0x561507aac700 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 10 client.0 _ll_register_callbacks cb 0x7fb74c00aef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad020 0x561507afe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad020 0x561507afe600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40094/0 (socket says 172.21.15.16:40094) 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 -- 172.21.15.16:0/1981425931 learned_addr learned my addr 172.21.15.16:0/1981425931 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb753400640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507afe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb753e00640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aee5f0 0x561507afeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 -- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 msgr2=0x561507afe0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507afe0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 -- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aee5f0 msgr2=0x561507afeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aee5f0 0x561507afeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 -- 172.21.15.16:0/1981425931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56150797f160 con 0x561507aad020 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb753e00640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aee5f0 0x561507afeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb74be00640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad020 0x561507afe600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb73c003f00 tx=0x7fb73c012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e90e74d5c62327 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 1 -- 172.21.15.16:0/1981425931 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c01a030 con 0x561507aad020 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 1 -- 172.21.15.16:0/1981425931 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb73c010050 con 0x561507aad020 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7440b0040 con 0x561507aad020 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 1 -- 172.21.15.16:0/1981425931 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb73c023050 con 0x561507aad020 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 10 client.4836 fetch_fsmap learned FSMap version 14 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5615075b60c0 con 0x561507aad020 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 1 -- 172.21.15.16:0/1981425931 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7440b0040 con 0x561507aad020 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 1 -- 172.21.15.16:0/1981425931 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fb73c01e3b0 con 0x561507aad020 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 10 client.4836 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 10 client.4836 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 20 client.4836 populate_metadata read hostname 'smithi016' 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507aad940 0x561507aff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 4 client.4836 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 --> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] -- command(tid 0: {"prefix": "status"}) -- 0x56150790aa10 con 0x561507aad940 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb753400640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507aad940 0x561507aff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb753400640 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507aad940 0x561507aff5f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7401ced275962d9 server_cookie=91aa2169aa4905f4 in_seq=0 out_seq=0 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 10 client.4836 ms_handle_connect on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 1 -- 172.21.15.16:0/1981425931 <== mds.0 v2:172.21.15.16:6835/1962586875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56150790aa10 con 0x561507aad940 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 10 client.4836 handle_command_reply: tid=0 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 client.4836 shutdown 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad020 msgr2=0x561507afe600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad020 0x561507afe600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb73c003f00 tx=0x7fb73c012630 comp rx=0 tx=0).stop 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 shutdown_connections 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:6835/1962586875,v1:172.21.15.16:6837/1962586875] conn(0x561507aad940 0x561507aff5f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561507aee5f0 0x561507afeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561507aad020 0x561507afe600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 --2- 172.21.15.16:0/1981425931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561507aac700 0x561507afe0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb740c00640 0 client.4836 ms_handle_reset on v2:172.21.15.16:6835/1962586875 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 >> 172.21.15.16:0/1981425931 conn(0x561507ab2300 msgr2=0x561507b0aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 shutdown_connections 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 1 -- 172.21.15.16:0/1981425931 wait complete. 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.586+0000 7fb75d81e000 20 client.4836 trim_cache size 0 max 16384 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "fae48009-e478-45bc-aae9-8a365e3cb2e9", 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-26T20:14:52.598 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4279, 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 38.152291396000003, 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 14, 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 25, 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 25, 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 45.534291488000001 2024-04-26T20:14:52.599 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb730068380 msgr2=0x7fb73006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb730068380 0x7fb73006a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb7440af000 tx=0x7fb7440a7000 comp rx=0 tx=0).stop 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 msgr2=0x7fb7541f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb7541f6180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00cbc0 tx=0x7fb74c00a430 comp rx=0 tx=0).stop 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 shutdown_connections 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb730068380 0x7fb73006a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb754156040 0x7fb7541f6180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7540c7b10 0x7fb754146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 --2- 172.21.15.16:0/2615242481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb754073760 0x7fb75415e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:52.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 >> 172.21.15.16:0/2615242481 conn(0x7fb7540c9d10 msgr2=0x7fb7541482e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:52.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 shutdown_connections 2024-04-26T20:14:52.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:52.590+0000 7fb75a400640 1 -- 172.21.15.16:0/2615242481 wait complete. 2024-04-26T20:14:52.613 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T20:14:52.624 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T20:14:52.624 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T20:14:52.625 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T20:14:52.625 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T20:14:52.636 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T20:14:52.636 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T20:14:52.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:52.637 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T20:14:52.646 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T20:14:52.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:52.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T20:14:52.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:52.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-26T20:14:52.880 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-26T20:14:52.880 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T20:14:52.880 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:14:52.881 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T20:14:53.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bee200640 1 Processor -- start 2024-04-26T20:14:53.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bee200640 1 -- start start 2024-04-26T20:14:53.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bee200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5be80b1d80 0x7f5be806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:53.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bee200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80c6340 0x7f5be80703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:53.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bee200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be80cfb50 con 0x7f5be80c9e80 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bee200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5be80cce10 con 0x7f5be80b1d80 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bee200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5be80cfe10 con 0x7f5be80c6340 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5be7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5be80b1d80 0x7f5be806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5be7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5be80b1d80 0x7f5be806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40110/0 (socket says 172.21.15.16:40110) 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5be7400640 1 -- 172.21.15.16:0/11578976 learned_addr learned my addr 172.21.15.16:0/11578976 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5bdfe00640 1 --2- 172.21.15.16:0/11578976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80c6340 0x7f5be80703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5be7400640 1 -- 172.21.15.16:0/11578976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80c6340 msgr2=0x7f5be80703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5be7400640 1 --2- 172.21.15.16:0/11578976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80c6340 0x7f5be80703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5be7400640 1 -- 172.21.15.16:0/11578976 >> v1:172.21.15.192:6789/0 conn(0x7f5be80c9e80 legacy=0x7f5be815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:53.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.018+0000 7f5be7400640 1 -- 172.21.15.16:0/11578976 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be806d650 con 0x7f5be80b1d80 2024-04-26T20:14:53.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5be7400640 1 --2- 172.21.15.16:0/11578976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80b1d80 0x7f5be806feb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524a1c18b5ce0396 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:53.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5be6a00640 1 -- 172.21.15.16:0/11578976 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80b5070 con 0x7f5be80b1d80 2024-04-26T20:14:53.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5be6a00640 1 -- 172.21.15.16:0/11578976 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd80a8a50 con 0x7f5be80b1d80 2024-04-26T20:14:53.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5be6a00640 1 -- 172.21.15.16:0/11578976 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80a8e20 con 0x7f5be80b1d80 2024-04-26T20:14:53.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 -- 172.21.15.16:0/11578976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80b1d80 msgr2=0x7f5be806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:53.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 --2- 172.21.15.16:0/11578976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80b1d80 0x7f5be806feb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd801ed50 comp rx=0 tx=0).stop 2024-04-26T20:14:53.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 -- 172.21.15.16:0/11578976 shutdown_connections 2024-04-26T20:14:53.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 --2- 172.21.15.16:0/11578976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80c6340 0x7f5be80703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 --2- 172.21.15.16:0/11578976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80b1d80 0x7f5be806feb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 -- 172.21.15.16:0/11578976 >> 172.21.15.16:0/11578976 conn(0x7f5be8071160 msgr2=0x7f5be8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:53.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 -- 172.21.15.16:0/11578976 shutdown_connections 2024-04-26T20:14:53.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.022+0000 7f5bee200640 1 -- 172.21.15.16:0/11578976 wait complete. 2024-04-26T20:14:53.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 Processor -- start 2024-04-26T20:14:53.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 -- start start 2024-04-26T20:14:53.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80b1d80 0x7f5be8154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:53.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80c6340 0x7f5be80b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:53.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5be80c9e80 0x7f5be80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:53.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5be80b2160 con 0x7f5be80c6340 2024-04-26T20:14:53.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5be806dc10 con 0x7f5be80c9e80 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5be8071970 con 0x7f5be80b1d80 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80c6340 0x7f5be80b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5be7400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80b1d80 0x7f5be8154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80c6340 0x7f5be80b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40116/0 (socket says 172.21.15.16:40116) 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 -- 172.21.15.16:0/3429188834 learned_addr learned my addr 172.21.15.16:0/3429188834 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5be7e00640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5be80c9e80 0x7f5be80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 -- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80b1d80 msgr2=0x7f5be8154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80b1d80 0x7f5be8154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 -- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5be80c9e80 msgr2=0x7f5be80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5be80c9e80 0x7f5be80b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 -- 172.21.15.16:0/3429188834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be81f6130 con 0x7f5be80c6340 2024-04-26T20:14:53.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5be7400640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80b1d80 0x7f5be8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:53.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdfe00640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80c6340 0x7f5be80b07f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e960 tx=0x7f5bd000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:53.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdf400640 1 -- 172.21.15.16:0/3429188834 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0017070 con 0x7f5be80c6340 2024-04-26T20:14:53.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdf400640 1 -- 172.21.15.16:0/3429188834 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd000ca00 con 0x7f5be80c6340 2024-04-26T20:14:53.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be8153340 con 0x7f5be80c6340 2024-04-26T20:14:53.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bdf400640 1 -- 172.21.15.16:0/3429188834 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000cdb0 con 0x7f5be80c6340 2024-04-26T20:14:53.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.026+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be80afff0 con 0x7f5be80c6340 2024-04-26T20:14:53.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.030+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be8077c20 con 0x7f5be80c6340 2024-04-26T20:14:53.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.030+0000 7f5bdf400640 1 -- 172.21.15.16:0/3429188834 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5bd001a070 con 0x7f5be80c6340 2024-04-26T20:14:53.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.030+0000 7f5bdf400640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5bc4068380 0x7f5bc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:53.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.030+0000 7f5bdf400640 1 -- 172.21.15.16:0/3429188834 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5bd0086d30 con 0x7f5be80c6340 2024-04-26T20:14:53.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.030+0000 7f5be7400640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5bc4068380 0x7f5bc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:53.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.030+0000 7f5be7400640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5bc4068380 0x7f5bc406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80b2000 tx=0x7f5bd8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:53.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.034+0000 7f5bdf400640 1 -- 172.21.15.16:0/3429188834 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5bd00568c0 con 0x7f5be80c6340 2024-04-26T20:14:53.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5be80d0210 con 0x7f5be80c6340 2024-04-26T20:14:53.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bdf400640 1 -- 172.21.15.16:0/3429188834 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+88 (secure 0 0 0) 0x7f5bd005abc0 con 0x7f5be80c6340 2024-04-26T20:14:53.246 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T20:14:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5bc4068380 msgr2=0x7f5bc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5bc4068380 0x7f5bc406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80b2000 tx=0x7f5bd8009040 comp rx=0 tx=0).stop 2024-04-26T20:14:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80c6340 msgr2=0x7f5be80b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80c6340 0x7f5be80b07f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e960 tx=0x7f5bd000ee20 comp rx=0 tx=0).stop 2024-04-26T20:14:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 shutdown_connections 2024-04-26T20:14:53.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5bc4068380 0x7f5bc406a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5be80c9e80 0x7f5be80b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be80c6340 0x7f5be80b07f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 --2- 172.21.15.16:0/3429188834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5be80b1d80 0x7f5be8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 >> 172.21.15.16:0/3429188834 conn(0x7f5be8071160 msgr2=0x7f5be815a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 shutdown_connections 2024-04-26T20:14:53.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53.242+0000 7f5bee200640 1 -- 172.21.15.16:0/3429188834 wait complete. 2024-04-26T20:14:53.267 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T20:14:53.267 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T20:14:53.267 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-04-26T20:14:53.268 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T20:14:53.268 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T20:14:53.268 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T20:14:53.268 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T20:14:53.268 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T20:14:53.268 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:14:53.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:53.268 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-04-26T20:14:53.277 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T20:14:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T20:14:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T20:14:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-04-26T20:14:53.277 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:53.277 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42381sec preferred_lft 42381sec 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:53.278 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T20:14:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-04-26T20:14:53.279 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T20:14:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:4d:77:e2:2f brd ff:ff:ff:ff:ff:ff 2024-04-26T20:14:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T20:14:53.279 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T20:14:53.280 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T20:14:53.280 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:53.280 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:53.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-04-26T20:14:53.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-04-26T20:14:53.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-04-26T20:14:53.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T20:14:53.280 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:53.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:53.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:53.440 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T20:14:53.459 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-04-26T20:14:53.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:53.461 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-04-26T20:14:53.514 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-04-26T20:14:53.514 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T20:14:53.515 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T20:14:53.515 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T20:14:53.515 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T20:14:53.515 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T20:14:53.515 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:53.515 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:53.515 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T20:14:53.515 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T20:14:53.515 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T20:14:53.516 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:53.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:53.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:53.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:53.654 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T20:14:53.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:53.711 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-04-26T20:14:53.762 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:53.762 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:53.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:14:53.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T20:14:53.762 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:53.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:53.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:53.889 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T20:14:53.890 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:53.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:54.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:54.032 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T20:14:54.032 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T20:14:54.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-04-26T20:14:54.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T20:14:54.032 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T20:14:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:54.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:54.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:14:54.118 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T20:14:54.127 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T20:14:54.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T20:14:54.127 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:14:54.180 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-26T20:14:54.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:54.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T20:14:54.271 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T20:14:54.271 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T20:14:54.271 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2024-04-26T20:14:54.857 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T20:14:54.857 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T20:14:54.857 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2024-04-26T20:14:54.857 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-04-26T20:14:54.857 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-04-26T20:14:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fae48009-e478-45bc-aae9-8a365e3cb2e9" will pass to kernel 2024-04-26T20:14:54.876 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T20:14:54.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:14:54.877 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T20:14:54.897 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:14:54.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:14:54.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:55.002 INFO:teuthology.orchestra.run.smithi016.stdout:client4903 2024-04-26T20:14:55.002 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:14:55.002 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:14:55.012 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:14:55.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:14:55.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:55.110 INFO:teuthology.orchestra.run.smithi016.stdout:client4903 2024-04-26T20:14:55.110 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T20:14:55.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T20:14:55.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:55.169 INFO:teuthology.orchestra.run.smithi016.stdout:client4903 2024-04-26T20:14:55.170 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fae48009-e478-45bc-aae9-8a365e3cb2e9.client4903/status') 2024-04-26T20:14:55.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T20:14:55.274 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4903 (3)172.21.15.16:0/4264371707 2024-04-26T20:14:55.274 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2024-04-26T20:14:55.274 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2024-04-26T20:14:55.275 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2024-04-26T20:14:55.275 INFO:teuthology.orchestra.run.smithi016.stderr:70 bytes copied, 6.4839e-05 s, 1.1 MB/s 2024-04-26T20:14:55.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T20:14:55.283 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-04-26T20:14:55.293 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:55.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac8e00640 1 Processor -- start 2024-04-26T20:14:55.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac8e00640 1 -- start start 2024-04-26T20:14:55.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac8e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ac41573a0 0x7f7ac40c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac8e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac40cf620 con 0x7f7ac40c5810 2024-04-26T20:14:55.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac8e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac40cf900 con 0x7f7ac40c4580 2024-04-26T20:14:55.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac8e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac40ca5a0 con 0x7f7ac41573a0 2024-04-26T20:14:55.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac1e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ac41573a0 0x7f7ac40c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac2800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7ac40c5810 0x7f7ac415d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51882/0 (socket says 172.21.15.16:51882) 2024-04-26T20:14:55.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac2800640 1 -- 172.21.15.16:0/2701235557 learned_addr learned my addr 172.21.15.16:0/2701235557 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:55.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac1e00640 1 -- 172.21.15.16:0/2701235557 >> v1:172.21.15.192:6789/0 conn(0x7f7ac40c4580 legacy=0x7f7ac40722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac1e00640 1 -- 172.21.15.16:0/2701235557 >> v1:172.21.15.16:6789/0 conn(0x7f7ac40c5810 legacy=0x7f7ac415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.430+0000 7f7ac1e00640 1 -- 172.21.15.16:0/2701235557 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac40cfbe0 con 0x7f7ac41573a0 2024-04-26T20:14:55.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/2701235557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41573a0 0x7f7ac40c9f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40097c0 tx=0x7f7ab401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c381dd81faa81c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:55.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac0a00640 1 -- 172.21.15.16:0/2701235557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40b0070 con 0x7f7ac41573a0 2024-04-26T20:14:55.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac0a00640 1 -- 172.21.15.16:0/2701235557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab40ab600 con 0x7f7ac41573a0 2024-04-26T20:14:55.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac0a00640 1 -- 172.21.15.16:0/2701235557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40ab9d0 con 0x7f7ac41573a0 2024-04-26T20:14:55.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 -- 172.21.15.16:0/2701235557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41573a0 msgr2=0x7f7ac40c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/2701235557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41573a0 0x7f7ac40c9f60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40097c0 tx=0x7f7ab401c410 comp rx=0 tx=0).stop 2024-04-26T20:14:55.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 -- 172.21.15.16:0/2701235557 shutdown_connections 2024-04-26T20:14:55.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/2701235557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41573a0 0x7f7ac40c9f60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 -- 172.21.15.16:0/2701235557 >> 172.21.15.16:0/2701235557 conn(0x7f7ac40704d0 msgr2=0x7f7ac40708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:55.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 -- 172.21.15.16:0/2701235557 shutdown_connections 2024-04-26T20:14:55.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 -- 172.21.15.16:0/2701235557 wait complete. 2024-04-26T20:14:55.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 Processor -- start 2024-04-26T20:14:55.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.434+0000 7f7ac8e00640 1 -- start start 2024-04-26T20:14:55.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac40c4580 0x7f7ac406f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac40c5810 0x7f7ac4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac41573a0 0x7f7ac41f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac4072b40 con 0x7f7ac40c4580 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac40729c0 con 0x7f7ac41573a0 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac4167d40 con 0x7f7ac40c5810 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac40c4580 0x7f7ac406f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac40c4580 0x7f7ac406f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37728/0 (socket says 172.21.15.16:37728) 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 -- 172.21.15.16:0/1230597260 learned_addr learned my addr 172.21.15.16:0/1230597260 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac2800640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac41573a0 0x7f7ac41f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1400640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac40c5810 0x7f7ac4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 -- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac40c5810 msgr2=0x7f7ac4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac40c5810 0x7f7ac4156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 -- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac41573a0 msgr2=0x7f7ac41f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac41573a0 0x7f7ac41f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 -- 172.21.15.16:0/1230597260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac41f51e0 con 0x7f7ac40c4580 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac40c4580 0x7f7ac406f0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40ae040 tx=0x7f7ab40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7aba000640 1 -- 172.21.15.16:0/1230597260 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40b8030 con 0x7f7ac40c4580 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7aba000640 1 -- 172.21.15.16:0/1230597260 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab40b4410 con 0x7f7ac40c4580 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7aba000640 1 -- 172.21.15.16:0/1230597260 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40b0040 con 0x7f7ac40c4580 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac406ed30 con 0x7f7ac40c4580 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac40b4da0 con 0x7f7ac40c4580 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac4077c20 con 0x7f7ac40c4580 2024-04-26T20:14:55.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.438+0000 7f7aba000640 1 -- 172.21.15.16:0/1230597260 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ab40bb070 con 0x7f7ac40c4580 2024-04-26T20:14:55.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.442+0000 7f7aba000640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa4068380 0x7f7aa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.442+0000 7f7aba000640 1 -- 172.21.15.16:0/1230597260 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7ab4120250 con 0x7f7ac40c4580 2024-04-26T20:14:55.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.442+0000 7f7ac1400640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa4068380 0x7f7aa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.442+0000 7f7ac1400640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa4068380 0x7f7aa406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40c5720 tx=0x7f7ab0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:55.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.446+0000 7f7aba000640 1 -- 172.21.15.16:0/1230597260 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ab40c3020 con 0x7f7ac40c4580 2024-04-26T20:14:55.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.614+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ac40cc390 con 0x7f7ac40c4580 2024-04-26T20:14:55.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.614+0000 7f7aba000640 1 -- 172.21.15.16:0/1230597260 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f7ab4016090 con 0x7f7ac40c4580 2024-04-26T20:14:55.620 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:55.620 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa4068380 msgr2=0x7f7aa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa4068380 0x7f7aa406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40c5720 tx=0x7f7ab0009040 comp rx=0 tx=0).stop 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac40c4580 msgr2=0x7f7ac406f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac40c4580 0x7f7ac406f0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40ae040 tx=0x7f7ab40191b0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 shutdown_connections 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa4068380 0x7f7aa406a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ac41573a0 0x7f7ac41f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac40c5810 0x7f7ac4156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 --2- 172.21.15.16:0/1230597260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac40c4580 0x7f7ac406f0f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 >> 172.21.15.16:0/1230597260 conn(0x7f7ac40704d0 msgr2=0x7f7ac40b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:55.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 shutdown_connections 2024-04-26T20:14:55.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.618+0000 7f7ac8e00640 1 -- 172.21.15.16:0/1230597260 wait complete. 2024-04-26T20:14:55.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:14:55.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:14:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bcd000640 1 Processor -- start 2024-04-26T20:14:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bcd000640 1 -- start start 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bcd000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7bc81593d0 0x7f7bc80cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bcd000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7bc815f340 0x7f7bc8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bcd000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bc80cbb70 con 0x7f7bc80c9e50 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bcd000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7bc80cbf50 con 0x7f7bc81593d0 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bcd000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f7bc80ca630 con 0x7f7bc815f340 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc5e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7bc81593d0 0x7f7bc80cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc5e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7bc81593d0 0x7f7bc80cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37740/0 (socket says 172.21.15.16:37740) 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc5e00640 1 -- 172.21.15.16:0/454322570 learned_addr learned my addr 172.21.15.16:0/454322570 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc6800640 1 --2- 172.21.15.16:0/454322570 >> v2:172.21.15.192:3300/0 conn(0x7f7bc815f340 0x7f7bc8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc5e00640 1 -- 172.21.15.16:0/454322570 >> v2:172.21.15.192:3300/0 conn(0x7f7bc815f340 msgr2=0x7f7bc8071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc5e00640 1 --2- 172.21.15.16:0/454322570 >> v2:172.21.15.192:3300/0 conn(0x7f7bc815f340 0x7f7bc8071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc5e00640 1 -- 172.21.15.16:0/454322570 >> v1:172.21.15.16:6789/0 conn(0x7f7bc80c9e50 legacy=0x7f7bc80cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.782+0000 7f7bc5e00640 1 -- 172.21.15.16:0/454322570 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc80ca910 con 0x7f7bc81593d0 2024-04-26T20:14:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bc5e00640 1 --2- 172.21.15.16:0/454322570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc81593d0 0x7f7bc80cb550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80cc0d0 tx=0x7f7bb801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799398832bb72577 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bc5400640 1 -- 172.21.15.16:0/454322570 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80b5070 con 0x7f7bc81593d0 2024-04-26T20:14:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bc5400640 1 -- 172.21.15.16:0/454322570 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb80a8a10 con 0x7f7bc81593d0 2024-04-26T20:14:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bc5400640 1 -- 172.21.15.16:0/454322570 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80a8de0 con 0x7f7bc81593d0 2024-04-26T20:14:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 -- 172.21.15.16:0/454322570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc81593d0 msgr2=0x7f7bc80cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 --2- 172.21.15.16:0/454322570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc81593d0 0x7f7bc80cb550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80cc0d0 tx=0x7f7bb801ed10 comp rx=0 tx=0).stop 2024-04-26T20:14:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 -- 172.21.15.16:0/454322570 shutdown_connections 2024-04-26T20:14:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 --2- 172.21.15.16:0/454322570 >> v2:172.21.15.192:3300/0 conn(0x7f7bc815f340 0x7f7bc8071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 --2- 172.21.15.16:0/454322570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc81593d0 0x7f7bc80cb550 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 -- 172.21.15.16:0/454322570 >> 172.21.15.16:0/454322570 conn(0x7f7bc8070570 msgr2=0x7f7bc806f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 -- 172.21.15.16:0/454322570 shutdown_connections 2024-04-26T20:14:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.786+0000 7f7bcd000640 1 -- 172.21.15.16:0/454322570 wait complete. 2024-04-26T20:14:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 Processor -- start 2024-04-26T20:14:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 -- start start 2024-04-26T20:14:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc80c9e50 0x7f7bc81f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc81593d0 0x7f7bc81511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc815f340 0x7f7bc8151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81597b0 con 0x7f7bc80c9e50 2024-04-26T20:14:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc80caed0 con 0x7f7bc81593d0 2024-04-26T20:14:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc80c62c0 con 0x7f7bc815f340 2024-04-26T20:14:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc80c9e50 0x7f7bc81f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc80c9e50 0x7f7bc81f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37756/0 (socket says 172.21.15.16:37756) 2024-04-26T20:14:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 -- 172.21.15.16:0/803405617 learned_addr learned my addr 172.21.15.16:0/803405617 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bbd400640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc81593d0 0x7f7bc81511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 -- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc815f340 msgr2=0x7f7bc8151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc6800640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc815f340 0x7f7bc8151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc815f340 0x7f7bc8151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 -- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc81593d0 msgr2=0x7f7bc81511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc81593d0 0x7f7bc81511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 -- 172.21.15.16:0/803405617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc815d180 con 0x7f7bc80c9e50 2024-04-26T20:14:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bc5e00640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc80c9e50 0x7f7bc81f1800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7bb801b920 tx=0x7f7bb801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bbea00640 1 -- 172.21.15.16:0/803405617 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80b5070 con 0x7f7bc80c9e50 2024-04-26T20:14:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bbea00640 1 -- 172.21.15.16:0/803405617 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb80b0b40 con 0x7f7bc80c9e50 2024-04-26T20:14:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc815d460 con 0x7f7bc80c9e50 2024-04-26T20:14:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bbea00640 1 -- 172.21.15.16:0/803405617 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80bb410 con 0x7f7bc80c9e50 2024-04-26T20:14:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc8154330 con 0x7f7bc80c9e50 2024-04-26T20:14:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.790+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc8077c20 con 0x7f7bc80c9e50 2024-04-26T20:14:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.794+0000 7f7bbea00640 1 -- 172.21.15.16:0/803405617 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7bb80c2060 con 0x7f7bc80c9e50 2024-04-26T20:14:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.794+0000 7f7bbea00640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7ba4068380 0x7f7ba406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.794+0000 7f7bbea00640 1 -- 172.21.15.16:0/803405617 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7bb8123fe0 con 0x7f7bc80c9e50 2024-04-26T20:14:55.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.794+0000 7f7bbd400640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7ba4068380 0x7f7ba406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:55.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.794+0000 7f7bbd400640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7ba4068380 0x7f7ba406a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8154120 tx=0x7f7bb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:55.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.798+0000 7f7bbea00640 1 -- 172.21.15.16:0/803405617 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7bb8018870 con 0x7f7bc80c9e50 2024-04-26T20:14:55.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.962+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7bc8150270 con 0x7f7bc80c9e50 2024-04-26T20:14:55.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bbea00640 1 -- 172.21.15.16:0/803405617 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f7bb80af3a0 con 0x7f7bc80c9e50 2024-04-26T20:14:55.970 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7ba4068380 msgr2=0x7f7ba406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7ba4068380 0x7f7ba406a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8154120 tx=0x7f7bb0009040 comp rx=0 tx=0).stop 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc80c9e50 msgr2=0x7f7bc81f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc80c9e50 0x7f7bc81f1800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7bb801b920 tx=0x7f7bb801bab0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 shutdown_connections 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7ba4068380 0x7f7ba406a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc815f340 0x7f7bc8151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc81593d0 0x7f7bc81511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 --2- 172.21.15.16:0/803405617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bc80c9e50 0x7f7bc81f1800 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 >> 172.21.15.16:0/803405617 conn(0x7f7bc8070570 msgr2=0x7f7bc806e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 shutdown_connections 2024-04-26T20:14:55.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:55.966+0000 7f7bcd000640 1 -- 172.21.15.16:0/803405617 wait complete. 2024-04-26T20:14:55.991 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:14:56.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.130+0000 7f37a6600640 1 Processor -- start 2024-04-26T20:14:56.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.130+0000 7f37a6600640 1 -- start start 2024-04-26T20:14:56.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f37a6600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a0155de0 0x7f37a015fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f37a6600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37a0072700 0x7f37a00cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f37a6600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a015ffd0 con 0x7f37a00cf940 2024-04-26T20:14:56.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f37a6600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f37a006d8d0 con 0x7f37a0072700 2024-04-26T20:14:56.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f37a6600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f37a006dbb0 con 0x7f37a0155de0 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f3797e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37a0072700 0x7f37a00cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f3797e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37a0072700 0x7f37a00cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37758/0 (socket says 172.21.15.16:37758) 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f37a5200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a0155de0 0x7f37a015fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f3797e00640 1 -- 172.21.15.16:0/978602216 learned_addr learned my addr 172.21.15.16:0/978602216 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f3797e00640 1 -- 172.21.15.16:0/978602216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a0155de0 msgr2=0x7f37a015fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f3797e00640 1 --2- 172.21.15.16:0/978602216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a0155de0 0x7f37a015fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f3797e00640 1 -- 172.21.15.16:0/978602216 >> v1:172.21.15.192:6789/0 conn(0x7f37a00cf940 legacy=0x7f37a00c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.134+0000 7f3797e00640 1 -- 172.21.15.16:0/978602216 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a006de90 con 0x7f37a0072700 2024-04-26T20:14:56.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f3797e00640 1 --2- 172.21.15.16:0/978602216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0072700 0x7f37a00cf400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3788009870 tx=0x7f378801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42382d98e393821a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f379fe00640 1 -- 172.21.15.16:0/978602216 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37880b5070 con 0x7f37a0072700 2024-04-26T20:14:56.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f379fe00640 1 -- 172.21.15.16:0/978602216 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37880a8a50 con 0x7f37a0072700 2024-04-26T20:14:56.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f379fe00640 1 -- 172.21.15.16:0/978602216 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37880a8e20 con 0x7f37a0072700 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- 172.21.15.16:0/978602216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0072700 msgr2=0x7f37a00cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 --2- 172.21.15.16:0/978602216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0072700 0x7f37a00cf400 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3788009870 tx=0x7f378801ed50 comp rx=0 tx=0).stop 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- 172.21.15.16:0/978602216 shutdown_connections 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 --2- 172.21.15.16:0/978602216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0072700 0x7f37a00cf400 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 --2- 172.21.15.16:0/978602216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a0155de0 0x7f37a015fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- 172.21.15.16:0/978602216 >> 172.21.15.16:0/978602216 conn(0x7f37a0070340 msgr2=0x7f37a0070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- 172.21.15.16:0/978602216 shutdown_connections 2024-04-26T20:14:56.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- 172.21.15.16:0/978602216 wait complete. 2024-04-26T20:14:56.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 Processor -- start 2024-04-26T20:14:56.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- start start 2024-04-26T20:14:56.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37a0072700 0x7f37a00c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a00cf940 0x7f37a015d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0155de0 0x7f37a00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f37a01561c0 con 0x7f37a0155de0 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.138+0000 7f37a6600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37a006e450 con 0x7f37a0072700 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a6600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f37a006d490 con 0x7f37a00cf940 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0155de0 0x7f37a00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0155de0 0x7f37a00cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37762/0 (socket says 172.21.15.16:37762) 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 -- 172.21.15.16:0/2615147219 learned_addr learned my addr 172.21.15.16:0/2615147219 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f3797e00640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a00cf940 0x7f37a015d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5200640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37a0072700 0x7f37a00c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 -- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a00cf940 msgr2=0x7f37a015d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a00cf940 0x7f37a015d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 -- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37a0072700 msgr2=0x7f37a00c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37a0072700 0x7f37a00c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 -- 172.21.15.16:0/2615147219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a01f2370 con 0x7f37a0155de0 2024-04-26T20:14:56.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5200640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37a0072700 0x7f37a00c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:56.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a5c00640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0155de0 0x7f37a00cbaa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f379800c760 tx=0x7f379800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f379d600640 1 -- 172.21.15.16:0/2615147219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798003b80 con 0x7f37a0155de0 2024-04-26T20:14:56.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f379d600640 1 -- 172.21.15.16:0/2615147219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3798003d20 con 0x7f37a0155de0 2024-04-26T20:14:56.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f379d600640 1 -- 172.21.15.16:0/2615147219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379800aa90 con 0x7f37a0155de0 2024-04-26T20:14:56.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a015cdd0 con 0x7f37a0155de0 2024-04-26T20:14:56.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a015e060 con 0x7f37a0155de0 2024-04-26T20:14:56.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a00506d0 con 0x7f37a0155de0 2024-04-26T20:14:56.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.142+0000 7f379d600640 1 -- 172.21.15.16:0/2615147219 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f379800ac30 con 0x7f37a0155de0 2024-04-26T20:14:56.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.146+0000 7f379d600640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f377c0683b0 0x7f377c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.146+0000 7f379d600640 1 -- 172.21.15.16:0/2615147219 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3798086a50 con 0x7f37a0155de0 2024-04-26T20:14:56.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.146+0000 7f37a5200640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f377c0683b0 0x7f377c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.146+0000 7f37a5200640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f377c0683b0 0x7f377c06a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3790009bb0 tx=0x7f3790008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.150+0000 7f379d600640 1 -- 172.21.15.16:0/2615147219 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3798056cc0 con 0x7f37a0155de0 2024-04-26T20:14:56.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.314+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f37a00ca320 con 0x7f37a0155de0 2024-04-26T20:14:56.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f379d600640 1 -- 172.21.15.16:0/2615147219 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f37980565c0 con 0x7f37a0155de0 2024-04-26T20:14:56.322 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f377c0683b0 msgr2=0x7f377c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f377c0683b0 0x7f377c06a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3790009bb0 tx=0x7f3790008040 comp rx=0 tx=0).stop 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0155de0 msgr2=0x7f37a00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0155de0 0x7f37a00cbaa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f379800c760 tx=0x7f379800cc20 comp rx=0 tx=0).stop 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 shutdown_connections 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f377c0683b0 0x7f377c06a870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a0155de0 0x7f37a00cbaa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37a00cf940 0x7f37a015d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 --2- 172.21.15.16:0/2615147219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37a0072700 0x7f37a00c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 >> 172.21.15.16:0/2615147219 conn(0x7f37a0070340 msgr2=0x7f37a0070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 shutdown_connections 2024-04-26T20:14:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.318+0000 7f37a6600640 1 -- 172.21.15.16:0/2615147219 wait complete. 2024-04-26T20:14:56.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:14:56.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9588a00640 1 Processor -- start 2024-04-26T20:14:56.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9588a00640 1 -- start start 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9588a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9584070da0 0x7f9584071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9588a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f958415c770 0x7f9584166860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9588a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95840c8e50 con 0x7f95840c9520 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9588a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9584160290 con 0x7f958415c770 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9588a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f95840c9110 con 0x7f9584070da0 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9582800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f958415c770 0x7f9584166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f957be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f95840c9520 0x7f958415c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51908/0 (socket says 172.21.15.16:51908) 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9582800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f958415c770 0x7f9584166860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37766/0 (socket says 172.21.15.16:37766) 2024-04-26T20:14:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f957be00640 1 -- 172.21.15.16:0/1018121564 learned_addr learned my addr 172.21.15.16:0/1018121564 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9581e00640 1 --2- 172.21.15.16:0/1018121564 >> v2:172.21.15.192:3300/0 conn(0x7f9584070da0 0x7f9584071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9582800640 1 -- 172.21.15.16:0/1018121564 >> v2:172.21.15.192:3300/0 conn(0x7f9584070da0 msgr2=0x7f9584071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9582800640 1 --2- 172.21.15.16:0/1018121564 >> v2:172.21.15.192:3300/0 conn(0x7f9584070da0 0x7f9584071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9582800640 1 -- 172.21.15.16:0/1018121564 >> v1:172.21.15.16:6789/0 conn(0x7f95840c9520 legacy=0x7f958415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9582800640 1 -- 172.21.15.16:0/1018121564 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95840c9d70 con 0x7f958415c770 2024-04-26T20:14:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.482+0000 7f9581e00640 1 --2- 172.21.15.16:0/1018121564 >> v2:172.21.15.192:3300/0 conn(0x7f9584070da0 0x7f9584071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:56.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9582800640 1 --2- 172.21.15.16:0/1018121564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f958415c770 0x7f9584166860 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95840cf260 tx=0x7f957c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b84b688fdc69522 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9581400640 1 -- 172.21.15.16:0/1018121564 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0b2070 con 0x7f958415c770 2024-04-26T20:14:56.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9581400640 1 -- 172.21.15.16:0/1018121564 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0a57f0 con 0x7f958415c770 2024-04-26T20:14:56.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9581400640 1 -- 172.21.15.16:0/1018121564 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0a5bc0 con 0x7f958415c770 2024-04-26T20:14:56.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 -- 172.21.15.16:0/1018121564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f958415c770 msgr2=0x7f9584166860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 --2- 172.21.15.16:0/1018121564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f958415c770 0x7f9584166860 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95840cf260 tx=0x7f957c01c930 comp rx=0 tx=0).stop 2024-04-26T20:14:56.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 -- 172.21.15.16:0/1018121564 shutdown_connections 2024-04-26T20:14:56.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 --2- 172.21.15.16:0/1018121564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f958415c770 0x7f9584166860 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 --2- 172.21.15.16:0/1018121564 >> v2:172.21.15.192:3300/0 conn(0x7f9584070da0 0x7f9584071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 -- 172.21.15.16:0/1018121564 >> 172.21.15.16:0/1018121564 conn(0x7f95840ce2c0 msgr2=0x7f95840ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 -- 172.21.15.16:0/1018121564 shutdown_connections 2024-04-26T20:14:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.486+0000 7f9588a00640 1 -- 172.21.15.16:0/1018121564 wait complete. 2024-04-26T20:14:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 Processor -- start 2024-04-26T20:14:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 -- start start 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9584070da0 0x7f95841509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95840c9520 0x7f9584150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f958415c770 0x7f958414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9584169950 con 0x7f9584070da0 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95841697d0 con 0x7f958415c770 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9584169ad0 con 0x7f95840c9520 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9584070da0 0x7f95841509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9584070da0 0x7f95841509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37782/0 (socket says 172.21.15.16:37782) 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 -- 172.21.15.16:0/3877139171 learned_addr learned my addr 172.21.15.16:0/3877139171 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f957be00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95840c9520 0x7f9584150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9582800640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f958415c770 0x7f958414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 -- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95840c9520 msgr2=0x7f9584150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95840c9520 0x7f9584150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 -- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f958415c770 msgr2=0x7f958414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f958415c770 0x7f958414c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 -- 172.21.15.16:0/3877139171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95840be670 con 0x7f9584070da0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9581e00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9584070da0 0x7f95841509f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f957400e810 tx=0x7f957400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f957a000640 1 -- 172.21.15.16:0/3877139171 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574017070 con 0x7f9584070da0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f957a000640 1 -- 172.21.15.16:0/3877139171 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957400c8d0 con 0x7f9584070da0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f957a000640 1 -- 172.21.15.16:0/3877139171 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957400f040 con 0x7f9584070da0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958415e590 con 0x7f9584070da0 2024-04-26T20:14:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958415dc50 con 0x7f9584070da0 2024-04-26T20:14:56.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.490+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9584077c20 con 0x7f9584070da0 2024-04-26T20:14:56.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.494+0000 7f957a000640 1 -- 172.21.15.16:0/3877139171 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f957401a070 con 0x7f9584070da0 2024-04-26T20:14:56.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.494+0000 7f957a000640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95600683b0 0x7f956006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.494+0000 7f957a000640 1 -- 172.21.15.16:0/3877139171 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9574086a30 con 0x7f9584070da0 2024-04-26T20:14:56.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.494+0000 7f957be00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95600683b0 0x7f956006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.494+0000 7f957be00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95600683b0 0x7f956006a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f958406db70 tx=0x7f956c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.498+0000 7f957a000640 1 -- 172.21.15.16:0/3877139171 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f95840be670 con 0x7f9584070da0 2024-04-26T20:14:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f95840c5fd0 con 0x7f9584070da0 2024-04-26T20:14:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f957a000640 1 -- 172.21.15.16:0/3877139171 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f9574056b80 con 0x7f9584070da0 2024-04-26T20:14:56.667 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:14:56.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95600683b0 msgr2=0x7f956006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95600683b0 0x7f956006a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f958406db70 tx=0x7f956c009040 comp rx=0 tx=0).stop 2024-04-26T20:14:56.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9584070da0 msgr2=0x7f95841509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9584070da0 0x7f95841509f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f957400e810 tx=0x7f957400ecd0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 shutdown_connections 2024-04-26T20:14:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f95600683b0 0x7f956006a870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f958415c770 0x7f958414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95840c9520 0x7f9584150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 --2- 172.21.15.16:0/3877139171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9584070da0 0x7f95841509f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 >> 172.21.15.16:0/3877139171 conn(0x7f95840ce2c0 msgr2=0x7f9584153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 shutdown_connections 2024-04-26T20:14:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.662+0000 7f9588a00640 1 -- 172.21.15.16:0/3877139171 wait complete. 2024-04-26T20:14:56.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:14:56.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.826+0000 7fbfb1e00640 1 Processor -- start 2024-04-26T20:14:56.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.826+0000 7fbfb1e00640 1 -- start start 2024-04-26T20:14:56.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfb1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbfac152d00 0x7fbfac0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfb1e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac073230 0x7fbfac073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfb1e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfac073bb0 con 0x7fbfac158a80 2024-04-26T20:14:56.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfb1e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fbfac0c4b30 con 0x7fbfac152d00 2024-04-26T20:14:56.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfb1e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbfac0c6f60 con 0x7fbfac073230 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac073230 0x7fbfac073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac073230 0x7fbfac073670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:50474/0 (socket says 172.21.15.16:50474) 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfa3e00640 1 -- 172.21.15.16:0/3886740946 learned_addr learned my addr 172.21.15.16:0/3886740946 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfaaa00640 1 --2- 172.21.15.16:0/3886740946 >> v2:172.21.15.192:3300/0 conn(0x7fbfac152d00 0x7fbfac0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfaa000640 1 -- 172.21.15.16:0/3886740946 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353477353 0 0) 0x7fbfac073bb0 con 0x7fbfac158a80 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfaa000640 1 -- 172.21.15.16:0/3886740946 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf90003530 con 0x7fbfac158a80 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfa3e00640 1 -- 172.21.15.16:0/3886740946 >> v2:172.21.15.192:3300/0 conn(0x7fbfac152d00 msgr2=0x7fbfac0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfa3e00640 1 --2- 172.21.15.16:0/3886740946 >> v2:172.21.15.192:3300/0 conn(0x7fbfac152d00 0x7fbfac0c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfa3e00640 1 -- 172.21.15.16:0/3886740946 >> v1:172.21.15.192:6789/0 conn(0x7fbfac158a80 legacy=0x7fbfac158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfa3e00640 1 -- 172.21.15.16:0/3886740946 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfac0c7240 con 0x7fbfac073230 2024-04-26T20:14:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.830+0000 7fbfaaa00640 1 --2- 172.21.15.16:0/3886740946 >> v2:172.21.15.192:3300/0 conn(0x7fbfac152d00 0x7fbfac0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:56.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfa3e00640 1 --2- 172.21.15.16:0/3886740946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac073230 0x7fbfac073670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009870 tx=0x7fbf9401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dab399231f4fbef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfaa000640 1 -- 172.21.15.16:0/3886740946 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf940b2070 con 0x7fbfac073230 2024-04-26T20:14:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfaa000640 1 -- 172.21.15.16:0/3886740946 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf940a9070 con 0x7fbfac073230 2024-04-26T20:14:56.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfaa000640 1 -- 172.21.15.16:0/3886740946 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf940ad880 con 0x7fbfac073230 2024-04-26T20:14:56.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 -- 172.21.15.16:0/3886740946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac073230 msgr2=0x7fbfac073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/3886740946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac073230 0x7fbfac073670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009870 tx=0x7fbf9401c560 comp rx=0 tx=0).stop 2024-04-26T20:14:56.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 -- 172.21.15.16:0/3886740946 shutdown_connections 2024-04-26T20:14:56.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/3886740946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac073230 0x7fbfac073670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/3886740946 >> v2:172.21.15.192:3300/0 conn(0x7fbfac152d00 0x7fbfac0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 -- 172.21.15.16:0/3886740946 >> 172.21.15.16:0/3886740946 conn(0x7fbfac0c9d10 msgr2=0x7fbfac0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:56.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 -- 172.21.15.16:0/3886740946 shutdown_connections 2024-04-26T20:14:56.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 -- 172.21.15.16:0/3886740946 wait complete. 2024-04-26T20:14:56.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 Processor -- start 2024-04-26T20:14:56.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.834+0000 7fbfb1e00640 1 -- start start 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfac073230 0x7fbfac0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfac152d00 0x7fbfac1656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac158a80 0x7fbfac145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac0c4890 con 0x7fbfac152d00 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbfac0c4710 con 0x7fbfac073230 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbfac163c10 con 0x7fbfac158a80 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfac152d00 0x7fbfac1656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfac152d00 0x7fbfac1656c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37784/0 (socket says 172.21.15.16:37784) 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfaaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfac073230 0x7fbfac0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 -- 172.21.15.16:0/1554121843 learned_addr learned my addr 172.21.15.16:0/1554121843 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfab400640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac158a80 0x7fbfac145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 -- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac158a80 msgr2=0x7fbfac145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac158a80 0x7fbfac145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 -- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfac073230 msgr2=0x7fbfac0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfac073230 0x7fbfac0cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 -- 172.21.15.16:0/1554121843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfac0cb0b0 con 0x7fbfac152d00 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfac152d00 0x7fbfac1656c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbf940b0040 tx=0x7fbf94019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3400640 1 -- 172.21.15.16:0/1554121843 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf940bb070 con 0x7fbfac152d00 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3400640 1 -- 172.21.15.16:0/1554121843 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf940adc50 con 0x7fbfac152d00 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfac0cb390 con 0x7fbfac152d00 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3400640 1 -- 172.21.15.16:0/1554121843 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf940b2040 con 0x7fbfac152d00 2024-04-26T20:14:56.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfac0cb950 con 0x7fbfac152d00 2024-04-26T20:14:56.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfac077c20 con 0x7fbfac152d00 2024-04-26T20:14:56.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.838+0000 7fbfa3400640 1 -- 172.21.15.16:0/1554121843 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf940be070 con 0x7fbfac152d00 2024-04-26T20:14:56.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.842+0000 7fbfa3400640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf880683b0 0x7fbf8806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:56.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.842+0000 7fbfa3400640 1 -- 172.21.15.16:0/1554121843 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbf9411fac0 con 0x7fbfac152d00 2024-04-26T20:14:56.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.842+0000 7fbfaaa00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf880683b0 0x7fbf8806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:56.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.842+0000 7fbfaaa00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf880683b0 0x7fbf8806a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009580 tx=0x7fbf9c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:56.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:56.846+0000 7fbfa3400640 1 -- 172.21.15.16:0/1554121843 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbf94016150 con 0x7fbfac152d00 2024-04-26T20:14:57.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbfac158eb0 con 0x7fbfac152d00 2024-04-26T20:14:57.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfa3400640 1 -- 172.21.15.16:0/1554121843 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fbf940ef650 con 0x7fbfac152d00 2024-04-26T20:14:57.015 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf880683b0 msgr2=0x7fbf8806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf880683b0 0x7fbf8806a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009580 tx=0x7fbf9c009190 comp rx=0 tx=0).stop 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfac152d00 msgr2=0x7fbfac1656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfac152d00 0x7fbfac1656c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbf940b0040 tx=0x7fbf94019300 comp rx=0 tx=0).stop 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 shutdown_connections 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbf880683b0 0x7fbf8806a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbfac158a80 0x7fbfac145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfac152d00 0x7fbfac1656c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 --2- 172.21.15.16:0/1554121843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfac073230 0x7fbfac0cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 >> 172.21.15.16:0/1554121843 conn(0x7fbfac0c9d10 msgr2=0x7fbfac073ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 shutdown_connections 2024-04-26T20:14:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.010+0000 7fbfb1e00640 1 -- 172.21.15.16:0/1554121843 wait complete. 2024-04-26T20:14:57.036 INFO:tasks.mds_thrash:mds thrasher using random seed: 1714162497 2024-04-26T20:14:57.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:14:57.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.170+0000 7fb9bda00640 1 Processor -- start 2024-04-26T20:14:57.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.170+0000 7fb9bda00640 1 -- start start 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9bda00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb9b80c6340 0x7fb9b815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9bda00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c9e80 0x7fb9b815c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9bda00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b80cfb50 con 0x7fb9b80b1d80 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9bda00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b80cce10 con 0x7fb9b80c6340 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9bda00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b80cfe10 con 0x7fb9b80c9e80 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b7400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c9e80 0x7fb9b815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9afe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb9b80c6340 0x7fb9b815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b7400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c9e80 0x7fb9b815c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:50500/0 (socket says 172.21.15.16:50500) 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b7400640 1 -- 172.21.15.16:0/3834710795 learned_addr learned my addr 172.21.15.16:0/3834710795 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:57.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b6a00640 1 --1- 172.21.15.16:0/3834710795 >> v1:172.21.15.192:6789/0 conn(0x7fb9b80b1d80 0x7fb9b806feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:38974/0 (socket says 172.21.15.16:38974) 2024-04-26T20:14:57.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b7400640 1 -- 172.21.15.16:0/3834710795 >> v2:172.21.15.192:3300/0 conn(0x7fb9b80c6340 msgr2=0x7fb9b815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:57.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b7400640 1 --2- 172.21.15.16:0/3834710795 >> v2:172.21.15.192:3300/0 conn(0x7fb9b80c6340 0x7fb9b815c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b7400640 1 -- 172.21.15.16:0/3834710795 >> v1:172.21.15.192:6789/0 conn(0x7fb9b80b1d80 legacy=0x7fb9b806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9b7400640 1 -- 172.21.15.16:0/3834710795 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b806d650 con 0x7fb9b80c9e80 2024-04-26T20:14:57.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.174+0000 7fb9afe00640 1 --2- 172.21.15.16:0/3834710795 >> v2:172.21.15.192:3300/0 conn(0x7fb9b80c6340 0x7fb9b815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:14:57.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9b7400640 1 --2- 172.21.15.16:0/3834710795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c9e80 0x7fb9b815c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009e50 tx=0x7fb9b001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4cd0e7911e8f94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9b6000640 1 -- 172.21.15.16:0/3834710795 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00b4070 con 0x7fb9b80c9e80 2024-04-26T20:14:57.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9b6000640 1 -- 172.21.15.16:0/3834710795 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b00af400 con 0x7fb9b80c9e80 2024-04-26T20:14:57.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9b6000640 1 -- 172.21.15.16:0/3834710795 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00af7d0 con 0x7fb9b80c9e80 2024-04-26T20:14:57.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 -- 172.21.15.16:0/3834710795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c9e80 msgr2=0x7fb9b815c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 --2- 172.21.15.16:0/3834710795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c9e80 0x7fb9b815c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009e50 tx=0x7fb9b001f210 comp rx=0 tx=0).stop 2024-04-26T20:14:57.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 -- 172.21.15.16:0/3834710795 shutdown_connections 2024-04-26T20:14:57.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 --2- 172.21.15.16:0/3834710795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c9e80 0x7fb9b815c610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 --2- 172.21.15.16:0/3834710795 >> v2:172.21.15.192:3300/0 conn(0x7fb9b80c6340 0x7fb9b815c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 -- 172.21.15.16:0/3834710795 >> 172.21.15.16:0/3834710795 conn(0x7fb9b8071160 msgr2=0x7fb9b8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:57.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 -- 172.21.15.16:0/3834710795 shutdown_connections 2024-04-26T20:14:57.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 -- 172.21.15.16:0/3834710795 wait complete. 2024-04-26T20:14:57.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 Processor -- start 2024-04-26T20:14:57.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.178+0000 7fb9bda00640 1 -- start start 2024-04-26T20:14:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9b80b1d80 0x7fb9b8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c6340 0x7fb9b815a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9b80c9e80 0x7fb9b80c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b80b2160 con 0x7fb9b80b1d80 2024-04-26T20:14:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b806dc10 con 0x7fb9b80c9e80 2024-04-26T20:14:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b8071970 con 0x7fb9b80c6340 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9b80b1d80 0x7fb9b8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9b80b1d80 0x7fb9b8159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37798/0 (socket says 172.21.15.16:37798) 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 -- 172.21.15.16:0/959210464 learned_addr learned my addr 172.21.15.16:0/959210464 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9afe00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c6340 0x7fb9b815a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b7400640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9b80c9e80 0x7fb9b80c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 -- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c6340 msgr2=0x7fb9b815a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c6340 0x7fb9b815a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 -- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9b80c9e80 msgr2=0x7fb9b80c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9b80c9e80 0x7fb9b80c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 -- 172.21.15.16:0/959210464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b80c7b40 con 0x7fb9b80b1d80 2024-04-26T20:14:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9b6a00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9b80b1d80 0x7fb9b8159cd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c450 tx=0x7fb9a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9aea00640 1 -- 172.21.15.16:0/959210464 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8018070 con 0x7fb9b80b1d80 2024-04-26T20:14:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9aea00640 1 -- 172.21.15.16:0/959210464 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a8007480 con 0x7fb9b80b1d80 2024-04-26T20:14:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9aea00640 1 -- 172.21.15.16:0/959210464 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80047f0 con 0x7fb9b80b1d80 2024-04-26T20:14:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b80b0890 con 0x7fb9b80b1d80 2024-04-26T20:14:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b80b0b50 con 0x7fb9b80b1d80 2024-04-26T20:14:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.182+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b8077c20 con 0x7fb9b80b1d80 2024-04-26T20:14:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.186+0000 7fb9aea00640 1 -- 172.21.15.16:0/959210464 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb9a801b070 con 0x7fb9b80b1d80 2024-04-26T20:14:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.186+0000 7fb9aea00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb9940683b0 0x7fb99406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.186+0000 7fb9aea00640 1 -- 172.21.15.16:0/959210464 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb9a8085e40 con 0x7fb9b80b1d80 2024-04-26T20:14:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.186+0000 7fb9afe00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb9940683b0 0x7fb99406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.186+0000 7fb9afe00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb9940683b0 0x7fb99406a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80c49a0 tx=0x7fb9a0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.190+0000 7fb9aea00640 1 -- 172.21.15.16:0/959210464 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb9a8055a60 con 0x7fb9b80b1d80 2024-04-26T20:14:57.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9b80d0210 con 0x7fb9b80b1d80 2024-04-26T20:14:57.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9aea00640 1 -- 172.21.15.16:0/959210464 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7fb9a8059d60 con 0x7fb9b80b1d80 2024-04-26T20:14:57.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:57.363 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:14:57.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb9940683b0 msgr2=0x7fb99406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb9940683b0 0x7fb99406a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80c49a0 tx=0x7fb9a0009190 comp rx=0 tx=0).stop 2024-04-26T20:14:57.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9b80b1d80 msgr2=0x7fb9b8159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9b80b1d80 0x7fb9b8159cd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800c450 tx=0x7fb9a800c910 comp rx=0 tx=0).stop 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 shutdown_connections 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb9940683b0 0x7fb99406a870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9b80c9e80 0x7fb9b80c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9b80c6340 0x7fb9b815a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 --2- 172.21.15.16:0/959210464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9b80b1d80 0x7fb9b8159cd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.358+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 >> 172.21.15.16:0/959210464 conn(0x7fb9b8071160 msgr2=0x7fb9b80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.362+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 shutdown_connections 2024-04-26T20:14:57.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.362+0000 7fb9bda00640 1 -- 172.21.15.16:0/959210464 wait complete. 2024-04-26T20:14:57.385 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:14:57.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:14:57.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fd0a00640 1 Processor -- start 2024-04-26T20:14:57.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fd0a00640 1 -- start start 2024-04-26T20:14:57.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fd0a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9fcc073940 0x7f9fcc0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fd0a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fcc0c4b30 con 0x7f9fcc152d00 2024-04-26T20:14:57.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fd0a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fcc0c6f60 con 0x7f9fcc15c070 2024-04-26T20:14:57.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fd0a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9fcc0c7240 con 0x7f9fcc073940 2024-04-26T20:14:57.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fc9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9fcc073940 0x7f9fcc0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fc9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9fcc073940 0x7f9fcc0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37814/0 (socket says 172.21.15.16:37814) 2024-04-26T20:14:57.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fc9400640 1 -- 172.21.15.16:0/154916809 learned_addr learned my addr 172.21.15.16:0/154916809 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:57.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fc9400640 1 -- 172.21.15.16:0/154916809 >> v1:172.21.15.192:6789/0 conn(0x7f9fcc15c070 legacy=0x7f9fcc15c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fc9400640 1 -- 172.21.15.16:0/154916809 >> v1:172.21.15.16:6789/0 conn(0x7f9fcc152d00 legacy=0x7f9fcc073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.526+0000 7f9fc9400640 1 -- 172.21.15.16:0/154916809 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc0c7520 con 0x7f9fcc073940 2024-04-26T20:14:57.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fc9400640 1 --2- 172.21.15.16:0/154916809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc073940 0x7f9fcc0c97d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800bb10 tx=0x7f9fb801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9766f43cf2c0377a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fc8a00640 1 -- 172.21.15.16:0/154916809 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80b4070 con 0x7f9fcc073940 2024-04-26T20:14:57.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fc8a00640 1 -- 172.21.15.16:0/154916809 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb80a7a90 con 0x7f9fcc073940 2024-04-26T20:14:57.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fc8a00640 1 -- 172.21.15.16:0/154916809 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a7e60 con 0x7f9fcc073940 2024-04-26T20:14:57.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fd0a00640 1 -- 172.21.15.16:0/154916809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc073940 msgr2=0x7f9fcc0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/154916809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc073940 0x7f9fcc0c97d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800bb10 tx=0x7f9fb801ec30 comp rx=0 tx=0).stop 2024-04-26T20:14:57.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fd0a00640 1 -- 172.21.15.16:0/154916809 shutdown_connections 2024-04-26T20:14:57.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/154916809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc073940 0x7f9fcc0c97d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fd0a00640 1 -- 172.21.15.16:0/154916809 >> 172.21.15.16:0/154916809 conn(0x7f9fcc0c9d10 msgr2=0x7f9fcc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:57.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fd0a00640 1 -- 172.21.15.16:0/154916809 shutdown_connections 2024-04-26T20:14:57.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.530+0000 7f9fd0a00640 1 -- 172.21.15.16:0/154916809 wait complete. 2024-04-26T20:14:57.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 Processor -- start 2024-04-26T20:14:57.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 -- start start 2024-04-26T20:14:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fcc073940 0x7f9fcc0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc152d00 0x7f9fcc1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fcc15c070 0x7f9fcc154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc070680 con 0x7f9fcc152d00 2024-04-26T20:14:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc070500 con 0x7f9fcc15c070 2024-04-26T20:14:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9fcc070800 con 0x7f9fcc073940 2024-04-26T20:14:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc152d00 0x7f9fcc1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc152d00 0x7f9fcc1549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37820/0 (socket says 172.21.15.16:37820) 2024-04-26T20:14:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 -- 172.21.15.16:0/3339341874 learned_addr learned my addr 172.21.15.16:0/3339341874 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9e00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fcc073940 0x7f9fcc0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fca800640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fcc15c070 0x7f9fcc154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 -- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fcc073940 msgr2=0x7f9fcc0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fcc073940 0x7f9fcc0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 -- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fcc15c070 msgr2=0x7f9fcc154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fcc15c070 0x7f9fcc154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 -- 172.21.15.16:0/3339341874 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc14de60 con 0x7f9fcc152d00 2024-04-26T20:14:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc9400640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc152d00 0x7f9fcc1549b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800b2c0 tx=0x7f9fb801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc2000640 1 -- 172.21.15.16:0/3339341874 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80b4030 con 0x7f9fcc152d00 2024-04-26T20:14:57.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc2000640 1 -- 172.21.15.16:0/3339341874 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb80b6070 con 0x7f9fcc152d00 2024-04-26T20:14:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fc2000640 1 -- 172.21.15.16:0/3339341874 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80ad7b0 con 0x7f9fcc152d00 2024-04-26T20:14:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc14e120 con 0x7f9fcc152d00 2024-04-26T20:14:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc14e6e0 con 0x7f9fcc152d00 2024-04-26T20:14:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.534+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fcc077c20 con 0x7f9fcc152d00 2024-04-26T20:14:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.538+0000 7f9fc2000640 1 -- 172.21.15.16:0/3339341874 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9fb80c1060 con 0x7f9fcc152d00 2024-04-26T20:14:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.538+0000 7f9fc2000640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9fac0683b0 0x7f9fac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.538+0000 7f9fc2000640 1 -- 172.21.15.16:0/3339341874 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9fb81211c0 con 0x7f9fcc152d00 2024-04-26T20:14:57.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.538+0000 7f9fc9e00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9fac0683b0 0x7f9fac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.538+0000 7f9fc9e00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9fac0683b0 0x7f9fac06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc000f70 tx=0x7f9fbc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.542+0000 7f9fc2000640 1 -- 172.21.15.16:0/3339341874 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9fb8018820 con 0x7f9fcc152d00 2024-04-26T20:14:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.706+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9fcc0c8b60 con 0x7f9fcc152d00 2024-04-26T20:14:57.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.706+0000 7f9fc2000640 1 -- 172.21.15.16:0/3339341874 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9fb80f1440 con 0x7f9fcc152d00 2024-04-26T20:14:57.712 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:14:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9fac0683b0 msgr2=0x7f9fac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9fac0683b0 0x7f9fac06a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc000f70 tx=0x7f9fbc009040 comp rx=0 tx=0).stop 2024-04-26T20:14:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc152d00 msgr2=0x7f9fcc1549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc152d00 0x7f9fcc1549b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800b2c0 tx=0x7f9fb801b9d0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 shutdown_connections 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9fac0683b0 0x7f9fac06a870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fcc15c070 0x7f9fcc154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fcc152d00 0x7f9fcc1549b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 --2- 172.21.15.16:0/3339341874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fcc073940 0x7f9fcc0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 >> 172.21.15.16:0/3339341874 conn(0x7f9fcc0c9d10 msgr2=0x7f9fcc073d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 shutdown_connections 2024-04-26T20:14:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.710+0000 7f9fd0a00640 1 -- 172.21.15.16:0/3339341874 wait complete. 2024-04-26T20:14:57.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:14:57.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe45a00640 1 Processor -- start 2024-04-26T20:14:57.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe45a00640 1 -- start start 2024-04-26T20:14:57.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe45a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe400ccc10 0x7efe4006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe45a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efe400b1f60 0x7efe40070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe45a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe401601b0 con 0x7efe40155e80 2024-04-26T20:14:57.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe45a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7efe4006d610 con 0x7efe400ccc10 2024-04-26T20:14:57.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe45a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7efe4015f3f0 con 0x7efe400b1f60 2024-04-26T20:14:57.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe400ccc10 0x7efe4006ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe400ccc10 0x7efe4006ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37826/0 (socket says 172.21.15.16:37826) 2024-04-26T20:14:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3e000640 1 -- 172.21.15.16:0/3624374226 learned_addr learned my addr 172.21.15.16:0/3624374226 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3f400640 1 --2- 172.21.15.16:0/3624374226 >> v2:172.21.15.192:3300/0 conn(0x7efe400b1f60 0x7efe40070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3e000640 1 -- 172.21.15.16:0/3624374226 >> v2:172.21.15.192:3300/0 conn(0x7efe400b1f60 msgr2=0x7efe40070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3e000640 1 --2- 172.21.15.16:0/3624374226 >> v2:172.21.15.192:3300/0 conn(0x7efe400b1f60 0x7efe40070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3e000640 1 -- 172.21.15.16:0/3624374226 >> v1:172.21.15.192:6789/0 conn(0x7efe40155e80 legacy=0x7efe4015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.874+0000 7efe3e000640 1 -- 172.21.15.16:0/3624374226 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4015f6d0 con 0x7efe400ccc10 2024-04-26T20:14:57.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe3e000640 1 --2- 172.21.15.16:0/3624374226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe400ccc10 0x7efe4006ff00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009870 tx=0x7efe2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6f75d95588cb6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe3d600640 1 -- 172.21.15.16:0/3624374226 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0b0070 con 0x7efe400ccc10 2024-04-26T20:14:57.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe3d600640 1 -- 172.21.15.16:0/3624374226 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c0ab600 con 0x7efe400ccc10 2024-04-26T20:14:57.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe3d600640 1 -- 172.21.15.16:0/3624374226 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0ab9d0 con 0x7efe400ccc10 2024-04-26T20:14:57.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 -- 172.21.15.16:0/3624374226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe400ccc10 msgr2=0x7efe4006ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 --2- 172.21.15.16:0/3624374226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe400ccc10 0x7efe4006ff00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009870 tx=0x7efe2c01c450 comp rx=0 tx=0).stop 2024-04-26T20:14:57.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 -- 172.21.15.16:0/3624374226 shutdown_connections 2024-04-26T20:14:57.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 --2- 172.21.15.16:0/3624374226 >> v2:172.21.15.192:3300/0 conn(0x7efe400b1f60 0x7efe40070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 --2- 172.21.15.16:0/3624374226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe400ccc10 0x7efe4006ff00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 -- 172.21.15.16:0/3624374226 >> 172.21.15.16:0/3624374226 conn(0x7efe40068140 msgr2=0x7efe40068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:57.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 -- 172.21.15.16:0/3624374226 shutdown_connections 2024-04-26T20:14:57.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.878+0000 7efe45a00640 1 -- 172.21.15.16:0/3624374226 wait complete. 2024-04-26T20:14:57.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 Processor -- start 2024-04-26T20:14:57.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 -- start start 2024-04-26T20:14:57.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe400b1f60 0x7efe400b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400ccc10 0x7efe4014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe40155e80 0x7efe40154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe40168e00 con 0x7efe40155e80 2024-04-26T20:14:57.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe40156260 con 0x7efe400ccc10 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efe40168f80 con 0x7efe400b1f60 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe40155e80 0x7efe40154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe40155e80 0x7efe40154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37838/0 (socket says 172.21.15.16:37838) 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 -- 172.21.15.16:0/3800365060 learned_addr learned my addr 172.21.15.16:0/3800365060 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3ea00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe400b1f60 0x7efe400b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3e000640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400ccc10 0x7efe4014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 -- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe400b1f60 msgr2=0x7efe400b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe400b1f60 0x7efe400b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 -- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400ccc10 msgr2=0x7efe4014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400ccc10 0x7efe4014ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 -- 172.21.15.16:0/3800365060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe40154ff0 con 0x7efe40155e80 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3ea00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe400b1f60 0x7efe400b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:57.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3e000640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400ccc10 0x7efe4014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:57.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe3f400640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe40155e80 0x7efe40154050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe38007e70 tx=0x7efe3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe36a00640 1 -- 172.21.15.16:0/3800365060 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38014620 con 0x7efe40155e80 2024-04-26T20:14:57.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe36a00640 1 -- 172.21.15.16:0/3800365060 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe38019070 con 0x7efe40155e80 2024-04-26T20:14:57.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe401f5e60 con 0x7efe40155e80 2024-04-26T20:14:57.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe36a00640 1 -- 172.21.15.16:0/3800365060 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38014a20 con 0x7efe40155e80 2024-04-26T20:14:57.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe400b30d0 con 0x7efe40155e80 2024-04-26T20:14:57.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.882+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe40077c20 con 0x7efe40155e80 2024-04-26T20:14:57.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.886+0000 7efe36a00640 1 -- 172.21.15.16:0/3800365060 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe38014bc0 con 0x7efe40155e80 2024-04-26T20:14:57.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.886+0000 7efe36a00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efe200683b0 0x7efe2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:57.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.886+0000 7efe36a00640 1 -- 172.21.15.16:0/3800365060 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efe38087650 con 0x7efe40155e80 2024-04-26T20:14:57.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.886+0000 7efe3ea00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efe200683b0 0x7efe2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:57.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.886+0000 7efe3ea00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efe200683b0 0x7efe2006a870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe40152320 tx=0x7efe30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:57.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:57.890+0000 7efe36a00640 1 -- 172.21.15.16:0/3800365060 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efe38011260 con 0x7efe40155e80 2024-04-26T20:14:58.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.054+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efe400c97b0 con 0x7efe40155e80 2024-04-26T20:14:58.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.054+0000 7efe36a00640 1 -- 172.21.15.16:0/3800365060 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7efe38057840 con 0x7efe40155e80 2024-04-26T20:14:58.060 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efe200683b0 msgr2=0x7efe2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efe200683b0 0x7efe2006a870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe40152320 tx=0x7efe30008040 comp rx=0 tx=0).stop 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe40155e80 msgr2=0x7efe40154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe40155e80 0x7efe40154050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe38007e70 tx=0x7efe3800e4b0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 shutdown_connections 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efe200683b0 0x7efe2006a870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe40155e80 0x7efe40154050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe400ccc10 0x7efe4014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 --2- 172.21.15.16:0/3800365060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe400b1f60 0x7efe400b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 >> 172.21.15.16:0/3800365060 conn(0x7efe40068140 msgr2=0x7efe400c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:58.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 shutdown_connections 2024-04-26T20:14:58.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.058+0000 7efe45a00640 1 -- 172.21.15.16:0/3800365060 wait complete. 2024-04-26T20:14:58.082 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:14:58.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e28400640 1 Processor -- start 2024-04-26T20:14:58.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e28400640 1 -- start start 2024-04-26T20:14:58.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e28400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8e20155f80 0x7f8e200cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e28400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e200cabe0 0x7f8e200ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e28400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2015f410 con 0x7f8e200cd470 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e28400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8e2015f6f0 con 0x7f8e200cabe0 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e28400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f8e2015f9d0 con 0x7f8e20155f80 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e25000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e200cabe0 0x7f8e200ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e26400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8e200cd470 0x7f8e2015bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51932/0 (socket says 172.21.15.16:51932) 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e25000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e200cabe0 0x7f8e200ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37842/0 (socket says 172.21.15.16:37842) 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e26400640 1 -- 172.21.15.16:0/3655892427 learned_addr learned my addr 172.21.15.16:0/3655892427 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e25a00640 1 --2- 172.21.15.16:0/3655892427 >> v2:172.21.15.192:3300/0 conn(0x7f8e20155f80 0x7f8e200cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e25000640 1 -- 172.21.15.16:0/3655892427 >> v2:172.21.15.192:3300/0 conn(0x7f8e20155f80 msgr2=0x7f8e200cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e25000640 1 --2- 172.21.15.16:0/3655892427 >> v2:172.21.15.192:3300/0 conn(0x7f8e20155f80 0x7f8e200cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e25000640 1 -- 172.21.15.16:0/3655892427 >> v1:172.21.15.16:6789/0 conn(0x7f8e200cd470 legacy=0x7f8e2015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.222+0000 7f8e25000640 1 -- 172.21.15.16:0/3655892427 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2015fcb0 con 0x7f8e200cabe0 2024-04-26T20:14:58.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e25000640 1 --2- 172.21.15.16:0/3655892427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e200ccf30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8e200cb590 tx=0x7f8e0c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3964d85ab1ddd97a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e1fe00640 1 -- 172.21.15.16:0/3655892427 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0b5070 con 0x7f8e200cabe0 2024-04-26T20:14:58.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e1fe00640 1 -- 172.21.15.16:0/3655892427 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0a8970 con 0x7f8e200cabe0 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e1fe00640 1 -- 172.21.15.16:0/3655892427 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0a8d40 con 0x7f8e200cabe0 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 -- 172.21.15.16:0/3655892427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 msgr2=0x7f8e200ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 --2- 172.21.15.16:0/3655892427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e200ccf30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8e200cb590 tx=0x7f8e0c01ec70 comp rx=0 tx=0).stop 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 -- 172.21.15.16:0/3655892427 shutdown_connections 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 --2- 172.21.15.16:0/3655892427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e200ccf30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 --2- 172.21.15.16:0/3655892427 >> v2:172.21.15.192:3300/0 conn(0x7f8e20155f80 0x7f8e200cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 -- 172.21.15.16:0/3655892427 >> 172.21.15.16:0/3655892427 conn(0x7f8e2006c380 msgr2=0x7f8e2006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 -- 172.21.15.16:0/3655892427 shutdown_connections 2024-04-26T20:14:58.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 -- 172.21.15.16:0/3655892427 wait complete. 2024-04-26T20:14:58.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 Processor -- start 2024-04-26T20:14:58.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.226+0000 7f8e28400640 1 -- start start 2024-04-26T20:14:58.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e20151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200cd470 0x7f8e2014aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e20155f80 0x7f8e2014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200cc7a0 con 0x7f8e200cabe0 2024-04-26T20:14:58.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200cbd10 con 0x7f8e200cd470 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8e20156360 con 0x7f8e20155f80 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e20151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e20151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37848/0 (socket says 172.21.15.16:37848) 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 -- 172.21.15.16:0/2558288044 learned_addr learned my addr 172.21.15.16:0/2558288044 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25000640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200cd470 0x7f8e2014aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e26400640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e20155f80 0x7f8e2014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 -- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e20155f80 msgr2=0x7f8e2014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e20155f80 0x7f8e2014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 -- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200cd470 msgr2=0x7f8e2014aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200cd470 0x7f8e2014aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 -- 172.21.15.16:0/2558288044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e201f2630 con 0x7f8e200cabe0 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25000640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200cd470 0x7f8e2014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:58.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e25a00640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e20151b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400e960 tx=0x7f8e1400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e1d600640 1 -- 172.21.15.16:0/2558288044 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14017070 con 0x7f8e200cabe0 2024-04-26T20:14:58.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e1d600640 1 -- 172.21.15.16:0/2558288044 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1400ca00 con 0x7f8e200cabe0 2024-04-26T20:14:58.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e1d600640 1 -- 172.21.15.16:0/2558288044 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400cdb0 con 0x7f8e200cabe0 2024-04-26T20:14:58.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e20150d50 con 0x7f8e200cabe0 2024-04-26T20:14:58.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e20151310 con 0x7f8e200cabe0 2024-04-26T20:14:58.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e20077c20 con 0x7f8e200cabe0 2024-04-26T20:14:58.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.230+0000 7f8e1d600640 1 -- 172.21.15.16:0/2558288044 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8e1401a070 con 0x7f8e200cabe0 2024-04-26T20:14:58.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.234+0000 7f8e1d600640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8e00068380 0x7f8e0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.234+0000 7f8e1d600640 1 -- 172.21.15.16:0/2558288044 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e14087100 con 0x7f8e200cabe0 2024-04-26T20:14:58.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.234+0000 7f8e25000640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8e00068380 0x7f8e0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.234+0000 7f8e25000640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8e00068380 0x7f8e0006a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0b2000 tx=0x7f8e0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.238+0000 7f8e1d600640 1 -- 172.21.15.16:0/2558288044 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8e14057370 con 0x7f8e200cabe0 2024-04-26T20:14:58.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8e200cc1d0 con 0x7f8e200cabe0 2024-04-26T20:14:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e1d600640 1 -- 172.21.15.16:0/2558288044 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f8e1405d030 con 0x7f8e200cabe0 2024-04-26T20:14:58.411 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8e00068380 msgr2=0x7f8e0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8e00068380 0x7f8e0006a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0b2000 tx=0x7f8e0c008040 comp rx=0 tx=0).stop 2024-04-26T20:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 msgr2=0x7f8e20151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e20151b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400e960 tx=0x7f8e1400ee20 comp rx=0 tx=0).stop 2024-04-26T20:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 shutdown_connections 2024-04-26T20:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8e00068380 0x7f8e0006a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e20155f80 0x7f8e2014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e200cd470 0x7f8e2014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 --2- 172.21.15.16:0/2558288044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e200cabe0 0x7f8e20151b10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 >> 172.21.15.16:0/2558288044 conn(0x7f8e2006c380 msgr2=0x7f8e20073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 shutdown_connections 2024-04-26T20:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.406+0000 7f8e28400640 1 -- 172.21.15.16:0/2558288044 wait complete. 2024-04-26T20:14:58.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:14:58.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5525600640 1 Processor -- start 2024-04-26T20:14:58.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5525600640 1 -- start start 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5525600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006f460 0x7f552015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5525600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5520153eb0 0x7f552006f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5525600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55200c96a0 con 0x7f552006fd80 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5525600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f552015ac00 con 0x7f5520153eb0 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5525600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5520070210 con 0x7f552006f460 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5517e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5520153eb0 0x7f552006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5517e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5520153eb0 0x7f552006f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37862/0 (socket says 172.21.15.16:37862) 2024-04-26T20:14:58.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5517e00640 1 -- 172.21.15.16:0/2154549750 learned_addr learned my addr 172.21.15.16:0/2154549750 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f551ea00640 1 --2- 172.21.15.16:0/2154549750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006f460 0x7f552015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5517e00640 1 -- 172.21.15.16:0/2154549750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006f460 msgr2=0x7f552015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5517e00640 1 --2- 172.21.15.16:0/2154549750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006f460 0x7f552015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5517e00640 1 -- 172.21.15.16:0/2154549750 >> v1:172.21.15.16:6789/0 conn(0x7f552006fd80 legacy=0x7f55200c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f5517e00640 1 -- 172.21.15.16:0/2154549750 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55200c9980 con 0x7f5520153eb0 2024-04-26T20:14:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f551ea00640 1 --2- 172.21.15.16:0/2154549750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006f460 0x7f552015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:58.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.574+0000 7f551e000640 1 -- 172.21.15.16:0/2154549750 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922431179 0 0) 0x7f55200c96a0 con 0x7f552006fd80 2024-04-26T20:14:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5517e00640 1 --2- 172.21.15.16:0/2154549750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520153eb0 0x7f552006f840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55080098a0 tx=0x7f550801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded1b08db5fbb8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f551e000640 1 -- 172.21.15.16:0/2154549750 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55080b5070 con 0x7f5520153eb0 2024-04-26T20:14:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f551e000640 1 -- 172.21.15.16:0/2154549750 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55080a8a30 con 0x7f5520153eb0 2024-04-26T20:14:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f551e000640 1 -- 172.21.15.16:0/2154549750 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55080a8e00 con 0x7f5520153eb0 2024-04-26T20:14:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 -- 172.21.15.16:0/2154549750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520153eb0 msgr2=0x7f552006f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 --2- 172.21.15.16:0/2154549750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520153eb0 0x7f552006f840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55080098a0 tx=0x7f550801ed30 comp rx=0 tx=0).stop 2024-04-26T20:14:58.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 -- 172.21.15.16:0/2154549750 shutdown_connections 2024-04-26T20:14:58.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 --2- 172.21.15.16:0/2154549750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520153eb0 0x7f552006f840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 --2- 172.21.15.16:0/2154549750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006f460 0x7f552015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 -- 172.21.15.16:0/2154549750 >> 172.21.15.16:0/2154549750 conn(0x7f55200c9d10 msgr2=0x7f55200ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:58.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 -- 172.21.15.16:0/2154549750 shutdown_connections 2024-04-26T20:14:58.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.578+0000 7f5525600640 1 -- 172.21.15.16:0/2154549750 wait complete. 2024-04-26T20:14:58.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 Processor -- start 2024-04-26T20:14:58.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 -- start start 2024-04-26T20:14:58.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f552006f460 0x7f55201550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006fd80 0x7f5520150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520074090 0x7f5520158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55200c5120 con 0x7f5520074090 2024-04-26T20:14:58.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f55200708f0 con 0x7f552006f460 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f55200c4d70 con 0x7f552006fd80 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520074090 0x7f5520158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520074090 0x7f5520158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37876/0 (socket says 172.21.15.16:37876) 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 -- 172.21.15.16:0/1074485631 learned_addr learned my addr 172.21.15.16:0/1074485631 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551ea00640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f552006f460 0x7f55201550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5517e00640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006fd80 0x7f5520150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 -- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006fd80 msgr2=0x7f5520150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006fd80 0x7f5520150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 -- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f552006f460 msgr2=0x7f55201550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f552006f460 0x7f55201550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 -- 172.21.15.16:0/1074485631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5520157bc0 con 0x7f5520074090 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f551f400640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520074090 0x7f5520158bc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f551800c780 tx=0x7f551800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5516a00640 1 -- 172.21.15.16:0/1074485631 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518003db0 con 0x7f5520074090 2024-04-26T20:14:58.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5516a00640 1 -- 172.21.15.16:0/1074485631 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5518005070 con 0x7f5520074090 2024-04-26T20:14:58.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5516a00640 1 -- 172.21.15.16:0/1074485631 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518005460 con 0x7f5520074090 2024-04-26T20:14:58.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5520149b90 con 0x7f5520074090 2024-04-26T20:14:58.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5520158120 con 0x7f5520074090 2024-04-26T20:14:58.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.582+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5520077c20 con 0x7f5520074090 2024-04-26T20:14:58.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.586+0000 7f5516a00640 1 -- 172.21.15.16:0/1074485631 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5518005600 con 0x7f5520074090 2024-04-26T20:14:58.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.586+0000 7f5516a00640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f54fc068450 0x7f54fc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.586+0000 7f5516a00640 1 -- 172.21.15.16:0/1074485631 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5518086ad0 con 0x7f5520074090 2024-04-26T20:14:58.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.586+0000 7f551ea00640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f54fc068450 0x7f54fc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.586+0000 7f551ea00640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f54fc068450 0x7f54fc06a910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5510009950 tx=0x7f5510008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.590+0000 7f5516a00640 1 -- 172.21.15.16:0/1074485631 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5520157bc0 con 0x7f5520074090 2024-04-26T20:14:58.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.754+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5520070c20 con 0x7f5520074090 2024-04-26T20:14:58.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.754+0000 7f5516a00640 1 -- 172.21.15.16:0/1074485631 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f5518056770 con 0x7f5520074090 2024-04-26T20:14:58.761 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f54fc068450 msgr2=0x7f54fc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f54fc068450 0x7f54fc06a910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5510009950 tx=0x7f5510008040 comp rx=0 tx=0).stop 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520074090 msgr2=0x7f5520158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520074090 0x7f5520158bc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f551800c780 tx=0x7f551800cc40 comp rx=0 tx=0).stop 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 shutdown_connections 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f54fc068450 0x7f54fc06a910 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5520074090 0x7f5520158bc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f552006fd80 0x7f5520150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 --2- 172.21.15.16:0/1074485631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f552006f460 0x7f55201550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 >> 172.21.15.16:0/1074485631 conn(0x7f55200c9d10 msgr2=0x7f55200c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:58.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 shutdown_connections 2024-04-26T20:14:58.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.758+0000 7f5525600640 1 -- 172.21.15.16:0/1074485631 wait complete. 2024-04-26T20:14:58.782 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-04-26T20:14:58.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:14:58.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d8ac00640 1 Processor -- start 2024-04-26T20:14:58.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d8ac00640 1 -- start start 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d8ac00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9d840b47e0 0x7f9d8406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d8ac00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9d840c63f0 0x7f9d840703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d8ac00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d840cb7f0 con 0x7f9d841574b0 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d8ac00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9d840ccd80 con 0x7f9d840b47e0 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d8ac00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f9d840c9e80 con 0x7f9d840c63f0 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d83e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9d841574b0 0x7f9d840ca730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51952/0 (socket says 172.21.15.16:51952) 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d83e00640 1 -- 172.21.15.16:0/3917132215 learned_addr learned my addr 172.21.15.16:0/3917132215 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d7b400640 1 --2- 172.21.15.16:0/3917132215 >> v2:172.21.15.16:3300/0 conn(0x7f9d840b47e0 0x7f9d8406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d88c00640 1 --2- 172.21.15.16:0/3917132215 >> v2:172.21.15.192:3300/0 conn(0x7f9d840c63f0 0x7f9d840703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d7b400640 1 -- 172.21.15.16:0/3917132215 >> v2:172.21.15.192:3300/0 conn(0x7f9d840c63f0 msgr2=0x7f9d840703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:58.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d7b400640 1 --2- 172.21.15.16:0/3917132215 >> v2:172.21.15.192:3300/0 conn(0x7f9d840c63f0 0x7f9d840703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d7b400640 1 -- 172.21.15.16:0/3917132215 >> v1:172.21.15.16:6789/0 conn(0x7f9d841574b0 legacy=0x7f9d840ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.918+0000 7f9d7b400640 1 -- 172.21.15.16:0/3917132215 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d840ca0d0 con 0x7f9d840b47e0 2024-04-26T20:14:58.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d7b400640 1 --2- 172.21.15.16:0/3917132215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406feb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9d840b2330 tx=0x7f9d6c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249b0923ea7e779b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d83400640 1 -- 172.21.15.16:0/3917132215 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0b2070 con 0x7f9d840b47e0 2024-04-26T20:14:58.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d83400640 1 -- 172.21.15.16:0/3917132215 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0a58e0 con 0x7f9d840b47e0 2024-04-26T20:14:58.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d83400640 1 -- 172.21.15.16:0/3917132215 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0a5cb0 con 0x7f9d840b47e0 2024-04-26T20:14:58.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 -- 172.21.15.16:0/3917132215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 msgr2=0x7f9d8406feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/3917132215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406feb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9d840b2330 tx=0x7f9d6c01c930 comp rx=0 tx=0).stop 2024-04-26T20:14:58.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 -- 172.21.15.16:0/3917132215 shutdown_connections 2024-04-26T20:14:58.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/3917132215 >> v2:172.21.15.192:3300/0 conn(0x7f9d840c63f0 0x7f9d840703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/3917132215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406feb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 -- 172.21.15.16:0/3917132215 >> 172.21.15.16:0/3917132215 conn(0x7f9d84071160 msgr2=0x7f9d84068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:58.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 -- 172.21.15.16:0/3917132215 shutdown_connections 2024-04-26T20:14:58.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.922+0000 7f9d8ac00640 1 -- 172.21.15.16:0/3917132215 wait complete. 2024-04-26T20:14:58.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 Processor -- start 2024-04-26T20:14:58.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 -- start start 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d840c63f0 0x7f9d84148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d841574b0 0x7f9d841f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9d84166ec0 con 0x7f9d840b47e0 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d84166d40 con 0x7f9d841574b0 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9d84167040 con 0x7f9d840c63f0 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37886/0 (socket says 172.21.15.16:37886) 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 -- 172.21.15.16:0/2424086428 learned_addr learned my addr 172.21.15.16:0/2424086428 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d88c00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d841574b0 0x7f9d841f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d7b400640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d840c63f0 0x7f9d84148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 -- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d840c63f0 msgr2=0x7f9d84148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d840c63f0 0x7f9d84148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 -- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d841574b0 msgr2=0x7f9d841f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d841574b0 0x7f9d841f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 -- 172.21.15.16:0/2424086428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d84153700 con 0x7f9d840b47e0 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d7b400640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d840c63f0 0x7f9d84148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d83e00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406eb50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400c3a0 tx=0x7f9d7400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d80c00640 1 -- 172.21.15.16:0/2424086428 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74017070 con 0x7f9d840b47e0 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d80c00640 1 -- 172.21.15.16:0/2424086428 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74005cf0 con 0x7f9d840b47e0 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d80c00640 1 -- 172.21.15.16:0/2424086428 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d740072f0 con 0x7f9d840b47e0 2024-04-26T20:14:58.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d841f8d50 con 0x7f9d840b47e0 2024-04-26T20:14:58.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d841f9310 con 0x7f9d840b47e0 2024-04-26T20:14:58.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.926+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d84077c20 con 0x7f9d840b47e0 2024-04-26T20:14:58.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.930+0000 7f9d80c00640 1 -- 172.21.15.16:0/2424086428 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d7401a070 con 0x7f9d840b47e0 2024-04-26T20:14:58.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.930+0000 7f9d80c00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d60068380 0x7f9d6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:58.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.930+0000 7f9d80c00640 1 -- 172.21.15.16:0/2424086428 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d74085f90 con 0x7f9d840b47e0 2024-04-26T20:14:58.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.930+0000 7f9d7b400640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d60068380 0x7f9d6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:58.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.930+0000 7f9d7b400640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d60068380 0x7f9d6006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0af000 tx=0x7f9d6c0a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:58.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:58.934+0000 7f9d80c00640 1 -- 172.21.15.16:0/2424086428 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9d74055bb0 con 0x7f9d840b47e0 2024-04-26T20:14:59.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.138+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d8415ab70 con 0x7f9d840b47e0 2024-04-26T20:14:59.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.138+0000 7f9d80c00640 1 -- 172.21.15.16:0/2424086428 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f9d74059eb0 con 0x7f9d840b47e0 2024-04-26T20:14:59.144 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:59.144 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:14:59.144 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d60068380 msgr2=0x7f9d6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d60068380 0x7f9d6006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0af000 tx=0x7f9d6c0a7070 comp rx=0 tx=0).stop 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 msgr2=0x7f9d8406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406eb50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400c3a0 tx=0x7f9d7400c860 comp rx=0 tx=0).stop 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 shutdown_connections 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d60068380 0x7f9d6006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d841574b0 0x7f9d841f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d840c63f0 0x7f9d84148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 --2- 172.21.15.16:0/2424086428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d840b47e0 0x7f9d8406eb50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 >> 172.21.15.16:0/2424086428 conn(0x7f9d84071160 msgr2=0x7f9d840caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 shutdown_connections 2024-04-26T20:14:59.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.142+0000 7f9d8ac00640 1 -- 172.21.15.16:0/2424086428 wait complete. 2024-04-26T20:14:59.165 INFO:tasks.mds_thrash:Ready to start thrashing 2024-04-26T20:14:59.165 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-04-26T20:14:59.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:14:59.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f820cc00640 1 Processor -- start 2024-04-26T20:14:59.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f820cc00640 1 -- start start 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f820cc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8208153af0 0x7f820815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f820cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f82080c7b80 0x7f82080c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f820cc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82080c9d90 con 0x7f82080c9010 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f820cc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f82080ca630 con 0x7f82080c7b80 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f820cc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f82080ca070 con 0x7f8208153af0 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f81fd400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f82080c7b80 0x7f82080c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f81fd400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f82080c7b80 0x7f82080c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37890/0 (socket says 172.21.15.16:37890) 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f81fd400640 1 -- 172.21.15.16:0/2044127769 learned_addr learned my addr 172.21.15.16:0/2044127769 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f8205e00640 1 --2- 172.21.15.16:0/2044127769 >> v2:172.21.15.192:3300/0 conn(0x7f8208153af0 0x7f820815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f81fd400640 1 -- 172.21.15.16:0/2044127769 >> v2:172.21.15.192:3300/0 conn(0x7f8208153af0 msgr2=0x7f820815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:59.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f81fd400640 1 --2- 172.21.15.16:0/2044127769 >> v2:172.21.15.192:3300/0 conn(0x7f8208153af0 0x7f820815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f81fd400640 1 -- 172.21.15.16:0/2044127769 >> v1:172.21.15.192:6789/0 conn(0x7f82080c9010 legacy=0x7f82080c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.302+0000 7f81fd400640 1 -- 172.21.15.16:0/2044127769 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82080ca350 con 0x7f82080c7b80 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f81fd400640 1 --2- 172.21.15.16:0/2044127769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c7b80 0x7f82080c7f80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f82080745d0 tx=0x7f81f001f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3043bbff1cc88984 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f8205400640 1 -- 172.21.15.16:0/2044127769 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00b4070 con 0x7f82080c7b80 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f8205400640 1 -- 172.21.15.16:0/2044127769 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f00af400 con 0x7f82080c7b80 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f8205400640 1 -- 172.21.15.16:0/2044127769 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00af7d0 con 0x7f82080c7b80 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 -- 172.21.15.16:0/2044127769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c7b80 msgr2=0x7f82080c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 --2- 172.21.15.16:0/2044127769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c7b80 0x7f82080c7f80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f82080745d0 tx=0x7f81f001f1a0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 -- 172.21.15.16:0/2044127769 shutdown_connections 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 --2- 172.21.15.16:0/2044127769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c7b80 0x7f82080c7f80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 --2- 172.21.15.16:0/2044127769 >> v2:172.21.15.192:3300/0 conn(0x7f8208153af0 0x7f820815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 -- 172.21.15.16:0/2044127769 >> 172.21.15.16:0/2044127769 conn(0x7f820806c380 msgr2=0x7f820806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:59.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 -- 172.21.15.16:0/2044127769 shutdown_connections 2024-04-26T20:14:59.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.306+0000 7f820cc00640 1 -- 172.21.15.16:0/2044127769 wait complete. 2024-04-26T20:14:59.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 Processor -- start 2024-04-26T20:14:59.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 -- start start 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82080c7b80 0x7f82081f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c9010 0x7f82081ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8208153af0 0x7f82081595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8208153ed0 con 0x7f82080c9010 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f820815d290 con 0x7f8208153af0 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8208154050 con 0x7f82080c7b80 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c9010 0x7f82081ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c9010 0x7f82081ef880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37900/0 (socket says 172.21.15.16:37900) 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 -- 172.21.15.16:0/2129979100 learned_addr learned my addr 172.21.15.16:0/2129979100 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:59.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f8205e00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82080c7b80 0x7f82081f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f8206800640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8208153af0 0x7f82081595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 -- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82080c7b80 msgr2=0x7f82081f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82080c7b80 0x7f82081f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 -- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8208153af0 msgr2=0x7f82081595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8208153af0 0x7f82081595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 -- 172.21.15.16:0/2129979100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82081f00c0 con 0x7f82080c9010 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fd400640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c9010 0x7f82081ef880 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81f00b2040 tx=0x7f81f001bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fea00640 1 -- 172.21.15.16:0/2129979100 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00b4040 con 0x7f82080c9010 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fea00640 1 -- 172.21.15.16:0/2129979100 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f00c0070 con 0x7f82080c9010 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82081f03a0 con 0x7f82080c9010 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f81fea00640 1 -- 172.21.15.16:0/2129979100 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0009510 con 0x7f82080c9010 2024-04-26T20:14:59.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.310+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82081f3060 con 0x7f82080c9010 2024-04-26T20:14:59.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.314+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8208077c20 con 0x7f82080c9010 2024-04-26T20:14:59.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.314+0000 7f81fea00640 1 -- 172.21.15.16:0/2129979100 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81f00ba660 con 0x7f82080c9010 2024-04-26T20:14:59.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.314+0000 7f81fea00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f81e4068380 0x7f81e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.314+0000 7f81fea00640 1 -- 172.21.15.16:0/2129979100 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f81f0125090 con 0x7f82080c9010 2024-04-26T20:14:59.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.314+0000 7f8205e00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f81e4068380 0x7f81e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.314+0000 7f8205e00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f81e4068380 0x7f81e406a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f81f80079c0 tx=0x7f81f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:59.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.318+0000 7f81fea00640 1 -- 172.21.15.16:0/2129979100 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f81f0018d00 con 0x7f82080c9010 2024-04-26T20:14:59.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.482+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82080c8670 con 0x7f81e4068380 2024-04-26T20:14:59.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.506+0000 7f81fea00640 1 -- 172.21.15.16:0/2129979100 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332699 (secure 0 0 0) 0x7f82080c8670 con 0x7f81e4068380 2024-04-26T20:14:59.514 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:59.516 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:14:59.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f81e4068380 msgr2=0x7f81e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f81e4068380 0x7f81e406a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f81f80079c0 tx=0x7f81f8008040 comp rx=0 tx=0).stop 2024-04-26T20:14:59.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c9010 msgr2=0x7f82081ef880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c9010 0x7f82081ef880 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81f00b2040 tx=0x7f81f001bf40 comp rx=0 tx=0).stop 2024-04-26T20:14:59.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 shutdown_connections 2024-04-26T20:14:59.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f81e4068380 0x7f81e406a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8208153af0 0x7f82081595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82080c9010 0x7f82081ef880 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 --2- 172.21.15.16:0/2129979100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82080c7b80 0x7f82081f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 >> 172.21.15.16:0/2129979100 conn(0x7f820806c380 msgr2=0x7f820814c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:59.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 shutdown_connections 2024-04-26T20:14:59.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.510+0000 7f820cc00640 1 -- 172.21.15.16:0/2129979100 wait complete. 2024-04-26T20:14:59.534 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-26T20:14:58.965874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226784,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747936,"statfs":{"total":773094113280,"available":772861886464,"internally_reserved":0,"allocated":2392064,"data_stored":2024628,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1664,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004874"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127396+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:14:46.127396+0000","last_peered":"2024-04-26T20:14:46.127396+0000","last_clean":"2024-04-26T20:14:46.127396+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:14:46.127396+0000","last_undegraded":"2024-04-26T20:14:46.127396+0000","last_fullsized":"2024-04-26T20:14:46.127396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547330+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:14:20.547330+0000","last_peered":"2024-04-26T20:14:20.547330+0000","last_clean":"2024-04-26T20:14:20.547330+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:14:20.547330+0000","last_undegraded":"2024-04-26T20:14:20.547330+0000","last_fullsized":"2024-04-26T20:14:20.547330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547016+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:14:20.547016+0000","last_peered":"2024-04-26T20:14:20.547016+0000","last_clean":"2024-04-26T20:14:20.547016+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:14:20.547016+0000","last_undegraded":"2024-04-26T20:14:20.547016+0000","last_fullsized":"2024-04-26T20:14:20.547016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547738+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:14:20.547738+0000","last_peered":"2024-04-26T20:14:20.547738+0000","last_clean":"2024-04-26T20:14:20.547738+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:14:20.547738+0000","last_undegraded":"2024-04-26T20:14:20.547738+0000","last_fullsized":"2024-04-26T20:14:20.547738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885447+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:14:19.885447+0000","last_peered":"2024-04-26T20:14:19.885447+0000","last_clean":"2024-04-26T20:14:19.885447+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:14:19.885447+0000","last_undegraded":"2024-04-26T20:14:19.885447+0000","last_fullsized":"2024-04-26T20:14:19.885447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507611+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:14:19.507611+0000","last_peered":"2024-04-26T20:14:19.507611+0000","last_clean":"2024-04-26T20:14:19.507611+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:14:19.507611+0000","last_undegraded":"2024-04-26T20:14:19.507611+0000","last_fullsized":"2024-04-26T20:14:19.507611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.124085+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:14:46.124085+0000","last_peered":"2024-04-26T20:14:46.124085+0000","last_clean":"2024-04-26T20:14:46.124085+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:14:46.124085+0000","last_undegraded":"2024-04-26T20:14:46.124085+0000","last_fullsized":"2024-04-26T20:14:46.124085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551492+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:14:20.551492+0000","last_peered":"2024-04-26T20:14:20.551492+0000","last_clean":"2024-04-26T20:14:20.551492+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:14:20.551492+0000","last_undegraded":"2024-04-26T20:14:20.551492+0000","last_fullsized":"2024-04-26T20:14:20.551492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507856+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:14:19.507856+0000","last_peered":"2024-04-26T20:14:19.507856+0000","last_clean":"2024-04-26T20:14:19.507856+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:14:19.507856+0000","last_undegraded":"2024-04-26T20:14:19.507856+0000","last_fullsized":"2024-04-26T20:14:19.507856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340190+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:14:20.340190+0000","last_peered":"2024-04-26T20:14:20.340190+0000","last_clean":"2024-04-26T20:14:20.340190+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:14:20.340190+0000","last_undegraded":"2024-04-26T20:14:20.340190+0000","last_fullsized":"2024-04-26T20:14:20.340190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551323+0000","last_change":"2024-04-26T20:14:14.499292+0000","last_active":"2024-04-26T20:14:20.551323+0000","last_peered":"2024-04-26T20:14:20.551323+0000","last_clean":"2024-04-26T20:14:20.551323+0000","last_became_active":"2024-04-26T20:14:14.498610+0000","last_became_peered":"2024-04-26T20:14:14.498610+0000","last_unstale":"2024-04-26T20:14:20.551323+0000","last_undegraded":"2024-04-26T20:14:20.551323+0000","last_fullsized":"2024-04-26T20:14:20.551323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:44.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508054+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:14:19.508054+0000","last_peered":"2024-04-26T20:14:19.508054+0000","last_clean":"2024-04-26T20:14:19.508054+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:14:19.508054+0000","last_undegraded":"2024-04-26T20:14:19.508054+0000","last_fullsized":"2024-04-26T20:14:19.508054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504675+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:14:19.504675+0000","last_peered":"2024-04-26T20:14:19.504675+0000","last_clean":"2024-04-26T20:14:19.504675+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:14:19.504675+0000","last_undegraded":"2024-04-26T20:14:19.504675+0000","last_fullsized":"2024-04-26T20:14:19.504675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.087410+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:14:40.087410+0000","last_peered":"2024-04-26T20:14:40.087410+0000","last_clean":"2024-04-26T20:14:40.087410+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:14:40.087410+0000","last_undegraded":"2024-04-26T20:14:40.087410+0000","last_fullsized":"2024-04-26T20:14:40.087410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509512+0000","last_change":"2024-04-26T20:14:18.527474+0000","last_active":"2024-04-26T20:14:19.509512+0000","last_peered":"2024-04-26T20:14:19.509512+0000","last_clean":"2024-04-26T20:14:19.509512+0000","last_became_active":"2024-04-26T20:14:18.526374+0000","last_became_peered":"2024-04-26T20:14:18.526374+0000","last_unstale":"2024-04-26T20:14:19.509512+0000","last_undegraded":"2024-04-26T20:14:19.509512+0000","last_fullsized":"2024-04-26T20:14:19.509512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:31.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547337+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:14:20.547337+0000","last_peered":"2024-04-26T20:14:20.547337+0000","last_clean":"2024-04-26T20:14:20.547337+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:14:20.547337+0000","last_undegraded":"2024-04-26T20:14:20.547337+0000","last_fullsized":"2024-04-26T20:14:20.547337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537897+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:14:20.537897+0000","last_peered":"2024-04-26T20:14:20.537897+0000","last_clean":"2024-04-26T20:14:20.537897+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:14:20.537897+0000","last_undegraded":"2024-04-26T20:14:20.537897+0000","last_fullsized":"2024-04-26T20:14:20.537897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509176+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:14:19.509176+0000","last_peered":"2024-04-26T20:14:19.509176+0000","last_clean":"2024-04-26T20:14:19.509176+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:14:19.509176+0000","last_undegraded":"2024-04-26T20:14:19.509176+0000","last_fullsized":"2024-04-26T20:14:19.509176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547119+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:14:20.547119+0000","last_peered":"2024-04-26T20:14:20.547119+0000","last_clean":"2024-04-26T20:14:20.547119+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:14:20.547119+0000","last_undegraded":"2024-04-26T20:14:20.547119+0000","last_fullsized":"2024-04-26T20:14:20.547119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.099897+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:14:40.099897+0000","last_peered":"2024-04-26T20:14:40.099897+0000","last_clean":"2024-04-26T20:14:40.099897+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:14:40.099897+0000","last_undegraded":"2024-04-26T20:14:40.099897+0000","last_fullsized":"2024-04-26T20:14:40.099897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508115+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:14:19.508115+0000","last_peered":"2024-04-26T20:14:19.508115+0000","last_clean":"2024-04-26T20:14:19.508115+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:14:19.508115+0000","last_undegraded":"2024-04-26T20:14:19.508115+0000","last_fullsized":"2024-04-26T20:14:19.508115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.090799+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:14:40.090799+0000","last_peered":"2024-04-26T20:14:40.090799+0000","last_clean":"2024-04-26T20:14:40.090799+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:14:40.090799+0000","last_undegraded":"2024-04-26T20:14:40.090799+0000","last_fullsized":"2024-04-26T20:14:40.090799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509417+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:14:19.509417+0000","last_peered":"2024-04-26T20:14:19.509417+0000","last_clean":"2024-04-26T20:14:19.509417+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:14:19.509417+0000","last_undegraded":"2024-04-26T20:14:19.509417+0000","last_fullsized":"2024-04-26T20:14:19.509417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885352+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:14:19.885352+0000","last_peered":"2024-04-26T20:14:19.885352+0000","last_clean":"2024-04-26T20:14:19.885352+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:14:19.885352+0000","last_undegraded":"2024-04-26T20:14:19.885352+0000","last_fullsized":"2024-04-26T20:14:19.885352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.091154+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:14:40.091154+0000","last_peered":"2024-04-26T20:14:40.091154+0000","last_clean":"2024-04-26T20:14:40.091154+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:14:40.091154+0000","last_undegraded":"2024-04-26T20:14:40.091154+0000","last_fullsized":"2024-04-26T20:14:40.091154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507739+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:14:19.507739+0000","last_peered":"2024-04-26T20:14:19.507739+0000","last_clean":"2024-04-26T20:14:19.507739+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:14:19.507739+0000","last_undegraded":"2024-04-26T20:14:19.507739+0000","last_fullsized":"2024-04-26T20:14:19.507739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547916+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:14:20.547916+0000","last_peered":"2024-04-26T20:14:20.547916+0000","last_clean":"2024-04-26T20:14:20.547916+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:14:20.547916+0000","last_undegraded":"2024-04-26T20:14:20.547916+0000","last_fullsized":"2024-04-26T20:14:20.547916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.129602+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:14:46.129602+0000","last_peered":"2024-04-26T20:14:46.129602+0000","last_clean":"2024-04-26T20:14:46.129602+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:14:46.129602+0000","last_undegraded":"2024-04-26T20:14:46.129602+0000","last_fullsized":"2024-04-26T20:14:46.129602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546922+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:14:20.546922+0000","last_peered":"2024-04-26T20:14:20.546922+0000","last_clean":"2024-04-26T20:14:20.546922+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:14:20.546922+0000","last_undegraded":"2024-04-26T20:14:20.546922+0000","last_fullsized":"2024-04-26T20:14:20.546922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538010+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:14:20.538010+0000","last_peered":"2024-04-26T20:14:20.538010+0000","last_clean":"2024-04-26T20:14:20.538010+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:14:20.538010+0000","last_undegraded":"2024-04-26T20:14:20.538010+0000","last_fullsized":"2024-04-26T20:14:20.538010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341065+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:14:20.341065+0000","last_peered":"2024-04-26T20:14:20.341065+0000","last_clean":"2024-04-26T20:14:20.341065+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:14:20.341065+0000","last_undegraded":"2024-04-26T20:14:20.341065+0000","last_fullsized":"2024-04-26T20:14:20.341065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885059+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:14:19.885059+0000","last_peered":"2024-04-26T20:14:19.885059+0000","last_clean":"2024-04-26T20:14:19.885059+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:14:19.885059+0000","last_undegraded":"2024-04-26T20:14:19.885059+0000","last_fullsized":"2024-04-26T20:14:19.885059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551624+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:14:20.551624+0000","last_peered":"2024-04-26T20:14:20.551624+0000","last_clean":"2024-04-26T20:14:20.551624+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:14:20.551624+0000","last_undegraded":"2024-04-26T20:14:20.551624+0000","last_fullsized":"2024-04-26T20:14:20.551624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538130+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:14:20.538130+0000","last_peered":"2024-04-26T20:14:20.538130+0000","last_clean":"2024-04-26T20:14:20.538130+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:14:20.538130+0000","last_undegraded":"2024-04-26T20:14:20.538130+0000","last_fullsized":"2024-04-26T20:14:20.538130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537670+0000","last_change":"2024-04-26T20:14:18.532352+0000","last_active":"2024-04-26T20:14:20.537670+0000","last_peered":"2024-04-26T20:14:20.537670+0000","last_clean":"2024-04-26T20:14:20.537670+0000","last_became_active":"2024-04-26T20:14:18.531948+0000","last_became_peered":"2024-04-26T20:14:18.531948+0000","last_unstale":"2024-04-26T20:14:20.537670+0000","last_undegraded":"2024-04-26T20:14:20.537670+0000","last_fullsized":"2024-04-26T20:14:20.537670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:07.005152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508466+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:14:19.508466+0000","last_peered":"2024-04-26T20:14:19.508466+0000","last_clean":"2024-04-26T20:14:19.508466+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:14:19.508466+0000","last_undegraded":"2024-04-26T20:14:19.508466+0000","last_fullsized":"2024-04-26T20:14:19.508466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551328+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:14:20.551328+0000","last_peered":"2024-04-26T20:14:20.551328+0000","last_clean":"2024-04-26T20:14:20.551328+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:14:20.551328+0000","last_undegraded":"2024-04-26T20:14:20.551328+0000","last_fullsized":"2024-04-26T20:14:20.551328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538131+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:14:20.538131+0000","last_peered":"2024-04-26T20:14:20.538131+0000","last_clean":"2024-04-26T20:14:20.538131+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:14:20.538131+0000","last_undegraded":"2024-04-26T20:14:20.538131+0000","last_fullsized":"2024-04-26T20:14:20.538131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537632+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:14:20.537632+0000","last_peered":"2024-04-26T20:14:20.537632+0000","last_clean":"2024-04-26T20:14:20.537632+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:14:20.537632+0000","last_undegraded":"2024-04-26T20:14:20.537632+0000","last_fullsized":"2024-04-26T20:14:20.537632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.124586+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:14:46.124586+0000","last_peered":"2024-04-26T20:14:46.124586+0000","last_clean":"2024-04-26T20:14:46.124586+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:14:46.124586+0000","last_undegraded":"2024-04-26T20:14:46.124586+0000","last_fullsized":"2024-04-26T20:14:46.124586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884667+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:14:19.884667+0000","last_peered":"2024-04-26T20:14:19.884667+0000","last_clean":"2024-04-26T20:14:19.884667+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:14:19.884667+0000","last_undegraded":"2024-04-26T20:14:19.884667+0000","last_fullsized":"2024-04-26T20:14:19.884667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127978+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:14:46.127978+0000","last_peered":"2024-04-26T20:14:46.127978+0000","last_clean":"2024-04-26T20:14:46.127978+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:14:46.127978+0000","last_undegraded":"2024-04-26T20:14:46.127978+0000","last_fullsized":"2024-04-26T20:14:46.127978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885284+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:14:19.885284+0000","last_peered":"2024-04-26T20:14:19.885284+0000","last_clean":"2024-04-26T20:14:19.885284+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:14:19.885284+0000","last_undegraded":"2024-04-26T20:14:19.885284+0000","last_fullsized":"2024-04-26T20:14:19.885284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547171+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:14:20.547171+0000","last_peered":"2024-04-26T20:14:20.547171+0000","last_clean":"2024-04-26T20:14:20.547171+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:14:20.547171+0000","last_undegraded":"2024-04-26T20:14:20.547171+0000","last_fullsized":"2024-04-26T20:14:20.547171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.100202+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:14:40.100202+0000","last_peered":"2024-04-26T20:14:40.100202+0000","last_clean":"2024-04-26T20:14:40.100202+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:14:40.100202+0000","last_undegraded":"2024-04-26T20:14:40.100202+0000","last_fullsized":"2024-04-26T20:14:40.100202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339797+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:14:20.339797+0000","last_peered":"2024-04-26T20:14:20.339797+0000","last_clean":"2024-04-26T20:14:20.339797+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:14:20.339797+0000","last_undegraded":"2024-04-26T20:14:20.339797+0000","last_fullsized":"2024-04-26T20:14:20.339797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505934+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:14:19.505934+0000","last_peered":"2024-04-26T20:14:19.505934+0000","last_clean":"2024-04-26T20:14:19.505934+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:14:19.505934+0000","last_undegraded":"2024-04-26T20:14:19.505934+0000","last_fullsized":"2024-04-26T20:14:19.505934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340425+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:14:20.340425+0000","last_peered":"2024-04-26T20:14:20.340425+0000","last_clean":"2024-04-26T20:14:20.340425+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:14:20.340425+0000","last_undegraded":"2024-04-26T20:14:20.340425+0000","last_fullsized":"2024-04-26T20:14:20.340425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.126688+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:14:46.126688+0000","last_peered":"2024-04-26T20:14:46.126688+0000","last_clean":"2024-04-26T20:14:46.126688+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:14:46.126688+0000","last_undegraded":"2024-04-26T20:14:46.126688+0000","last_fullsized":"2024-04-26T20:14:46.126688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504513+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:14:19.504513+0000","last_peered":"2024-04-26T20:14:19.504513+0000","last_clean":"2024-04-26T20:14:19.504513+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:14:19.504513+0000","last_undegraded":"2024-04-26T20:14:19.504513+0000","last_fullsized":"2024-04-26T20:14:19.504513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551589+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:14:20.551589+0000","last_peered":"2024-04-26T20:14:20.551589+0000","last_clean":"2024-04-26T20:14:20.551589+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:14:20.551589+0000","last_undegraded":"2024-04-26T20:14:20.551589+0000","last_fullsized":"2024-04-26T20:14:20.551589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538251+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:14:20.538251+0000","last_peered":"2024-04-26T20:14:20.538251+0000","last_clean":"2024-04-26T20:14:20.538251+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:14:20.538251+0000","last_undegraded":"2024-04-26T20:14:20.538251+0000","last_fullsized":"2024-04-26T20:14:20.538251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885149+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:14:19.885149+0000","last_peered":"2024-04-26T20:14:19.885149+0000","last_clean":"2024-04-26T20:14:19.885149+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:14:19.885149+0000","last_undegraded":"2024-04-26T20:14:19.885149+0000","last_fullsized":"2024-04-26T20:14:19.885149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341171+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:14:20.341171+0000","last_peered":"2024-04-26T20:14:20.341171+0000","last_clean":"2024-04-26T20:14:20.341171+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:14:20.341171+0000","last_undegraded":"2024-04-26T20:14:20.341171+0000","last_fullsized":"2024-04-26T20:14:20.341171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.497025+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:14:19.497025+0000","last_peered":"2024-04-26T20:14:19.497025+0000","last_clean":"2024-04-26T20:14:19.497025+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:14:19.497025+0000","last_undegraded":"2024-04-26T20:14:19.497025+0000","last_fullsized":"2024-04-26T20:14:19.497025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550272+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:14:20.550272+0000","last_peered":"2024-04-26T20:14:20.550272+0000","last_clean":"2024-04-26T20:14:20.550272+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:14:20.550272+0000","last_undegraded":"2024-04-26T20:14:20.550272+0000","last_fullsized":"2024-04-26T20:14:20.550272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341179+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:14:20.341179+0000","last_peered":"2024-04-26T20:14:20.341179+0000","last_clean":"2024-04-26T20:14:20.341179+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:14:20.341179+0000","last_undegraded":"2024-04-26T20:14:20.341179+0000","last_fullsized":"2024-04-26T20:14:20.341179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509704+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:14:19.509704+0000","last_peered":"2024-04-26T20:14:19.509704+0000","last_clean":"2024-04-26T20:14:19.509704+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:14:19.509704+0000","last_undegraded":"2024-04-26T20:14:19.509704+0000","last_fullsized":"2024-04-26T20:14:19.509704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507544+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:14:19.507544+0000","last_peered":"2024-04-26T20:14:19.507544+0000","last_clean":"2024-04-26T20:14:19.507544+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:14:19.507544+0000","last_undegraded":"2024-04-26T20:14:19.507544+0000","last_fullsized":"2024-04-26T20:14:19.507544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340080+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:14:20.340080+0000","last_peered":"2024-04-26T20:14:20.340080+0000","last_clean":"2024-04-26T20:14:20.340080+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:14:20.340080+0000","last_undegraded":"2024-04-26T20:14:20.340080+0000","last_fullsized":"2024-04-26T20:14:20.340080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127779+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:14:46.127779+0000","last_peered":"2024-04-26T20:14:46.127779+0000","last_clean":"2024-04-26T20:14:46.127779+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:14:46.127779+0000","last_undegraded":"2024-04-26T20:14:46.127779+0000","last_fullsized":"2024-04-26T20:14:46.127779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885253+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:14:19.885253+0000","last_peered":"2024-04-26T20:14:19.885253+0000","last_clean":"2024-04-26T20:14:19.885253+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:14:19.885253+0000","last_undegraded":"2024-04-26T20:14:19.885253+0000","last_fullsized":"2024-04-26T20:14:19.885253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504382+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:14:19.504382+0000","last_peered":"2024-04-26T20:14:19.504382+0000","last_clean":"2024-04-26T20:14:19.504382+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:14:19.504382+0000","last_undegraded":"2024-04-26T20:14:19.504382+0000","last_fullsized":"2024-04-26T20:14:19.504382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.131333+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:14:46.131333+0000","last_peered":"2024-04-26T20:14:46.131333+0000","last_clean":"2024-04-26T20:14:46.131333+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:14:46.131333+0000","last_undegraded":"2024-04-26T20:14:46.131333+0000","last_fullsized":"2024-04-26T20:14:46.131333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547904+0000","last_change":"2024-04-26T20:14:18.642156+0000","last_active":"2024-04-26T20:14:20.547904+0000","last_peered":"2024-04-26T20:14:20.547904+0000","last_clean":"2024-04-26T20:14:20.547904+0000","last_became_active":"2024-04-26T20:14:18.641452+0000","last_became_peered":"2024-04-26T20:14:18.641452+0000","last_unstale":"2024-04-26T20:14:20.547904+0000","last_undegraded":"2024-04-26T20:14:20.547904+0000","last_fullsized":"2024-04-26T20:14:20.547904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:30.242536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340685+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:14:20.340685+0000","last_peered":"2024-04-26T20:14:20.340685+0000","last_clean":"2024-04-26T20:14:20.340685+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:14:20.340685+0000","last_undegraded":"2024-04-26T20:14:20.340685+0000","last_fullsized":"2024-04-26T20:14:20.340685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.093099+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:14:40.093099+0000","last_peered":"2024-04-26T20:14:40.093099+0000","last_clean":"2024-04-26T20:14:40.093099+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:14:40.093099+0000","last_undegraded":"2024-04-26T20:14:40.093099+0000","last_fullsized":"2024-04-26T20:14:40.093099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547744+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:14:20.547744+0000","last_peered":"2024-04-26T20:14:20.547744+0000","last_clean":"2024-04-26T20:14:20.547744+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:14:20.547744+0000","last_undegraded":"2024-04-26T20:14:20.547744+0000","last_fullsized":"2024-04-26T20:14:20.547744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884892+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:14:19.884892+0000","last_peered":"2024-04-26T20:14:19.884892+0000","last_clean":"2024-04-26T20:14:19.884892+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:14:19.884892+0000","last_undegraded":"2024-04-26T20:14:19.884892+0000","last_fullsized":"2024-04-26T20:14:19.884892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.123062+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:14:46.123062+0000","last_peered":"2024-04-26T20:14:46.123062+0000","last_clean":"2024-04-26T20:14:46.123062+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:14:46.123062+0000","last_undegraded":"2024-04-26T20:14:46.123062+0000","last_fullsized":"2024-04-26T20:14:46.123062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551667+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:14:20.551667+0000","last_peered":"2024-04-26T20:14:20.551667+0000","last_clean":"2024-04-26T20:14:20.551667+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:14:20.551667+0000","last_undegraded":"2024-04-26T20:14:20.551667+0000","last_fullsized":"2024-04-26T20:14:20.551667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340243+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:14:20.340243+0000","last_peered":"2024-04-26T20:14:20.340243+0000","last_clean":"2024-04-26T20:14:20.340243+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:14:20.340243+0000","last_undegraded":"2024-04-26T20:14:20.340243+0000","last_fullsized":"2024-04-26T20:14:20.340243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.086670+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:14:40.086670+0000","last_peered":"2024-04-26T20:14:40.086670+0000","last_clean":"2024-04-26T20:14:40.086670+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:14:40.086670+0000","last_undegraded":"2024-04-26T20:14:40.086670+0000","last_fullsized":"2024-04-26T20:14:40.086670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537725+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:14:20.537725+0000","last_peered":"2024-04-26T20:14:20.537725+0000","last_clean":"2024-04-26T20:14:20.537725+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:14:20.537725+0000","last_undegraded":"2024-04-26T20:14:20.537725+0000","last_fullsized":"2024-04-26T20:14:20.537725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509332+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:14:19.509332+0000","last_peered":"2024-04-26T20:14:19.509332+0000","last_clean":"2024-04-26T20:14:19.509332+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:14:19.509332+0000","last_undegraded":"2024-04-26T20:14:19.509332+0000","last_fullsized":"2024-04-26T20:14:19.509332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538197+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:14:20.538197+0000","last_peered":"2024-04-26T20:14:20.538197+0000","last_clean":"2024-04-26T20:14:20.538197+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:14:20.538197+0000","last_undegraded":"2024-04-26T20:14:20.538197+0000","last_fullsized":"2024-04-26T20:14:20.538197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508332+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:14:19.508332+0000","last_peered":"2024-04-26T20:14:19.508332+0000","last_clean":"2024-04-26T20:14:19.508332+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:14:19.508332+0000","last_undegraded":"2024-04-26T20:14:19.508332+0000","last_fullsized":"2024-04-26T20:14:19.508332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885496+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:14:19.885496+0000","last_peered":"2024-04-26T20:14:19.885496+0000","last_clean":"2024-04-26T20:14:19.885496+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:14:19.885496+0000","last_undegraded":"2024-04-26T20:14:19.885496+0000","last_fullsized":"2024-04-26T20:14:19.885496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.097720+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:14:40.097720+0000","last_peered":"2024-04-26T20:14:40.097720+0000","last_clean":"2024-04-26T20:14:40.097720+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:14:40.097720+0000","last_undegraded":"2024-04-26T20:14:40.097720+0000","last_fullsized":"2024-04-26T20:14:40.097720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547103+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:14:20.547103+0000","last_peered":"2024-04-26T20:14:20.547103+0000","last_clean":"2024-04-26T20:14:20.547103+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:14:20.547103+0000","last_undegraded":"2024-04-26T20:14:20.547103+0000","last_fullsized":"2024-04-26T20:14:20.547103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551023+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:14:20.551023+0000","last_peered":"2024-04-26T20:14:20.551023+0000","last_clean":"2024-04-26T20:14:20.551023+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:14:20.551023+0000","last_undegraded":"2024-04-26T20:14:20.551023+0000","last_fullsized":"2024-04-26T20:14:20.551023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.092533+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:14:40.092533+0000","last_peered":"2024-04-26T20:14:40.092533+0000","last_clean":"2024-04-26T20:14:40.092533+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:14:40.092533+0000","last_undegraded":"2024-04-26T20:14:40.092533+0000","last_fullsized":"2024-04-26T20:14:40.092533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547062+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:14:20.547062+0000","last_peered":"2024-04-26T20:14:20.547062+0000","last_clean":"2024-04-26T20:14:20.547062+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:14:20.547062+0000","last_undegraded":"2024-04-26T20:14:20.547062+0000","last_fullsized":"2024-04-26T20:14:20.547062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885190+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:14:19.885190+0000","last_peered":"2024-04-26T20:14:19.885190+0000","last_clean":"2024-04-26T20:14:19.885190+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:14:19.885190+0000","last_undegraded":"2024-04-26T20:14:19.885190+0000","last_fullsized":"2024-04-26T20:14:19.885190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537488+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:14:20.537488+0000","last_peered":"2024-04-26T20:14:20.537488+0000","last_clean":"2024-04-26T20:14:20.537488+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:14:20.537488+0000","last_undegraded":"2024-04-26T20:14:20.537488+0000","last_fullsized":"2024-04-26T20:14:20.537488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550778+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:14:20.550778+0000","last_peered":"2024-04-26T20:14:20.550778+0000","last_clean":"2024-04-26T20:14:20.550778+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:14:20.550778+0000","last_undegraded":"2024-04-26T20:14:20.550778+0000","last_fullsized":"2024-04-26T20:14:20.550778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506621+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:14:19.506621+0000","last_peered":"2024-04-26T20:14:19.506621+0000","last_clean":"2024-04-26T20:14:19.506621+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:14:19.506621+0000","last_undegraded":"2024-04-26T20:14:19.506621+0000","last_fullsized":"2024-04-26T20:14:19.506621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547012+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:14:20.547012+0000","last_peered":"2024-04-26T20:14:20.547012+0000","last_clean":"2024-04-26T20:14:20.547012+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:14:20.547012+0000","last_undegraded":"2024-04-26T20:14:20.547012+0000","last_fullsized":"2024-04-26T20:14:20.547012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.122360+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:14:46.122360+0000","last_peered":"2024-04-26T20:14:46.122360+0000","last_clean":"2024-04-26T20:14:46.122360+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:14:46.122360+0000","last_undegraded":"2024-04-26T20:14:46.122360+0000","last_fullsized":"2024-04-26T20:14:46.122360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.128712+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:14:46.128712+0000","last_peered":"2024-04-26T20:14:46.128712+0000","last_clean":"2024-04-26T20:14:46.128712+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:14:46.128712+0000","last_undegraded":"2024-04-26T20:14:46.128712+0000","last_fullsized":"2024-04-26T20:14:46.128712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885205+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:14:19.885205+0000","last_peered":"2024-04-26T20:14:19.885205+0000","last_clean":"2024-04-26T20:14:19.885205+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:14:19.885205+0000","last_undegraded":"2024-04-26T20:14:19.885205+0000","last_fullsized":"2024-04-26T20:14:19.885205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496841+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:14:19.496841+0000","last_peered":"2024-04-26T20:14:19.496841+0000","last_clean":"2024-04-26T20:14:19.496841+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:14:19.496841+0000","last_undegraded":"2024-04-26T20:14:19.496841+0000","last_fullsized":"2024-04-26T20:14:19.496841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.106751+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:14:40.106751+0000","last_peered":"2024-04-26T20:14:40.106751+0000","last_clean":"2024-04-26T20:14:40.106751+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:14:40.106751+0000","last_undegraded":"2024-04-26T20:14:40.106751+0000","last_fullsized":"2024-04-26T20:14:40.106751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508517+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:14:19.508517+0000","last_peered":"2024-04-26T20:14:19.508517+0000","last_clean":"2024-04-26T20:14:19.508517+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:14:19.508517+0000","last_undegraded":"2024-04-26T20:14:19.508517+0000","last_fullsized":"2024-04-26T20:14:19.508517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547503+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:14:20.547503+0000","last_peered":"2024-04-26T20:14:20.547503+0000","last_clean":"2024-04-26T20:14:20.547503+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:14:20.547503+0000","last_undegraded":"2024-04-26T20:14:20.547503+0000","last_fullsized":"2024-04-26T20:14:20.547503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504099+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:14:19.504099+0000","last_peered":"2024-04-26T20:14:19.504099+0000","last_clean":"2024-04-26T20:14:19.504099+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:14:19.504099+0000","last_undegraded":"2024-04-26T20:14:19.504099+0000","last_fullsized":"2024-04-26T20:14:19.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496540+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:14:19.496540+0000","last_peered":"2024-04-26T20:14:19.496540+0000","last_clean":"2024-04-26T20:14:19.496540+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:14:19.496540+0000","last_undegraded":"2024-04-26T20:14:19.496540+0000","last_fullsized":"2024-04-26T20:14:19.496540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550979+0000","last_change":"2024-04-26T20:14:14.482803+0000","last_active":"2024-04-26T20:14:20.550979+0000","last_peered":"2024-04-26T20:14:20.550979+0000","last_clean":"2024-04-26T20:14:20.550979+0000","last_became_active":"2024-04-26T20:14:14.482022+0000","last_became_peered":"2024-04-26T20:14:14.482022+0000","last_unstale":"2024-04-26T20:14:20.550979+0000","last_undegraded":"2024-04-26T20:14:20.550979+0000","last_fullsized":"2024-04-26T20:14:20.550979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885112+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:14:19.885112+0000","last_peered":"2024-04-26T20:14:19.885112+0000","last_clean":"2024-04-26T20:14:19.885112+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:14:19.885112+0000","last_undegraded":"2024-04-26T20:14:19.885112+0000","last_fullsized":"2024-04-26T20:14:19.885112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547807+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:14:20.547807+0000","last_peered":"2024-04-26T20:14:20.547807+0000","last_clean":"2024-04-26T20:14:20.547807+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:14:20.547807+0000","last_undegraded":"2024-04-26T20:14:20.547807+0000","last_fullsized":"2024-04-26T20:14:20.547807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537992+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:14:20.537992+0000","last_peered":"2024-04-26T20:14:20.537992+0000","last_clean":"2024-04-26T20:14:20.537992+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:14:20.537992+0000","last_undegraded":"2024-04-26T20:14:20.537992+0000","last_fullsized":"2024-04-26T20:14:20.537992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506318+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:14:19.506318+0000","last_peered":"2024-04-26T20:14:19.506318+0000","last_clean":"2024-04-26T20:14:19.506318+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:14:19.506318+0000","last_undegraded":"2024-04-26T20:14:19.506318+0000","last_fullsized":"2024-04-26T20:14:19.506318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547804+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:14:20.547804+0000","last_peered":"2024-04-26T20:14:20.547804+0000","last_clean":"2024-04-26T20:14:20.547804+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:14:20.547804+0000","last_undegraded":"2024-04-26T20:14:20.547804+0000","last_fullsized":"2024-04-26T20:14:20.547804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550486+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:14:20.550486+0000","last_peered":"2024-04-26T20:14:20.550486+0000","last_clean":"2024-04-26T20:14:20.550486+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:14:20.550486+0000","last_undegraded":"2024-04-26T20:14:20.550486+0000","last_fullsized":"2024-04-26T20:14:20.550486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547253+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:14:20.547253+0000","last_peered":"2024-04-26T20:14:20.547253+0000","last_clean":"2024-04-26T20:14:20.547253+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:14:20.547253+0000","last_undegraded":"2024-04-26T20:14:20.547253+0000","last_fullsized":"2024-04-26T20:14:20.547253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550633+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:14:20.550633+0000","last_peered":"2024-04-26T20:14:20.550633+0000","last_clean":"2024-04-26T20:14:20.550633+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:14:20.550633+0000","last_undegraded":"2024-04-26T20:14:20.550633+0000","last_fullsized":"2024-04-26T20:14:20.550633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884953+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:14:19.884953+0000","last_peered":"2024-04-26T20:14:19.884953+0000","last_clean":"2024-04-26T20:14:19.884953+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:14:19.884953+0000","last_undegraded":"2024-04-26T20:14:19.884953+0000","last_fullsized":"2024-04-26T20:14:19.884953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505625+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:14:19.505625+0000","last_peered":"2024-04-26T20:14:19.505625+0000","last_clean":"2024-04-26T20:14:19.505625+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:14:19.505625+0000","last_undegraded":"2024-04-26T20:14:19.505625+0000","last_fullsized":"2024-04-26T20:14:19.505625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340721+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:14:20.340721+0000","last_peered":"2024-04-26T20:14:20.340721+0000","last_clean":"2024-04-26T20:14:20.340721+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:14:20.340721+0000","last_undegraded":"2024-04-26T20:14:20.340721+0000","last_fullsized":"2024-04-26T20:14:20.340721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496988+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:14:19.496988+0000","last_peered":"2024-04-26T20:14:19.496988+0000","last_clean":"2024-04-26T20:14:19.496988+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:14:19.496988+0000","last_undegraded":"2024-04-26T20:14:19.496988+0000","last_fullsized":"2024-04-26T20:14:19.496988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551847+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:14:20.551847+0000","last_peered":"2024-04-26T20:14:20.551847+0000","last_clean":"2024-04-26T20:14:20.551847+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:14:20.551847+0000","last_undegraded":"2024-04-26T20:14:20.551847+0000","last_fullsized":"2024-04-26T20:14:20.551847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550171+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:14:20.550171+0000","last_peered":"2024-04-26T20:14:20.550171+0000","last_clean":"2024-04-26T20:14:20.550171+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:14:20.550171+0000","last_undegraded":"2024-04-26T20:14:20.550171+0000","last_fullsized":"2024-04-26T20:14:20.550171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537556+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:14:20.537556+0000","last_peered":"2024-04-26T20:14:20.537556+0000","last_clean":"2024-04-26T20:14:20.537556+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:14:20.537556+0000","last_undegraded":"2024-04-26T20:14:20.537556+0000","last_fullsized":"2024-04-26T20:14:20.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884895+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:14:19.884895+0000","last_peered":"2024-04-26T20:14:19.884895+0000","last_clean":"2024-04-26T20:14:19.884895+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:14:19.884895+0000","last_undegraded":"2024-04-26T20:14:19.884895+0000","last_fullsized":"2024-04-26T20:14:19.884895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547283+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:14:20.547283+0000","last_peered":"2024-04-26T20:14:20.547283+0000","last_clean":"2024-04-26T20:14:20.547283+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:14:20.547283+0000","last_undegraded":"2024-04-26T20:14:20.547283+0000","last_fullsized":"2024-04-26T20:14:20.547283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509243+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:14:19.509243+0000","last_peered":"2024-04-26T20:14:19.509243+0000","last_clean":"2024-04-26T20:14:19.509243+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:14:19.509243+0000","last_undegraded":"2024-04-26T20:14:19.509243+0000","last_fullsized":"2024-04-26T20:14:19.509243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505396+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:14:19.505396+0000","last_peered":"2024-04-26T20:14:19.505396+0000","last_clean":"2024-04-26T20:14:19.505396+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:14:19.505396+0000","last_undegraded":"2024-04-26T20:14:19.505396+0000","last_fullsized":"2024-04-26T20:14:19.505396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506202+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:14:19.506202+0000","last_peered":"2024-04-26T20:14:19.506202+0000","last_clean":"2024-04-26T20:14:19.506202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:14:19.506202+0000","last_undegraded":"2024-04-26T20:14:19.506202+0000","last_fullsized":"2024-04-26T20:14:19.506202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341083+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:14:20.341083+0000","last_peered":"2024-04-26T20:14:20.341083+0000","last_clean":"2024-04-26T20:14:20.341083+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:14:20.341083+0000","last_undegraded":"2024-04-26T20:14:20.341083+0000","last_fullsized":"2024-04-26T20:14:20.341083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546910+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:14:20.546910+0000","last_peered":"2024-04-26T20:14:20.546910+0000","last_clean":"2024-04-26T20:14:20.546910+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:14:20.546910+0000","last_undegraded":"2024-04-26T20:14:20.546910+0000","last_fullsized":"2024-04-26T20:14:20.546910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339971+0000","last_change":"2024-04-26T20:14:14.463139+0000","last_active":"2024-04-26T20:14:20.339971+0000","last_peered":"2024-04-26T20:14:20.339971+0000","last_clean":"2024-04-26T20:14:20.339971+0000","last_became_active":"2024-04-26T20:14:14.462083+0000","last_became_peered":"2024-04-26T20:14:14.462083+0000","last_unstale":"2024-04-26T20:14:20.339971+0000","last_undegraded":"2024-04-26T20:14:20.339971+0000","last_fullsized":"2024-04-26T20:14:20.339971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:28.615893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550418+0000","last_change":"2024-04-26T20:14:14.475535+0000","last_active":"2024-04-26T20:14:20.550418+0000","last_peered":"2024-04-26T20:14:20.550418+0000","last_clean":"2024-04-26T20:14:20.550418+0000","last_became_active":"2024-04-26T20:14:14.474445+0000","last_became_peered":"2024-04-26T20:14:14.474445+0000","last_unstale":"2024-04-26T20:14:20.550418+0000","last_undegraded":"2024-04-26T20:14:20.550418+0000","last_fullsized":"2024-04-26T20:14:20.550418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:51.715142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339972+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:14:20.339972+0000","last_peered":"2024-04-26T20:14:20.339972+0000","last_clean":"2024-04-26T20:14:20.339972+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:14:20.339972+0000","last_undegraded":"2024-04-26T20:14:20.339972+0000","last_fullsized":"2024-04-26T20:14:20.339972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551012+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:14:20.551012+0000","last_peered":"2024-04-26T20:14:20.551012+0000","last_clean":"2024-04-26T20:14:20.551012+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:14:20.551012+0000","last_undegraded":"2024-04-26T20:14:20.551012+0000","last_fullsized":"2024-04-26T20:14:20.551012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885153+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:14:19.885153+0000","last_peered":"2024-04-26T20:14:19.885153+0000","last_clean":"2024-04-26T20:14:19.885153+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:14:19.885153+0000","last_undegraded":"2024-04-26T20:14:19.885153+0000","last_fullsized":"2024-04-26T20:14:19.885153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538165+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:14:20.538165+0000","last_peered":"2024-04-26T20:14:20.538165+0000","last_clean":"2024-04-26T20:14:20.538165+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:14:20.538165+0000","last_undegraded":"2024-04-26T20:14:20.538165+0000","last_fullsized":"2024-04-26T20:14:20.538165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340878+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:14:20.340878+0000","last_peered":"2024-04-26T20:14:20.340878+0000","last_clean":"2024-04-26T20:14:20.340878+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:14:20.340878+0000","last_undegraded":"2024-04-26T20:14:20.340878+0000","last_fullsized":"2024-04-26T20:14:20.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":695501,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":104937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":108371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":104377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":104503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":344064,"data_stored":694587,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:14:59.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:14:59.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e9000640 1 Processor -- start 2024-04-26T20:14:59.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e9000640 1 -- start start 2024-04-26T20:14:59.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e9000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f86e415f490 0x7f86e40cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e9000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86e40d1640 0x7f86e40d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e9000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e40ce550 con 0x7f86e40cb270 2024-04-26T20:14:59.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e9000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f86e40ce7c0 con 0x7f86e415f490 2024-04-26T20:14:59.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e9000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f86e40cea80 con 0x7f86e40d1640 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e1400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f86e415f490 0x7f86e40cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e1e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f86e40cb270 0x7f86e40cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51968/0 (socket says 172.21.15.16:51968) 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e1e00640 1 -- 172.21.15.16:0/2596894665 learned_addr learned my addr 172.21.15.16:0/2596894665 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e2800640 1 --2- 172.21.15.16:0/2596894665 >> v2:172.21.15.192:3300/0 conn(0x7f86e40d1640 0x7f86e40d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e1400640 1 -- 172.21.15.16:0/2596894665 >> v2:172.21.15.192:3300/0 conn(0x7f86e40d1640 msgr2=0x7f86e40d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e1400640 1 --2- 172.21.15.16:0/2596894665 >> v2:172.21.15.192:3300/0 conn(0x7f86e40d1640 0x7f86e40d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e1400640 1 -- 172.21.15.16:0/2596894665 >> v1:172.21.15.16:6789/0 conn(0x7f86e40cb270 legacy=0x7f86e40cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e1400640 1 -- 172.21.15.16:0/2596894665 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e40ced60 con 0x7f86e415f490 2024-04-26T20:14:59.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.718+0000 7f86e0a00640 1 -- 172.21.15.16:0/2596894665 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111134517 0 0) 0x7f86e40ce550 con 0x7f86e40cb270 2024-04-26T20:14:59.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e1400640 1 --2- 172.21.15.16:0/2596894665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e415f490 0x7f86e40cb650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86e40c4fa0 tx=0x7f86d001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceaaebcf343a622 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:59.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e0a00640 1 -- 172.21.15.16:0/2596894665 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00b5070 con 0x7f86e415f490 2024-04-26T20:14:59.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e0a00640 1 -- 172.21.15.16:0/2596894665 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d00a8970 con 0x7f86e415f490 2024-04-26T20:14:59.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e0a00640 1 -- 172.21.15.16:0/2596894665 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00a8d40 con 0x7f86e415f490 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 -- 172.21.15.16:0/2596894665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e415f490 msgr2=0x7f86e40cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 --2- 172.21.15.16:0/2596894665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e415f490 0x7f86e40cb650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86e40c4fa0 tx=0x7f86d001ec70 comp rx=0 tx=0).stop 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 -- 172.21.15.16:0/2596894665 shutdown_connections 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 --2- 172.21.15.16:0/2596894665 >> v2:172.21.15.192:3300/0 conn(0x7f86e40d1640 0x7f86e40d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 --2- 172.21.15.16:0/2596894665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e415f490 0x7f86e40cb650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 -- 172.21.15.16:0/2596894665 >> 172.21.15.16:0/2596894665 conn(0x7f86e406eaf0 msgr2=0x7f86e406eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 -- 172.21.15.16:0/2596894665 shutdown_connections 2024-04-26T20:14:59.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 -- 172.21.15.16:0/2596894665 wait complete. 2024-04-26T20:14:59.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 Processor -- start 2024-04-26T20:14:59.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.722+0000 7f86e9000640 1 -- start start 2024-04-26T20:14:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86e40cb270 0x7f86e41f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e40d1640 0x7f86e414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86e415f490 0x7f86e415fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86e40ccc70 con 0x7f86e40d1640 2024-04-26T20:14:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f86e40cc990 con 0x7f86e40cb270 2024-04-26T20:14:59.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f86e40cd190 con 0x7f86e415f490 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e40d1640 0x7f86e414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e40d1640 0x7f86e414fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37912/0 (socket says 172.21.15.16:37912) 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 -- 172.21.15.16:0/3789558356 learned_addr learned my addr 172.21.15.16:0/3789558356 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1e00640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86e40cb270 0x7f86e41f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e2800640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86e415f490 0x7f86e415fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 -- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86e415f490 msgr2=0x7f86e415fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86e415f490 0x7f86e415fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 -- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86e40cb270 msgr2=0x7f86e41f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86e40cb270 0x7f86e41f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 -- 172.21.15.16:0/3789558356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e41f5050 con 0x7f86e40d1640 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e1400640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e40d1640 0x7f86e414fd00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f86d001c8a0 tx=0x7f86d001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86da000640 1 -- 172.21.15.16:0/3789558356 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00c1070 con 0x7f86e40d1640 2024-04-26T20:14:59.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86da000640 1 -- 172.21.15.16:0/3789558356 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d00b0740 con 0x7f86e40d1640 2024-04-26T20:14:59.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86da000640 1 -- 172.21.15.16:0/3789558356 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00b5040 con 0x7f86e40d1640 2024-04-26T20:14:59.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e414ecd0 con 0x7f86e40d1640 2024-04-26T20:14:59.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e4157840 con 0x7f86e40d1640 2024-04-26T20:14:59.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e4077c20 con 0x7f86e40d1640 2024-04-26T20:14:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.726+0000 7f86da000640 1 -- 172.21.15.16:0/3789558356 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86d00b0af0 con 0x7f86e40d1640 2024-04-26T20:14:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.730+0000 7f86da000640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86c4068380 0x7f86c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:14:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.730+0000 7f86da000640 1 -- 172.21.15.16:0/3789558356 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f86d0123da0 con 0x7f86e40d1640 2024-04-26T20:14:59.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.730+0000 7f86e1e00640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86c4068380 0x7f86c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:14:59.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.730+0000 7f86e1e00640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86c4068380 0x7f86c406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f86d4000f70 tx=0x7f86d4007c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:14:59.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.734+0000 7f86da000640 1 -- 172.21.15.16:0/3789558356 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f86d00187d0 con 0x7f86e40d1640 2024-04-26T20:14:59.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.894+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86e4154610 con 0x7f86c4068380 2024-04-26T20:14:59.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.918+0000 7f86da000640 1 -- 172.21.15.16:0/3789558356 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332699 (secure 0 0 0) 0x7f86e4154610 con 0x7f86c4068380 2024-04-26T20:14:59.925 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:14:59.927 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:14:59.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86c4068380 msgr2=0x7f86c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86c4068380 0x7f86c406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f86d4000f70 tx=0x7f86d4007c10 comp rx=0 tx=0).stop 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e40d1640 msgr2=0x7f86e414fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e40d1640 0x7f86e414fd00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f86d001c8a0 tx=0x7f86d001ba10 comp rx=0 tx=0).stop 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 shutdown_connections 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86c4068380 0x7f86c406a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86e415f490 0x7f86e415fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86e40d1640 0x7f86e414fd00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 --2- 172.21.15.16:0/3789558356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86e40cb270 0x7f86e41f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 >> 172.21.15.16:0/3789558356 conn(0x7f86e406eaf0 msgr2=0x7f86e4154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 shutdown_connections 2024-04-26T20:14:59.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:14:59.922+0000 7f86e9000640 1 -- 172.21.15.16:0/3789558356 wait complete. 2024-04-26T20:14:59.944 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-26T20:14:58.965874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226784,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747936,"statfs":{"total":773094113280,"available":772861886464,"internally_reserved":0,"allocated":2392064,"data_stored":2024628,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1664,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004874"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127396+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:14:46.127396+0000","last_peered":"2024-04-26T20:14:46.127396+0000","last_clean":"2024-04-26T20:14:46.127396+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:14:46.127396+0000","last_undegraded":"2024-04-26T20:14:46.127396+0000","last_fullsized":"2024-04-26T20:14:46.127396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547330+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:14:20.547330+0000","last_peered":"2024-04-26T20:14:20.547330+0000","last_clean":"2024-04-26T20:14:20.547330+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:14:20.547330+0000","last_undegraded":"2024-04-26T20:14:20.547330+0000","last_fullsized":"2024-04-26T20:14:20.547330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547016+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:14:20.547016+0000","last_peered":"2024-04-26T20:14:20.547016+0000","last_clean":"2024-04-26T20:14:20.547016+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:14:20.547016+0000","last_undegraded":"2024-04-26T20:14:20.547016+0000","last_fullsized":"2024-04-26T20:14:20.547016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547738+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:14:20.547738+0000","last_peered":"2024-04-26T20:14:20.547738+0000","last_clean":"2024-04-26T20:14:20.547738+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:14:20.547738+0000","last_undegraded":"2024-04-26T20:14:20.547738+0000","last_fullsized":"2024-04-26T20:14:20.547738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885447+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:14:19.885447+0000","last_peered":"2024-04-26T20:14:19.885447+0000","last_clean":"2024-04-26T20:14:19.885447+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:14:19.885447+0000","last_undegraded":"2024-04-26T20:14:19.885447+0000","last_fullsized":"2024-04-26T20:14:19.885447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507611+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:14:19.507611+0000","last_peered":"2024-04-26T20:14:19.507611+0000","last_clean":"2024-04-26T20:14:19.507611+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:14:19.507611+0000","last_undegraded":"2024-04-26T20:14:19.507611+0000","last_fullsized":"2024-04-26T20:14:19.507611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.124085+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:14:46.124085+0000","last_peered":"2024-04-26T20:14:46.124085+0000","last_clean":"2024-04-26T20:14:46.124085+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:14:46.124085+0000","last_undegraded":"2024-04-26T20:14:46.124085+0000","last_fullsized":"2024-04-26T20:14:46.124085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551492+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:14:20.551492+0000","last_peered":"2024-04-26T20:14:20.551492+0000","last_clean":"2024-04-26T20:14:20.551492+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:14:20.551492+0000","last_undegraded":"2024-04-26T20:14:20.551492+0000","last_fullsized":"2024-04-26T20:14:20.551492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507856+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:14:19.507856+0000","last_peered":"2024-04-26T20:14:19.507856+0000","last_clean":"2024-04-26T20:14:19.507856+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:14:19.507856+0000","last_undegraded":"2024-04-26T20:14:19.507856+0000","last_fullsized":"2024-04-26T20:14:19.507856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340190+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:14:20.340190+0000","last_peered":"2024-04-26T20:14:20.340190+0000","last_clean":"2024-04-26T20:14:20.340190+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:14:20.340190+0000","last_undegraded":"2024-04-26T20:14:20.340190+0000","last_fullsized":"2024-04-26T20:14:20.340190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551323+0000","last_change":"2024-04-26T20:14:14.499292+0000","last_active":"2024-04-26T20:14:20.551323+0000","last_peered":"2024-04-26T20:14:20.551323+0000","last_clean":"2024-04-26T20:14:20.551323+0000","last_became_active":"2024-04-26T20:14:14.498610+0000","last_became_peered":"2024-04-26T20:14:14.498610+0000","last_unstale":"2024-04-26T20:14:20.551323+0000","last_undegraded":"2024-04-26T20:14:20.551323+0000","last_fullsized":"2024-04-26T20:14:20.551323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:44.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508054+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:14:19.508054+0000","last_peered":"2024-04-26T20:14:19.508054+0000","last_clean":"2024-04-26T20:14:19.508054+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:14:19.508054+0000","last_undegraded":"2024-04-26T20:14:19.508054+0000","last_fullsized":"2024-04-26T20:14:19.508054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504675+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:14:19.504675+0000","last_peered":"2024-04-26T20:14:19.504675+0000","last_clean":"2024-04-26T20:14:19.504675+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:14:19.504675+0000","last_undegraded":"2024-04-26T20:14:19.504675+0000","last_fullsized":"2024-04-26T20:14:19.504675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.087410+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:14:40.087410+0000","last_peered":"2024-04-26T20:14:40.087410+0000","last_clean":"2024-04-26T20:14:40.087410+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:14:40.087410+0000","last_undegraded":"2024-04-26T20:14:40.087410+0000","last_fullsized":"2024-04-26T20:14:40.087410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509512+0000","last_change":"2024-04-26T20:14:18.527474+0000","last_active":"2024-04-26T20:14:19.509512+0000","last_peered":"2024-04-26T20:14:19.509512+0000","last_clean":"2024-04-26T20:14:19.509512+0000","last_became_active":"2024-04-26T20:14:18.526374+0000","last_became_peered":"2024-04-26T20:14:18.526374+0000","last_unstale":"2024-04-26T20:14:19.509512+0000","last_undegraded":"2024-04-26T20:14:19.509512+0000","last_fullsized":"2024-04-26T20:14:19.509512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:31.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547337+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:14:20.547337+0000","last_peered":"2024-04-26T20:14:20.547337+0000","last_clean":"2024-04-26T20:14:20.547337+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:14:20.547337+0000","last_undegraded":"2024-04-26T20:14:20.547337+0000","last_fullsized":"2024-04-26T20:14:20.547337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537897+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:14:20.537897+0000","last_peered":"2024-04-26T20:14:20.537897+0000","last_clean":"2024-04-26T20:14:20.537897+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:14:20.537897+0000","last_undegraded":"2024-04-26T20:14:20.537897+0000","last_fullsized":"2024-04-26T20:14:20.537897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509176+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:14:19.509176+0000","last_peered":"2024-04-26T20:14:19.509176+0000","last_clean":"2024-04-26T20:14:19.509176+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:14:19.509176+0000","last_undegraded":"2024-04-26T20:14:19.509176+0000","last_fullsized":"2024-04-26T20:14:19.509176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547119+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:14:20.547119+0000","last_peered":"2024-04-26T20:14:20.547119+0000","last_clean":"2024-04-26T20:14:20.547119+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:14:20.547119+0000","last_undegraded":"2024-04-26T20:14:20.547119+0000","last_fullsized":"2024-04-26T20:14:20.547119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.099897+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:14:40.099897+0000","last_peered":"2024-04-26T20:14:40.099897+0000","last_clean":"2024-04-26T20:14:40.099897+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:14:40.099897+0000","last_undegraded":"2024-04-26T20:14:40.099897+0000","last_fullsized":"2024-04-26T20:14:40.099897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508115+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:14:19.508115+0000","last_peered":"2024-04-26T20:14:19.508115+0000","last_clean":"2024-04-26T20:14:19.508115+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:14:19.508115+0000","last_undegraded":"2024-04-26T20:14:19.508115+0000","last_fullsized":"2024-04-26T20:14:19.508115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.090799+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:14:40.090799+0000","last_peered":"2024-04-26T20:14:40.090799+0000","last_clean":"2024-04-26T20:14:40.090799+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:14:40.090799+0000","last_undegraded":"2024-04-26T20:14:40.090799+0000","last_fullsized":"2024-04-26T20:14:40.090799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509417+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:14:19.509417+0000","last_peered":"2024-04-26T20:14:19.509417+0000","last_clean":"2024-04-26T20:14:19.509417+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:14:19.509417+0000","last_undegraded":"2024-04-26T20:14:19.509417+0000","last_fullsized":"2024-04-26T20:14:19.509417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885352+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:14:19.885352+0000","last_peered":"2024-04-26T20:14:19.885352+0000","last_clean":"2024-04-26T20:14:19.885352+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:14:19.885352+0000","last_undegraded":"2024-04-26T20:14:19.885352+0000","last_fullsized":"2024-04-26T20:14:19.885352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.091154+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:14:40.091154+0000","last_peered":"2024-04-26T20:14:40.091154+0000","last_clean":"2024-04-26T20:14:40.091154+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:14:40.091154+0000","last_undegraded":"2024-04-26T20:14:40.091154+0000","last_fullsized":"2024-04-26T20:14:40.091154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507739+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:14:19.507739+0000","last_peered":"2024-04-26T20:14:19.507739+0000","last_clean":"2024-04-26T20:14:19.507739+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:14:19.507739+0000","last_undegraded":"2024-04-26T20:14:19.507739+0000","last_fullsized":"2024-04-26T20:14:19.507739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547916+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:14:20.547916+0000","last_peered":"2024-04-26T20:14:20.547916+0000","last_clean":"2024-04-26T20:14:20.547916+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:14:20.547916+0000","last_undegraded":"2024-04-26T20:14:20.547916+0000","last_fullsized":"2024-04-26T20:14:20.547916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.129602+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:14:46.129602+0000","last_peered":"2024-04-26T20:14:46.129602+0000","last_clean":"2024-04-26T20:14:46.129602+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:14:46.129602+0000","last_undegraded":"2024-04-26T20:14:46.129602+0000","last_fullsized":"2024-04-26T20:14:46.129602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546922+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:14:20.546922+0000","last_peered":"2024-04-26T20:14:20.546922+0000","last_clean":"2024-04-26T20:14:20.546922+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:14:20.546922+0000","last_undegraded":"2024-04-26T20:14:20.546922+0000","last_fullsized":"2024-04-26T20:14:20.546922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538010+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:14:20.538010+0000","last_peered":"2024-04-26T20:14:20.538010+0000","last_clean":"2024-04-26T20:14:20.538010+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:14:20.538010+0000","last_undegraded":"2024-04-26T20:14:20.538010+0000","last_fullsized":"2024-04-26T20:14:20.538010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341065+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:14:20.341065+0000","last_peered":"2024-04-26T20:14:20.341065+0000","last_clean":"2024-04-26T20:14:20.341065+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:14:20.341065+0000","last_undegraded":"2024-04-26T20:14:20.341065+0000","last_fullsized":"2024-04-26T20:14:20.341065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885059+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:14:19.885059+0000","last_peered":"2024-04-26T20:14:19.885059+0000","last_clean":"2024-04-26T20:14:19.885059+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:14:19.885059+0000","last_undegraded":"2024-04-26T20:14:19.885059+0000","last_fullsized":"2024-04-26T20:14:19.885059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551624+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:14:20.551624+0000","last_peered":"2024-04-26T20:14:20.551624+0000","last_clean":"2024-04-26T20:14:20.551624+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:14:20.551624+0000","last_undegraded":"2024-04-26T20:14:20.551624+0000","last_fullsized":"2024-04-26T20:14:20.551624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538130+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:14:20.538130+0000","last_peered":"2024-04-26T20:14:20.538130+0000","last_clean":"2024-04-26T20:14:20.538130+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:14:20.538130+0000","last_undegraded":"2024-04-26T20:14:20.538130+0000","last_fullsized":"2024-04-26T20:14:20.538130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537670+0000","last_change":"2024-04-26T20:14:18.532352+0000","last_active":"2024-04-26T20:14:20.537670+0000","last_peered":"2024-04-26T20:14:20.537670+0000","last_clean":"2024-04-26T20:14:20.537670+0000","last_became_active":"2024-04-26T20:14:18.531948+0000","last_became_peered":"2024-04-26T20:14:18.531948+0000","last_unstale":"2024-04-26T20:14:20.537670+0000","last_undegraded":"2024-04-26T20:14:20.537670+0000","last_fullsized":"2024-04-26T20:14:20.537670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:07.005152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508466+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:14:19.508466+0000","last_peered":"2024-04-26T20:14:19.508466+0000","last_clean":"2024-04-26T20:14:19.508466+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:14:19.508466+0000","last_undegraded":"2024-04-26T20:14:19.508466+0000","last_fullsized":"2024-04-26T20:14:19.508466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551328+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:14:20.551328+0000","last_peered":"2024-04-26T20:14:20.551328+0000","last_clean":"2024-04-26T20:14:20.551328+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:14:20.551328+0000","last_undegraded":"2024-04-26T20:14:20.551328+0000","last_fullsized":"2024-04-26T20:14:20.551328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538131+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:14:20.538131+0000","last_peered":"2024-04-26T20:14:20.538131+0000","last_clean":"2024-04-26T20:14:20.538131+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:14:20.538131+0000","last_undegraded":"2024-04-26T20:14:20.538131+0000","last_fullsized":"2024-04-26T20:14:20.538131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537632+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:14:20.537632+0000","last_peered":"2024-04-26T20:14:20.537632+0000","last_clean":"2024-04-26T20:14:20.537632+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:14:20.537632+0000","last_undegraded":"2024-04-26T20:14:20.537632+0000","last_fullsized":"2024-04-26T20:14:20.537632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.124586+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:14:46.124586+0000","last_peered":"2024-04-26T20:14:46.124586+0000","last_clean":"2024-04-26T20:14:46.124586+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:14:46.124586+0000","last_undegraded":"2024-04-26T20:14:46.124586+0000","last_fullsized":"2024-04-26T20:14:46.124586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884667+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:14:19.884667+0000","last_peered":"2024-04-26T20:14:19.884667+0000","last_clean":"2024-04-26T20:14:19.884667+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:14:19.884667+0000","last_undegraded":"2024-04-26T20:14:19.884667+0000","last_fullsized":"2024-04-26T20:14:19.884667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127978+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:14:46.127978+0000","last_peered":"2024-04-26T20:14:46.127978+0000","last_clean":"2024-04-26T20:14:46.127978+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:14:46.127978+0000","last_undegraded":"2024-04-26T20:14:46.127978+0000","last_fullsized":"2024-04-26T20:14:46.127978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885284+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:14:19.885284+0000","last_peered":"2024-04-26T20:14:19.885284+0000","last_clean":"2024-04-26T20:14:19.885284+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:14:19.885284+0000","last_undegraded":"2024-04-26T20:14:19.885284+0000","last_fullsized":"2024-04-26T20:14:19.885284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547171+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:14:20.547171+0000","last_peered":"2024-04-26T20:14:20.547171+0000","last_clean":"2024-04-26T20:14:20.547171+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:14:20.547171+0000","last_undegraded":"2024-04-26T20:14:20.547171+0000","last_fullsized":"2024-04-26T20:14:20.547171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.100202+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:14:40.100202+0000","last_peered":"2024-04-26T20:14:40.100202+0000","last_clean":"2024-04-26T20:14:40.100202+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:14:40.100202+0000","last_undegraded":"2024-04-26T20:14:40.100202+0000","last_fullsized":"2024-04-26T20:14:40.100202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339797+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:14:20.339797+0000","last_peered":"2024-04-26T20:14:20.339797+0000","last_clean":"2024-04-26T20:14:20.339797+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:14:20.339797+0000","last_undegraded":"2024-04-26T20:14:20.339797+0000","last_fullsized":"2024-04-26T20:14:20.339797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505934+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:14:19.505934+0000","last_peered":"2024-04-26T20:14:19.505934+0000","last_clean":"2024-04-26T20:14:19.505934+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:14:19.505934+0000","last_undegraded":"2024-04-26T20:14:19.505934+0000","last_fullsized":"2024-04-26T20:14:19.505934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340425+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:14:20.340425+0000","last_peered":"2024-04-26T20:14:20.340425+0000","last_clean":"2024-04-26T20:14:20.340425+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:14:20.340425+0000","last_undegraded":"2024-04-26T20:14:20.340425+0000","last_fullsized":"2024-04-26T20:14:20.340425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.126688+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:14:46.126688+0000","last_peered":"2024-04-26T20:14:46.126688+0000","last_clean":"2024-04-26T20:14:46.126688+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:14:46.126688+0000","last_undegraded":"2024-04-26T20:14:46.126688+0000","last_fullsized":"2024-04-26T20:14:46.126688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504513+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:14:19.504513+0000","last_peered":"2024-04-26T20:14:19.504513+0000","last_clean":"2024-04-26T20:14:19.504513+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:14:19.504513+0000","last_undegraded":"2024-04-26T20:14:19.504513+0000","last_fullsized":"2024-04-26T20:14:19.504513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551589+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:14:20.551589+0000","last_peered":"2024-04-26T20:14:20.551589+0000","last_clean":"2024-04-26T20:14:20.551589+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:14:20.551589+0000","last_undegraded":"2024-04-26T20:14:20.551589+0000","last_fullsized":"2024-04-26T20:14:20.551589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538251+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:14:20.538251+0000","last_peered":"2024-04-26T20:14:20.538251+0000","last_clean":"2024-04-26T20:14:20.538251+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:14:20.538251+0000","last_undegraded":"2024-04-26T20:14:20.538251+0000","last_fullsized":"2024-04-26T20:14:20.538251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885149+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:14:19.885149+0000","last_peered":"2024-04-26T20:14:19.885149+0000","last_clean":"2024-04-26T20:14:19.885149+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:14:19.885149+0000","last_undegraded":"2024-04-26T20:14:19.885149+0000","last_fullsized":"2024-04-26T20:14:19.885149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341171+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:14:20.341171+0000","last_peered":"2024-04-26T20:14:20.341171+0000","last_clean":"2024-04-26T20:14:20.341171+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:14:20.341171+0000","last_undegraded":"2024-04-26T20:14:20.341171+0000","last_fullsized":"2024-04-26T20:14:20.341171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.497025+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:14:19.497025+0000","last_peered":"2024-04-26T20:14:19.497025+0000","last_clean":"2024-04-26T20:14:19.497025+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:14:19.497025+0000","last_undegraded":"2024-04-26T20:14:19.497025+0000","last_fullsized":"2024-04-26T20:14:19.497025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550272+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:14:20.550272+0000","last_peered":"2024-04-26T20:14:20.550272+0000","last_clean":"2024-04-26T20:14:20.550272+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:14:20.550272+0000","last_undegraded":"2024-04-26T20:14:20.550272+0000","last_fullsized":"2024-04-26T20:14:20.550272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341179+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:14:20.341179+0000","last_peered":"2024-04-26T20:14:20.341179+0000","last_clean":"2024-04-26T20:14:20.341179+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:14:20.341179+0000","last_undegraded":"2024-04-26T20:14:20.341179+0000","last_fullsized":"2024-04-26T20:14:20.341179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509704+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:14:19.509704+0000","last_peered":"2024-04-26T20:14:19.509704+0000","last_clean":"2024-04-26T20:14:19.509704+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:14:19.509704+0000","last_undegraded":"2024-04-26T20:14:19.509704+0000","last_fullsized":"2024-04-26T20:14:19.509704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507544+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:14:19.507544+0000","last_peered":"2024-04-26T20:14:19.507544+0000","last_clean":"2024-04-26T20:14:19.507544+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:14:19.507544+0000","last_undegraded":"2024-04-26T20:14:19.507544+0000","last_fullsized":"2024-04-26T20:14:19.507544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340080+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:14:20.340080+0000","last_peered":"2024-04-26T20:14:20.340080+0000","last_clean":"2024-04-26T20:14:20.340080+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:14:20.340080+0000","last_undegraded":"2024-04-26T20:14:20.340080+0000","last_fullsized":"2024-04-26T20:14:20.340080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127779+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:14:46.127779+0000","last_peered":"2024-04-26T20:14:46.127779+0000","last_clean":"2024-04-26T20:14:46.127779+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:14:46.127779+0000","last_undegraded":"2024-04-26T20:14:46.127779+0000","last_fullsized":"2024-04-26T20:14:46.127779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885253+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:14:19.885253+0000","last_peered":"2024-04-26T20:14:19.885253+0000","last_clean":"2024-04-26T20:14:19.885253+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:14:19.885253+0000","last_undegraded":"2024-04-26T20:14:19.885253+0000","last_fullsized":"2024-04-26T20:14:19.885253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504382+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:14:19.504382+0000","last_peered":"2024-04-26T20:14:19.504382+0000","last_clean":"2024-04-26T20:14:19.504382+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:14:19.504382+0000","last_undegraded":"2024-04-26T20:14:19.504382+0000","last_fullsized":"2024-04-26T20:14:19.504382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.131333+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:14:46.131333+0000","last_peered":"2024-04-26T20:14:46.131333+0000","last_clean":"2024-04-26T20:14:46.131333+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:14:46.131333+0000","last_undegraded":"2024-04-26T20:14:46.131333+0000","last_fullsized":"2024-04-26T20:14:46.131333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547904+0000","last_change":"2024-04-26T20:14:18.642156+0000","last_active":"2024-04-26T20:14:20.547904+0000","last_peered":"2024-04-26T20:14:20.547904+0000","last_clean":"2024-04-26T20:14:20.547904+0000","last_became_active":"2024-04-26T20:14:18.641452+0000","last_became_peered":"2024-04-26T20:14:18.641452+0000","last_unstale":"2024-04-26T20:14:20.547904+0000","last_undegraded":"2024-04-26T20:14:20.547904+0000","last_fullsized":"2024-04-26T20:14:20.547904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:30.242536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340685+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:14:20.340685+0000","last_peered":"2024-04-26T20:14:20.340685+0000","last_clean":"2024-04-26T20:14:20.340685+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:14:20.340685+0000","last_undegraded":"2024-04-26T20:14:20.340685+0000","last_fullsized":"2024-04-26T20:14:20.340685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.093099+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:14:40.093099+0000","last_peered":"2024-04-26T20:14:40.093099+0000","last_clean":"2024-04-26T20:14:40.093099+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:14:40.093099+0000","last_undegraded":"2024-04-26T20:14:40.093099+0000","last_fullsized":"2024-04-26T20:14:40.093099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547744+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:14:20.547744+0000","last_peered":"2024-04-26T20:14:20.547744+0000","last_clean":"2024-04-26T20:14:20.547744+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:14:20.547744+0000","last_undegraded":"2024-04-26T20:14:20.547744+0000","last_fullsized":"2024-04-26T20:14:20.547744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884892+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:14:19.884892+0000","last_peered":"2024-04-26T20:14:19.884892+0000","last_clean":"2024-04-26T20:14:19.884892+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:14:19.884892+0000","last_undegraded":"2024-04-26T20:14:19.884892+0000","last_fullsized":"2024-04-26T20:14:19.884892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.123062+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:14:46.123062+0000","last_peered":"2024-04-26T20:14:46.123062+0000","last_clean":"2024-04-26T20:14:46.123062+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:14:46.123062+0000","last_undegraded":"2024-04-26T20:14:46.123062+0000","last_fullsized":"2024-04-26T20:14:46.123062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551667+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:14:20.551667+0000","last_peered":"2024-04-26T20:14:20.551667+0000","last_clean":"2024-04-26T20:14:20.551667+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:14:20.551667+0000","last_undegraded":"2024-04-26T20:14:20.551667+0000","last_fullsized":"2024-04-26T20:14:20.551667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340243+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:14:20.340243+0000","last_peered":"2024-04-26T20:14:20.340243+0000","last_clean":"2024-04-26T20:14:20.340243+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:14:20.340243+0000","last_undegraded":"2024-04-26T20:14:20.340243+0000","last_fullsized":"2024-04-26T20:14:20.340243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.086670+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:14:40.086670+0000","last_peered":"2024-04-26T20:14:40.086670+0000","last_clean":"2024-04-26T20:14:40.086670+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:14:40.086670+0000","last_undegraded":"2024-04-26T20:14:40.086670+0000","last_fullsized":"2024-04-26T20:14:40.086670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537725+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:14:20.537725+0000","last_peered":"2024-04-26T20:14:20.537725+0000","last_clean":"2024-04-26T20:14:20.537725+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:14:20.537725+0000","last_undegraded":"2024-04-26T20:14:20.537725+0000","last_fullsized":"2024-04-26T20:14:20.537725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509332+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:14:19.509332+0000","last_peered":"2024-04-26T20:14:19.509332+0000","last_clean":"2024-04-26T20:14:19.509332+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:14:19.509332+0000","last_undegraded":"2024-04-26T20:14:19.509332+0000","last_fullsized":"2024-04-26T20:14:19.509332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538197+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:14:20.538197+0000","last_peered":"2024-04-26T20:14:20.538197+0000","last_clean":"2024-04-26T20:14:20.538197+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:14:20.538197+0000","last_undegraded":"2024-04-26T20:14:20.538197+0000","last_fullsized":"2024-04-26T20:14:20.538197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508332+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:14:19.508332+0000","last_peered":"2024-04-26T20:14:19.508332+0000","last_clean":"2024-04-26T20:14:19.508332+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:14:19.508332+0000","last_undegraded":"2024-04-26T20:14:19.508332+0000","last_fullsized":"2024-04-26T20:14:19.508332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885496+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:14:19.885496+0000","last_peered":"2024-04-26T20:14:19.885496+0000","last_clean":"2024-04-26T20:14:19.885496+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:14:19.885496+0000","last_undegraded":"2024-04-26T20:14:19.885496+0000","last_fullsized":"2024-04-26T20:14:19.885496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.097720+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:14:40.097720+0000","last_peered":"2024-04-26T20:14:40.097720+0000","last_clean":"2024-04-26T20:14:40.097720+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:14:40.097720+0000","last_undegraded":"2024-04-26T20:14:40.097720+0000","last_fullsized":"2024-04-26T20:14:40.097720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547103+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:14:20.547103+0000","last_peered":"2024-04-26T20:14:20.547103+0000","last_clean":"2024-04-26T20:14:20.547103+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:14:20.547103+0000","last_undegraded":"2024-04-26T20:14:20.547103+0000","last_fullsized":"2024-04-26T20:14:20.547103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551023+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:14:20.551023+0000","last_peered":"2024-04-26T20:14:20.551023+0000","last_clean":"2024-04-26T20:14:20.551023+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:14:20.551023+0000","last_undegraded":"2024-04-26T20:14:20.551023+0000","last_fullsized":"2024-04-26T20:14:20.551023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.092533+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:14:40.092533+0000","last_peered":"2024-04-26T20:14:40.092533+0000","last_clean":"2024-04-26T20:14:40.092533+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:14:40.092533+0000","last_undegraded":"2024-04-26T20:14:40.092533+0000","last_fullsized":"2024-04-26T20:14:40.092533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547062+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:14:20.547062+0000","last_peered":"2024-04-26T20:14:20.547062+0000","last_clean":"2024-04-26T20:14:20.547062+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:14:20.547062+0000","last_undegraded":"2024-04-26T20:14:20.547062+0000","last_fullsized":"2024-04-26T20:14:20.547062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885190+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:14:19.885190+0000","last_peered":"2024-04-26T20:14:19.885190+0000","last_clean":"2024-04-26T20:14:19.885190+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:14:19.885190+0000","last_undegraded":"2024-04-26T20:14:19.885190+0000","last_fullsized":"2024-04-26T20:14:19.885190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537488+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:14:20.537488+0000","last_peered":"2024-04-26T20:14:20.537488+0000","last_clean":"2024-04-26T20:14:20.537488+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:14:20.537488+0000","last_undegraded":"2024-04-26T20:14:20.537488+0000","last_fullsized":"2024-04-26T20:14:20.537488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550778+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:14:20.550778+0000","last_peered":"2024-04-26T20:14:20.550778+0000","last_clean":"2024-04-26T20:14:20.550778+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:14:20.550778+0000","last_undegraded":"2024-04-26T20:14:20.550778+0000","last_fullsized":"2024-04-26T20:14:20.550778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506621+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:14:19.506621+0000","last_peered":"2024-04-26T20:14:19.506621+0000","last_clean":"2024-04-26T20:14:19.506621+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:14:19.506621+0000","last_undegraded":"2024-04-26T20:14:19.506621+0000","last_fullsized":"2024-04-26T20:14:19.506621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547012+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:14:20.547012+0000","last_peered":"2024-04-26T20:14:20.547012+0000","last_clean":"2024-04-26T20:14:20.547012+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:14:20.547012+0000","last_undegraded":"2024-04-26T20:14:20.547012+0000","last_fullsized":"2024-04-26T20:14:20.547012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.122360+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:14:46.122360+0000","last_peered":"2024-04-26T20:14:46.122360+0000","last_clean":"2024-04-26T20:14:46.122360+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:14:46.122360+0000","last_undegraded":"2024-04-26T20:14:46.122360+0000","last_fullsized":"2024-04-26T20:14:46.122360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.128712+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:14:46.128712+0000","last_peered":"2024-04-26T20:14:46.128712+0000","last_clean":"2024-04-26T20:14:46.128712+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:14:46.128712+0000","last_undegraded":"2024-04-26T20:14:46.128712+0000","last_fullsized":"2024-04-26T20:14:46.128712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885205+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:14:19.885205+0000","last_peered":"2024-04-26T20:14:19.885205+0000","last_clean":"2024-04-26T20:14:19.885205+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:14:19.885205+0000","last_undegraded":"2024-04-26T20:14:19.885205+0000","last_fullsized":"2024-04-26T20:14:19.885205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496841+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:14:19.496841+0000","last_peered":"2024-04-26T20:14:19.496841+0000","last_clean":"2024-04-26T20:14:19.496841+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:14:19.496841+0000","last_undegraded":"2024-04-26T20:14:19.496841+0000","last_fullsized":"2024-04-26T20:14:19.496841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.106751+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:14:40.106751+0000","last_peered":"2024-04-26T20:14:40.106751+0000","last_clean":"2024-04-26T20:14:40.106751+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:14:40.106751+0000","last_undegraded":"2024-04-26T20:14:40.106751+0000","last_fullsized":"2024-04-26T20:14:40.106751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508517+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:14:19.508517+0000","last_peered":"2024-04-26T20:14:19.508517+0000","last_clean":"2024-04-26T20:14:19.508517+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:14:19.508517+0000","last_undegraded":"2024-04-26T20:14:19.508517+0000","last_fullsized":"2024-04-26T20:14:19.508517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547503+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:14:20.547503+0000","last_peered":"2024-04-26T20:14:20.547503+0000","last_clean":"2024-04-26T20:14:20.547503+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:14:20.547503+0000","last_undegraded":"2024-04-26T20:14:20.547503+0000","last_fullsized":"2024-04-26T20:14:20.547503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504099+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:14:19.504099+0000","last_peered":"2024-04-26T20:14:19.504099+0000","last_clean":"2024-04-26T20:14:19.504099+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:14:19.504099+0000","last_undegraded":"2024-04-26T20:14:19.504099+0000","last_fullsized":"2024-04-26T20:14:19.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496540+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:14:19.496540+0000","last_peered":"2024-04-26T20:14:19.496540+0000","last_clean":"2024-04-26T20:14:19.496540+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:14:19.496540+0000","last_undegraded":"2024-04-26T20:14:19.496540+0000","last_fullsized":"2024-04-26T20:14:19.496540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550979+0000","last_change":"2024-04-26T20:14:14.482803+0000","last_active":"2024-04-26T20:14:20.550979+0000","last_peered":"2024-04-26T20:14:20.550979+0000","last_clean":"2024-04-26T20:14:20.550979+0000","last_became_active":"2024-04-26T20:14:14.482022+0000","last_became_peered":"2024-04-26T20:14:14.482022+0000","last_unstale":"2024-04-26T20:14:20.550979+0000","last_undegraded":"2024-04-26T20:14:20.550979+0000","last_fullsized":"2024-04-26T20:14:20.550979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885112+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:14:19.885112+0000","last_peered":"2024-04-26T20:14:19.885112+0000","last_clean":"2024-04-26T20:14:19.885112+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:14:19.885112+0000","last_undegraded":"2024-04-26T20:14:19.885112+0000","last_fullsized":"2024-04-26T20:14:19.885112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547807+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:14:20.547807+0000","last_peered":"2024-04-26T20:14:20.547807+0000","last_clean":"2024-04-26T20:14:20.547807+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:14:20.547807+0000","last_undegraded":"2024-04-26T20:14:20.547807+0000","last_fullsized":"2024-04-26T20:14:20.547807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537992+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:14:20.537992+0000","last_peered":"2024-04-26T20:14:20.537992+0000","last_clean":"2024-04-26T20:14:20.537992+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:14:20.537992+0000","last_undegraded":"2024-04-26T20:14:20.537992+0000","last_fullsized":"2024-04-26T20:14:20.537992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506318+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:14:19.506318+0000","last_peered":"2024-04-26T20:14:19.506318+0000","last_clean":"2024-04-26T20:14:19.506318+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:14:19.506318+0000","last_undegraded":"2024-04-26T20:14:19.506318+0000","last_fullsized":"2024-04-26T20:14:19.506318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547804+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:14:20.547804+0000","last_peered":"2024-04-26T20:14:20.547804+0000","last_clean":"2024-04-26T20:14:20.547804+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:14:20.547804+0000","last_undegraded":"2024-04-26T20:14:20.547804+0000","last_fullsized":"2024-04-26T20:14:20.547804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550486+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:14:20.550486+0000","last_peered":"2024-04-26T20:14:20.550486+0000","last_clean":"2024-04-26T20:14:20.550486+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:14:20.550486+0000","last_undegraded":"2024-04-26T20:14:20.550486+0000","last_fullsized":"2024-04-26T20:14:20.550486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547253+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:14:20.547253+0000","last_peered":"2024-04-26T20:14:20.547253+0000","last_clean":"2024-04-26T20:14:20.547253+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:14:20.547253+0000","last_undegraded":"2024-04-26T20:14:20.547253+0000","last_fullsized":"2024-04-26T20:14:20.547253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550633+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:14:20.550633+0000","last_peered":"2024-04-26T20:14:20.550633+0000","last_clean":"2024-04-26T20:14:20.550633+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:14:20.550633+0000","last_undegraded":"2024-04-26T20:14:20.550633+0000","last_fullsized":"2024-04-26T20:14:20.550633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884953+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:14:19.884953+0000","last_peered":"2024-04-26T20:14:19.884953+0000","last_clean":"2024-04-26T20:14:19.884953+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:14:19.884953+0000","last_undegraded":"2024-04-26T20:14:19.884953+0000","last_fullsized":"2024-04-26T20:14:19.884953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505625+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:14:19.505625+0000","last_peered":"2024-04-26T20:14:19.505625+0000","last_clean":"2024-04-26T20:14:19.505625+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:14:19.505625+0000","last_undegraded":"2024-04-26T20:14:19.505625+0000","last_fullsized":"2024-04-26T20:14:19.505625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340721+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:14:20.340721+0000","last_peered":"2024-04-26T20:14:20.340721+0000","last_clean":"2024-04-26T20:14:20.340721+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:14:20.340721+0000","last_undegraded":"2024-04-26T20:14:20.340721+0000","last_fullsized":"2024-04-26T20:14:20.340721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496988+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:14:19.496988+0000","last_peered":"2024-04-26T20:14:19.496988+0000","last_clean":"2024-04-26T20:14:19.496988+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:14:19.496988+0000","last_undegraded":"2024-04-26T20:14:19.496988+0000","last_fullsized":"2024-04-26T20:14:19.496988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551847+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:14:20.551847+0000","last_peered":"2024-04-26T20:14:20.551847+0000","last_clean":"2024-04-26T20:14:20.551847+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:14:20.551847+0000","last_undegraded":"2024-04-26T20:14:20.551847+0000","last_fullsized":"2024-04-26T20:14:20.551847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550171+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:14:20.550171+0000","last_peered":"2024-04-26T20:14:20.550171+0000","last_clean":"2024-04-26T20:14:20.550171+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:14:20.550171+0000","last_undegraded":"2024-04-26T20:14:20.550171+0000","last_fullsized":"2024-04-26T20:14:20.550171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537556+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:14:20.537556+0000","last_peered":"2024-04-26T20:14:20.537556+0000","last_clean":"2024-04-26T20:14:20.537556+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:14:20.537556+0000","last_undegraded":"2024-04-26T20:14:20.537556+0000","last_fullsized":"2024-04-26T20:14:20.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884895+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:14:19.884895+0000","last_peered":"2024-04-26T20:14:19.884895+0000","last_clean":"2024-04-26T20:14:19.884895+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:14:19.884895+0000","last_undegraded":"2024-04-26T20:14:19.884895+0000","last_fullsized":"2024-04-26T20:14:19.884895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547283+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:14:20.547283+0000","last_peered":"2024-04-26T20:14:20.547283+0000","last_clean":"2024-04-26T20:14:20.547283+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:14:20.547283+0000","last_undegraded":"2024-04-26T20:14:20.547283+0000","last_fullsized":"2024-04-26T20:14:20.547283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509243+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:14:19.509243+0000","last_peered":"2024-04-26T20:14:19.509243+0000","last_clean":"2024-04-26T20:14:19.509243+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:14:19.509243+0000","last_undegraded":"2024-04-26T20:14:19.509243+0000","last_fullsized":"2024-04-26T20:14:19.509243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505396+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:14:19.505396+0000","last_peered":"2024-04-26T20:14:19.505396+0000","last_clean":"2024-04-26T20:14:19.505396+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:14:19.505396+0000","last_undegraded":"2024-04-26T20:14:19.505396+0000","last_fullsized":"2024-04-26T20:14:19.505396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506202+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:14:19.506202+0000","last_peered":"2024-04-26T20:14:19.506202+0000","last_clean":"2024-04-26T20:14:19.506202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:14:19.506202+0000","last_undegraded":"2024-04-26T20:14:19.506202+0000","last_fullsized":"2024-04-26T20:14:19.506202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341083+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:14:20.341083+0000","last_peered":"2024-04-26T20:14:20.341083+0000","last_clean":"2024-04-26T20:14:20.341083+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:14:20.341083+0000","last_undegraded":"2024-04-26T20:14:20.341083+0000","last_fullsized":"2024-04-26T20:14:20.341083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546910+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:14:20.546910+0000","last_peered":"2024-04-26T20:14:20.546910+0000","last_clean":"2024-04-26T20:14:20.546910+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:14:20.546910+0000","last_undegraded":"2024-04-26T20:14:20.546910+0000","last_fullsized":"2024-04-26T20:14:20.546910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339971+0000","last_change":"2024-04-26T20:14:14.463139+0000","last_active":"2024-04-26T20:14:20.339971+0000","last_peered":"2024-04-26T20:14:20.339971+0000","last_clean":"2024-04-26T20:14:20.339971+0000","last_became_active":"2024-04-26T20:14:14.462083+0000","last_became_peered":"2024-04-26T20:14:14.462083+0000","last_unstale":"2024-04-26T20:14:20.339971+0000","last_undegraded":"2024-04-26T20:14:20.339971+0000","last_fullsized":"2024-04-26T20:14:20.339971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:28.615893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550418+0000","last_change":"2024-04-26T20:14:14.475535+0000","last_active":"2024-04-26T20:14:20.550418+0000","last_peered":"2024-04-26T20:14:20.550418+0000","last_clean":"2024-04-26T20:14:20.550418+0000","last_became_active":"2024-04-26T20:14:14.474445+0000","last_became_peered":"2024-04-26T20:14:14.474445+0000","last_unstale":"2024-04-26T20:14:20.550418+0000","last_undegraded":"2024-04-26T20:14:20.550418+0000","last_fullsized":"2024-04-26T20:14:20.550418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:51.715142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339972+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:14:20.339972+0000","last_peered":"2024-04-26T20:14:20.339972+0000","last_clean":"2024-04-26T20:14:20.339972+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:14:20.339972+0000","last_undegraded":"2024-04-26T20:14:20.339972+0000","last_fullsized":"2024-04-26T20:14:20.339972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551012+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:14:20.551012+0000","last_peered":"2024-04-26T20:14:20.551012+0000","last_clean":"2024-04-26T20:14:20.551012+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:14:20.551012+0000","last_undegraded":"2024-04-26T20:14:20.551012+0000","last_fullsized":"2024-04-26T20:14:20.551012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885153+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:14:19.885153+0000","last_peered":"2024-04-26T20:14:19.885153+0000","last_clean":"2024-04-26T20:14:19.885153+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:14:19.885153+0000","last_undegraded":"2024-04-26T20:14:19.885153+0000","last_fullsized":"2024-04-26T20:14:19.885153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538165+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:14:20.538165+0000","last_peered":"2024-04-26T20:14:20.538165+0000","last_clean":"2024-04-26T20:14:20.538165+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:14:20.538165+0000","last_undegraded":"2024-04-26T20:14:20.538165+0000","last_fullsized":"2024-04-26T20:14:20.538165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340878+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:14:20.340878+0000","last_peered":"2024-04-26T20:14:20.340878+0000","last_clean":"2024-04-26T20:14:20.340878+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:14:20.340878+0000","last_undegraded":"2024-04-26T20:14:20.340878+0000","last_fullsized":"2024-04-26T20:14:20.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":695501,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":104937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":108371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":104377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":104503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":344064,"data_stored":694587,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:14:59.951 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-04-26T20:14:59.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:15:00.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a9400640 1 Processor -- start 2024-04-26T20:15:00.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a9400640 1 -- start start 2024-04-26T20:15:00.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a415c770 0x7fd0a4071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a9400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd0a40c9520 0x7fd0a4166860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a9400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a40c8e50 con 0x7fd0a4070da0 2024-04-26T20:15:00.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a9400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a4160290 con 0x7fd0a40c9520 2024-04-26T20:15:00.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a9400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a40c9110 con 0x7fd0a415c770 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a1e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a415c770 0x7fd0a4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a1e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a415c770 0x7fd0a4071180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:50580/0 (socket says 172.21.15.16:50580) 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a1e00640 1 -- 172.21.15.16:0/1886315678 learned_addr learned my addr 172.21.15.16:0/1886315678 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a3200640 1 --2- 172.21.15.16:0/1886315678 >> v2:172.21.15.192:3300/0 conn(0x7fd0a40c9520 0x7fd0a4166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a1e00640 1 -- 172.21.15.16:0/1886315678 >> v2:172.21.15.192:3300/0 conn(0x7fd0a40c9520 msgr2=0x7fd0a4166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a1e00640 1 --2- 172.21.15.16:0/1886315678 >> v2:172.21.15.192:3300/0 conn(0x7fd0a40c9520 0x7fd0a4166860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a1e00640 1 -- 172.21.15.16:0/1886315678 >> v1:172.21.15.192:6789/0 conn(0x7fd0a4070da0 legacy=0x7fd0a415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.126+0000 7fd0a1e00640 1 -- 172.21.15.16:0/1886315678 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a40c9d70 con 0x7fd0a415c770 2024-04-26T20:15:00.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a1e00640 1 --2- 172.21.15.16:0/1886315678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a415c770 0x7fd0a4071180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd090009870 tx=0x7fd09001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68b15cf205d66796 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a1400640 1 -- 172.21.15.16:0/1886315678 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0900b2070 con 0x7fd0a415c770 2024-04-26T20:15:00.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a1400640 1 -- 172.21.15.16:0/1886315678 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0900a9070 con 0x7fd0a415c770 2024-04-26T20:15:00.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a1400640 1 -- 172.21.15.16:0/1886315678 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0900ad880 con 0x7fd0a415c770 2024-04-26T20:15:00.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 -- 172.21.15.16:0/1886315678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a415c770 msgr2=0x7fd0a4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 --2- 172.21.15.16:0/1886315678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a415c770 0x7fd0a4071180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd090009870 tx=0x7fd09001c560 comp rx=0 tx=0).stop 2024-04-26T20:15:00.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 -- 172.21.15.16:0/1886315678 shutdown_connections 2024-04-26T20:15:00.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 --2- 172.21.15.16:0/1886315678 >> v2:172.21.15.192:3300/0 conn(0x7fd0a40c9520 0x7fd0a4166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 --2- 172.21.15.16:0/1886315678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a415c770 0x7fd0a4071180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 -- 172.21.15.16:0/1886315678 >> 172.21.15.16:0/1886315678 conn(0x7fd0a40ce2c0 msgr2=0x7fd0a40ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:00.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 -- 172.21.15.16:0/1886315678 shutdown_connections 2024-04-26T20:15:00.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.130+0000 7fd0a9400640 1 -- 172.21.15.16:0/1886315678 wait complete. 2024-04-26T20:15:00.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 Processor -- start 2024-04-26T20:15:00.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 -- start start 2024-04-26T20:15:00.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0a4070da0 0x7fd0a41498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a40c9520 0x7fd0a4148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0a415c770 0x7fd0a40cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a4169950 con 0x7fd0a415c770 2024-04-26T20:15:00.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a41697d0 con 0x7fd0a4070da0 2024-04-26T20:15:00.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a4169ad0 con 0x7fd0a40c9520 2024-04-26T20:15:00.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0a415c770 0x7fd0a40cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0a415c770 0x7fd0a40cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37914/0 (socket says 172.21.15.16:37914) 2024-04-26T20:15:00.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 -- 172.21.15.16:0/2893724112 learned_addr learned my addr 172.21.15.16:0/2893724112 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:00.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a1e00640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a40c9520 0x7fd0a4148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a2800640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0a4070da0 0x7fd0a41498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 -- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a40c9520 msgr2=0x7fd0a4148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a40c9520 0x7fd0a4148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 -- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0a4070da0 msgr2=0x7fd0a41498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0a4070da0 0x7fd0a41498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 -- 172.21.15.16:0/2893724112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a4149660 con 0x7fd0a415c770 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a3200640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0a415c770 0x7fd0a40cca40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009dd0 tx=0x7fd09c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd09aa00640 1 -- 172.21.15.16:0/2893724112 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c018020 con 0x7fd0a415c770 2024-04-26T20:15:00.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd09aa00640 1 -- 172.21.15.16:0/2893724112 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c014480 con 0x7fd0a415c770 2024-04-26T20:15:00.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a414d5b0 con 0x7fd0a415c770 2024-04-26T20:15:00.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd09aa00640 1 -- 172.21.15.16:0/2893724112 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c014870 con 0x7fd0a415c770 2024-04-26T20:15:00.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.134+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a40cc240 con 0x7fd0a415c770 2024-04-26T20:15:00.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.138+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a414dad0 con 0x7fd0a415c770 2024-04-26T20:15:00.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.138+0000 7fd09aa00640 1 -- 172.21.15.16:0/2893724112 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd09c01b020 con 0x7fd0a415c770 2024-04-26T20:15:00.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.138+0000 7fd09aa00640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd084068380 0x7fd08406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.138+0000 7fd09aa00640 1 -- 172.21.15.16:0/2893724112 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd09c087680 con 0x7fd0a415c770 2024-04-26T20:15:00.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.138+0000 7fd0a2800640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd084068380 0x7fd08406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.142+0000 7fd0a2800640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd084068380 0x7fd08406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd094001810 tx=0x7fd094009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.142+0000 7fd09aa00640 1 -- 172.21.15.16:0/2893724112 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd09c022070 con 0x7fd0a415c770 2024-04-26T20:15:00.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.306+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0a4153bc0 con 0x7fd084068380 2024-04-26T20:15:00.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.326+0000 7fd09aa00640 1 -- 172.21.15.16:0/2893724112 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332699 (secure 0 0 0) 0x7fd0a4153bc0 con 0x7fd084068380 2024-04-26T20:15:00.333 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:15:00.335 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:15:00.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd084068380 msgr2=0x7fd08406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd084068380 0x7fd08406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd094001810 tx=0x7fd094009040 comp rx=0 tx=0).stop 2024-04-26T20:15:00.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0a415c770 msgr2=0x7fd0a40cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0a415c770 0x7fd0a40cca40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009dd0 tx=0x7fd09c00c490 comp rx=0 tx=0).stop 2024-04-26T20:15:00.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 shutdown_connections 2024-04-26T20:15:00.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd084068380 0x7fd08406a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0a415c770 0x7fd0a40cca40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0a40c9520 0x7fd0a4148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 --2- 172.21.15.16:0/2893724112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0a4070da0 0x7fd0a41498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 >> 172.21.15.16:0/2893724112 conn(0x7fd0a40ce2c0 msgr2=0x7fd0a4155a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:00.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 shutdown_connections 2024-04-26T20:15:00.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.330+0000 7fd0a9400640 1 -- 172.21.15.16:0/2893724112 wait complete. 2024-04-26T20:15:00.353 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-26T20:14:58.965874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598078,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226784,"kb_used_data":2336,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747936,"statfs":{"total":773094113280,"available":772861886464,"internally_reserved":0,"allocated":2392064,"data_stored":2024628,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1664,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004874"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127396+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:14:46.127396+0000","last_peered":"2024-04-26T20:14:46.127396+0000","last_clean":"2024-04-26T20:14:46.127396+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:14:46.127396+0000","last_undegraded":"2024-04-26T20:14:46.127396+0000","last_fullsized":"2024-04-26T20:14:46.127396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547330+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:14:20.547330+0000","last_peered":"2024-04-26T20:14:20.547330+0000","last_clean":"2024-04-26T20:14:20.547330+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:14:20.547330+0000","last_undegraded":"2024-04-26T20:14:20.547330+0000","last_fullsized":"2024-04-26T20:14:20.547330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547016+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:14:20.547016+0000","last_peered":"2024-04-26T20:14:20.547016+0000","last_clean":"2024-04-26T20:14:20.547016+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:14:20.547016+0000","last_undegraded":"2024-04-26T20:14:20.547016+0000","last_fullsized":"2024-04-26T20:14:20.547016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547738+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:14:20.547738+0000","last_peered":"2024-04-26T20:14:20.547738+0000","last_clean":"2024-04-26T20:14:20.547738+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:14:20.547738+0000","last_undegraded":"2024-04-26T20:14:20.547738+0000","last_fullsized":"2024-04-26T20:14:20.547738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885447+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:14:19.885447+0000","last_peered":"2024-04-26T20:14:19.885447+0000","last_clean":"2024-04-26T20:14:19.885447+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:14:19.885447+0000","last_undegraded":"2024-04-26T20:14:19.885447+0000","last_fullsized":"2024-04-26T20:14:19.885447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507611+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:14:19.507611+0000","last_peered":"2024-04-26T20:14:19.507611+0000","last_clean":"2024-04-26T20:14:19.507611+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:14:19.507611+0000","last_undegraded":"2024-04-26T20:14:19.507611+0000","last_fullsized":"2024-04-26T20:14:19.507611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.124085+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:14:46.124085+0000","last_peered":"2024-04-26T20:14:46.124085+0000","last_clean":"2024-04-26T20:14:46.124085+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:14:46.124085+0000","last_undegraded":"2024-04-26T20:14:46.124085+0000","last_fullsized":"2024-04-26T20:14:46.124085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551492+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:14:20.551492+0000","last_peered":"2024-04-26T20:14:20.551492+0000","last_clean":"2024-04-26T20:14:20.551492+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:14:20.551492+0000","last_undegraded":"2024-04-26T20:14:20.551492+0000","last_fullsized":"2024-04-26T20:14:20.551492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507856+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:14:19.507856+0000","last_peered":"2024-04-26T20:14:19.507856+0000","last_clean":"2024-04-26T20:14:19.507856+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:14:19.507856+0000","last_undegraded":"2024-04-26T20:14:19.507856+0000","last_fullsized":"2024-04-26T20:14:19.507856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340190+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:14:20.340190+0000","last_peered":"2024-04-26T20:14:20.340190+0000","last_clean":"2024-04-26T20:14:20.340190+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:14:20.340190+0000","last_undegraded":"2024-04-26T20:14:20.340190+0000","last_fullsized":"2024-04-26T20:14:20.340190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551323+0000","last_change":"2024-04-26T20:14:14.499292+0000","last_active":"2024-04-26T20:14:20.551323+0000","last_peered":"2024-04-26T20:14:20.551323+0000","last_clean":"2024-04-26T20:14:20.551323+0000","last_became_active":"2024-04-26T20:14:14.498610+0000","last_became_peered":"2024-04-26T20:14:14.498610+0000","last_unstale":"2024-04-26T20:14:20.551323+0000","last_undegraded":"2024-04-26T20:14:20.551323+0000","last_fullsized":"2024-04-26T20:14:20.551323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:44.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508054+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:14:19.508054+0000","last_peered":"2024-04-26T20:14:19.508054+0000","last_clean":"2024-04-26T20:14:19.508054+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:14:19.508054+0000","last_undegraded":"2024-04-26T20:14:19.508054+0000","last_fullsized":"2024-04-26T20:14:19.508054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504675+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:14:19.504675+0000","last_peered":"2024-04-26T20:14:19.504675+0000","last_clean":"2024-04-26T20:14:19.504675+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:14:19.504675+0000","last_undegraded":"2024-04-26T20:14:19.504675+0000","last_fullsized":"2024-04-26T20:14:19.504675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.087410+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:14:40.087410+0000","last_peered":"2024-04-26T20:14:40.087410+0000","last_clean":"2024-04-26T20:14:40.087410+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:14:40.087410+0000","last_undegraded":"2024-04-26T20:14:40.087410+0000","last_fullsized":"2024-04-26T20:14:40.087410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509512+0000","last_change":"2024-04-26T20:14:18.527474+0000","last_active":"2024-04-26T20:14:19.509512+0000","last_peered":"2024-04-26T20:14:19.509512+0000","last_clean":"2024-04-26T20:14:19.509512+0000","last_became_active":"2024-04-26T20:14:18.526374+0000","last_became_peered":"2024-04-26T20:14:18.526374+0000","last_unstale":"2024-04-26T20:14:19.509512+0000","last_undegraded":"2024-04-26T20:14:19.509512+0000","last_fullsized":"2024-04-26T20:14:19.509512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:31.961201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547337+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:14:20.547337+0000","last_peered":"2024-04-26T20:14:20.547337+0000","last_clean":"2024-04-26T20:14:20.547337+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:14:20.547337+0000","last_undegraded":"2024-04-26T20:14:20.547337+0000","last_fullsized":"2024-04-26T20:14:20.547337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537897+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:14:20.537897+0000","last_peered":"2024-04-26T20:14:20.537897+0000","last_clean":"2024-04-26T20:14:20.537897+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:14:20.537897+0000","last_undegraded":"2024-04-26T20:14:20.537897+0000","last_fullsized":"2024-04-26T20:14:20.537897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509176+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:14:19.509176+0000","last_peered":"2024-04-26T20:14:19.509176+0000","last_clean":"2024-04-26T20:14:19.509176+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:14:19.509176+0000","last_undegraded":"2024-04-26T20:14:19.509176+0000","last_fullsized":"2024-04-26T20:14:19.509176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547119+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:14:20.547119+0000","last_peered":"2024-04-26T20:14:20.547119+0000","last_clean":"2024-04-26T20:14:20.547119+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:14:20.547119+0000","last_undegraded":"2024-04-26T20:14:20.547119+0000","last_fullsized":"2024-04-26T20:14:20.547119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.099897+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:14:40.099897+0000","last_peered":"2024-04-26T20:14:40.099897+0000","last_clean":"2024-04-26T20:14:40.099897+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:14:40.099897+0000","last_undegraded":"2024-04-26T20:14:40.099897+0000","last_fullsized":"2024-04-26T20:14:40.099897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508115+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:14:19.508115+0000","last_peered":"2024-04-26T20:14:19.508115+0000","last_clean":"2024-04-26T20:14:19.508115+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:14:19.508115+0000","last_undegraded":"2024-04-26T20:14:19.508115+0000","last_fullsized":"2024-04-26T20:14:19.508115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.090799+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:14:40.090799+0000","last_peered":"2024-04-26T20:14:40.090799+0000","last_clean":"2024-04-26T20:14:40.090799+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:14:40.090799+0000","last_undegraded":"2024-04-26T20:14:40.090799+0000","last_fullsized":"2024-04-26T20:14:40.090799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509417+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:14:19.509417+0000","last_peered":"2024-04-26T20:14:19.509417+0000","last_clean":"2024-04-26T20:14:19.509417+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:14:19.509417+0000","last_undegraded":"2024-04-26T20:14:19.509417+0000","last_fullsized":"2024-04-26T20:14:19.509417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885352+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:14:19.885352+0000","last_peered":"2024-04-26T20:14:19.885352+0000","last_clean":"2024-04-26T20:14:19.885352+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:14:19.885352+0000","last_undegraded":"2024-04-26T20:14:19.885352+0000","last_fullsized":"2024-04-26T20:14:19.885352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.091154+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:14:40.091154+0000","last_peered":"2024-04-26T20:14:40.091154+0000","last_clean":"2024-04-26T20:14:40.091154+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:14:40.091154+0000","last_undegraded":"2024-04-26T20:14:40.091154+0000","last_fullsized":"2024-04-26T20:14:40.091154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507739+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:14:19.507739+0000","last_peered":"2024-04-26T20:14:19.507739+0000","last_clean":"2024-04-26T20:14:19.507739+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:14:19.507739+0000","last_undegraded":"2024-04-26T20:14:19.507739+0000","last_fullsized":"2024-04-26T20:14:19.507739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547916+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:14:20.547916+0000","last_peered":"2024-04-26T20:14:20.547916+0000","last_clean":"2024-04-26T20:14:20.547916+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:14:20.547916+0000","last_undegraded":"2024-04-26T20:14:20.547916+0000","last_fullsized":"2024-04-26T20:14:20.547916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.129602+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:14:46.129602+0000","last_peered":"2024-04-26T20:14:46.129602+0000","last_clean":"2024-04-26T20:14:46.129602+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:14:46.129602+0000","last_undegraded":"2024-04-26T20:14:46.129602+0000","last_fullsized":"2024-04-26T20:14:46.129602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546922+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:14:20.546922+0000","last_peered":"2024-04-26T20:14:20.546922+0000","last_clean":"2024-04-26T20:14:20.546922+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:14:20.546922+0000","last_undegraded":"2024-04-26T20:14:20.546922+0000","last_fullsized":"2024-04-26T20:14:20.546922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538010+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:14:20.538010+0000","last_peered":"2024-04-26T20:14:20.538010+0000","last_clean":"2024-04-26T20:14:20.538010+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:14:20.538010+0000","last_undegraded":"2024-04-26T20:14:20.538010+0000","last_fullsized":"2024-04-26T20:14:20.538010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341065+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:14:20.341065+0000","last_peered":"2024-04-26T20:14:20.341065+0000","last_clean":"2024-04-26T20:14:20.341065+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:14:20.341065+0000","last_undegraded":"2024-04-26T20:14:20.341065+0000","last_fullsized":"2024-04-26T20:14:20.341065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885059+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:14:19.885059+0000","last_peered":"2024-04-26T20:14:19.885059+0000","last_clean":"2024-04-26T20:14:19.885059+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:14:19.885059+0000","last_undegraded":"2024-04-26T20:14:19.885059+0000","last_fullsized":"2024-04-26T20:14:19.885059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551624+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:14:20.551624+0000","last_peered":"2024-04-26T20:14:20.551624+0000","last_clean":"2024-04-26T20:14:20.551624+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:14:20.551624+0000","last_undegraded":"2024-04-26T20:14:20.551624+0000","last_fullsized":"2024-04-26T20:14:20.551624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538130+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:14:20.538130+0000","last_peered":"2024-04-26T20:14:20.538130+0000","last_clean":"2024-04-26T20:14:20.538130+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:14:20.538130+0000","last_undegraded":"2024-04-26T20:14:20.538130+0000","last_fullsized":"2024-04-26T20:14:20.538130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537670+0000","last_change":"2024-04-26T20:14:18.532352+0000","last_active":"2024-04-26T20:14:20.537670+0000","last_peered":"2024-04-26T20:14:20.537670+0000","last_clean":"2024-04-26T20:14:20.537670+0000","last_became_active":"2024-04-26T20:14:18.531948+0000","last_became_peered":"2024-04-26T20:14:18.531948+0000","last_unstale":"2024-04-26T20:14:20.537670+0000","last_undegraded":"2024-04-26T20:14:20.537670+0000","last_fullsized":"2024-04-26T20:14:20.537670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:07.005152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508466+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:14:19.508466+0000","last_peered":"2024-04-26T20:14:19.508466+0000","last_clean":"2024-04-26T20:14:19.508466+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:14:19.508466+0000","last_undegraded":"2024-04-26T20:14:19.508466+0000","last_fullsized":"2024-04-26T20:14:19.508466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551328+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:14:20.551328+0000","last_peered":"2024-04-26T20:14:20.551328+0000","last_clean":"2024-04-26T20:14:20.551328+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:14:20.551328+0000","last_undegraded":"2024-04-26T20:14:20.551328+0000","last_fullsized":"2024-04-26T20:14:20.551328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538131+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:14:20.538131+0000","last_peered":"2024-04-26T20:14:20.538131+0000","last_clean":"2024-04-26T20:14:20.538131+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:14:20.538131+0000","last_undegraded":"2024-04-26T20:14:20.538131+0000","last_fullsized":"2024-04-26T20:14:20.538131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537632+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:14:20.537632+0000","last_peered":"2024-04-26T20:14:20.537632+0000","last_clean":"2024-04-26T20:14:20.537632+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:14:20.537632+0000","last_undegraded":"2024-04-26T20:14:20.537632+0000","last_fullsized":"2024-04-26T20:14:20.537632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.124586+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:14:46.124586+0000","last_peered":"2024-04-26T20:14:46.124586+0000","last_clean":"2024-04-26T20:14:46.124586+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:14:46.124586+0000","last_undegraded":"2024-04-26T20:14:46.124586+0000","last_fullsized":"2024-04-26T20:14:46.124586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538412+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:14:20.538412+0000","last_peered":"2024-04-26T20:14:20.538412+0000","last_clean":"2024-04-26T20:14:20.538412+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:14:20.538412+0000","last_undegraded":"2024-04-26T20:14:20.538412+0000","last_fullsized":"2024-04-26T20:14:20.538412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884667+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:14:19.884667+0000","last_peered":"2024-04-26T20:14:19.884667+0000","last_clean":"2024-04-26T20:14:19.884667+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:14:19.884667+0000","last_undegraded":"2024-04-26T20:14:19.884667+0000","last_fullsized":"2024-04-26T20:14:19.884667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127978+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:14:46.127978+0000","last_peered":"2024-04-26T20:14:46.127978+0000","last_clean":"2024-04-26T20:14:46.127978+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:14:46.127978+0000","last_undegraded":"2024-04-26T20:14:46.127978+0000","last_fullsized":"2024-04-26T20:14:46.127978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885284+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:14:19.885284+0000","last_peered":"2024-04-26T20:14:19.885284+0000","last_clean":"2024-04-26T20:14:19.885284+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:14:19.885284+0000","last_undegraded":"2024-04-26T20:14:19.885284+0000","last_fullsized":"2024-04-26T20:14:19.885284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547171+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:14:20.547171+0000","last_peered":"2024-04-26T20:14:20.547171+0000","last_clean":"2024-04-26T20:14:20.547171+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:14:20.547171+0000","last_undegraded":"2024-04-26T20:14:20.547171+0000","last_fullsized":"2024-04-26T20:14:20.547171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.100202+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:14:40.100202+0000","last_peered":"2024-04-26T20:14:40.100202+0000","last_clean":"2024-04-26T20:14:40.100202+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:14:40.100202+0000","last_undegraded":"2024-04-26T20:14:40.100202+0000","last_fullsized":"2024-04-26T20:14:40.100202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339797+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:14:20.339797+0000","last_peered":"2024-04-26T20:14:20.339797+0000","last_clean":"2024-04-26T20:14:20.339797+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:14:20.339797+0000","last_undegraded":"2024-04-26T20:14:20.339797+0000","last_fullsized":"2024-04-26T20:14:20.339797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505934+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:14:19.505934+0000","last_peered":"2024-04-26T20:14:19.505934+0000","last_clean":"2024-04-26T20:14:19.505934+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:14:19.505934+0000","last_undegraded":"2024-04-26T20:14:19.505934+0000","last_fullsized":"2024-04-26T20:14:19.505934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340425+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:14:20.340425+0000","last_peered":"2024-04-26T20:14:20.340425+0000","last_clean":"2024-04-26T20:14:20.340425+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:14:20.340425+0000","last_undegraded":"2024-04-26T20:14:20.340425+0000","last_fullsized":"2024-04-26T20:14:20.340425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.126688+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:14:46.126688+0000","last_peered":"2024-04-26T20:14:46.126688+0000","last_clean":"2024-04-26T20:14:46.126688+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:14:46.126688+0000","last_undegraded":"2024-04-26T20:14:46.126688+0000","last_fullsized":"2024-04-26T20:14:46.126688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504513+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:14:19.504513+0000","last_peered":"2024-04-26T20:14:19.504513+0000","last_clean":"2024-04-26T20:14:19.504513+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:14:19.504513+0000","last_undegraded":"2024-04-26T20:14:19.504513+0000","last_fullsized":"2024-04-26T20:14:19.504513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551589+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:14:20.551589+0000","last_peered":"2024-04-26T20:14:20.551589+0000","last_clean":"2024-04-26T20:14:20.551589+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:14:20.551589+0000","last_undegraded":"2024-04-26T20:14:20.551589+0000","last_fullsized":"2024-04-26T20:14:20.551589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538251+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:14:20.538251+0000","last_peered":"2024-04-26T20:14:20.538251+0000","last_clean":"2024-04-26T20:14:20.538251+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:14:20.538251+0000","last_undegraded":"2024-04-26T20:14:20.538251+0000","last_fullsized":"2024-04-26T20:14:20.538251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885149+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:14:19.885149+0000","last_peered":"2024-04-26T20:14:19.885149+0000","last_clean":"2024-04-26T20:14:19.885149+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:14:19.885149+0000","last_undegraded":"2024-04-26T20:14:19.885149+0000","last_fullsized":"2024-04-26T20:14:19.885149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341171+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:14:20.341171+0000","last_peered":"2024-04-26T20:14:20.341171+0000","last_clean":"2024-04-26T20:14:20.341171+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:14:20.341171+0000","last_undegraded":"2024-04-26T20:14:20.341171+0000","last_fullsized":"2024-04-26T20:14:20.341171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.497025+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:14:19.497025+0000","last_peered":"2024-04-26T20:14:19.497025+0000","last_clean":"2024-04-26T20:14:19.497025+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:14:19.497025+0000","last_undegraded":"2024-04-26T20:14:19.497025+0000","last_fullsized":"2024-04-26T20:14:19.497025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550272+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:14:20.550272+0000","last_peered":"2024-04-26T20:14:20.550272+0000","last_clean":"2024-04-26T20:14:20.550272+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:14:20.550272+0000","last_undegraded":"2024-04-26T20:14:20.550272+0000","last_fullsized":"2024-04-26T20:14:20.550272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341179+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:14:20.341179+0000","last_peered":"2024-04-26T20:14:20.341179+0000","last_clean":"2024-04-26T20:14:20.341179+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:14:20.341179+0000","last_undegraded":"2024-04-26T20:14:20.341179+0000","last_fullsized":"2024-04-26T20:14:20.341179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509704+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:14:19.509704+0000","last_peered":"2024-04-26T20:14:19.509704+0000","last_clean":"2024-04-26T20:14:19.509704+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:14:19.509704+0000","last_undegraded":"2024-04-26T20:14:19.509704+0000","last_fullsized":"2024-04-26T20:14:19.509704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.507544+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:14:19.507544+0000","last_peered":"2024-04-26T20:14:19.507544+0000","last_clean":"2024-04-26T20:14:19.507544+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:14:19.507544+0000","last_undegraded":"2024-04-26T20:14:19.507544+0000","last_fullsized":"2024-04-26T20:14:19.507544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340080+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:14:20.340080+0000","last_peered":"2024-04-26T20:14:20.340080+0000","last_clean":"2024-04-26T20:14:20.340080+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:14:20.340080+0000","last_undegraded":"2024-04-26T20:14:20.340080+0000","last_fullsized":"2024-04-26T20:14:20.340080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.127779+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:14:46.127779+0000","last_peered":"2024-04-26T20:14:46.127779+0000","last_clean":"2024-04-26T20:14:46.127779+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:14:46.127779+0000","last_undegraded":"2024-04-26T20:14:46.127779+0000","last_fullsized":"2024-04-26T20:14:46.127779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885253+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:14:19.885253+0000","last_peered":"2024-04-26T20:14:19.885253+0000","last_clean":"2024-04-26T20:14:19.885253+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:14:19.885253+0000","last_undegraded":"2024-04-26T20:14:19.885253+0000","last_fullsized":"2024-04-26T20:14:19.885253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504382+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:14:19.504382+0000","last_peered":"2024-04-26T20:14:19.504382+0000","last_clean":"2024-04-26T20:14:19.504382+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:14:19.504382+0000","last_undegraded":"2024-04-26T20:14:19.504382+0000","last_fullsized":"2024-04-26T20:14:19.504382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.131333+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:14:46.131333+0000","last_peered":"2024-04-26T20:14:46.131333+0000","last_clean":"2024-04-26T20:14:46.131333+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:14:46.131333+0000","last_undegraded":"2024-04-26T20:14:46.131333+0000","last_fullsized":"2024-04-26T20:14:46.131333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547904+0000","last_change":"2024-04-26T20:14:18.642156+0000","last_active":"2024-04-26T20:14:20.547904+0000","last_peered":"2024-04-26T20:14:20.547904+0000","last_clean":"2024-04-26T20:14:20.547904+0000","last_became_active":"2024-04-26T20:14:18.641452+0000","last_became_peered":"2024-04-26T20:14:18.641452+0000","last_unstale":"2024-04-26T20:14:20.547904+0000","last_undegraded":"2024-04-26T20:14:20.547904+0000","last_fullsized":"2024-04-26T20:14:20.547904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:30.242536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340685+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:14:20.340685+0000","last_peered":"2024-04-26T20:14:20.340685+0000","last_clean":"2024-04-26T20:14:20.340685+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:14:20.340685+0000","last_undegraded":"2024-04-26T20:14:20.340685+0000","last_fullsized":"2024-04-26T20:14:20.340685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.093099+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:14:40.093099+0000","last_peered":"2024-04-26T20:14:40.093099+0000","last_clean":"2024-04-26T20:14:40.093099+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:14:40.093099+0000","last_undegraded":"2024-04-26T20:14:40.093099+0000","last_fullsized":"2024-04-26T20:14:40.093099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547744+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:14:20.547744+0000","last_peered":"2024-04-26T20:14:20.547744+0000","last_clean":"2024-04-26T20:14:20.547744+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:14:20.547744+0000","last_undegraded":"2024-04-26T20:14:20.547744+0000","last_fullsized":"2024-04-26T20:14:20.547744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884892+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:14:19.884892+0000","last_peered":"2024-04-26T20:14:19.884892+0000","last_clean":"2024-04-26T20:14:19.884892+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:14:19.884892+0000","last_undegraded":"2024-04-26T20:14:19.884892+0000","last_fullsized":"2024-04-26T20:14:19.884892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.123062+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:14:46.123062+0000","last_peered":"2024-04-26T20:14:46.123062+0000","last_clean":"2024-04-26T20:14:46.123062+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:14:46.123062+0000","last_undegraded":"2024-04-26T20:14:46.123062+0000","last_fullsized":"2024-04-26T20:14:46.123062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551667+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:14:20.551667+0000","last_peered":"2024-04-26T20:14:20.551667+0000","last_clean":"2024-04-26T20:14:20.551667+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:14:20.551667+0000","last_undegraded":"2024-04-26T20:14:20.551667+0000","last_fullsized":"2024-04-26T20:14:20.551667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340243+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:14:20.340243+0000","last_peered":"2024-04-26T20:14:20.340243+0000","last_clean":"2024-04-26T20:14:20.340243+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:14:20.340243+0000","last_undegraded":"2024-04-26T20:14:20.340243+0000","last_fullsized":"2024-04-26T20:14:20.340243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.086670+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:14:40.086670+0000","last_peered":"2024-04-26T20:14:40.086670+0000","last_clean":"2024-04-26T20:14:40.086670+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:14:40.086670+0000","last_undegraded":"2024-04-26T20:14:40.086670+0000","last_fullsized":"2024-04-26T20:14:40.086670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537725+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:14:20.537725+0000","last_peered":"2024-04-26T20:14:20.537725+0000","last_clean":"2024-04-26T20:14:20.537725+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:14:20.537725+0000","last_undegraded":"2024-04-26T20:14:20.537725+0000","last_fullsized":"2024-04-26T20:14:20.537725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509332+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:14:19.509332+0000","last_peered":"2024-04-26T20:14:19.509332+0000","last_clean":"2024-04-26T20:14:19.509332+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:14:19.509332+0000","last_undegraded":"2024-04-26T20:14:19.509332+0000","last_fullsized":"2024-04-26T20:14:19.509332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538197+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:14:20.538197+0000","last_peered":"2024-04-26T20:14:20.538197+0000","last_clean":"2024-04-26T20:14:20.538197+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:14:20.538197+0000","last_undegraded":"2024-04-26T20:14:20.538197+0000","last_fullsized":"2024-04-26T20:14:20.538197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508332+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:14:19.508332+0000","last_peered":"2024-04-26T20:14:19.508332+0000","last_clean":"2024-04-26T20:14:19.508332+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:14:19.508332+0000","last_undegraded":"2024-04-26T20:14:19.508332+0000","last_fullsized":"2024-04-26T20:14:19.508332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885496+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:14:19.885496+0000","last_peered":"2024-04-26T20:14:19.885496+0000","last_clean":"2024-04-26T20:14:19.885496+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:14:19.885496+0000","last_undegraded":"2024-04-26T20:14:19.885496+0000","last_fullsized":"2024-04-26T20:14:19.885496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.097720+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:14:40.097720+0000","last_peered":"2024-04-26T20:14:40.097720+0000","last_clean":"2024-04-26T20:14:40.097720+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:14:40.097720+0000","last_undegraded":"2024-04-26T20:14:40.097720+0000","last_fullsized":"2024-04-26T20:14:40.097720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547103+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:14:20.547103+0000","last_peered":"2024-04-26T20:14:20.547103+0000","last_clean":"2024-04-26T20:14:20.547103+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:14:20.547103+0000","last_undegraded":"2024-04-26T20:14:20.547103+0000","last_fullsized":"2024-04-26T20:14:20.547103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551023+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:14:20.551023+0000","last_peered":"2024-04-26T20:14:20.551023+0000","last_clean":"2024-04-26T20:14:20.551023+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:14:20.551023+0000","last_undegraded":"2024-04-26T20:14:20.551023+0000","last_fullsized":"2024-04-26T20:14:20.551023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.092533+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:14:40.092533+0000","last_peered":"2024-04-26T20:14:40.092533+0000","last_clean":"2024-04-26T20:14:40.092533+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:14:40.092533+0000","last_undegraded":"2024-04-26T20:14:40.092533+0000","last_fullsized":"2024-04-26T20:14:40.092533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547062+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:14:20.547062+0000","last_peered":"2024-04-26T20:14:20.547062+0000","last_clean":"2024-04-26T20:14:20.547062+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:14:20.547062+0000","last_undegraded":"2024-04-26T20:14:20.547062+0000","last_fullsized":"2024-04-26T20:14:20.547062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885190+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:14:19.885190+0000","last_peered":"2024-04-26T20:14:19.885190+0000","last_clean":"2024-04-26T20:14:19.885190+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:14:19.885190+0000","last_undegraded":"2024-04-26T20:14:19.885190+0000","last_fullsized":"2024-04-26T20:14:19.885190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537488+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:14:20.537488+0000","last_peered":"2024-04-26T20:14:20.537488+0000","last_clean":"2024-04-26T20:14:20.537488+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:14:20.537488+0000","last_undegraded":"2024-04-26T20:14:20.537488+0000","last_fullsized":"2024-04-26T20:14:20.537488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550778+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:14:20.550778+0000","last_peered":"2024-04-26T20:14:20.550778+0000","last_clean":"2024-04-26T20:14:20.550778+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:14:20.550778+0000","last_undegraded":"2024-04-26T20:14:20.550778+0000","last_fullsized":"2024-04-26T20:14:20.550778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506621+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:14:19.506621+0000","last_peered":"2024-04-26T20:14:19.506621+0000","last_clean":"2024-04-26T20:14:19.506621+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:14:19.506621+0000","last_undegraded":"2024-04-26T20:14:19.506621+0000","last_fullsized":"2024-04-26T20:14:19.506621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547012+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:14:20.547012+0000","last_peered":"2024-04-26T20:14:20.547012+0000","last_clean":"2024-04-26T20:14:20.547012+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:14:20.547012+0000","last_undegraded":"2024-04-26T20:14:20.547012+0000","last_fullsized":"2024-04-26T20:14:20.547012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.122360+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:14:46.122360+0000","last_peered":"2024-04-26T20:14:46.122360+0000","last_clean":"2024-04-26T20:14:46.122360+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:14:46.122360+0000","last_undegraded":"2024-04-26T20:14:46.122360+0000","last_fullsized":"2024-04-26T20:14:46.122360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:46.128712+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:14:46.128712+0000","last_peered":"2024-04-26T20:14:46.128712+0000","last_clean":"2024-04-26T20:14:46.128712+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:14:46.128712+0000","last_undegraded":"2024-04-26T20:14:46.128712+0000","last_fullsized":"2024-04-26T20:14:46.128712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885205+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:14:19.885205+0000","last_peered":"2024-04-26T20:14:19.885205+0000","last_clean":"2024-04-26T20:14:19.885205+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:14:19.885205+0000","last_undegraded":"2024-04-26T20:14:19.885205+0000","last_fullsized":"2024-04-26T20:14:19.885205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496841+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:14:19.496841+0000","last_peered":"2024-04-26T20:14:19.496841+0000","last_clean":"2024-04-26T20:14:19.496841+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:14:19.496841+0000","last_undegraded":"2024-04-26T20:14:19.496841+0000","last_fullsized":"2024-04-26T20:14:19.496841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:40.106751+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:14:40.106751+0000","last_peered":"2024-04-26T20:14:40.106751+0000","last_clean":"2024-04-26T20:14:40.106751+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:14:40.106751+0000","last_undegraded":"2024-04-26T20:14:40.106751+0000","last_fullsized":"2024-04-26T20:14:40.106751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.508517+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:14:19.508517+0000","last_peered":"2024-04-26T20:14:19.508517+0000","last_clean":"2024-04-26T20:14:19.508517+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:14:19.508517+0000","last_undegraded":"2024-04-26T20:14:19.508517+0000","last_fullsized":"2024-04-26T20:14:19.508517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547503+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:14:20.547503+0000","last_peered":"2024-04-26T20:14:20.547503+0000","last_clean":"2024-04-26T20:14:20.547503+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:14:20.547503+0000","last_undegraded":"2024-04-26T20:14:20.547503+0000","last_fullsized":"2024-04-26T20:14:20.547503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.504099+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:14:19.504099+0000","last_peered":"2024-04-26T20:14:19.504099+0000","last_clean":"2024-04-26T20:14:19.504099+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:14:19.504099+0000","last_undegraded":"2024-04-26T20:14:19.504099+0000","last_fullsized":"2024-04-26T20:14:19.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496540+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:14:19.496540+0000","last_peered":"2024-04-26T20:14:19.496540+0000","last_clean":"2024-04-26T20:14:19.496540+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:14:19.496540+0000","last_undegraded":"2024-04-26T20:14:19.496540+0000","last_fullsized":"2024-04-26T20:14:19.496540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550979+0000","last_change":"2024-04-26T20:14:14.482803+0000","last_active":"2024-04-26T20:14:20.550979+0000","last_peered":"2024-04-26T20:14:20.550979+0000","last_clean":"2024-04-26T20:14:20.550979+0000","last_became_active":"2024-04-26T20:14:14.482022+0000","last_became_peered":"2024-04-26T20:14:14.482022+0000","last_unstale":"2024-04-26T20:14:20.550979+0000","last_undegraded":"2024-04-26T20:14:20.550979+0000","last_fullsized":"2024-04-26T20:14:20.550979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.936384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885112+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:14:19.885112+0000","last_peered":"2024-04-26T20:14:19.885112+0000","last_clean":"2024-04-26T20:14:19.885112+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:14:19.885112+0000","last_undegraded":"2024-04-26T20:14:19.885112+0000","last_fullsized":"2024-04-26T20:14:19.885112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547807+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:14:20.547807+0000","last_peered":"2024-04-26T20:14:20.547807+0000","last_clean":"2024-04-26T20:14:20.547807+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:14:20.547807+0000","last_undegraded":"2024-04-26T20:14:20.547807+0000","last_fullsized":"2024-04-26T20:14:20.547807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537992+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:14:20.537992+0000","last_peered":"2024-04-26T20:14:20.537992+0000","last_clean":"2024-04-26T20:14:20.537992+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:14:20.537992+0000","last_undegraded":"2024-04-26T20:14:20.537992+0000","last_fullsized":"2024-04-26T20:14:20.537992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506318+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:14:19.506318+0000","last_peered":"2024-04-26T20:14:19.506318+0000","last_clean":"2024-04-26T20:14:19.506318+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:14:19.506318+0000","last_undegraded":"2024-04-26T20:14:19.506318+0000","last_fullsized":"2024-04-26T20:14:19.506318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547804+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:14:20.547804+0000","last_peered":"2024-04-26T20:14:20.547804+0000","last_clean":"2024-04-26T20:14:20.547804+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:14:20.547804+0000","last_undegraded":"2024-04-26T20:14:20.547804+0000","last_fullsized":"2024-04-26T20:14:20.547804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550486+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:14:20.550486+0000","last_peered":"2024-04-26T20:14:20.550486+0000","last_clean":"2024-04-26T20:14:20.550486+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:14:20.550486+0000","last_undegraded":"2024-04-26T20:14:20.550486+0000","last_fullsized":"2024-04-26T20:14:20.550486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547253+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:14:20.547253+0000","last_peered":"2024-04-26T20:14:20.547253+0000","last_clean":"2024-04-26T20:14:20.547253+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:14:20.547253+0000","last_undegraded":"2024-04-26T20:14:20.547253+0000","last_fullsized":"2024-04-26T20:14:20.547253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550633+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:14:20.550633+0000","last_peered":"2024-04-26T20:14:20.550633+0000","last_clean":"2024-04-26T20:14:20.550633+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:14:20.550633+0000","last_undegraded":"2024-04-26T20:14:20.550633+0000","last_fullsized":"2024-04-26T20:14:20.550633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884953+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:14:19.884953+0000","last_peered":"2024-04-26T20:14:19.884953+0000","last_clean":"2024-04-26T20:14:19.884953+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:14:19.884953+0000","last_undegraded":"2024-04-26T20:14:19.884953+0000","last_fullsized":"2024-04-26T20:14:19.884953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505625+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:14:19.505625+0000","last_peered":"2024-04-26T20:14:19.505625+0000","last_clean":"2024-04-26T20:14:19.505625+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:14:19.505625+0000","last_undegraded":"2024-04-26T20:14:19.505625+0000","last_fullsized":"2024-04-26T20:14:19.505625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340721+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:14:20.340721+0000","last_peered":"2024-04-26T20:14:20.340721+0000","last_clean":"2024-04-26T20:14:20.340721+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:14:20.340721+0000","last_undegraded":"2024-04-26T20:14:20.340721+0000","last_fullsized":"2024-04-26T20:14:20.340721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.496988+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:14:19.496988+0000","last_peered":"2024-04-26T20:14:19.496988+0000","last_clean":"2024-04-26T20:14:19.496988+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:14:19.496988+0000","last_undegraded":"2024-04-26T20:14:19.496988+0000","last_fullsized":"2024-04-26T20:14:19.496988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551847+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:14:20.551847+0000","last_peered":"2024-04-26T20:14:20.551847+0000","last_clean":"2024-04-26T20:14:20.551847+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:14:20.551847+0000","last_undegraded":"2024-04-26T20:14:20.551847+0000","last_fullsized":"2024-04-26T20:14:20.551847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550171+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:14:20.550171+0000","last_peered":"2024-04-26T20:14:20.550171+0000","last_clean":"2024-04-26T20:14:20.550171+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:14:20.550171+0000","last_undegraded":"2024-04-26T20:14:20.550171+0000","last_fullsized":"2024-04-26T20:14:20.550171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.537556+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:14:20.537556+0000","last_peered":"2024-04-26T20:14:20.537556+0000","last_clean":"2024-04-26T20:14:20.537556+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:14:20.537556+0000","last_undegraded":"2024-04-26T20:14:20.537556+0000","last_fullsized":"2024-04-26T20:14:20.537556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.884895+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:14:19.884895+0000","last_peered":"2024-04-26T20:14:19.884895+0000","last_clean":"2024-04-26T20:14:19.884895+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:14:19.884895+0000","last_undegraded":"2024-04-26T20:14:19.884895+0000","last_fullsized":"2024-04-26T20:14:19.884895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.547283+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:14:20.547283+0000","last_peered":"2024-04-26T20:14:20.547283+0000","last_clean":"2024-04-26T20:14:20.547283+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:14:20.547283+0000","last_undegraded":"2024-04-26T20:14:20.547283+0000","last_fullsized":"2024-04-26T20:14:20.547283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.509243+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:14:19.509243+0000","last_peered":"2024-04-26T20:14:19.509243+0000","last_clean":"2024-04-26T20:14:19.509243+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:14:19.509243+0000","last_undegraded":"2024-04-26T20:14:19.509243+0000","last_fullsized":"2024-04-26T20:14:19.509243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.505396+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:14:19.505396+0000","last_peered":"2024-04-26T20:14:19.505396+0000","last_clean":"2024-04-26T20:14:19.505396+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:14:19.505396+0000","last_undegraded":"2024-04-26T20:14:19.505396+0000","last_fullsized":"2024-04-26T20:14:19.505396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.506202+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:14:19.506202+0000","last_peered":"2024-04-26T20:14:19.506202+0000","last_clean":"2024-04-26T20:14:19.506202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:14:19.506202+0000","last_undegraded":"2024-04-26T20:14:19.506202+0000","last_fullsized":"2024-04-26T20:14:19.506202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.341083+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:14:20.341083+0000","last_peered":"2024-04-26T20:14:20.341083+0000","last_clean":"2024-04-26T20:14:20.341083+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:14:20.341083+0000","last_undegraded":"2024-04-26T20:14:20.341083+0000","last_fullsized":"2024-04-26T20:14:20.341083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.546910+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:14:20.546910+0000","last_peered":"2024-04-26T20:14:20.546910+0000","last_clean":"2024-04-26T20:14:20.546910+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:14:20.546910+0000","last_undegraded":"2024-04-26T20:14:20.546910+0000","last_fullsized":"2024-04-26T20:14:20.546910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339971+0000","last_change":"2024-04-26T20:14:14.463139+0000","last_active":"2024-04-26T20:14:20.339971+0000","last_peered":"2024-04-26T20:14:20.339971+0000","last_clean":"2024-04-26T20:14:20.339971+0000","last_became_active":"2024-04-26T20:14:14.462083+0000","last_became_peered":"2024-04-26T20:14:14.462083+0000","last_unstale":"2024-04-26T20:14:20.339971+0000","last_undegraded":"2024-04-26T20:14:20.339971+0000","last_fullsized":"2024-04-26T20:14:20.339971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:28.615893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.550418+0000","last_change":"2024-04-26T20:14:14.475535+0000","last_active":"2024-04-26T20:14:20.550418+0000","last_peered":"2024-04-26T20:14:20.550418+0000","last_clean":"2024-04-26T20:14:20.550418+0000","last_became_active":"2024-04-26T20:14:14.474445+0000","last_became_peered":"2024-04-26T20:14:14.474445+0000","last_unstale":"2024-04-26T20:14:20.550418+0000","last_undegraded":"2024-04-26T20:14:20.550418+0000","last_fullsized":"2024-04-26T20:14:20.550418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:51.715142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.339972+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:14:20.339972+0000","last_peered":"2024-04-26T20:14:20.339972+0000","last_clean":"2024-04-26T20:14:20.339972+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:14:20.339972+0000","last_undegraded":"2024-04-26T20:14:20.339972+0000","last_fullsized":"2024-04-26T20:14:20.339972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.551012+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:14:20.551012+0000","last_peered":"2024-04-26T20:14:20.551012+0000","last_clean":"2024-04-26T20:14:20.551012+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:14:20.551012+0000","last_undegraded":"2024-04-26T20:14:20.551012+0000","last_fullsized":"2024-04-26T20:14:20.551012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:19.885153+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:14:19.885153+0000","last_peered":"2024-04-26T20:14:19.885153+0000","last_clean":"2024-04-26T20:14:19.885153+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:14:19.885153+0000","last_undegraded":"2024-04-26T20:14:19.885153+0000","last_fullsized":"2024-04-26T20:14:19.885153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.538165+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:14:20.538165+0000","last_peered":"2024-04-26T20:14:20.538165+0000","last_clean":"2024-04-26T20:14:20.538165+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:14:20.538165+0000","last_undegraded":"2024-04-26T20:14:20.538165+0000","last_fullsized":"2024-04-26T20:14:20.538165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-26T20:14:20.340878+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:14:20.340878+0000","last_peered":"2024-04-26T20:14:20.340878+0000","last_clean":"2024-04-26T20:14:20.340878+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:14:20.340878+0000","last_undegraded":"2024-04-26T20:14:20.340878+0000","last_fullsized":"2024-04-26T20:14:20.340878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7710,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":695501,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":104937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":108371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":104377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":104503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":344064,"data_stored":694587,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:15:00.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:15:00.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 Processor -- start 2024-04-26T20:15:00.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 -- start start 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f901c0b1d80 0x7f901c06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f901c0c6340 0x7f901c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f901c0cce10 con 0x7f901c0c6340 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f901c0cfb50 con 0x7f901c0b1d80 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9023400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f901c0cfe10 con 0x7f901c0c9e80 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f901c0c6340 0x7f901c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f901c0c6340 0x7f901c0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37920/0 (socket says 172.21.15.16:37920) 2024-04-26T20:15:00.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 -- 172.21.15.16:0/55372788 learned_addr learned my addr 172.21.15.16:0/55372788 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:00.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9021400640 1 --2- 172.21.15.16:0/55372788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f9020a00640 1 --2- 172.21.15.16:0/55372788 >> v2:172.21.15.192:3300/0 conn(0x7f901c0b1d80 0x7f901c06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 -- 172.21.15.16:0/55372788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 msgr2=0x7f901c15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:00.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 --2- 172.21.15.16:0/55372788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c15c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 -- 172.21.15.16:0/55372788 >> v2:172.21.15.192:3300/0 conn(0x7f901c0b1d80 msgr2=0x7f901c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:00.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 --2- 172.21.15.16:0/55372788 >> v2:172.21.15.192:3300/0 conn(0x7f901c0b1d80 0x7f901c06feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.534+0000 7f901be00640 1 -- 172.21.15.16:0/55372788 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c06d650 con 0x7f901c0c6340 2024-04-26T20:15:00.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f901be00640 1 --2- 172.21.15.16:0/55372788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0c6340 0x7f901c0703f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f901c070a00 tx=0x7f900801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f90d9a79f66ed2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f901b400640 1 -- 172.21.15.16:0/55372788 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90080b5070 con 0x7f901c0c6340 2024-04-26T20:15:00.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f901b400640 1 -- 172.21.15.16:0/55372788 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90080a89d0 con 0x7f901c0c6340 2024-04-26T20:15:00.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f901b400640 1 -- 172.21.15.16:0/55372788 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90080a8da0 con 0x7f901c0c6340 2024-04-26T20:15:00.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 -- 172.21.15.16:0/55372788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0c6340 msgr2=0x7f901c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 --2- 172.21.15.16:0/55372788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0c6340 0x7f901c0703f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f901c070a00 tx=0x7f900801ed10 comp rx=0 tx=0).stop 2024-04-26T20:15:00.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 -- 172.21.15.16:0/55372788 shutdown_connections 2024-04-26T20:15:00.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 --2- 172.21.15.16:0/55372788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 --2- 172.21.15.16:0/55372788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0c6340 0x7f901c0703f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 --2- 172.21.15.16:0/55372788 >> v2:172.21.15.192:3300/0 conn(0x7f901c0b1d80 0x7f901c06feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 -- 172.21.15.16:0/55372788 >> 172.21.15.16:0/55372788 conn(0x7f901c071160 msgr2=0x7f901c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:00.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 -- 172.21.15.16:0/55372788 shutdown_connections 2024-04-26T20:15:00.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.538+0000 7f9023400640 1 -- 172.21.15.16:0/55372788 wait complete. 2024-04-26T20:15:00.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 Processor -- start 2024-04-26T20:15:00.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 -- start start 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0b1d80 0x7f901c152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f901c0c6340 0x7f901c0c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f901c0b2160 con 0x7f901c0b1d80 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f901c06dc10 con 0x7f901c0c6340 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f901c071970 con 0x7f901c0c9e80 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0b1d80 0x7f901c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0b1d80 0x7f901c152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37924/0 (socket says 172.21.15.16:37924) 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 -- 172.21.15.16:0/3734694743 learned_addr learned my addr 172.21.15.16:0/3734694743 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:00.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9021400640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f901be00640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f901c0c6340 0x7f901c0c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 -- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 msgr2=0x7f901c0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c0b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 -- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f901c0c6340 msgr2=0x7f901c0c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f901c0c6340 0x7f901c0c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 -- 172.21.15.16:0/3734694743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1f1b30 con 0x7f901c0b1d80 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9020a00640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0b1d80 0x7f901c152160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f901000d800 tx=0x7f901000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9018c00640 1 -- 172.21.15.16:0/3734694743 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010018030 con 0x7f901c0b1d80 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9018c00640 1 -- 172.21.15.16:0/3734694743 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90100096a0 con 0x7f901c0b1d80 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9018c00640 1 -- 172.21.15.16:0/3734694743 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010009870 con 0x7f901c0b1d80 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c155680 con 0x7f901c0b1d80 2024-04-26T20:15:00.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c0b45c0 con 0x7f901c0b1d80 2024-04-26T20:15:00.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.542+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901c077c20 con 0x7f901c0b1d80 2024-04-26T20:15:00.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.546+0000 7f9018c00640 1 -- 172.21.15.16:0/3734694743 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f901001b070 con 0x7f901c0b1d80 2024-04-26T20:15:00.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.546+0000 7f9018c00640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8ffc0683b0 0x7f8ffc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.546+0000 7f9018c00640 1 -- 172.21.15.16:0/3734694743 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9010086ab0 con 0x7f901c0b1d80 2024-04-26T20:15:00.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.546+0000 7f901be00640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8ffc0683b0 0x7f8ffc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.546+0000 7f901be00640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8ffc0683b0 0x7f8ffc06a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f90080b2000 tx=0x7f9008008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.550+0000 7f9018c00640 1 -- 172.21.15.16:0/3734694743 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f901c1f1b30 con 0x7f901c0b1d80 2024-04-26T20:15:00.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.718+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f901c159ae0 con 0x7f901c0b1d80 2024-04-26T20:15:00.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.718+0000 7f9018c00640 1 -- 172.21.15.16:0/3734694743 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18526 (secure 0 0 0) 0x7f9010056da0 con 0x7f901c0b1d80 2024-04-26T20:15:00.724 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:15:00.724 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:14:18.911027+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:15:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8ffc0683b0 msgr2=0x7f8ffc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8ffc0683b0 0x7f8ffc06a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f90080b2000 tx=0x7f9008008040 comp rx=0 tx=0).stop 2024-04-26T20:15:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0b1d80 msgr2=0x7f901c152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0b1d80 0x7f901c152160 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f901000d800 tx=0x7f901000dcc0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 shutdown_connections 2024-04-26T20:15:00.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8ffc0683b0 0x7f8ffc06a870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f901c0c9e80 0x7f901c0b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f901c0c6340 0x7f901c0c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 --2- 172.21.15.16:0/3734694743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901c0b1d80 0x7f901c152160 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 >> 172.21.15.16:0/3734694743 conn(0x7f901c071160 msgr2=0x7f901c0cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 shutdown_connections 2024-04-26T20:15:00.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.722+0000 7f9023400640 1 -- 172.21.15.16:0/3734694743 wait complete. 2024-04-26T20:15:00.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:15:00.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:15:00.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bfac00640 1 Processor -- start 2024-04-26T20:15:00.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bfac00640 1 -- start start 2024-04-26T20:15:00.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bfac00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9bf41593d0 0x7f9bf40cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bfac00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf40cbb70 con 0x7f9bf415f340 2024-04-26T20:15:00.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bfac00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf40ca630 con 0x7f9bf40c9e50 2024-04-26T20:15:00.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bfac00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf40cbf50 con 0x7f9bf41593d0 2024-04-26T20:15:00.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bf3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9bf41593d0 0x7f9bf40cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bf8c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9bf415f340 0x7f9bf4071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51984/0 (socket says 172.21.15.16:51984) 2024-04-26T20:15:00.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bf8c00640 1 -- 172.21.15.16:0/4193927261 learned_addr learned my addr 172.21.15.16:0/4193927261 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:15:00.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bf3e00640 1 -- 172.21.15.16:0/4193927261 >> v1:172.21.15.192:6789/0 conn(0x7f9bf40c9e50 legacy=0x7f9bf40cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bf3e00640 1 -- 172.21.15.16:0/4193927261 >> v1:172.21.15.16:6789/0 conn(0x7f9bf415f340 legacy=0x7f9bf4071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bf3e00640 1 -- 172.21.15.16:0/4193927261 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf40ca910 con 0x7f9bf41593d0 2024-04-26T20:15:00.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.886+0000 7f9bf3400640 1 -- 172.21.15.16:0/4193927261 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313394172 0 0) 0x7f9bf40cbb70 con 0x7f9bf415f340 2024-04-26T20:15:00.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bf3e00640 1 --2- 172.21.15.16:0/4193927261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf41593d0 0x7f9bf40cb550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9be40097c0 tx=0x7f9be401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b573e29ec08ca05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bf3400640 1 -- 172.21.15.16:0/4193927261 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be40b5070 con 0x7f9bf41593d0 2024-04-26T20:15:00.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bf3400640 1 -- 172.21.15.16:0/4193927261 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be40a8990 con 0x7f9bf41593d0 2024-04-26T20:15:00.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bf3400640 1 -- 172.21.15.16:0/4193927261 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be40a8d60 con 0x7f9bf41593d0 2024-04-26T20:15:00.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bfac00640 1 -- 172.21.15.16:0/4193927261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf41593d0 msgr2=0x7f9bf40cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bfac00640 1 --2- 172.21.15.16:0/4193927261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf41593d0 0x7f9bf40cb550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9be40097c0 tx=0x7f9be401ec90 comp rx=0 tx=0).stop 2024-04-26T20:15:00.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bfac00640 1 -- 172.21.15.16:0/4193927261 shutdown_connections 2024-04-26T20:15:00.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bfac00640 1 --2- 172.21.15.16:0/4193927261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf41593d0 0x7f9bf40cb550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bfac00640 1 -- 172.21.15.16:0/4193927261 >> 172.21.15.16:0/4193927261 conn(0x7f9bf4070570 msgr2=0x7f9bf406f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:00.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bfac00640 1 -- 172.21.15.16:0/4193927261 shutdown_connections 2024-04-26T20:15:00.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.890+0000 7f9bfac00640 1 -- 172.21.15.16:0/4193927261 wait complete. 2024-04-26T20:15:00.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 Processor -- start 2024-04-26T20:15:00.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 -- start start 2024-04-26T20:15:00.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bf40c9e50 0x7f9bf415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bf41593d0 0x7f9bf40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf415f340 0x7f9bf4156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf41597b0 con 0x7f9bf415f340 2024-04-26T20:15:00.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40caed0 con 0x7f9bf40c9e50 2024-04-26T20:15:00.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf4072650 con 0x7f9bf41593d0 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf415f340 0x7f9bf4156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf415f340 0x7f9bf4156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37942/0 (socket says 172.21.15.16:37942) 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 -- 172.21.15.16:0/2193012366 learned_addr learned my addr 172.21.15.16:0/2193012366 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9beb400640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bf41593d0 0x7f9bf40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf3e00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bf40c9e50 0x7f9bf415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 -- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bf41593d0 msgr2=0x7f9bf40c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bf41593d0 0x7f9bf40c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 -- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bf40c9e50 msgr2=0x7f9bf415aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bf40c9e50 0x7f9bf415aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 -- 172.21.15.16:0/2193012366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf40c7940 con 0x7f9bf415f340 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf3e00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bf40c9e50 0x7f9bf415aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:15:00.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf8c00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf415f340 0x7f9bf4156b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c7b0 tx=0x7f9bec00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf0c00640 1 -- 172.21.15.16:0/2193012366 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec018070 con 0x7f9bf415f340 2024-04-26T20:15:00.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf0c00640 1 -- 172.21.15.16:0/2193012366 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec00a640 con 0x7f9bf415f340 2024-04-26T20:15:00.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bf0c00640 1 -- 172.21.15.16:0/2193012366 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00aa30 con 0x7f9bf415f340 2024-04-26T20:15:00.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf41f2530 con 0x7f9bf415f340 2024-04-26T20:15:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf41f2810 con 0x7f9bf415f340 2024-04-26T20:15:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.894+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf4077c20 con 0x7f9bf415f340 2024-04-26T20:15:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.898+0000 7f9bf0c00640 1 -- 172.21.15.16:0/2193012366 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9bec00abd0 con 0x7f9bf415f340 2024-04-26T20:15:00.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.898+0000 7f9bf0c00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9bd0068380 0x7f9bd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.898+0000 7f9bf0c00640 1 -- 172.21.15.16:0/2193012366 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9bec086260 con 0x7f9bf415f340 2024-04-26T20:15:00.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.898+0000 7f9bf3e00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9bd0068380 0x7f9bd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:00.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.898+0000 7f9bf3e00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9bd0068380 0x7f9bd006a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b2000 tx=0x7f9be4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:00.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:00.902+0000 7f9bf0c00640 1 -- 172.21.15.16:0/2193012366 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9bec055e90 con 0x7f9bf415f340 2024-04-26T20:15:01.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.066+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9bf4070be0 con 0x7f9bf415f340 2024-04-26T20:15:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.066+0000 7f9bf0c00640 1 -- 172.21.15.16:0/2193012366 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9bec05a190 con 0x7f9bf415f340 2024-04-26T20:15:01.072 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9bd0068380 msgr2=0x7f9bd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9bd0068380 0x7f9bd006a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b2000 tx=0x7f9be4008040 comp rx=0 tx=0).stop 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf415f340 msgr2=0x7f9bf4156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf415f340 0x7f9bf4156b70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c7b0 tx=0x7f9bec00cc70 comp rx=0 tx=0).stop 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 shutdown_connections 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9bd0068380 0x7f9bd006a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf415f340 0x7f9bf4156b70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9bf41593d0 0x7f9bf40c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 --2- 172.21.15.16:0/2193012366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bf40c9e50 0x7f9bf415aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 >> 172.21.15.16:0/2193012366 conn(0x7f9bf4070570 msgr2=0x7f9bf415fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:01.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 shutdown_connections 2024-04-26T20:15:01.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.070+0000 7f9bfac00640 1 -- 172.21.15.16:0/2193012366 wait complete. 2024-04-26T20:15:01.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:15:01.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.238+0000 7fb88fe00640 1 Processor -- start 2024-04-26T20:15:01.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.238+0000 7fb88fe00640 1 -- start start 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb888073940 0x7fb8880c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb88815c070 0x7fb88815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88fe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8880c4b30 con 0x7fb888152d00 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88fe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fb8880c6f60 con 0x7fb888073940 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88fe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb8880c7240 con 0x7fb88815c070 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88de00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb88815c070 0x7fb88815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88de00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb88815c070 0x7fb88815c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:50608/0 (socket says 172.21.15.16:50608) 2024-04-26T20:15:01.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88de00640 1 -- 172.21.15.16:0/2866831058 learned_addr learned my addr 172.21.15.16:0/2866831058 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:01.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88ca00640 1 --2- 172.21.15.16:0/2866831058 >> v2:172.21.15.192:3300/0 conn(0x7fb888073940 0x7fb8880c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88de00640 1 -- 172.21.15.16:0/2866831058 >> v2:172.21.15.192:3300/0 conn(0x7fb888073940 msgr2=0x7fb8880c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:01.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88de00640 1 --2- 172.21.15.16:0/2866831058 >> v2:172.21.15.192:3300/0 conn(0x7fb888073940 0x7fb8880c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88de00640 1 -- 172.21.15.16:0/2866831058 >> v1:172.21.15.192:6789/0 conn(0x7fb888152d00 legacy=0x7fb888073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.242+0000 7fb88de00640 1 -- 172.21.15.16:0/2866831058 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8880c7520 con 0x7fb88815c070 2024-04-26T20:15:01.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88de00640 1 --2- 172.21.15.16:0/2866831058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb88815c070 0x7fb88815c4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb880009e50 tx=0x7fb88001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d252e6b5381c34e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb887e00640 1 -- 172.21.15.16:0/2866831058 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8800a58a0 con 0x7fb88815c070 2024-04-26T20:15:01.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb887e00640 1 -- 172.21.15.16:0/2866831058 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8800a5a40 con 0x7fb88815c070 2024-04-26T20:15:01.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb887e00640 1 -- 172.21.15.16:0/2866831058 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8800a5e10 con 0x7fb88815c070 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- 172.21.15.16:0/2866831058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb88815c070 msgr2=0x7fb88815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 --2- 172.21.15.16:0/2866831058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb88815c070 0x7fb88815c4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb880009e50 tx=0x7fb88001ca30 comp rx=0 tx=0).stop 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- 172.21.15.16:0/2866831058 shutdown_connections 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 --2- 172.21.15.16:0/2866831058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb88815c070 0x7fb88815c4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 --2- 172.21.15.16:0/2866831058 >> v2:172.21.15.192:3300/0 conn(0x7fb888073940 0x7fb8880c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- 172.21.15.16:0/2866831058 >> 172.21.15.16:0/2866831058 conn(0x7fb8880c9d10 msgr2=0x7fb8880ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- 172.21.15.16:0/2866831058 shutdown_connections 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- 172.21.15.16:0/2866831058 wait complete. 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 Processor -- start 2024-04-26T20:15:01.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- start start 2024-04-26T20:15:01.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb888073940 0x7fb8880c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb888152d00 0x7fb888151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb88815c070 0x7fb88814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb88815cfb0 con 0x7fb888073940 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb88815ce30 con 0x7fb88815c070 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88fe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb88806fcf0 con 0x7fb888152d00 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb888073940 0x7fb8880c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb888073940 0x7fb8880c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37958/0 (socket says 172.21.15.16:37958) 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88d400640 1 -- 172.21.15.16:0/4133343731 learned_addr learned my addr 172.21.15.16:0/4133343731 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88ca00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb888152d00 0x7fb888151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.246+0000 7fb88de00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb88815c070 0x7fb88814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88d400640 1 -- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb888152d00 msgr2=0x7fb888151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88d400640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb888152d00 0x7fb888151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88d400640 1 -- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb88815c070 msgr2=0x7fb88814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88d400640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb88815c070 0x7fb88814f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88d400640 1 -- 172.21.15.16:0/4133343731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8881f7fe0 con 0x7fb888073940 2024-04-26T20:15:01.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88d400640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb888073940 0x7fb8880c7b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c450 tx=0x7fb87c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb885600640 1 -- 172.21.15.16:0/4133343731 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c016020 con 0x7fb888073940 2024-04-26T20:15:01.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb885600640 1 -- 172.21.15.16:0/4133343731 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c0052d0 con 0x7fb888073940 2024-04-26T20:15:01.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb888150980 con 0x7fb888073940 2024-04-26T20:15:01.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb885600640 1 -- 172.21.15.16:0/4133343731 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c007260 con 0x7fb888073940 2024-04-26T20:15:01.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8880c86e0 con 0x7fb888073940 2024-04-26T20:15:01.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb888156430 con 0x7fb888073940 2024-04-26T20:15:01.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb885600640 1 -- 172.21.15.16:0/4133343731 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb87c007400 con 0x7fb888073940 2024-04-26T20:15:01.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb885600640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb8680683b0 0x7fb86806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.250+0000 7fb885600640 1 -- 172.21.15.16:0/4133343731 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb87c086700 con 0x7fb888073940 2024-04-26T20:15:01.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.254+0000 7fb88ca00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb8680683b0 0x7fb86806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.254+0000 7fb88ca00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb8680683b0 0x7fb86806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb888147cf0 tx=0x7fb874009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.254+0000 7fb885600640 1 -- 172.21.15.16:0/4133343731 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb87c020020 con 0x7fb888073940 2024-04-26T20:15:01.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.418+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb888151ec0 con 0x7fb888073940 2024-04-26T20:15:01.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb885600640 1 -- 172.21.15.16:0/4133343731 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fb87c005480 con 0x7fb888073940 2024-04-26T20:15:01.426 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:15:01.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb8680683b0 msgr2=0x7fb86806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb8680683b0 0x7fb86806a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb888147cf0 tx=0x7fb874009190 comp rx=0 tx=0).stop 2024-04-26T20:15:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb888073940 msgr2=0x7fb8880c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb888073940 0x7fb8880c7b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c450 tx=0x7fb87c00c910 comp rx=0 tx=0).stop 2024-04-26T20:15:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 shutdown_connections 2024-04-26T20:15:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb8680683b0 0x7fb86806a870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb88815c070 0x7fb88814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb888152d00 0x7fb888151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 --2- 172.21.15.16:0/4133343731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb888073940 0x7fb8880c7b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 >> 172.21.15.16:0/4133343731 conn(0x7fb8880c9d10 msgr2=0x7fb888162a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 shutdown_connections 2024-04-26T20:15:01.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.422+0000 7fb88fe00640 1 -- 172.21.15.16:0/4133343731 wait complete. 2024-04-26T20:15:01.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:15:01.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.586+0000 7fc2ec200640 1 Processor -- start 2024-04-26T20:15:01.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.586+0000 7fc2ec200640 1 -- start start 2024-04-26T20:15:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ec200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc2e415c770 0x7fc2e4071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ec200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 0x7fc2e4166860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ec200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e40c8e50 con 0x7fc2e4070da0 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ec200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e4160290 con 0x7fc2e415c770 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ec200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e40c9110 con 0x7fc2e40c9520 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e9800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc2e4070da0 0x7fc2e415c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51994/0 (socket says 172.21.15.16:51994) 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e9800640 1 -- 172.21.15.16:0/716950964 learned_addr learned my addr 172.21.15.16:0/716950964 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ea200640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 0x7fc2e4166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e8e00640 1 --2- 172.21.15.16:0/716950964 >> v2:172.21.15.192:3300/0 conn(0x7fc2e415c770 0x7fc2e4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279081787 0 0) 0x7fc2e40c8e50 con 0x7fc2e4070da0 2024-04-26T20:15:01.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2cc003530 con 0x7fc2e4070da0 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2755595265 0 0) 0x7fc2cc003530 con 0x7fc2e4070da0 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 msgr2=0x7fc2e4166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 0x7fc2e4166860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 >> v2:172.21.15.192:3300/0 conn(0x7fc2e415c770 msgr2=0x7fc2e4071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 --2- 172.21.15.16:0/716950964 >> v2:172.21.15.192:3300/0 conn(0x7fc2e415c770 0x7fc2e4071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e40c9d70 con 0x7fc2e4070da0 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fc2d8001680 con 0x7fc2e4070da0 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 >> v1:172.21.15.16:6789/0 conn(0x7fc2e4070da0 legacy=0x7fc2e415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 0x7fc2cc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2cc003f40 0x7fc2cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2cc004d50 0x7fc2cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4160290 con 0x7fc2cc004d50 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e40c9110 con 0x7fc2cc003f40 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc2cc00b9d0 con 0x7fc2e40c9520 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ea200640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2cc004d50 0x7fc2cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e9800640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 0x7fc2cc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2e8e00640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2cc003f40 0x7fc2cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ea200640 1 -- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 msgr2=0x7fc2cc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ea200640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2e40c9520 0x7fc2cc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ea200640 1 -- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2cc003f40 msgr2=0x7fc2cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ea200640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2cc003f40 0x7fc2cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.590+0000 7fc2ea200640 1 -- 172.21.15.16:0/716950964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc003530 con 0x7fc2cc004d50 2024-04-26T20:15:01.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ea200640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2cc004d50 0x7fc2cc0051d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009fc0 tx=0x7fc2dc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cadf6a08f7e6f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0b2070 con 0x7fc2cc004d50 2024-04-26T20:15:01.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0a5cb0 con 0x7fc2cc004d50 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2e3e00640 1 -- 172.21.15.16:0/716950964 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc009c10 con 0x7fc2cc004d50 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 -- 172.21.15.16:0/716950964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2cc004d50 msgr2=0x7fc2cc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 --2- 172.21.15.16:0/716950964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2cc004d50 0x7fc2cc0051d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009fc0 tx=0x7fc2dc01cc40 comp rx=0 tx=0).stop 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ea200640 1 -- 172.21.15.16:0/716950964 reap_dead start 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 -- 172.21.15.16:0/716950964 shutdown_connections 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 -- 172.21.15.16:0/716950964 >> 172.21.15.16:0/716950964 conn(0x7fc2e40ce2c0 msgr2=0x7fc2e40ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 -- 172.21.15.16:0/716950964 shutdown_connections 2024-04-26T20:15:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 -- 172.21.15.16:0/716950964 wait complete. 2024-04-26T20:15:01.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 Processor -- start 2024-04-26T20:15:01.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.594+0000 7fc2ec200640 1 -- start start 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2cc004d50 0x7fc2e40c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2e41f5fe0 0x7fc2e415eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e415a4b0 0x7fc2e41f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e406cb60 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e406c9e0 con 0x7fc2e415a4b0 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e40ca710 con 0x7fc2cc004d50 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2e41f5fe0 0x7fc2e415eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2e41f5fe0 0x7fc2e415eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37978/0 (socket says 172.21.15.16:37978) 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 -- 172.21.15.16:0/2997144896 learned_addr learned my addr 172.21.15.16:0/2997144896 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ea200640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e415a4b0 0x7fc2e41f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e9800640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2cc004d50 0x7fc2e40c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 -- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2cc004d50 msgr2=0x7fc2e40c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2cc004d50 0x7fc2e40c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 -- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e415a4b0 msgr2=0x7fc2e41f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e415a4b0 0x7fc2e41f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 -- 172.21.15.16:0/2997144896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e415da60 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e8e00640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2e41f5fe0 0x7fc2e415eb70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00115e0 tx=0x7fc2d0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e1600640 1 -- 172.21.15.16:0/2997144896 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0015870 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e1600640 1 -- 172.21.15.16:0/2997144896 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0015a10 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2e1600640 1 -- 172.21.15.16:0/2997144896 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0015dc0 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e415dd40 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e415d1b0 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.598+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e4077c20 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.602+0000 7fc2e1600640 1 -- 172.21.15.16:0/2997144896 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2d00263f0 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.602+0000 7fc2e1600640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc2c4068380 0x7fc2c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.602+0000 7fc2e1600640 1 -- 172.21.15.16:0/2997144896 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc2d0087690 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.602+0000 7fc2e9800640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc2c4068380 0x7fc2c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.602+0000 7fc2e9800640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc2c4068380 0x7fc2c406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8001ec0 tx=0x7fc2d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.606+0000 7fc2e1600640 1 -- 172.21.15.16:0/2997144896 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc2d0019030 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.766+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc2e40c8480 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.766+0000 7fc2e1600640 1 -- 172.21.15.16:0/2997144896 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fc2d0057840 con 0x7fc2e41f5fe0 2024-04-26T20:15:01.773 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc2c4068380 msgr2=0x7fc2c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc2c4068380 0x7fc2c406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8001ec0 tx=0x7fc2d8009040 comp rx=0 tx=0).stop 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2e41f5fe0 msgr2=0x7fc2e415eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2e41f5fe0 0x7fc2e415eb70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00115e0 tx=0x7fc2d0011aa0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 shutdown_connections 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc2c4068380 0x7fc2c406a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e415a4b0 0x7fc2e41f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2e41f5fe0 0x7fc2e415eb70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 --2- 172.21.15.16:0/2997144896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2cc004d50 0x7fc2e40c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 >> 172.21.15.16:0/2997144896 conn(0x7fc2e40ce2c0 msgr2=0x7fc2e40cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 shutdown_connections 2024-04-26T20:15:01.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.770+0000 7fc2ec200640 1 -- 172.21.15.16:0/2997144896 wait complete. 2024-04-26T20:15:01.795 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:15:01.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac91a00640 1 Processor -- start 2024-04-26T20:15:01.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac91a00640 1 -- start start 2024-04-26T20:15:01.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac91a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c153eb0 0x7fac8c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac91a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac8c06ff50 0x7fac8c0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac91a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c0c96a0 con 0x7fac8c06f460 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac91a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fac8c15ac00 con 0x7fac8c06ff50 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac91a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c0c9980 con 0x7fac8c153eb0 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac8b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac8c06ff50 0x7fac8c0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac8b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac8c06ff50 0x7fac8c0c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37994/0 (socket says 172.21.15.16:37994) 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac8b400640 1 -- 172.21.15.16:0/4048021363 learned_addr learned my addr 172.21.15.16:0/4048021363 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:01.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac82000640 1 --2- 172.21.15.16:0/4048021363 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c153eb0 0x7fac8c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac8b400640 1 -- 172.21.15.16:0/4048021363 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c153eb0 msgr2=0x7fac8c15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:01.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac8b400640 1 --2- 172.21.15.16:0/4048021363 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c153eb0 0x7fac8c15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac8b400640 1 -- 172.21.15.16:0/4048021363 >> v1:172.21.15.192:6789/0 conn(0x7fac8c06f460 legacy=0x7fac8c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.934+0000 7fac8b400640 1 -- 172.21.15.16:0/4048021363 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c070610 con 0x7fac8c06ff50 2024-04-26T20:15:01.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac8b400640 1 --2- 172.21.15.16:0/4048021363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0c5640 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fac84009e50 tx=0x7fac8401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c563648aeb525f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac8a000640 1 -- 172.21.15.16:0/4048021363 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac840b4070 con 0x7fac8c06ff50 2024-04-26T20:15:01.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac8a000640 1 -- 172.21.15.16:0/4048021363 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac840af400 con 0x7fac8c06ff50 2024-04-26T20:15:01.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac8a000640 1 -- 172.21.15.16:0/4048021363 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac840af7d0 con 0x7fac8c06ff50 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 -- 172.21.15.16:0/4048021363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 msgr2=0x7fac8c0c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 --2- 172.21.15.16:0/4048021363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0c5640 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fac84009e50 tx=0x7fac8401f210 comp rx=0 tx=0).stop 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 -- 172.21.15.16:0/4048021363 shutdown_connections 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 --2- 172.21.15.16:0/4048021363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0c5640 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 --2- 172.21.15.16:0/4048021363 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c153eb0 0x7fac8c15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 -- 172.21.15.16:0/4048021363 >> 172.21.15.16:0/4048021363 conn(0x7fac8c0c9d10 msgr2=0x7fac8c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 -- 172.21.15.16:0/4048021363 shutdown_connections 2024-04-26T20:15:01.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.938+0000 7fac91a00640 1 -- 172.21.15.16:0/4048021363 wait complete. 2024-04-26T20:15:01.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 Processor -- start 2024-04-26T20:15:01.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 -- start start 2024-04-26T20:15:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c06f460 0x7fac8c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac8c149760 0x7fac8c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0c4d70 con 0x7fac8c06ff50 2024-04-26T20:15:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0c5120 con 0x7fac8c149760 2024-04-26T20:15:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c0c4ef0 con 0x7fac8c06f460 2024-04-26T20:15:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38010/0 (socket says 172.21.15.16:38010) 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 -- 172.21.15.16:0/423376360 learned_addr learned my addr 172.21.15.16:0/423376360 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac8b400640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac8c149760 0x7fac8c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac8aa00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c06f460 0x7fac8c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 -- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c06f460 msgr2=0x7fac8c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c06f460 0x7fac8c1508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 -- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac8c149760 msgr2=0x7fac8c146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac8c149760 0x7fac8c146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 -- 172.21.15.16:0/423376360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c1efd00 con 0x7fac8c06ff50 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac82000640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0cbe80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac7400e870 tx=0x7fac7400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac83400640 1 -- 172.21.15.16:0/423376360 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74017070 con 0x7fac8c06ff50 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac83400640 1 -- 172.21.15.16:0/423376360 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7400c8e0 con 0x7fac8c06ff50 2024-04-26T20:15:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c1effe0 con 0x7fac8c06ff50 2024-04-26T20:15:01.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac83400640 1 -- 172.21.15.16:0/423376360 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7400cc90 con 0x7fac8c06ff50 2024-04-26T20:15:01.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c1f05a0 con 0x7fac8c06ff50 2024-04-26T20:15:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.942+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c077c20 con 0x7fac8c06ff50 2024-04-26T20:15:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.946+0000 7fac83400640 1 -- 172.21.15.16:0/423376360 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac7401a070 con 0x7fac8c06ff50 2024-04-26T20:15:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.946+0000 7fac83400640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fac680683b0 0x7fac6806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.946+0000 7fac83400640 1 -- 172.21.15.16:0/423376360 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fac74086fe0 con 0x7fac8c06ff50 2024-04-26T20:15:01.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.946+0000 7fac8aa00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fac680683b0 0x7fac6806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:01.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.946+0000 7fac8aa00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fac680683b0 0x7fac6806a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac7c001650 tx=0x7fac7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:01.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:01.950+0000 7fac83400640 1 -- 172.21.15.16:0/423376360 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fac74057140 con 0x7fac8c06ff50 2024-04-26T20:15:02.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.114+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fac8c070c20 con 0x7fac8c06ff50 2024-04-26T20:15:02.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.114+0000 7fac83400640 1 -- 172.21.15.16:0/423376360 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fac74056a40 con 0x7fac8c06ff50 2024-04-26T20:15:02.121 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:15:02.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fac680683b0 msgr2=0x7fac6806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fac680683b0 0x7fac6806a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac7c001650 tx=0x7fac7c009040 comp rx=0 tx=0).stop 2024-04-26T20:15:02.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 msgr2=0x7fac8c0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0cbe80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac7400e870 tx=0x7fac7400ec70 comp rx=0 tx=0).stop 2024-04-26T20:15:02.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 shutdown_connections 2024-04-26T20:15:02.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fac680683b0 0x7fac6806a870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac8c149760 0x7fac8c146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac8c06ff50 0x7fac8c0cbe80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 --2- 172.21.15.16:0/423376360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac8c06f460 0x7fac8c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 >> 172.21.15.16:0/423376360 conn(0x7fac8c0c9d10 msgr2=0x7fac8c0cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 shutdown_connections 2024-04-26T20:15:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.118+0000 7fac91a00640 1 -- 172.21.15.16:0/423376360 wait complete. 2024-04-26T20:15:02.143 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:15:02.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.286+0000 7f5d8a400640 1 Processor -- start 2024-04-26T20:15:02.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.286+0000 7f5d8a400640 1 -- start start 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d8a400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5d84155ee0 0x7f5d8406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d8a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8406e440 0x7f5d840c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d8a400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d84070380 con 0x7f5d8415fbb0 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d8a400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5d84070660 con 0x7f5d84155ee0 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d8a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5d84070940 con 0x7f5d8406e440 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5d84155ee0 0x7f5d8406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5d84155ee0 0x7f5d8406d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38016/0 (socket says 172.21.15.16:38016) 2024-04-26T20:15:02.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d7aa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5d8415fbb0 0x7f5d8406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52008/0 (socket says 172.21.15.16:52008) 2024-04-26T20:15:02.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 -- 172.21.15.16:0/347035842 learned_addr learned my addr 172.21.15.16:0/347035842 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:02.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83e00640 1 --2- 172.21.15.16:0/347035842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8406e440 0x7f5d840c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 -- 172.21.15.16:0/347035842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8406e440 msgr2=0x7f5d840c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:02.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 --2- 172.21.15.16:0/347035842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8406e440 0x7f5d840c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 -- 172.21.15.16:0/347035842 >> v1:172.21.15.16:6789/0 conn(0x7f5d8415fbb0 legacy=0x7f5d8406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 -- 172.21.15.16:0/347035842 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d84070c20 con 0x7f5d84155ee0 2024-04-26T20:15:02.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d82a00640 1 -- 172.21.15.16:0/347035842 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829011228 0 0) 0x7f5d84070380 con 0x7f5d8415fbb0 2024-04-26T20:15:02.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.290+0000 7f5d83400640 1 --2- 172.21.15.16:0/347035842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d84155ee0 0x7f5d8406d490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009e50 tx=0x7f5d7401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab12ec55226a8c3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:02.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d82a00640 1 -- 172.21.15.16:0/347035842 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d740a57d0 con 0x7f5d84155ee0 2024-04-26T20:15:02.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d82a00640 1 -- 172.21.15.16:0/347035842 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d740a5970 con 0x7f5d84155ee0 2024-04-26T20:15:02.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d82a00640 1 -- 172.21.15.16:0/347035842 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d740a5d40 con 0x7f5d84155ee0 2024-04-26T20:15:02.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- 172.21.15.16:0/347035842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d84155ee0 msgr2=0x7f5d8406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 --2- 172.21.15.16:0/347035842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d84155ee0 0x7f5d8406d490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009e50 tx=0x7f5d7401ca30 comp rx=0 tx=0).stop 2024-04-26T20:15:02.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- 172.21.15.16:0/347035842 shutdown_connections 2024-04-26T20:15:02.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 --2- 172.21.15.16:0/347035842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8406e440 0x7f5d840c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 --2- 172.21.15.16:0/347035842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d84155ee0 0x7f5d8406d490 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- 172.21.15.16:0/347035842 >> 172.21.15.16:0/347035842 conn(0x7f5d84071f60 msgr2=0x7f5d84072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:02.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- 172.21.15.16:0/347035842 shutdown_connections 2024-04-26T20:15:02.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- 172.21.15.16:0/347035842 wait complete. 2024-04-26T20:15:02.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 Processor -- start 2024-04-26T20:15:02.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- start start 2024-04-26T20:15:02.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d84155ee0 0x7f5d840cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8415fbb0 0x7f5d84156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d840d00c0 0x7f5d8415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840ca160 con 0x7f5d840d00c0 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840c9fe0 con 0x7f5d84155ee0 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d8a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8415ffb0 con 0x7f5d8415fbb0 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d83e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d840d00c0 0x7f5d8415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d83e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d840d00c0 0x7f5d8415c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38022/0 (socket says 172.21.15.16:38022) 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d83e00640 1 -- 172.21.15.16:0/2020392731 learned_addr learned my addr 172.21.15.16:0/2020392731 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d83400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d84155ee0 0x7f5d840cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.294+0000 7f5d7aa00640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8415fbb0 0x7f5d84156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d83e00640 1 -- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8415fbb0 msgr2=0x7f5d84156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d83e00640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8415fbb0 0x7f5d84156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d83e00640 1 -- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d84155ee0 msgr2=0x7f5d840cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d83e00640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d84155ee0 0x7f5d840cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d83e00640 1 -- 172.21.15.16:0/2020392731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d841ee3c0 con 0x7f5d840d00c0 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d83e00640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d840d00c0 0x7f5d8415c130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00d530 tx=0x7f5d7c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d7be00640 1 -- 172.21.15.16:0/2020392731 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0125f0 con 0x7f5d840d00c0 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d7be00640 1 -- 172.21.15.16:0/2020392731 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c019070 con 0x7f5d840d00c0 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d7be00640 1 -- 172.21.15.16:0/2020392731 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0129d0 con 0x7f5d840d00c0 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8415a6b0 con 0x7f5d840d00c0 2024-04-26T20:15:02.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d841ee960 con 0x7f5d840d00c0 2024-04-26T20:15:02.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d84077c20 con 0x7f5d840d00c0 2024-04-26T20:15:02.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d7be00640 1 -- 172.21.15.16:0/2020392731 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d7c012b70 con 0x7f5d840d00c0 2024-04-26T20:15:02.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d7be00640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5d600683b0 0x7f5d6006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.298+0000 7f5d7be00640 1 -- 172.21.15.16:0/2020392731 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5d7c086de0 con 0x7f5d840d00c0 2024-04-26T20:15:02.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.302+0000 7f5d83400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5d600683b0 0x7f5d6006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.302+0000 7f5d83400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5d600683b0 0x7f5d6006a870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d740ae000 tx=0x7f5d740a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:02.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.302+0000 7f5d7be00640 1 -- 172.21.15.16:0/2020392731 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d7c023020 con 0x7f5d840d00c0 2024-04-26T20:15:02.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.502+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d840caa80 con 0x7f5d840d00c0 2024-04-26T20:15:02.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d7be00640 1 -- 172.21.15.16:0/2020392731 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f5d7c0568c0 con 0x7f5d840d00c0 2024-04-26T20:15:02.510 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:15:02.510 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:15:02.510 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:15:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5d600683b0 msgr2=0x7f5d6006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5d600683b0 0x7f5d6006a870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d740ae000 tx=0x7f5d740a7070 comp rx=0 tx=0).stop 2024-04-26T20:15:02.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d840d00c0 msgr2=0x7f5d8415c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d840d00c0 0x7f5d8415c130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00d530 tx=0x7f5d7c00d9f0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 shutdown_connections 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5d600683b0 0x7f5d6006a870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d840d00c0 0x7f5d8415c130 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8415fbb0 0x7f5d84156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 --2- 172.21.15.16:0/2020392731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d84155ee0 0x7f5d840cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 >> 172.21.15.16:0/2020392731 conn(0x7f5d84071f60 msgr2=0x7f5d841529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 shutdown_connections 2024-04-26T20:15:02.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.506+0000 7f5d8a400640 1 -- 172.21.15.16:0/2020392731 wait complete. 2024-04-26T20:15:02.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:15:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.666+0000 7f9f21200640 1 Processor -- start 2024-04-26T20:15:02.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.666+0000 7f9f21200640 1 -- start start 2024-04-26T20:15:02.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f21200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f21200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9f1c0c9340 0x7f9f1c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f21200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1c152fa0 con 0x7f9f1c0732b0 2024-04-26T20:15:02.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f21200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f9f1c073700 con 0x7f9f1c0c9340 2024-04-26T20:15:02.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f21200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1c159790 con 0x7f9f1c152bc0 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f19e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f11400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9f1c0c9340 0x7f9f1c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f11400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9f1c0c9340 0x7f9f1c072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:57316/0 (socket says 172.21.15.16:57316) 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f11400640 1 -- 172.21.15.16:0/1948610860 learned_addr learned my addr 172.21.15.16:0/1948610860 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f1a800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9f1c0732b0 0x7f9f1c0c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:39036/0 (socket says 172.21.15.16:39036) 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f19e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:50680/0 (socket says 172.21.15.16:50680) 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f19e00640 1 -- 172.21.15.16:0/1948610860 >> v2:172.21.15.192:3300/0 conn(0x7f9f1c0c9340 msgr2=0x7f9f1c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f19e00640 1 --2- 172.21.15.16:0/1948610860 >> v2:172.21.15.192:3300/0 conn(0x7f9f1c0c9340 0x7f9f1c072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f19e00640 1 -- 172.21.15.16:0/1948610860 >> v1:172.21.15.192:6789/0 conn(0x7f9f1c0732b0 legacy=0x7f9f1c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f19e00640 1 -- 172.21.15.16:0/1948610860 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1c158930 con 0x7f9f1c152bc0 2024-04-26T20:15:02.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.670+0000 7f9f11400640 1 --2- 172.21.15.16:0/1948610860 >> v2:172.21.15.192:3300/0 conn(0x7f9f1c0c9340 0x7f9f1c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:15:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f19e00640 1 --2- 172.21.15.16:0/1948610860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c0c8e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0097c0 tx=0x7f9f0c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=347489d7cc3a198b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f19400640 1 -- 172.21.15.16:0/1948610860 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0b5070 con 0x7f9f1c152bc0 2024-04-26T20:15:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f19400640 1 -- 172.21.15.16:0/1948610860 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c0a8990 con 0x7f9f1c152bc0 2024-04-26T20:15:02.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f19400640 1 -- 172.21.15.16:0/1948610860 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0a8d60 con 0x7f9f1c152bc0 2024-04-26T20:15:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 -- 172.21.15.16:0/1948610860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 msgr2=0x7f9f1c0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 --2- 172.21.15.16:0/1948610860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c0c8e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0097c0 tx=0x7f9f0c01ec90 comp rx=0 tx=0).stop 2024-04-26T20:15:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 -- 172.21.15.16:0/1948610860 shutdown_connections 2024-04-26T20:15:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 --2- 172.21.15.16:0/1948610860 >> v2:172.21.15.192:3300/0 conn(0x7f9f1c0c9340 0x7f9f1c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 --2- 172.21.15.16:0/1948610860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c0c8e00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 -- 172.21.15.16:0/1948610860 >> 172.21.15.16:0/1948610860 conn(0x7f9f1c06c380 msgr2=0x7f9f1c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 -- 172.21.15.16:0/1948610860 shutdown_connections 2024-04-26T20:15:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 -- 172.21.15.16:0/1948610860 wait complete. 2024-04-26T20:15:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 Processor -- start 2024-04-26T20:15:02.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 -- start start 2024-04-26T20:15:02.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.674+0000 7f9f21200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f1c0732b0 0x7f9f1c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f1c0c9340 0x7f9f1c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c1591d0 con 0x7f9f1c0732b0 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c158ef0 con 0x7f9f1c0c9340 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1c1594b0 con 0x7f9f1c152bc0 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f1c0732b0 0x7f9f1c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f1c0732b0 0x7f9f1c159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38028/0 (socket says 172.21.15.16:38028) 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 -- 172.21.15.16:0/840486967 learned_addr learned my addr 172.21.15.16:0/840486967 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f1a800640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f11400640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f1c0c9340 0x7f9f1c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 -- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 msgr2=0x7f9f1c15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 -- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f1c0c9340 msgr2=0x7f9f1c15a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f1c0c9340 0x7f9f1c15a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 -- 172.21.15.16:0/840486967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1c147070 con 0x7f9f1c0732b0 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f19e00640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f1c0732b0 0x7f9f1c159c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c01d340 tx=0x7f9f0c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f12a00640 1 -- 172.21.15.16:0/840486967 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0c1070 con 0x7f9f1c0732b0 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f12a00640 1 -- 172.21.15.16:0/840486967 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c0b0640 con 0x7f9f1c0732b0 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f12a00640 1 -- 172.21.15.16:0/840486967 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0b5040 con 0x7f9f1c0732b0 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1c1f1990 con 0x7f9f1c0732b0 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1c1f1f50 con 0x7f9f1c0732b0 2024-04-26T20:15:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1c077c20 con 0x7f9f1c0732b0 2024-04-26T20:15:02.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.678+0000 7f9f12a00640 1 -- 172.21.15.16:0/840486967 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f0c0b0a10 con 0x7f9f1c0732b0 2024-04-26T20:15:02.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.682+0000 7f9f12a00640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ef80683b0 0x7f9ef806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:15:02.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.682+0000 7f9f12a00640 1 -- 172.21.15.16:0/840486967 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9f0c123d60 con 0x7f9f1c0732b0 2024-04-26T20:15:02.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.682+0000 7f9f11400640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ef80683b0 0x7f9ef806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:15:02.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.682+0000 7f9f11400640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ef80683b0 0x7f9ef806a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c145d10 tx=0x7f9f04009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:15:02.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.686+0000 7f9f12a00640 1 -- 172.21.15.16:0/840486967 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9f0c0187f0 con 0x7f9f1c0732b0 2024-04-26T20:15:02.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.850+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f1c0c9940 con 0x7f9f1c0732b0 2024-04-26T20:15:02.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.850+0000 7f9f12a00640 1 -- 172.21.15.16:0/840486967 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18915 (secure 0 0 0) 0x7f9f0c0b0d00 con 0x7f9f1c0732b0 2024-04-26T20:15:02.856 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:15:02.856 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:15:02.186138+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ef80683b0 msgr2=0x7f9ef806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ef80683b0 0x7f9ef806a870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c145d10 tx=0x7f9f04009240 comp rx=0 tx=0).stop 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f1c0732b0 msgr2=0x7f9f1c159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f1c0732b0 0x7f9f1c159c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c01d340 tx=0x7f9f0c01ba30 comp rx=0 tx=0).stop 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 shutdown_connections 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ef80683b0 0x7f9ef806a870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f1c152bc0 0x7f9f1c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f1c0c9340 0x7f9f1c15a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 --2- 172.21.15.16:0/840486967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f1c0732b0 0x7f9f1c159c40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 >> 172.21.15.16:0/840486967 conn(0x7f9f1c06c380 msgr2=0x7f9f1c150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:15:02.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 shutdown_connections 2024-04-26T20:15:02.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:15:02.854+0000 7f9f21200640 1 -- 172.21.15.16:0/840486967 wait complete. 2024-04-26T20:15:02.878 DEBUG:tasks.mds_thrash:Yielding 2024-04-26T20:15:02.878 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T20:15:02.890 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:02.891 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T20:15:02.891 INFO:tasks.workunit:timeout=6h 2024-04-26T20:15:02.891 INFO:tasks.workunit:cleanup=True 2024-04-26T20:15:02.891 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T20:15:02.892 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-04-26T20:15:02.892 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 102 secs before thrashing 2024-04-26T20:15:02.900 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T20:15:02.900 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T20:15:02.900 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-26T20:15:02.901 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T20:15:02.901 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T20:15:02.901 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 20:14:19.442723009 +0000 2024-04-26T20:15:02.901 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 20:14:28.283728110 +0000 2024-04-26T20:15:02.901 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 20:14:19.442723009 +0000 2024-04-26T20:15:02.901 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T20:15:02.901 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T20:15:02.971 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T20:15:03.023 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T20:15:15.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:15:15.926 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:15:46.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:15:46.075 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:16:16.326 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:16:16.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:16:28.004 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 63% (7821/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T20:16:28.526 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T20:16:28.527 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T20:16:28.539 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T20:16:28.548 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T20:16:28.551 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T20:16:28.551 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T20:16:29.306 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T20:16:29.386 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T20:16:29.442 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T20:16:29.444 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T20:16:29.445 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T20:16:29.501 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T20:16:29.507 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:16:29.507 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T20:16:29.556 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T20:16:29.557 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T20:16:29.558 DEBUG:teuthology.orchestra.run.smithi016:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T20:16:29.618 INFO:tasks.workunit.client.0.smithi016.stderr:+ mkdir -p fsstress 2024-04-26T20:16:29.621 INFO:tasks.workunit.client.0.smithi016.stderr:+ pushd fsstress 2024-04-26T20:16:29.621 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T20:16:29.621 INFO:tasks.workunit.client.0.smithi016.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T20:16:31.998 INFO:tasks.workunit.client.0.smithi016.stderr:+ tar xzf ltp-full.tgz 2024-04-26T20:16:44.893 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 Processor -- start 2024-04-26T20:16:45.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 -- start start 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efe14153af0 0x7efe1415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe140c7b80 0x7efe140c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe140c9010 0x7efe140c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7efe140ca630 con 0x7efe140c9010 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7efe140c99e0 con 0x7efe14153af0 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe1a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efe140c9d90 con 0x7efe140c7b80 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe140c9010 0x7efe140c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe140c9010 0x7efe140c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57500/0 (socket says 172.21.15.16:57500) 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 -- 172.21.15.16:0/1856809781 learned_addr learned my addr 172.21.15.16:0/1856809781 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13400640 1 --2- 172.21.15.16:0/1856809781 >> v2:172.21.15.192:3300/0 conn(0x7efe14153af0 0x7efe1415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe0aa00640 1 --2- 172.21.15.16:0/1856809781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe140c7b80 0x7efe140c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 -- 172.21.15.16:0/1856809781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe140c7b80 msgr2=0x7efe140c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 --2- 172.21.15.16:0/1856809781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe140c7b80 0x7efe140c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 -- 172.21.15.16:0/1856809781 >> v2:172.21.15.192:3300/0 conn(0x7efe14153af0 msgr2=0x7efe1415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 --2- 172.21.15.16:0/1856809781 >> v2:172.21.15.192:3300/0 conn(0x7efe14153af0 0x7efe1415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13e00640 1 -- 172.21.15.16:0/1856809781 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe140ca070 con 0x7efe140c9010 2024-04-26T20:16:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.045+0000 7efe13400640 1 --2- 172.21.15.16:0/1856809781 >> v2:172.21.15.192:3300/0 conn(0x7efe14153af0 0x7efe1415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:16:45.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe13e00640 1 --2- 172.21.15.16:0/1856809781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c9010 0x7efe140c94a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe140745d0 tx=0x7efe0c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc3786dc1218a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:45.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe12a00640 1 -- 172.21.15.16:0/1856809781 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0b4070 con 0x7efe140c9010 2024-04-26T20:16:45.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe12a00640 1 -- 172.21.15.16:0/1856809781 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c0af400 con 0x7efe140c9010 2024-04-26T20:16:45.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe12a00640 1 -- 172.21.15.16:0/1856809781 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0af7d0 con 0x7efe140c9010 2024-04-26T20:16:45.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 -- 172.21.15.16:0/1856809781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c9010 msgr2=0x7efe140c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 --2- 172.21.15.16:0/1856809781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c9010 0x7efe140c94a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe140745d0 tx=0x7efe0c01f1e0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 -- 172.21.15.16:0/1856809781 shutdown_connections 2024-04-26T20:16:45.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 --2- 172.21.15.16:0/1856809781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c9010 0x7efe140c94a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 --2- 172.21.15.16:0/1856809781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe140c7b80 0x7efe140c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 --2- 172.21.15.16:0/1856809781 >> v2:172.21.15.192:3300/0 conn(0x7efe14153af0 0x7efe1415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 -- 172.21.15.16:0/1856809781 >> 172.21.15.16:0/1856809781 conn(0x7efe1406c380 msgr2=0x7efe1406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:45.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 -- 172.21.15.16:0/1856809781 shutdown_connections 2024-04-26T20:16:45.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.049+0000 7efe1a400640 1 -- 172.21.15.16:0/1856809781 wait complete. 2024-04-26T20:16:45.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 Processor -- start 2024-04-26T20:16:45.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 -- start start 2024-04-26T20:16:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c7b80 0x7efe141eff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe140c9010 0x7efe1415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe14153af0 0x7efe1415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe1415d290 con 0x7efe140c7b80 2024-04-26T20:16:45.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe1415cfb0 con 0x7efe140c9010 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efe14153ed0 con 0x7efe14153af0 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c7b80 0x7efe141eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c7b80 0x7efe141eff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57510/0 (socket says 172.21.15.16:57510) 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 -- 172.21.15.16:0/1155682998 learned_addr learned my addr 172.21.15.16:0/1155682998 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13e00640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe14153af0 0x7efe1415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe0aa00640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe140c9010 0x7efe1415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 -- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe14153af0 msgr2=0x7efe1415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe14153af0 0x7efe1415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 -- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe140c9010 msgr2=0x7efe1415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe140c9010 0x7efe1415ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 -- 172.21.15.16:0/1155682998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe14156310 con 0x7efe140c7b80 2024-04-26T20:16:45.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe13400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c7b80 0x7efe141eff80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe0400d830 tx=0x7efe0400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe0be00640 1 -- 172.21.15.16:0/1155682998 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400b6c0 con 0x7efe140c7b80 2024-04-26T20:16:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe0be00640 1 -- 172.21.15.16:0/1155682998 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe04019070 con 0x7efe140c7b80 2024-04-26T20:16:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe0be00640 1 -- 172.21.15.16:0/1155682998 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400baa0 con 0x7efe140c7b80 2024-04-26T20:16:45.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1415bf60 con 0x7efe140c7b80 2024-04-26T20:16:45.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.053+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe141e4910 con 0x7efe140c7b80 2024-04-26T20:16:45.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.057+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe14077c20 con 0x7efe140c7b80 2024-04-26T20:16:45.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.057+0000 7efe0be00640 1 -- 172.21.15.16:0/1155682998 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe0401e460 con 0x7efe140c7b80 2024-04-26T20:16:45.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.057+0000 7efe0be00640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efdf0068380 0x7efdf006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.057+0000 7efe0be00640 1 -- 172.21.15.16:0/1155682998 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efe04087410 con 0x7efe140c7b80 2024-04-26T20:16:45.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.057+0000 7efe0aa00640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efdf0068380 0x7efdf006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.057+0000 7efe0aa00640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efdf0068380 0x7efdf006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe141f0630 tx=0x7efdfc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:45.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.061+0000 7efe0be00640 1 -- 172.21.15.16:0/1155682998 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efe14156310 con 0x7efe140c7b80 2024-04-26T20:16:45.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.261+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe140cb790 con 0x7efe140c7b80 2024-04-26T20:16:45.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.261+0000 7efe0be00640 1 -- 172.21.15.16:0/1155682998 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7efe04057530 con 0x7efe140c7b80 2024-04-26T20:16:45.264 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:16:45.264 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:16:45.265 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efdf0068380 msgr2=0x7efdf006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efdf0068380 0x7efdf006a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe141f0630 tx=0x7efdfc008040 comp rx=0 tx=0).stop 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c7b80 msgr2=0x7efe141eff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c7b80 0x7efe141eff80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efe0400d830 tx=0x7efe0400dcf0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 shutdown_connections 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efdf0068380 0x7efdf006a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe14153af0 0x7efe1415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe140c9010 0x7efe1415ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 --2- 172.21.15.16:0/1155682998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe140c7b80 0x7efe141eff80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 >> 172.21.15.16:0/1155682998 conn(0x7efe1406c380 msgr2=0x7efe140cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 shutdown_connections 2024-04-26T20:16:45.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.265+0000 7efe1a400640 1 -- 172.21.15.16:0/1155682998 wait complete. 2024-04-26T20:16:45.284 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=2) 2024-04-26T20:16:45.284 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T20:16:45.284 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:16:45.297 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T20:16:45.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:45.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5366e00640 1 Processor -- start 2024-04-26T20:16:45.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5366e00640 1 -- start start 2024-04-26T20:16:45.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5366e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5360153af0 0x7f536015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5366e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53600c9720 0x7f53600c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5366e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53600c9d90 con 0x7f53600c7b80 2024-04-26T20:16:45.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5366e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f53600ca630 con 0x7f53600c9720 2024-04-26T20:16:45.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5366e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f53600ca070 con 0x7f5360153af0 2024-04-26T20:16:45.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5364e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53600c9720 0x7f53600c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5357e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f53600c7b80 0x7f53600c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:45972/0 (socket says 172.21.15.16:45972) 2024-04-26T20:16:45.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5357e00640 1 -- 172.21.15.16:0/3143926576 learned_addr learned my addr 172.21.15.16:0/3143926576 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:16:45.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f535fe00640 1 --2- 172.21.15.16:0/3143926576 >> v2:172.21.15.192:3300/0 conn(0x7f5360153af0 0x7f536015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5364e00640 1 -- 172.21.15.16:0/3143926576 >> v2:172.21.15.192:3300/0 conn(0x7f5360153af0 msgr2=0x7f536015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:45.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5364e00640 1 --2- 172.21.15.16:0/3143926576 >> v2:172.21.15.192:3300/0 conn(0x7f5360153af0 0x7f536015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5364e00640 1 -- 172.21.15.16:0/3143926576 >> v1:172.21.15.16:6789/0 conn(0x7f53600c7b80 legacy=0x7f53600c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f5364e00640 1 -- 172.21.15.16:0/3143926576 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53600ca350 con 0x7f53600c9720 2024-04-26T20:16:45.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.481+0000 7f535f400640 1 -- 172.21.15.16:0/3143926576 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 649493378 0 0) 0x7f53600c9d90 con 0x7f53600c7b80 2024-04-26T20:16:45.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5364e00640 1 --2- 172.21.15.16:0/3143926576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c9720 0x7f53600c7f80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f53600745d0 tx=0x7f535801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7735ee990edb55c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:45.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f535f400640 1 -- 172.21.15.16:0/3143926576 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580b4070 con 0x7f53600c9720 2024-04-26T20:16:45.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f535f400640 1 -- 172.21.15.16:0/3143926576 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53580af600 con 0x7f53600c9720 2024-04-26T20:16:45.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f535f400640 1 -- 172.21.15.16:0/3143926576 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580af9d0 con 0x7f53600c9720 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 -- 172.21.15.16:0/3143926576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c9720 msgr2=0x7f53600c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 --2- 172.21.15.16:0/3143926576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c9720 0x7f53600c7f80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f53600745d0 tx=0x7f535801f110 comp rx=0 tx=0).stop 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 -- 172.21.15.16:0/3143926576 shutdown_connections 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 --2- 172.21.15.16:0/3143926576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c9720 0x7f53600c7f80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 --2- 172.21.15.16:0/3143926576 >> v2:172.21.15.192:3300/0 conn(0x7f5360153af0 0x7f536015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 -- 172.21.15.16:0/3143926576 >> 172.21.15.16:0/3143926576 conn(0x7f536006c380 msgr2=0x7f536006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 -- 172.21.15.16:0/3143926576 shutdown_connections 2024-04-26T20:16:45.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.485+0000 7f5366e00640 1 -- 172.21.15.16:0/3143926576 wait complete. 2024-04-26T20:16:45.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 Processor -- start 2024-04-26T20:16:45.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 -- start start 2024-04-26T20:16:45.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c7b80 0x7f53600cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53600c9720 0x7f53601520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360153af0 0x7f53600cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5360153ed0 con 0x7f53600c7b80 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f536015d290 con 0x7f5360153af0 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5360154050 con 0x7f53600c9720 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c7b80 0x7f53600cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c7b80 0x7f53600cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42262/0 (socket says 172.21.15.16:42262) 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 -- 172.21.15.16:0/1798588654 learned_addr learned my addr 172.21.15.16:0/1798588654 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5357e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53600c9720 0x7f53601520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5364e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360153af0 0x7f53600cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 -- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53600c9720 msgr2=0x7f53601520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53600c9720 0x7f53601520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 -- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360153af0 msgr2=0x7f53600cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360153af0 0x7f53600cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 -- 172.21.15.16:0/1798588654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53601e6e80 con 0x7f53600c7b80 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5364e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360153af0 0x7f53600cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535fe00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c7b80 0x7f53600cc210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f535000d620 tx=0x7f535000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535cc00640 1 -- 172.21.15.16:0/1798588654 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535000b620 con 0x7f53600c7b80 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535cc00640 1 -- 172.21.15.16:0/1798588654 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350019070 con 0x7f53600c7b80 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f535cc00640 1 -- 172.21.15.16:0/1798588654 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535000b9e0 con 0x7f53600c7b80 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53601e5b40 con 0x7f53600c7b80 2024-04-26T20:16:45.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53601e48b0 con 0x7f53600c7b80 2024-04-26T20:16:45.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.489+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5360077c20 con 0x7f53600c7b80 2024-04-26T20:16:45.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.493+0000 7f535cc00640 1 -- 172.21.15.16:0/1798588654 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f535000bb80 con 0x7f53600c7b80 2024-04-26T20:16:45.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.493+0000 7f535cc00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f533c0683b0 0x7f533c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:45.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.493+0000 7f535cc00640 1 -- 172.21.15.16:0/1798588654 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5350087100 con 0x7f53600c7b80 2024-04-26T20:16:45.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.493+0000 7f5357e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f533c0683b0 0x7f533c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:45.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.493+0000 7f5357e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f533c0683b0 0x7f533c06a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f53600cde60 tx=0x7f5348007b60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:45.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.497+0000 7f535cc00640 1 -- 172.21.15.16:0/1798588654 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5350057350 con 0x7f53600c7b80 2024-04-26T20:16:45.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.693+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53600c8670 con 0x7f53600c7b80 2024-04-26T20:16:45.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f535cc00640 1 -- 172.21.15.16:0/1798588654 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f5350056c50 con 0x7f53600c7b80 2024-04-26T20:16:45.697 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:16:45.697 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:16:45.697 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f533c0683b0 msgr2=0x7f533c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f533c0683b0 0x7f533c06a870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f53600cde60 tx=0x7f5348007b60 comp rx=0 tx=0).stop 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c7b80 msgr2=0x7f53600cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c7b80 0x7f53600cc210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f535000d620 tx=0x7f535000dae0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 shutdown_connections 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f533c0683b0 0x7f533c06a870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360153af0 0x7f53600cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53600c9720 0x7f53601520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 --2- 172.21.15.16:0/1798588654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53600c7b80 0x7f53600cc210 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:45.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 >> 172.21.15.16:0/1798588654 conn(0x7f536006c380 msgr2=0x7f5360152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:45.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 shutdown_connections 2024-04-26T20:16:45.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:45.697+0000 7f5366e00640 1 -- 172.21.15.16:0/1798588654 wait complete. 2024-04-26T20:16:45.718 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-26T20:16:46.455 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:16:46.459 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:16:47.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:47.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.861+0000 7f28da800640 1 Processor -- start 2024-04-26T20:16:47.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.861+0000 7f28da800640 1 -- start start 2024-04-26T20:16:47.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28da800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f28d41574b0 0x7f28d40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28da800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d40cb7f0 con 0x7f28d40c63f0 2024-04-26T20:16:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28da800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d40ca0d0 con 0x7f28d40b47e0 2024-04-26T20:16:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28da800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f28d40ccd80 con 0x7f28d41574b0 2024-04-26T20:16:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28d3e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f28d40c63f0 0x7f28d4164520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:45974/0 (socket says 172.21.15.16:45974) 2024-04-26T20:16:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28d3e00640 1 -- 172.21.15.16:0/1697787997 learned_addr learned my addr 172.21.15.16:0/1697787997 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:16:47.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28d3400640 1 --2- 172.21.15.16:0/1697787997 >> v2:172.21.15.16:3300/0 conn(0x7f28d41574b0 0x7f28d40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28d3400640 1 -- 172.21.15.16:0/1697787997 >> v1:172.21.15.192:6789/0 conn(0x7f28d40b47e0 legacy=0x7f28d406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28d3400640 1 -- 172.21.15.16:0/1697787997 >> v1:172.21.15.16:6789/0 conn(0x7f28d40c63f0 legacy=0x7f28d4164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28d2a00640 1 -- 172.21.15.16:0/1697787997 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284702690 0 0) 0x7f28d40cb7f0 con 0x7f28d40c63f0 2024-04-26T20:16:47.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.865+0000 7f28d3400640 1 -- 172.21.15.16:0/1697787997 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d40cba90 con 0x7f28d41574b0 2024-04-26T20:16:47.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28d3400640 1 --2- 172.21.15.16:0/1697787997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d41574b0 0x7f28d40ca730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097c0 tx=0x7f28c401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5b56285b8111ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:47.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28d2a00640 1 -- 172.21.15.16:0/1697787997 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40b0070 con 0x7f28d41574b0 2024-04-26T20:16:47.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28d2a00640 1 -- 172.21.15.16:0/1697787997 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c40ab600 con 0x7f28d41574b0 2024-04-26T20:16:47.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28d2a00640 1 -- 172.21.15.16:0/1697787997 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c40ab9d0 con 0x7f28d41574b0 2024-04-26T20:16:47.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28da800640 1 -- 172.21.15.16:0/1697787997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d41574b0 msgr2=0x7f28d40ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:47.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28da800640 1 --2- 172.21.15.16:0/1697787997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d41574b0 0x7f28d40ca730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097c0 tx=0x7f28c401c4c0 comp rx=0 tx=0).stop 2024-04-26T20:16:47.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28da800640 1 -- 172.21.15.16:0/1697787997 shutdown_connections 2024-04-26T20:16:47.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28da800640 1 --2- 172.21.15.16:0/1697787997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d41574b0 0x7f28d40ca730 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:47.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28da800640 1 -- 172.21.15.16:0/1697787997 >> 172.21.15.16:0/1697787997 conn(0x7f28d4071160 msgr2=0x7f28d4068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:47.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28da800640 1 -- 172.21.15.16:0/1697787997 shutdown_connections 2024-04-26T20:16:47.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.869+0000 7f28da800640 1 -- 172.21.15.16:0/1697787997 wait complete. 2024-04-26T20:16:47.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 Processor -- start 2024-04-26T20:16:47.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 -- start start 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28d40b47e0 0x7f28d41f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d40c63f0 0x7f28d4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28d41574b0 0x7f28d40ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28d4070740 con 0x7f28d40c63f0 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f28d40705c0 con 0x7f28d40b47e0 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f28d4168460 con 0x7f28d41574b0 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d40c63f0 0x7f28d4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d40c63f0 0x7f28d4071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42280/0 (socket says 172.21.15.16:42280) 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 -- 172.21.15.16:0/4205660271 learned_addr learned my addr 172.21.15.16:0/4205660271 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28d3400640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28d40b47e0 0x7f28d41f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28d3e00640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28d41574b0 0x7f28d40ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:47.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 -- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28d41574b0 msgr2=0x7f28d40ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28d41574b0 0x7f28d40ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 -- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28d40b47e0 msgr2=0x7f28d41f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28d40b47e0 0x7f28d41f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 -- 172.21.15.16:0/4205660271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d4148110 con 0x7f28d40c63f0 2024-04-26T20:16:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28d3e00640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28d41574b0 0x7f28d40ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:16:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cbe00640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d40c63f0 0x7f28d4071f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00c4d0 tx=0x7f28bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cb400640 1 -- 172.21.15.16:0/4205660271 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0052d0 con 0x7f28d40c63f0 2024-04-26T20:16:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cb400640 1 -- 172.21.15.16:0/4205660271 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28bc005470 con 0x7f28d40c63f0 2024-04-26T20:16:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28cb400640 1 -- 172.21.15.16:0/4205660271 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc012830 con 0x7f28d40c63f0 2024-04-26T20:16:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d40c6cb0 con 0x7f28d40c63f0 2024-04-26T20:16:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.873+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d40c9440 con 0x7f28d40c63f0 2024-04-26T20:16:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.877+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d4077c20 con 0x7f28d40c63f0 2024-04-26T20:16:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.877+0000 7f28cb400640 1 -- 172.21.15.16:0/4205660271 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f28bc0129d0 con 0x7f28d40c63f0 2024-04-26T20:16:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.877+0000 7f28cb400640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f28b0068380 0x7f28b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.877+0000 7f28cb400640 1 -- 172.21.15.16:0/4205660271 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f28bc0869f0 con 0x7f28d40c63f0 2024-04-26T20:16:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.877+0000 7f28d3400640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f28b0068380 0x7f28b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:47.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.881+0000 7f28d3400640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f28b0068380 0x7f28b006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f28c40ad000 tx=0x7f28c40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:47.881+0000 7f28cb400640 1 -- 172.21.15.16:0/4205660271 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f28bc056a80 con 0x7f28d40c63f0 2024-04-26T20:16:48.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.081+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28d4072d20 con 0x7f28d40c63f0 2024-04-26T20:16:48.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.081+0000 7f28cb400640 1 -- 172.21.15.16:0/4205660271 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f28bc056380 con 0x7f28d40c63f0 2024-04-26T20:16:48.083 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:16:48.083 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:16:48.084 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:16:48.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f28b0068380 msgr2=0x7f28b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f28b0068380 0x7f28b006a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f28c40ad000 tx=0x7f28c40a6000 comp rx=0 tx=0).stop 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d40c63f0 msgr2=0x7f28d4071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d40c63f0 0x7f28d4071f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00c4d0 tx=0x7f28bc00c990 comp rx=0 tx=0).stop 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 shutdown_connections 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f28b0068380 0x7f28b006a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28d41574b0 0x7f28d40ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28d40c63f0 0x7f28d4071f90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 --2- 172.21.15.16:0/4205660271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28d40b47e0 0x7f28d41f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 >> 172.21.15.16:0/4205660271 conn(0x7f28d4071160 msgr2=0x7f28d41567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 shutdown_connections 2024-04-26T20:16:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:48.085+0000 7f28da800640 1 -- 172.21.15.16:0/4205660271 wait complete. 2024-04-26T20:16:48.104 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-26T20:16:50.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:50.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f4657400640 1 Processor -- start 2024-04-26T20:16:50.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f4657400640 1 -- start start 2024-04-26T20:16:50.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f4657400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:50.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f4657400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f46500c7b80 0x7f46500c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f4657400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46500c9d90 con 0x7f46500c9010 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f4657400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f46500ca630 con 0x7f46500c7b80 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f4657400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f46500ca070 con 0x7f4650153af0 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.257+0000 7f464fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f46500c7b80 0x7f46500c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f46500c7b80 0x7f46500c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42286/0 (socket says 172.21.15.16:42286) 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464fe00640 1 -- 172.21.15.16:0/4543907 learned_addr learned my addr 172.21.15.16:0/4543907 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f4654a00640 1 --2- 172.21.15.16:0/4543907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:50.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464fe00640 1 -- 172.21.15.16:0/4543907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 msgr2=0x7f465015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464fe00640 1 --2- 172.21.15.16:0/4543907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464fe00640 1 -- 172.21.15.16:0/4543907 >> v1:172.21.15.192:6789/0 conn(0x7f46500c9010 legacy=0x7f46500c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:50.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464fe00640 1 -- 172.21.15.16:0/4543907 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46500ca350 con 0x7f46500c7b80 2024-04-26T20:16:50.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464fe00640 1 --2- 172.21.15.16:0/4543907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46500c7f80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f463c009870 tx=0x7f463c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf6d746e583eddc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464f400640 1 -- 172.21.15.16:0/4543907 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c0b5070 con 0x7f46500c7b80 2024-04-26T20:16:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464f400640 1 -- 172.21.15.16:0/4543907 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463c0a8a50 con 0x7f46500c7b80 2024-04-26T20:16:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.261+0000 7f464f400640 1 -- 172.21.15.16:0/4543907 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c0a8e20 con 0x7f46500c7b80 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- 172.21.15.16:0/4543907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 msgr2=0x7f46500c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 --2- 172.21.15.16:0/4543907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46500c7f80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f463c009870 tx=0x7f463c01ed50 comp rx=0 tx=0).stop 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- 172.21.15.16:0/4543907 shutdown_connections 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 --2- 172.21.15.16:0/4543907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46500c7f80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 --2- 172.21.15.16:0/4543907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- 172.21.15.16:0/4543907 >> 172.21.15.16:0/4543907 conn(0x7f465006c380 msgr2=0x7f465006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- 172.21.15.16:0/4543907 shutdown_connections 2024-04-26T20:16:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- 172.21.15.16:0/4543907 wait complete. 2024-04-26T20:16:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 Processor -- start 2024-04-26T20:16:50.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- start start 2024-04-26T20:16:50.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46501f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46500c9010 0x7f465014e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465014f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4650153ed0 con 0x7f46500c7b80 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f465015d290 con 0x7f46500c9010 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4657400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4650154050 con 0x7f4650153af0 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46501f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46501f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42302/0 (socket says 172.21.15.16:42302) 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 -- 172.21.15.16:0/3772497507 learned_addr learned my addr 172.21.15.16:0/3772497507 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f464fe00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46500c9010 0x7f465014e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4655400640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465014f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 -- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 msgr2=0x7f465014f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465014f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 -- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46500c9010 msgr2=0x7f465014e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46500c9010 0x7f465014e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 -- 172.21.15.16:0/3772497507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46501f4cb0 con 0x7f46500c7b80 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f464fe00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46500c9010 0x7f465014e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.265+0000 7f4654a00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46501f5750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f464400d5f0 tx=0x7f464400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f464cc00640 1 -- 172.21.15.16:0/3772497507 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440125f0 con 0x7f46500c7b80 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f464cc00640 1 -- 172.21.15.16:0/3772497507 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4644019070 con 0x7f46500c7b80 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46501e4c30 con 0x7f46500c7b80 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f464cc00640 1 -- 172.21.15.16:0/3772497507 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440129b0 con 0x7f46500c7b80 2024-04-26T20:16:50.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46501f4f50 con 0x7f46500c7b80 2024-04-26T20:16:50.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4650077c20 con 0x7f46500c7b80 2024-04-26T20:16:50.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f464cc00640 1 -- 172.21.15.16:0/3772497507 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4644012b50 con 0x7f46500c7b80 2024-04-26T20:16:50.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f464cc00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f46300683b0 0x7f463006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:50.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f464cc00640 1 -- 172.21.15.16:0/3772497507 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f46440872e0 con 0x7f46500c7b80 2024-04-26T20:16:50.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.269+0000 7f464fe00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f46300683b0 0x7f463006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:50.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.273+0000 7f464fe00640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f46300683b0 0x7f463006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f463c0b2000 tx=0x7f463c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:50.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.273+0000 7f464cc00640 1 -- 172.21.15.16:0/3772497507 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4644057370 con 0x7f46500c7b80 2024-04-26T20:16:50.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.473+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4650159e90 con 0x7f46500c7b80 2024-04-26T20:16:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.473+0000 7f464cc00640 1 -- 172.21.15.16:0/3772497507 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f4644056c70 con 0x7f46500c7b80 2024-04-26T20:16:50.563 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:16:50.563 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:16:50.564 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f46300683b0 msgr2=0x7f463006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f46300683b0 0x7f463006a870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f463c0b2000 tx=0x7f463c008040 comp rx=0 tx=0).stop 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 msgr2=0x7f46501f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46501f5750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f464400d5f0 tx=0x7f464400dab0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 shutdown_connections 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f46300683b0 0x7f463006a870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4650153af0 0x7f465014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46500c9010 0x7f465014e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 --2- 172.21.15.16:0/3772497507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500c7b80 0x7f46501f5750 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 >> 172.21.15.16:0/3772497507 conn(0x7f465006c380 msgr2=0x7f465015b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 shutdown_connections 2024-04-26T20:16:50.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:50.477+0000 7f4657400640 1 -- 172.21.15.16:0/3772497507 wait complete. 2024-04-26T20:16:50.566 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-26T20:16:52.566 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:52.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57f5800640 1 Processor -- start 2024-04-26T20:16:52.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57f5800640 1 -- start start 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57f5800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f57f0152bc0 0x7f57f00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57f5800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57f0073480 0x7f57f00c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57f5800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f0152fa0 con 0x7f57f00c9340 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57f5800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f57f0159790 con 0x7f57f0152bc0 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57f5800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f57f0158930 con 0x7f57f0073480 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57eea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f57f0152bc0 0x7f57f00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57eea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f57f0152bc0 0x7f57f00c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42314/0 (socket says 172.21.15.16:42314) 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57eea00640 1 -- 172.21.15.16:0/32391508 learned_addr learned my addr 172.21.15.16:0/32391508 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:52.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57ef400640 1 --2- 172.21.15.16:0/32391508 >> v2:172.21.15.192:3300/0 conn(0x7f57f0073480 0x7f57f00c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:52.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57eea00640 1 -- 172.21.15.16:0/32391508 >> v2:172.21.15.192:3300/0 conn(0x7f57f0073480 msgr2=0x7f57f00c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:52.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57eea00640 1 --2- 172.21.15.16:0/32391508 >> v2:172.21.15.192:3300/0 conn(0x7f57f0073480 0x7f57f00c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57eea00640 1 -- 172.21.15.16:0/32391508 >> v1:172.21.15.192:6789/0 conn(0x7f57f00c9340 legacy=0x7f57f0072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:52.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.709+0000 7f57eea00640 1 -- 172.21.15.16:0/32391508 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f0158c10 con 0x7f57f0152bc0 2024-04-26T20:16:52.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57eea00640 1 --2- 172.21.15.16:0/32391508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f0152bc0 0x7f57f00c8e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009870 tx=0x7f57e001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f13b3bbf0c938b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:52.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57ee000640 1 -- 172.21.15.16:0/32391508 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e00b5070 con 0x7f57f0152bc0 2024-04-26T20:16:52.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57ee000640 1 -- 172.21.15.16:0/32391508 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e00a8a10 con 0x7f57f0152bc0 2024-04-26T20:16:52.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57ee000640 1 -- 172.21.15.16:0/32391508 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e00a8de0 con 0x7f57f0152bc0 2024-04-26T20:16:52.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 -- 172.21.15.16:0/32391508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f0152bc0 msgr2=0x7f57f00c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 --2- 172.21.15.16:0/32391508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f0152bc0 0x7f57f00c8e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009870 tx=0x7f57e001ed10 comp rx=0 tx=0).stop 2024-04-26T20:16:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 -- 172.21.15.16:0/32391508 shutdown_connections 2024-04-26T20:16:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 --2- 172.21.15.16:0/32391508 >> v2:172.21.15.192:3300/0 conn(0x7f57f0073480 0x7f57f00c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 --2- 172.21.15.16:0/32391508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f0152bc0 0x7f57f00c8e00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 -- 172.21.15.16:0/32391508 >> 172.21.15.16:0/32391508 conn(0x7f57f006c380 msgr2=0x7f57f006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 -- 172.21.15.16:0/32391508 shutdown_connections 2024-04-26T20:16:52.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.713+0000 7f57f5800640 1 -- 172.21.15.16:0/32391508 wait complete. 2024-04-26T20:16:52.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 Processor -- start 2024-04-26T20:16:52.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 -- start start 2024-04-26T20:16:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57f0073480 0x7f57f0156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f00c9340 0x7f57f0153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57f0152bc0 0x7f57f0153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01594b0 con 0x7f57f00c9340 2024-04-26T20:16:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01591d0 con 0x7f57f0073480 2024-04-26T20:16:52.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f57f00c47d0 con 0x7f57f0152bc0 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f00c9340 0x7f57f0153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f00c9340 0x7f57f0153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42318/0 (socket says 172.21.15.16:42318) 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 -- 172.21.15.16:0/2325977508 learned_addr learned my addr 172.21.15.16:0/2325977508 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57eea00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57f0073480 0x7f57f0156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57ef400640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57f0152bc0 0x7f57f0153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 -- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57f0152bc0 msgr2=0x7f57f0153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57f0152bc0 0x7f57f0153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 -- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57f0073480 msgr2=0x7f57f0156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57f0073480 0x7f57f0156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 -- 172.21.15.16:0/2325977508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f0152170 con 0x7f57f00c9340 2024-04-26T20:16:52.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57eea00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57f0073480 0x7f57f0156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:16:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57ef400640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57f0152bc0 0x7f57f0153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:16:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e7e00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f00c9340 0x7f57f0153600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c450 tx=0x7f57d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e6a00640 1 -- 172.21.15.16:0/2325977508 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8016020 con 0x7f57f00c9340 2024-04-26T20:16:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e6a00640 1 -- 172.21.15.16:0/2325977508 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d80052d0 con 0x7f57f00c9340 2024-04-26T20:16:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f00cb120 con 0x7f57f00c9340 2024-04-26T20:16:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57e6a00640 1 -- 172.21.15.16:0/2325977508 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8007260 con 0x7f57f00c9340 2024-04-26T20:16:52.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f00cc0b0 con 0x7f57f00c9340 2024-04-26T20:16:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.717+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f0152370 con 0x7f57f00c9340 2024-04-26T20:16:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.721+0000 7f57e6a00640 1 -- 172.21.15.16:0/2325977508 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f57d8007400 con 0x7f57f00c9340 2024-04-26T20:16:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.721+0000 7f57e6a00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57cc068380 0x7f57cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:52.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.721+0000 7f57e6a00640 1 -- 172.21.15.16:0/2325977508 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f57d8086760 con 0x7f57f00c9340 2024-04-26T20:16:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.721+0000 7f57eea00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57cc068380 0x7f57cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:52.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.721+0000 7f57eea00640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57cc068380 0x7f57cc06a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57e00b2000 tx=0x7f57e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:52.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.725+0000 7f57e6a00640 1 -- 172.21.15.16:0/2325977508 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f57f0152370 con 0x7f57f00c9340 2024-04-26T20:16:52.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.921+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57f0077c20 con 0x7f57f00c9340 2024-04-26T20:16:52.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57e6a00640 1 -- 172.21.15.16:0/2325977508 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f57d8020020 con 0x7f57f00c9340 2024-04-26T20:16:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:16:52.926 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:16:52.926 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:16:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57cc068380 msgr2=0x7f57cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57cc068380 0x7f57cc06a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57e00b2000 tx=0x7f57e0008040 comp rx=0 tx=0).stop 2024-04-26T20:16:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f00c9340 msgr2=0x7f57f0153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:52.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f00c9340 0x7f57f0153600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c450 tx=0x7f57d800c910 comp rx=0 tx=0).stop 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 shutdown_connections 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f57cc068380 0x7f57cc06a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57f0152bc0 0x7f57f0153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57f00c9340 0x7f57f0153600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 --2- 172.21.15.16:0/2325977508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57f0073480 0x7f57f0156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 >> 172.21.15.16:0/2325977508 conn(0x7f57f006c380 msgr2=0x7f57f00c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 shutdown_connections 2024-04-26T20:16:52.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:52.925+0000 7f57f5800640 1 -- 172.21.15.16:0/2325977508 wait complete. 2024-04-26T20:16:52.945 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-26T20:16:54.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:55.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.085+0000 7faa8fc00640 1 Processor -- start 2024-04-26T20:16:55.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.085+0000 7faa8fc00640 1 -- start start 2024-04-26T20:16:55.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8fc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa88153af0 0x7faa8815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:55.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8fc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa880c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8fc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa880c9d90 con 0x7faa880c9010 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8fc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7faa880ca630 con 0x7faa88153af0 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8fc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faa880ca070 con 0x7faa880c7b80 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8dc00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faa880c9010 0x7faa880c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:45982/0 (socket says 172.21.15.16:45982) 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8dc00640 1 -- 172.21.15.16:0/2920389760 learned_addr learned my addr 172.21.15.16:0/2920389760 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8d200640 1 --2- 172.21.15.16:0/2920389760 >> v2:172.21.15.16:3300/0 conn(0x7faa88153af0 0x7faa8815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa7fe00640 1 --2- 172.21.15.16:0/2920389760 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa880c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8d200640 1 -- 172.21.15.16:0/2920389760 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 msgr2=0x7faa880c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8d200640 1 --2- 172.21.15.16:0/2920389760 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa880c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8d200640 1 -- 172.21.15.16:0/2920389760 >> v1:172.21.15.16:6789/0 conn(0x7faa880c9010 legacy=0x7faa880c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8d200640 1 -- 172.21.15.16:0/2920389760 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880ca350 con 0x7faa88153af0 2024-04-26T20:16:55.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa87e00640 1 -- 172.21.15.16:0/2920389760 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253958106 0 0) 0x7faa880c9d90 con 0x7faa880c9010 2024-04-26T20:16:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.089+0000 7faa8d200640 1 --2- 172.21.15.16:0/2920389760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa8815d7b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa780097c0 tx=0x7faa7801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a483b2f0f40930 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa87e00640 1 -- 172.21.15.16:0/2920389760 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780b5070 con 0x7faa88153af0 2024-04-26T20:16:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa87e00640 1 -- 172.21.15.16:0/2920389760 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa780a8990 con 0x7faa88153af0 2024-04-26T20:16:55.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa87e00640 1 -- 172.21.15.16:0/2920389760 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780a8d60 con 0x7faa88153af0 2024-04-26T20:16:55.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- 172.21.15.16:0/2920389760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 msgr2=0x7faa8815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2920389760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa8815d7b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa780097c0 tx=0x7faa7801ec90 comp rx=0 tx=0).stop 2024-04-26T20:16:55.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- 172.21.15.16:0/2920389760 shutdown_connections 2024-04-26T20:16:55.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2920389760 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa880c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2920389760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa8815d7b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- 172.21.15.16:0/2920389760 >> 172.21.15.16:0/2920389760 conn(0x7faa8806c380 msgr2=0x7faa8806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:55.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- 172.21.15.16:0/2920389760 shutdown_connections 2024-04-26T20:16:55.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- 172.21.15.16:0/2920389760 wait complete. 2024-04-26T20:16:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 Processor -- start 2024-04-26T20:16:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- start start 2024-04-26T20:16:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa88073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa880c9010 0x7faa88151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa881520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa88153ed0 con 0x7faa88153af0 2024-04-26T20:16:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faa8815d290 con 0x7faa880c9010 2024-04-26T20:16:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8fc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faa88154050 con 0x7faa880c7b80 2024-04-26T20:16:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa881520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa881520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42338/0 (socket says 172.21.15.16:42338) 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8dc00640 1 -- 172.21.15.16:0/2112742826 learned_addr learned my addr 172.21.15.16:0/2112742826 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa7fe00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa880c9010 0x7faa88151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.093+0000 7faa8d200640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa88073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8dc00640 1 -- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 msgr2=0x7faa88073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8dc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa88073b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8dc00640 1 -- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa880c9010 msgr2=0x7faa88151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8dc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa880c9010 0x7faa88151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8dc00640 1 -- 172.21.15.16:0/2112742826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880cc330 con 0x7faa88153af0 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8d200640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa88073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8dc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa881520e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c7d0 tx=0x7faa8000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa85600640 1 -- 172.21.15.16:0/2112742826 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80018070 con 0x7faa88153af0 2024-04-26T20:16:55.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa85600640 1 -- 172.21.15.16:0/2112742826 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8000a640 con 0x7faa88153af0 2024-04-26T20:16:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa880cc610 con 0x7faa88153af0 2024-04-26T20:16:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa85600640 1 -- 172.21.15.16:0/2112742826 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8000aa70 con 0x7faa88153af0 2024-04-26T20:16:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa881e76c0 con 0x7faa88153af0 2024-04-26T20:16:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa88077c20 con 0x7faa88153af0 2024-04-26T20:16:55.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa85600640 1 -- 172.21.15.16:0/2112742826 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa8001b070 con 0x7faa88153af0 2024-04-26T20:16:55.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa85600640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faa64068380 0x7faa6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:55.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa85600640 1 -- 172.21.15.16:0/2112742826 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7faa80086460 con 0x7faa88153af0 2024-04-26T20:16:55.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.097+0000 7faa8d200640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faa64068380 0x7faa6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:55.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.101+0000 7faa8d200640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faa64068380 0x7faa6406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa780b2000 tx=0x7faa78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:55.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.101+0000 7faa85600640 1 -- 172.21.15.16:0/2112742826 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faa80056580 con 0x7faa88153af0 2024-04-26T20:16:55.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa880c8670 con 0x7faa88153af0 2024-04-26T20:16:55.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa85600640 1 -- 172.21.15.16:0/2112742826 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7faa80059af0 con 0x7faa88153af0 2024-04-26T20:16:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:16:55.306 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:16:55.306 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faa64068380 msgr2=0x7faa6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faa64068380 0x7faa6406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa780b2000 tx=0x7faa78008040 comp rx=0 tx=0).stop 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 msgr2=0x7faa881520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa881520e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c7d0 tx=0x7faa8000cc90 comp rx=0 tx=0).stop 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 shutdown_connections 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faa64068380 0x7faa6406a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa88153af0 0x7faa881520e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa880c9010 0x7faa88151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 --2- 172.21.15.16:0/2112742826 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa880c7b80 0x7faa88073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 >> 172.21.15.16:0/2112742826 conn(0x7faa8806c380 msgr2=0x7faa880c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 shutdown_connections 2024-04-26T20:16:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:55.305+0000 7faa8fc00640 1 -- 172.21.15.16:0/2112742826 wait complete. 2024-04-26T20:16:55.327 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-26T20:16:57.329 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.469+0000 7f8399000640 1 Processor -- start 2024-04-26T20:16:57.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.469+0000 7f8399000640 1 -- start start 2024-04-26T20:16:57.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8399000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8394153af0 0x7f839415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8399000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f83940c7b80 0x7f83940c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8399000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83940c9d90 con 0x7f83940c9010 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8399000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f83940ca630 con 0x7f8394153af0 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8399000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f83940ca070 con 0x7f83940c7b80 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8391e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8394153af0 0x7f839415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8391e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8394153af0 0x7f839415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32800/0 (socket says 172.21.15.16:32800) 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8391e00640 1 -- 172.21.15.16:0/3885631577 learned_addr learned my addr 172.21.15.16:0/3885631577 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:57.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f838be00640 1 --2- 172.21.15.16:0/3885631577 >> v2:172.21.15.192:3300/0 conn(0x7f83940c7b80 0x7f83940c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8391e00640 1 -- 172.21.15.16:0/3885631577 >> v2:172.21.15.192:3300/0 conn(0x7f83940c7b80 msgr2=0x7f83940c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8391e00640 1 --2- 172.21.15.16:0/3885631577 >> v2:172.21.15.192:3300/0 conn(0x7f83940c7b80 0x7f83940c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8391e00640 1 -- 172.21.15.16:0/3885631577 >> v1:172.21.15.192:6789/0 conn(0x7f83940c9010 legacy=0x7f83940c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:57.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.473+0000 7f8391e00640 1 -- 172.21.15.16:0/3885631577 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83940ca350 con 0x7f8394153af0 2024-04-26T20:16:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8391e00640 1 --2- 172.21.15.16:0/3885631577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8394153af0 0x7f839415d7b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8394071cb0 tx=0x7f838401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc3f0c3b2dbbd25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8391400640 1 -- 172.21.15.16:0/3885631577 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83840b5070 con 0x7f8394153af0 2024-04-26T20:16:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8391400640 1 -- 172.21.15.16:0/3885631577 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83840a89d0 con 0x7f8394153af0 2024-04-26T20:16:57.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8391400640 1 -- 172.21.15.16:0/3885631577 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83840a8da0 con 0x7f8394153af0 2024-04-26T20:16:57.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- 172.21.15.16:0/3885631577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8394153af0 msgr2=0x7f839415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:57.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 --2- 172.21.15.16:0/3885631577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8394153af0 0x7f839415d7b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8394071cb0 tx=0x7f838401ecd0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- 172.21.15.16:0/3885631577 shutdown_connections 2024-04-26T20:16:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 --2- 172.21.15.16:0/3885631577 >> v2:172.21.15.192:3300/0 conn(0x7f83940c7b80 0x7f83940c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 --2- 172.21.15.16:0/3885631577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8394153af0 0x7f839415d7b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- 172.21.15.16:0/3885631577 >> 172.21.15.16:0/3885631577 conn(0x7f839406c380 msgr2=0x7f839406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- 172.21.15.16:0/3885631577 shutdown_connections 2024-04-26T20:16:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- 172.21.15.16:0/3885631577 wait complete. 2024-04-26T20:16:57.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 Processor -- start 2024-04-26T20:16:57.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- start start 2024-04-26T20:16:57.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940c7b80 0x7f83940ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83940c9010 0x7f839414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8394153af0 0x7f83941efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8394153ed0 con 0x7f83940c9010 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f839415d290 con 0x7f8394153af0 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.477+0000 7f8399000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8394154050 con 0x7f83940c7b80 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83940c9010 0x7f839414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83940c9010 0x7f839414b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32814/0 (socket says 172.21.15.16:32814) 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 -- 172.21.15.16:0/3442451073 learned_addr learned my addr 172.21.15.16:0/3442451073 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f8391e00640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940c7b80 0x7f83940ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f8392800640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8394153af0 0x7f83941efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 -- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940c7b80 msgr2=0x7f83940ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:57.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940c7b80 0x7f83940ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 -- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8394153af0 msgr2=0x7f83941efb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8394153af0 0x7f83941efb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 -- 172.21.15.16:0/3442451073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83940cd4b0 con 0x7f83940c9010 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f8391e00640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940c7b80 0x7f83940ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838be00640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83940c9010 0x7f839414b070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f837c00d800 tx=0x7f837c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838a000640 1 -- 172.21.15.16:0/3442451073 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c00b660 con 0x7f83940c9010 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838a000640 1 -- 172.21.15.16:0/3442451073 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837c019070 con 0x7f83940c9010 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838a000640 1 -- 172.21.15.16:0/3442451073 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c00ba00 con 0x7f83940c9010 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83940cd770 con 0x7f83940c9010 2024-04-26T20:16:57.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83941f3560 con 0x7f83940c9010 2024-04-26T20:16:57.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8394077c20 con 0x7f83940c9010 2024-04-26T20:16:57.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838a000640 1 -- 172.21.15.16:0/3442451073 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f837c00bba0 con 0x7f83940c9010 2024-04-26T20:16:57.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838a000640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8370068380 0x7f837006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:57.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.481+0000 7f838a000640 1 -- 172.21.15.16:0/3442451073 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f837c0872b0 con 0x7f83940c9010 2024-04-26T20:16:57.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.485+0000 7f8391e00640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8370068380 0x7f837006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:57.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.485+0000 7f8391e00640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8370068380 0x7f837006a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83840b2000 tx=0x7f8384008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:57.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.489+0000 7f838a000640 1 -- 172.21.15.16:0/3442451073 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f837c0573d0 con 0x7f83940c9010 2024-04-26T20:16:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.685+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f839415b580 con 0x7f83940c9010 2024-04-26T20:16:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.685+0000 7f838a000640 1 -- 172.21.15.16:0/3442451073 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f837c056cd0 con 0x7f83940c9010 2024-04-26T20:16:57.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:16:57.689 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:16:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:16:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8370068380 msgr2=0x7f837006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8370068380 0x7f837006a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83840b2000 tx=0x7f8384008040 comp rx=0 tx=0).stop 2024-04-26T20:16:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83940c9010 msgr2=0x7f839414b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83940c9010 0x7f839414b070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f837c00d800 tx=0x7f837c00dcc0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 shutdown_connections 2024-04-26T20:16:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8370068380 0x7f837006a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8394153af0 0x7f83941efb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83940c9010 0x7f839414b070 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 --2- 172.21.15.16:0/3442451073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83940c7b80 0x7f83940ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 >> 172.21.15.16:0/3442451073 conn(0x7f839406c380 msgr2=0x7f83940c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 shutdown_connections 2024-04-26T20:16:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:57.689+0000 7f8399000640 1 -- 172.21.15.16:0/3442451073 wait complete. 2024-04-26T20:16:57.710 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-26T20:16:59.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:16:59.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.849+0000 7f86d5c00640 1 Processor -- start 2024-04-26T20:16:59.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.849+0000 7f86d5c00640 1 -- start start 2024-04-26T20:16:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86d5c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86d0152bc0 0x7f86d00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86d5c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 0x7f86d00c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86d5c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d0152fa0 con 0x7f86d00c9340 2024-04-26T20:16:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86d5c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f86d0159790 con 0x7f86d0152bc0 2024-04-26T20:16:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86d5c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f86d0158930 con 0x7f86d0073480 2024-04-26T20:16:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86c7e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f86d00c9340 0x7f86d0072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35882/0 (socket says 172.21.15.16:35882) 2024-04-26T20:16:59.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86c7e00640 1 -- 172.21.15.16:0/962214950 learned_addr learned my addr 172.21.15.16:0/962214950 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cf400640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 0x7f86d00c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cea00640 1 --2- 172.21.15.16:0/962214950 >> v2:172.21.15.192:3300/0 conn(0x7f86d0152bc0 0x7f86d00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365857910 0 0) 0x7f86d0152fa0 con 0x7f86d00c9340 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86b4005740 con 0x7f86d00c9340 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3100557111 0 0) 0x7f86b4005740 con 0x7f86d00c9340 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 msgr2=0x7f86d00c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 0x7f86d00c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 >> v2:172.21.15.192:3300/0 conn(0x7f86d0152bc0 msgr2=0x7f86d00c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 --2- 172.21.15.16:0/962214950 >> v2:172.21.15.192:3300/0 conn(0x7f86d0152bc0 0x7f86d00c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d0158c10 con 0x7f86d00c9340 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f86b8001680 con 0x7f86d00c9340 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 >> v1:172.21.15.16:6789/0 conn(0x7f86d00c9340 legacy=0x7f86d0072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:59.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86b4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4006a20 0x7f86b4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 0x7f86b40073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0159790 con 0x7f86b4005bd0 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0158930 con 0x7f86b4006a20 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f86b400dbe0 con 0x7f86d0073480 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cea00640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86b4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86c7e00640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4006a20 0x7f86b4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cf400640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 0x7f86b40073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cea00640 1 -- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 msgr2=0x7f86b40073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cea00640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d0073480 0x7f86b40073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cea00640 1 -- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4006a20 msgr2=0x7f86b4006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:16:59.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cea00640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86b4006a20 0x7f86b4006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:59.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.853+0000 7f86cea00640 1 -- 172.21.15.16:0/962214950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b4005740 con 0x7f86b4005bd0 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86cea00640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86b4005ff0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009ae0 tx=0x7f86c001c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c70a6b5fde0037e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b1070 con 0x7f86b4005bd0 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c00a4af0 con 0x7f86b4005bd0 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86ce000640 1 -- 172.21.15.16:0/962214950 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00096b0 con 0x7f86b4005bd0 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 -- 172.21.15.16:0/962214950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 msgr2=0x7f86b4005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 --2- 172.21.15.16:0/962214950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86b4005ff0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009ae0 tx=0x7f86c001c790 comp rx=0 tx=0).stop 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86cf400640 1 -- 172.21.15.16:0/962214950 reap_dead start 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 -- 172.21.15.16:0/962214950 shutdown_connections 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 -- 172.21.15.16:0/962214950 >> 172.21.15.16:0/962214950 conn(0x7f86d006c380 msgr2=0x7f86d006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:16:59.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 -- 172.21.15.16:0/962214950 shutdown_connections 2024-04-26T20:16:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 -- 172.21.15.16:0/962214950 wait complete. 2024-04-26T20:16:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 Processor -- start 2024-04-26T20:16:59.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.857+0000 7f86d5c00640 1 -- start start 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86d01e3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d015bb50 0x7f86d015a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d01e1c50 0x7f86d00c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86d01594b0 con 0x7f86b4005bd0 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f86d01591d0 con 0x7f86d01e1c50 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f86d00c47d0 con 0x7f86d015bb50 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86d01e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86d01e3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32830/0 (socket says 172.21.15.16:32830) 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 -- 172.21.15.16:0/1631173964 learned_addr learned my addr 172.21.15.16:0/1631173964 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:16:59.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86c7e00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d015bb50 0x7f86d015a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cf400640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d01e1c50 0x7f86d00c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 -- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d015bb50 msgr2=0x7f86d015a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d015bb50 0x7f86d015a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 -- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d01e1c50 msgr2=0x7f86d00c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d01e1c50 0x7f86d00c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 -- 172.21.15.16:0/1631173964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d015c9b0 con 0x7f86b4005bd0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86cea00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86d01e3260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f86c001c5c0 tx=0x7f86b4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86c6a00640 1 -- 172.21.15.16:0/1631173964 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00b1040 con 0x7f86b4005bd0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86c6a00640 1 -- 172.21.15.16:0/1631173964 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c000f000 con 0x7f86b4005bd0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86c6a00640 1 -- 172.21.15.16:0/1631173964 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0004020 con 0x7f86b4005bd0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d015c410 con 0x7f86b4005bd0 2024-04-26T20:16:59.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d0159af0 con 0x7f86b4005bd0 2024-04-26T20:16:59.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.861+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d0077c20 con 0x7f86b4005bd0 2024-04-26T20:16:59.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.865+0000 7f86c6a00640 1 -- 172.21.15.16:0/1631173964 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86c00bf030 con 0x7f86b4005bd0 2024-04-26T20:16:59.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.865+0000 7f86c6a00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86ac0683b0 0x7f86ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:16:59.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.865+0000 7f86c6a00640 1 -- 172.21.15.16:0/1631173964 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f86c0120380 con 0x7f86b4005bd0 2024-04-26T20:16:59.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.865+0000 7f86c7e00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86ac0683b0 0x7f86ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:16:59.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.865+0000 7f86c7e00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86ac0683b0 0x7f86ac06a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f86d00c8fb0 tx=0x7f86b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:16:59.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:16:59.869+0000 7f86c6a00640 1 -- 172.21.15.16:0/1631173964 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f86c00c6060 con 0x7f86b4005bd0 2024-04-26T20:17:00.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.117+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86d00c9940 con 0x7f86b4005bd0 2024-04-26T20:17:00.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86c6a00640 1 -- 172.21.15.16:0/1631173964 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6878 (secure 0 0 0) 0x7f86c00167c0 con 0x7f86b4005bd0 2024-04-26T20:17:00.121 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:00.122 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:14:47.129019+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.16:6833/3670477050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3670477050},{"type":"v1","addr":"172.21.15.16:6833","nonce":3670477050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4267,4276,4279]},"id":1}]} 2024-04-26T20:17:00.122 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 14 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86ac0683b0 msgr2=0x7f86ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86ac0683b0 0x7f86ac06a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f86d00c8fb0 tx=0x7f86b8009040 comp rx=0 tx=0).stop 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 msgr2=0x7f86d01e3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86d01e3260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f86c001c5c0 tx=0x7f86b4007a50 comp rx=0 tx=0).stop 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 shutdown_connections 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f86ac0683b0 0x7f86ac06a870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86d01e1c50 0x7f86d00c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86d015bb50 0x7f86d015a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 --2- 172.21.15.16:0/1631173964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86b4005bd0 0x7f86d01e3260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:00.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 >> 172.21.15.16:0/1631173964 conn(0x7f86d006c380 msgr2=0x7f86d00c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:00.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 shutdown_connections 2024-04-26T20:17:00.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:00.121+0000 7f86d5c00640 1 -- 172.21.15.16:0/1631173964 wait complete. 2024-04-26T20:17:00.145 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-26T20:17:02.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.317+0000 7fe431400640 1 Processor -- start 2024-04-26T20:17:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.317+0000 7fe431400640 1 -- start start 2024-04-26T20:17:02.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.317+0000 7fe431400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe42c153cf0 0x7fe42c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.317+0000 7fe431400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c0ca880 con 0x7fe42c0c9e50 2024-04-26T20:17:02.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.317+0000 7fe431400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c1540d0 con 0x7fe42c15d560 2024-04-26T20:17:02.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.317+0000 7fe431400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fe42c15d0d0 con 0x7fe42c153cf0 2024-04-26T20:17:02.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe423e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe42c0c9e50 0x7fe42c071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35894/0 (socket says 172.21.15.16:35894) 2024-04-26T20:17:02.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe423e00640 1 -- 172.21.15.16:0/578766050 learned_addr learned my addr 172.21.15.16:0/578766050 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:17:02.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe42a800640 1 --2- 172.21.15.16:0/578766050 >> v2:172.21.15.192:3300/0 conn(0x7fe42c153cf0 0x7fe42c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe429e00640 1 -- 172.21.15.16:0/578766050 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653062225 0 0) 0x7fe414001120 con 0x7fe42c0c9e50 2024-04-26T20:17:02.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe429e00640 1 -- 172.21.15.16:0/578766050 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe410003530 con 0x7fe42c0c9e50 2024-04-26T20:17:02.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe42a800640 1 -- 172.21.15.16:0/578766050 >> v1:172.21.15.192:6789/0 conn(0x7fe42c15d560 legacy=0x7fe42c164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe429e00640 1 -- 172.21.15.16:0/578766050 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2911107787 0 0) 0x7fe410003530 con 0x7fe42c0c9e50 2024-04-26T20:17:02.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe42a800640 1 -- 172.21.15.16:0/578766050 >> v1:172.21.15.16:6789/0 conn(0x7fe42c0c9e50 legacy=0x7fe42c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.321+0000 7fe42a800640 1 -- 172.21.15.16:0/578766050 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c159d60 con 0x7fe42c153cf0 2024-04-26T20:17:02.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe42a800640 1 --2- 172.21.15.16:0/578766050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c153cf0 0x7fe42c0c62f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0097c0 tx=0x7fe41c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35628cb6dcab278 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:02.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe429e00640 1 -- 172.21.15.16:0/578766050 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0b0070 con 0x7fe42c153cf0 2024-04-26T20:17:02.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe429e00640 1 -- 172.21.15.16:0/578766050 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41c0ab400 con 0x7fe42c153cf0 2024-04-26T20:17:02.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe429e00640 1 -- 172.21.15.16:0/578766050 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414001850 con 0x7fe42c153cf0 2024-04-26T20:17:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe431400640 1 -- 172.21.15.16:0/578766050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c153cf0 msgr2=0x7fe42c0c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe431400640 1 --2- 172.21.15.16:0/578766050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c153cf0 0x7fe42c0c62f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0097c0 tx=0x7fe41c01c3c0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe431400640 1 -- 172.21.15.16:0/578766050 shutdown_connections 2024-04-26T20:17:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe431400640 1 --2- 172.21.15.16:0/578766050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c153cf0 0x7fe42c0c62f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.325+0000 7fe431400640 1 -- 172.21.15.16:0/578766050 >> 172.21.15.16:0/578766050 conn(0x7fe42c070550 msgr2=0x7fe42c06f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.329+0000 7fe431400640 1 -- 172.21.15.16:0/578766050 shutdown_connections 2024-04-26T20:17:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.329+0000 7fe431400640 1 -- 172.21.15.16:0/578766050 wait complete. 2024-04-26T20:17:02.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.329+0000 7fe431400640 1 Processor -- start 2024-04-26T20:17:02.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.329+0000 7fe431400640 1 -- start start 2024-04-26T20:17:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c0c9e50 0x7fe42c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe42c153cf0 0x7fe42c071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe42c15d560 0x7fe42c140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c15dd80 con 0x7fe42c15d560 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c15a5e0 con 0x7fe42c0c9e50 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c0ca280 con 0x7fe42c153cf0 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c0c9e50 0x7fe42c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe423e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe42c153cf0 0x7fe42c071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe423e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe42c153cf0 0x7fe42c071f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:56772/0 (socket says 172.21.15.16:56772) 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe423e00640 1 -- 172.21.15.16:0/1075715206 learned_addr learned my addr 172.21.15.16:0/1075715206 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42b200640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe42c15d560 0x7fe42c140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42b200640 1 -- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe42c153cf0 msgr2=0x7fe42c071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42b200640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe42c153cf0 0x7fe42c071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42b200640 1 -- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c0c9e50 msgr2=0x7fe42c152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42b200640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c0c9e50 0x7fe42c152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42b200640 1 -- 172.21.15.16:0/1075715206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c151560 con 0x7fe42c15d560 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe423e00640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe42c153cf0 0x7fe42c071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42a800640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c0c9e50 0x7fe42c152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe42b200640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe42c15d560 0x7fe42c140dd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c730 tx=0x7fe42400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe422a00640 1 -- 172.21.15.16:0/1075715206 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424003b80 con 0x7fe42c15d560 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe422a00640 1 -- 172.21.15.16:0/1075715206 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe424003d20 con 0x7fe42c15d560 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe422a00640 1 -- 172.21.15.16:0/1075715206 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424005310 con 0x7fe42c15d560 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c15ad80 con 0x7fe42c15d560 2024-04-26T20:17:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c151b00 con 0x7fe42c15d560 2024-04-26T20:17:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.333+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c077c20 con 0x7fe42c15d560 2024-04-26T20:17:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.337+0000 7fe422a00640 1 -- 172.21.15.16:0/1075715206 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4240056c0 con 0x7fe42c15d560 2024-04-26T20:17:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.337+0000 7fe422a00640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4080683b0 0x7fe40806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.337+0000 7fe422a00640 1 -- 172.21.15.16:0/1075715206 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fe424086d60 con 0x7fe42c15d560 2024-04-26T20:17:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.337+0000 7fe42a800640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4080683b0 0x7fe40806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.341+0000 7fe42a800640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4080683b0 0x7fe40806a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe42c070ae0 tx=0x7fe41c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:02.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.345+0000 7fe422a00640 1 -- 172.21.15.16:0/1075715206 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe4240567d0 con 0x7fe42c15d560 2024-04-26T20:17:02.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.597+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe42c0ccbc0 con 0x7fe42c15d560 2024-04-26T20:17:02.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe422a00640 1 -- 172.21.15.16:0/1075715206 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6049 (secure 0 0 0) 0x7fe424086090 con 0x7fe42c15d560 2024-04-26T20:17:02.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:02.601 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:00.827342+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:17:02.602 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 15 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4080683b0 msgr2=0x7fe40806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4080683b0 0x7fe40806a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe42c070ae0 tx=0x7fe41c008040 comp rx=0 tx=0).stop 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe42c15d560 msgr2=0x7fe42c140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe42c15d560 0x7fe42c140dd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c730 tx=0x7fe42400cbf0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 shutdown_connections 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fe4080683b0 0x7fe40806a870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe42c15d560 0x7fe42c140dd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe42c153cf0 0x7fe42c071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 --2- 172.21.15.16:0/1075715206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe42c0c9e50 0x7fe42c152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 >> 172.21.15.16:0/1075715206 conn(0x7fe42c070550 msgr2=0x7fe42c1580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 shutdown_connections 2024-04-26T20:17:02.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.601+0000 7fe431400640 1 -- 172.21.15.16:0/1075715206 wait complete. 2024-04-26T20:17:02.628 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2024-04-26T20:17:02.628 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-26T20:17:02.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:02.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d0f600640 1 Processor -- start 2024-04-26T20:17:02.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d0f600640 1 -- start start 2024-04-26T20:17:02.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d0f600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d081574b0 0x7f2d080ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d0f600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080cb7f0 con 0x7f2d080b47e0 2024-04-26T20:17:02.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d0f600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080ca0d0 con 0x7f2d080c63f0 2024-04-26T20:17:02.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d0f600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f2d080ccd80 con 0x7f2d081574b0 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d07e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2d080b47e0 0x7f2d0806feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35896/0 (socket says 172.21.15.16:35896) 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d07e00640 1 -- 172.21.15.16:0/1471157353 learned_addr learned my addr 172.21.15.16:0/1471157353 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d0cc00640 1 --2- 172.21.15.16:0/1471157353 >> v2:172.21.15.192:3300/0 conn(0x7f2d081574b0 0x7f2d080ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530413606 0 0) 0x7f2d080cb7f0 con 0x7f2d080b47e0 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.793+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf0003530 con 0x7f2d080b47e0 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.797+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888729713 0 0) 0x7f2d080ca0d0 con 0x7f2d080c63f0 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.797+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d080cb7f0 con 0x7f2d080c63f0 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.797+0000 7f2d0cc00640 1 -- 172.21.15.16:0/1471157353 >> v1:172.21.15.192:6789/0 conn(0x7f2d080c63f0 legacy=0x7f2d08164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.797+0000 7f2d0cc00640 1 -- 172.21.15.16:0/1471157353 >> v1:172.21.15.16:6789/0 conn(0x7f2d080b47e0 legacy=0x7f2d0806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.797+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3176278376 0 0) 0x7f2cf0003530 con 0x7f2d080b47e0 2024-04-26T20:17:02.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.797+0000 7f2d0cc00640 1 -- 172.21.15.16:0/1471157353 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d080cba90 con 0x7f2d081574b0 2024-04-26T20:17:02.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0cc00640 1 --2- 172.21.15.16:0/1471157353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d081574b0 0x7f2d080ca730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0097c0 tx=0x7f2cfc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17477cd64f8c3309 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:02.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0b0070 con 0x7f2d081574b0 2024-04-26T20:17:02.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0ab400 con 0x7f2d081574b0 2024-04-26T20:17:02.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d07400640 1 -- 172.21.15.16:0/1471157353 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4001680 con 0x7f2d081574b0 2024-04-26T20:17:02.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 -- 172.21.15.16:0/1471157353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d081574b0 msgr2=0x7f2d080ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1471157353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d081574b0 0x7f2d080ca730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0097c0 tx=0x7f2cfc01c3c0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 -- 172.21.15.16:0/1471157353 shutdown_connections 2024-04-26T20:17:02.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1471157353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d081574b0 0x7f2d080ca730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 -- 172.21.15.16:0/1471157353 >> 172.21.15.16:0/1471157353 conn(0x7f2d08071160 msgr2=0x7f2d08068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:02.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 -- 172.21.15.16:0/1471157353 shutdown_connections 2024-04-26T20:17:02.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 -- 172.21.15.16:0/1471157353 wait complete. 2024-04-26T20:17:02.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 Processor -- start 2024-04-26T20:17:02.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.801+0000 7f2d0f600640 1 -- start start 2024-04-26T20:17:02.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d080b47e0 0x7f2d0814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d080c63f0 0x7f2d081519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d081574b0 0x7f2d080afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d08070740 con 0x7f2d080b47e0 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2d080705c0 con 0x7f2d080c63f0 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2d08168460 con 0x7f2d081574b0 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d080b47e0 0x7f2d0814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d080b47e0 0x7f2d0814ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32854/0 (socket says 172.21.15.16:32854) 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 -- 172.21.15.16:0/1979701711 learned_addr learned my addr 172.21.15.16:0/1979701711 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d07e00640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d080c63f0 0x7f2d081519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0d600640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d081574b0 0x7f2d080afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 -- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d081574b0 msgr2=0x7f2d080afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d081574b0 0x7f2d080afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 -- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d080c63f0 msgr2=0x7f2d081519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:02.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d080c63f0 0x7f2d081519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:02.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 -- 172.21.15.16:0/1979701711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d080ceec0 con 0x7f2d080b47e0 2024-04-26T20:17:02.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0cc00640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d080b47e0 0x7f2d0814ff20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc018fd0 tx=0x7f2cfc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d04c00640 1 -- 172.21.15.16:0/1979701711 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0b9020 con 0x7f2d080b47e0 2024-04-26T20:17:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d04c00640 1 -- 172.21.15.16:0/1979701711 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc003820 con 0x7f2d080b47e0 2024-04-26T20:17:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d04c00640 1 -- 172.21.15.16:0/1979701711 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0b0040 con 0x7f2d080b47e0 2024-04-26T20:17:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d080cf180 con 0x7f2d080b47e0 2024-04-26T20:17:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d08157d60 con 0x7f2d080b47e0 2024-04-26T20:17:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.805+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d08077c20 con 0x7f2d080b47e0 2024-04-26T20:17:02.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.809+0000 7f2d04c00640 1 -- 172.21.15.16:0/1979701711 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cfc0bc020 con 0x7f2d080b47e0 2024-04-26T20:17:02.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.809+0000 7f2d04c00640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2ce8068380 0x7f2ce806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:02.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.809+0000 7f2d04c00640 1 -- 172.21.15.16:0/1979701711 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f2cfc120c20 con 0x7f2d080b47e0 2024-04-26T20:17:02.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.809+0000 7f2d07e00640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2ce8068380 0x7f2ce806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:02.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.809+0000 7f2d07e00640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2ce8068380 0x7f2ce806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d080b2600 tx=0x7f2cf4000fa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:02.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:02.813+0000 7f2d04c00640 1 -- 172.21.15.16:0/1979701711 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2cfc0c3030 con 0x7f2d080b47e0 2024-04-26T20:17:03.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.025+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d080729e0 con 0x7f2d080b47e0 2024-04-26T20:17:03.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.025+0000 7f2d04c00640 1 -- 172.21.15.16:0/1979701711 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6049 (secure 0 0 0) 0x7f2cfc015fb0 con 0x7f2d080b47e0 2024-04-26T20:17:03.029 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:03.029 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:00.827342+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:17:03.029 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 15 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2ce8068380 msgr2=0x7f2ce806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2ce8068380 0x7f2ce806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d080b2600 tx=0x7f2cf4000fa0 comp rx=0 tx=0).stop 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d080b47e0 msgr2=0x7f2d0814ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d080b47e0 0x7f2d0814ff20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc018fd0 tx=0x7f2cfc019160 comp rx=0 tx=0).stop 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 shutdown_connections 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2ce8068380 0x7f2ce806a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d081574b0 0x7f2d080afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d080c63f0 0x7f2d081519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 --2- 172.21.15.16:0/1979701711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d080b47e0 0x7f2d0814ff20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 >> 172.21.15.16:0/1979701711 conn(0x7f2d08071160 msgr2=0x7f2d080b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:03.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 shutdown_connections 2024-04-26T20:17:03.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:03.029+0000 7f2d0f600640 1 -- 172.21.15.16:0/1979701711 wait complete. 2024-04-26T20:17:03.050 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 15, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 15, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4261": { "addr": "172.21.15.192:6838/2295577139", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6836", "nonce": 2295577139, "type": "v2" }, { "addr": "172.21.15.192:6838", "nonce": 2295577139, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4261, "incarnation": 15, "join_fscid": -1, "name": "b", "rank": 2, "state": "up:replay", "state_seq": 1 }, "gid_4276": { "addr": "172.21.15.16:6836/1882507975", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6834", "nonce": 1882507975, "type": "v2" }, { "addr": "172.21.15.16:6836", "nonce": 1882507975, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4276, "incarnation": 9, "join_fscid": -1, "name": "c", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4279": { "addr": "172.21.15.16:6837/1962586875", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6835", "nonce": 1962586875, "type": "v2" }, { "addr": "172.21.15.16:6837", "nonce": 1962586875, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4279, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 5 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:17:00.827342+0000", "qdb_cluster": [ 4276, 4279 ], "qdb_leader": 4279, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4279, "mds_1": 4276, "mds_2": 4261 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:17:05.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:05.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78bb200640 1 Processor -- start 2024-04-26T20:17:05.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78bb200640 1 -- start start 2024-04-26T20:17:05.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78bb200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78b40c62f0 0x7f78b40c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78bb200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78b415d560 0x7f78b415d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78bb200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b40ca880 con 0x7f78b4153cf0 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78bb200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f78b415d0d0 con 0x7f78b40c62f0 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78bb200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f78b40ca390 con 0x7f78b415d560 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78ab400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78b40c62f0 0x7f78b40c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78ab400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78b40c62f0 0x7f78b40c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45482/0 (socket says 172.21.15.16:45482) 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78ab400640 1 -- 172.21.15.16:0/2076401802 learned_addr learned my addr 172.21.15.16:0/2076401802 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78b9200640 1 --2- 172.21.15.16:0/2076401802 >> v2:172.21.15.192:3300/0 conn(0x7f78b415d560 0x7f78b415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78ab400640 1 -- 172.21.15.16:0/2076401802 >> v2:172.21.15.192:3300/0 conn(0x7f78b415d560 msgr2=0x7f78b415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78ab400640 1 --2- 172.21.15.16:0/2076401802 >> v2:172.21.15.192:3300/0 conn(0x7f78b415d560 0x7f78b415d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78ab400640 1 -- 172.21.15.16:0/2076401802 >> v1:172.21.15.192:6789/0 conn(0x7f78b4153cf0 legacy=0x7f78b4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.205+0000 7f78ab400640 1 -- 172.21.15.16:0/2076401802 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b41540d0 con 0x7f78b40c62f0 2024-04-26T20:17:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78ab400640 1 --2- 172.21.15.16:0/2076401802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b40c62f0 0x7f78b40c9e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f78b415d040 tx=0x7f789c01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874888a3b8e58012 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78b3400640 1 -- 172.21.15.16:0/2076401802 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0b0070 con 0x7f78b40c62f0 2024-04-26T20:17:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78b3400640 1 -- 172.21.15.16:0/2076401802 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c0ab600 con 0x7f78b40c62f0 2024-04-26T20:17:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78b3400640 1 -- 172.21.15.16:0/2076401802 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0ab9d0 con 0x7f78b40c62f0 2024-04-26T20:17:05.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 -- 172.21.15.16:0/2076401802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b40c62f0 msgr2=0x7f78b40c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:05.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 --2- 172.21.15.16:0/2076401802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b40c62f0 0x7f78b40c9e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f78b415d040 tx=0x7f789c01c300 comp rx=0 tx=0).stop 2024-04-26T20:17:05.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 -- 172.21.15.16:0/2076401802 shutdown_connections 2024-04-26T20:17:05.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 --2- 172.21.15.16:0/2076401802 >> v2:172.21.15.192:3300/0 conn(0x7f78b415d560 0x7f78b415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 --2- 172.21.15.16:0/2076401802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b40c62f0 0x7f78b40c9e50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 -- 172.21.15.16:0/2076401802 >> 172.21.15.16:0/2076401802 conn(0x7f78b4070550 msgr2=0x7f78b406f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:05.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 -- 172.21.15.16:0/2076401802 shutdown_connections 2024-04-26T20:17:05.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.209+0000 7f78bb200640 1 -- 172.21.15.16:0/2076401802 wait complete. 2024-04-26T20:17:05.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 Processor -- start 2024-04-26T20:17:05.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 -- start start 2024-04-26T20:17:05.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78b40c62f0 0x7f78b4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78b4153cf0 0x7f78b40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b415d560 0x7f78b406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f78b415a5e0 con 0x7f78b415d560 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78b415a300 con 0x7f78b4153cf0 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f78b41599b0 con 0x7f78b40c62f0 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b415d560 0x7f78b406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b415d560 0x7f78b406d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45492/0 (socket says 172.21.15.16:45492) 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 -- 172.21.15.16:0/108457302 learned_addr learned my addr 172.21.15.16:0/108457302 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78ab400640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78b4153cf0 0x7f78b40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b3e00640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78b40c62f0 0x7f78b4158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:05.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 -- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78b40c62f0 msgr2=0x7f78b4158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78b40c62f0 0x7f78b4158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 -- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78b4153cf0 msgr2=0x7f78b40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78b4153cf0 0x7f78b40cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 -- 172.21.15.16:0/108457302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b40cc2e0 con 0x7f78b415d560 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b9200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b415d560 0x7f78b406d680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007e40 tx=0x7f78ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b0c00640 1 -- 172.21.15.16:0/108457302 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac014620 con 0x7f78b415d560 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b0c00640 1 -- 172.21.15.16:0/108457302 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ac019070 con 0x7f78b415d560 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78b0c00640 1 -- 172.21.15.16:0/108457302 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac014a20 con 0x7f78b415d560 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b4162830 con 0x7f78b415d560 2024-04-26T20:17:05.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b41f8020 con 0x7f78b415d560 2024-04-26T20:17:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.213+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b4077c20 con 0x7f78b415d560 2024-04-26T20:17:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.217+0000 7f78b0c00640 1 -- 172.21.15.16:0/108457302 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f78ac014bc0 con 0x7f78b415d560 2024-04-26T20:17:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.217+0000 7f78b0c00640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7890068380 0x7f789006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.217+0000 7f78b0c00640 1 -- 172.21.15.16:0/108457302 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f78ac087760 con 0x7f78b415d560 2024-04-26T20:17:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.217+0000 7f78b3e00640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7890068380 0x7f789006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:05.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.217+0000 7f78b3e00640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7890068380 0x7f789006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f78a4004e30 tx=0x7f78a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:05.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.221+0000 7f78b0c00640 1 -- 172.21.15.16:0/108457302 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f78ac057820 con 0x7f78b415d560 2024-04-26T20:17:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.421+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78b40ccbc0 con 0x7f78b415d560 2024-04-26T20:17:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.421+0000 7f78b0c00640 1 -- 172.21.15.16:0/108457302 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6049 (secure 0 0 0) 0x7f78ac057120 con 0x7f78b415d560 2024-04-26T20:17:05.424 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:05.424 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:00.827342+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:17:05.424 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 15 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7890068380 msgr2=0x7f789006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7890068380 0x7f789006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f78a4004e30 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b415d560 msgr2=0x7f78b406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b415d560 0x7f78b406d680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007e40 tx=0x7f78ac00e4b0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 shutdown_connections 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7890068380 0x7f789006a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78b415d560 0x7f78b406d680 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78b4153cf0 0x7f78b40cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 --2- 172.21.15.16:0/108457302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78b40c62f0 0x7f78b4158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 >> 172.21.15.16:0/108457302 conn(0x7f78b4070550 msgr2=0x7f78b4157820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 shutdown_connections 2024-04-26T20:17:05.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:05.425+0000 7f78bb200640 1 -- 172.21.15.16:0/108457302 wait complete. 2024-04-26T20:17:05.445 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:07.445 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:07.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5c800640 1 Processor -- start 2024-04-26T20:17:07.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5c800640 1 -- start start 2024-04-26T20:17:07.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5c800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5c54152bc0 0x7f5c540c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:07.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5c800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c540c9340 0x7f5c54072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:07.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5c800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c54152fa0 con 0x7f5c540732b0 2024-04-26T20:17:07.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5c800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5c54073700 con 0x7f5c54152bc0 2024-04-26T20:17:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5c800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f5c54159790 con 0x7f5c540c9340 2024-04-26T20:17:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5a800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5c540732b0 0x7f5c540c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51168/0 (socket says 172.21.15.16:51168) 2024-04-26T20:17:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c5a800640 1 -- 172.21.15.16:0/4183045094 learned_addr learned my addr 172.21.15.16:0/4183045094 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:17:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.597+0000 7f5c59e00640 1 --2- 172.21.15.16:0/4183045094 >> v2:172.21.15.16:3300/0 conn(0x7f5c54152bc0 0x7f5c540c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c59400640 1 --2- 172.21.15.16:0/4183045094 >> v2:172.21.15.192:3300/0 conn(0x7f5c540c9340 0x7f5c54072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c59e00640 1 -- 172.21.15.16:0/4183045094 >> v2:172.21.15.192:3300/0 conn(0x7f5c540c9340 msgr2=0x7f5c54072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:07.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c59e00640 1 --2- 172.21.15.16:0/4183045094 >> v2:172.21.15.192:3300/0 conn(0x7f5c540c9340 0x7f5c54072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c59e00640 1 -- 172.21.15.16:0/4183045094 >> v1:172.21.15.16:6789/0 conn(0x7f5c540732b0 legacy=0x7f5c540c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:07.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c59e00640 1 -- 172.21.15.16:0/4183045094 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c54158930 con 0x7f5c54152bc0 2024-04-26T20:17:07.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c58a00640 1 -- 172.21.15.16:0/4183045094 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337169534 0 0) 0x7f5c54152fa0 con 0x7f5c540732b0 2024-04-26T20:17:07.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c59e00640 1 --2- 172.21.15.16:0/4183045094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c54152bc0 0x7f5c540c8e00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5c54071cb0 tx=0x7f5c4801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d95f730cad7e72a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:07.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c58a00640 1 -- 172.21.15.16:0/4183045094 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480b5070 con 0x7f5c54152bc0 2024-04-26T20:17:07.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c58a00640 1 -- 172.21.15.16:0/4183045094 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c480a8970 con 0x7f5c54152bc0 2024-04-26T20:17:07.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.601+0000 7f5c58a00640 1 -- 172.21.15.16:0/4183045094 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480a8d40 con 0x7f5c54152bc0 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- 172.21.15.16:0/4183045094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c54152bc0 msgr2=0x7f5c540c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4183045094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c54152bc0 0x7f5c540c8e00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5c54071cb0 tx=0x7f5c4801ec70 comp rx=0 tx=0).stop 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- 172.21.15.16:0/4183045094 shutdown_connections 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4183045094 >> v2:172.21.15.192:3300/0 conn(0x7f5c540c9340 0x7f5c54072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4183045094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c54152bc0 0x7f5c540c8e00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- 172.21.15.16:0/4183045094 >> 172.21.15.16:0/4183045094 conn(0x7f5c5406c380 msgr2=0x7f5c5406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- 172.21.15.16:0/4183045094 shutdown_connections 2024-04-26T20:17:07.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- 172.21.15.16:0/4183045094 wait complete. 2024-04-26T20:17:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 Processor -- start 2024-04-26T20:17:07.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- start start 2024-04-26T20:17:07.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c540732b0 0x7f5c541f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:07.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c540c9340 0x7f5c541489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c54152bc0 0x7f5c541f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5c541591d0 con 0x7f5c540c9340 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54158ef0 con 0x7f5c54152bc0 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5c800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5c541594b0 con 0x7f5c540732b0 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c540c9340 0x7f5c541489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c540c9340 0x7f5c541489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45508/0 (socket says 172.21.15.16:45508) 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 -- 172.21.15.16:0/4216327473 learned_addr learned my addr 172.21.15.16:0/4216327473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5a800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c54152bc0 0x7f5c541f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:07.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59e00640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c540732b0 0x7f5c541f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:07.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 -- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c540732b0 msgr2=0x7f5c541f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:07.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c540732b0 0x7f5c541f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 -- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c54152bc0 msgr2=0x7f5c541f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c54152bc0 0x7f5c541f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 -- 172.21.15.16:0/4216327473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c54143530 con 0x7f5c540c9340 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c5a800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c54152bc0 0x7f5c541f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.605+0000 7f5c59400640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c540c9340 0x7f5c541489c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d800 tx=0x7f5c4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c4e000640 1 -- 172.21.15.16:0/4216327473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400b6c0 con 0x7f5c540c9340 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c4e000640 1 -- 172.21.15.16:0/4216327473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c44019070 con 0x7f5c540c9340 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c4e000640 1 -- 172.21.15.16:0/4216327473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400ba60 con 0x7f5c540c9340 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c54143810 con 0x7f5c540c9340 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c54143230 con 0x7f5c540c9340 2024-04-26T20:17:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c54077c20 con 0x7f5c540c9340 2024-04-26T20:17:07.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c4e000640 1 -- 172.21.15.16:0/4216327473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c4400bc00 con 0x7f5c540c9340 2024-04-26T20:17:07.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c4e000640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5c38068380 0x7f5c3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:07.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c4e000640 1 -- 172.21.15.16:0/4216327473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f5c44087380 con 0x7f5c540c9340 2024-04-26T20:17:07.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.609+0000 7f5c59e00640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5c38068380 0x7f5c3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:07.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.613+0000 7f5c59e00640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5c38068380 0x7f5c3806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5c480b2000 tx=0x7f5c48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:07.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.613+0000 7f5c4e000640 1 -- 172.21.15.16:0/4216327473 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c440573b0 con 0x7f5c540c9340 2024-04-26T20:17:07.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.817+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c540c70f0 con 0x7f5c540c9340 2024-04-26T20:17:07.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.817+0000 7f5c4e000640 1 -- 172.21.15.16:0/4216327473 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6051 (secure 0 0 0) 0x7f5c44056cb0 con 0x7f5c540c9340 2024-04-26T20:17:07.820 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:07.820 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:05.860699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:resolve","state_seq":46,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:17:07.820 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 16 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5c38068380 msgr2=0x7f5c3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5c38068380 0x7f5c3806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5c480b2000 tx=0x7f5c48008040 comp rx=0 tx=0).stop 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c540c9340 msgr2=0x7f5c541489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c540c9340 0x7f5c541489c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d800 tx=0x7f5c4400dcc0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 shutdown_connections 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5c38068380 0x7f5c3806a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c54152bc0 0x7f5c541f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c540c9340 0x7f5c541489c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 --2- 172.21.15.16:0/4216327473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c540732b0 0x7f5c541f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:07.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 >> 172.21.15.16:0/4216327473 conn(0x7f5c5406c380 msgr2=0x7f5c540c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:07.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 shutdown_connections 2024-04-26T20:17:07.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:07.821+0000 7f5c5c800640 1 -- 172.21.15.16:0/4216327473 wait complete. 2024-04-26T20:17:07.841 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:09.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:09.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4531e00640 1 Processor -- start 2024-04-26T20:17:09.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4531e00640 1 -- start start 2024-04-26T20:17:09.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4531e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c1594f0 0x7f452c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:09.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4531e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f452c15ca90 0x7f452c070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:09.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4531e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452c160240 con 0x7f452c0712e0 2024-04-26T20:17:09.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4531e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f452c1598d0 con 0x7f452c15ca90 2024-04-26T20:17:09.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4531e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f452c15f6c0 con 0x7f452c1594f0 2024-04-26T20:17:09.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f452b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f452c0712e0 0x7f452c0ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51174/0 (socket says 172.21.15.16:51174) 2024-04-26T20:17:09.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4522000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f452c15ca90 0x7f452c070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:09.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f452b400640 1 -- 172.21.15.16:0/3078706565 learned_addr learned my addr 172.21.15.16:0/3078706565 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:17:09.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f452aa00640 1 --2- 172.21.15.16:0/3078706565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c1594f0 0x7f452c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:09.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f452a000640 1 -- 172.21.15.16:0/3078706565 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 894519290 0 0) 0x7f452c160240 con 0x7f452c0712e0 2024-04-26T20:17:09.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f452a000640 1 -- 172.21.15.16:0/3078706565 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4510003530 con 0x7f452c0712e0 2024-04-26T20:17:09.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4522000640 1 -- 172.21.15.16:0/3078706565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c1594f0 msgr2=0x7f452c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:09.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4522000640 1 --2- 172.21.15.16:0/3078706565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c1594f0 0x7f452c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:09.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4522000640 1 -- 172.21.15.16:0/3078706565 >> v1:172.21.15.16:6789/0 conn(0x7f452c0712e0 legacy=0x7f452c0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:09.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.985+0000 7f4522000640 1 -- 172.21.15.16:0/3078706565 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c15f9a0 con 0x7f452c15ca90 2024-04-26T20:17:09.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4522000640 1 --2- 172.21.15.16:0/3078706565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c15ca90 0x7f452c070da0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f45140097c0 tx=0x7f451401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806b1d97ef1d638f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:09.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f452a000640 1 -- 172.21.15.16:0/3078706565 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45140b5070 con 0x7f452c15ca90 2024-04-26T20:17:09.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f452a000640 1 -- 172.21.15.16:0/3078706565 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45140a8990 con 0x7f452c15ca90 2024-04-26T20:17:09.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f452a000640 1 -- 172.21.15.16:0/3078706565 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45140a8d60 con 0x7f452c15ca90 2024-04-26T20:17:09.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 -- 172.21.15.16:0/3078706565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c15ca90 msgr2=0x7f452c070da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:09.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 --2- 172.21.15.16:0/3078706565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c15ca90 0x7f452c070da0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f45140097c0 tx=0x7f451401ec90 comp rx=0 tx=0).stop 2024-04-26T20:17:09.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 -- 172.21.15.16:0/3078706565 shutdown_connections 2024-04-26T20:17:09.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 --2- 172.21.15.16:0/3078706565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c15ca90 0x7f452c070da0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:09.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 --2- 172.21.15.16:0/3078706565 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c1594f0 0x7f452c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:09.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 -- 172.21.15.16:0/3078706565 >> 172.21.15.16:0/3078706565 conn(0x7f452c0ce2c0 msgr2=0x7f452c0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:09.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 -- 172.21.15.16:0/3078706565 shutdown_connections 2024-04-26T20:17:09.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.989+0000 7f4531e00640 1 -- 172.21.15.16:0/3078706565 wait complete. 2024-04-26T20:17:09.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 Processor -- start 2024-04-26T20:17:09.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 -- start start 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f452c0712e0 0x7f452c0be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c1594f0 0x7f452c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c15ca90 0x7f452c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f452c0c9c50 con 0x7f452c1594f0 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f452c15ff60 con 0x7f452c0712e0 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f452c15f360 con 0x7f452c15ca90 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c1594f0 0x7f452c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c1594f0 0x7f452c15bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45518/0 (socket says 172.21.15.16:45518) 2024-04-26T20:17:09.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 -- 172.21.15.16:0/1935105797 learned_addr learned my addr 172.21.15.16:0/1935105797 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f452aa00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f452c0712e0 0x7f452c0be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f452b400640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c15ca90 0x7f452c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 -- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c15ca90 msgr2=0x7f452c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c15ca90 0x7f452c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 -- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f452c0712e0 msgr2=0x7f452c0be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f452c0712e0 0x7f452c0be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 -- 172.21.15.16:0/1935105797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c15b350 con 0x7f452c1594f0 2024-04-26T20:17:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4522000640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c1594f0 0x7f452c15bae0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f451401c8c0 tx=0x7f451401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4523e00640 1 -- 172.21.15.16:0/1935105797 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45140bf070 con 0x7f452c1594f0 2024-04-26T20:17:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4523e00640 1 -- 172.21.15.16:0/1935105797 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45140b0700 con 0x7f452c1594f0 2024-04-26T20:17:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4523e00640 1 -- 172.21.15.16:0/1935105797 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45140b5040 con 0x7f452c1594f0 2024-04-26T20:17:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452c15aab0 con 0x7f452c1594f0 2024-04-26T20:17:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.993+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452c15b070 con 0x7f452c1594f0 2024-04-26T20:17:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.997+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452c077c20 con 0x7f452c1594f0 2024-04-26T20:17:09.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.997+0000 7f4523e00640 1 -- 172.21.15.16:0/1935105797 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45140b0af0 con 0x7f452c1594f0 2024-04-26T20:17:09.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.997+0000 7f4523e00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4508068380 0x7f450806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:09.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.997+0000 7f4523e00640 1 -- 172.21.15.16:0/1935105797 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f4514123630 con 0x7f452c1594f0 2024-04-26T20:17:09.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:09.997+0000 7f452aa00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4508068380 0x7f450806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:10.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.001+0000 7f452aa00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4508068380 0x7f450806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f451c009af0 tx=0x7f451c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:10.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.001+0000 7f4523e00640 1 -- 172.21.15.16:0/1935105797 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f45140187f0 con 0x7f452c1594f0 2024-04-26T20:17:10.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.201+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f452c0c9990 con 0x7f452c1594f0 2024-04-26T20:17:10.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.201+0000 7f4523e00640 1 -- 172.21.15.16:0/1935105797 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+6051 (secure 0 0 0) 0x7f45140f3780 con 0x7f452c1594f0 2024-04-26T20:17:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:10.203 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:05.860699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:resolve","state_seq":46,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:17:10.204 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 16 2024-04-26T20:17:10.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4508068380 msgr2=0x7f450806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4508068380 0x7f450806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f451c009af0 tx=0x7f451c008040 comp rx=0 tx=0).stop 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c1594f0 msgr2=0x7f452c15bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c1594f0 0x7f452c15bae0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f451401c8c0 tx=0x7f451401ba30 comp rx=0 tx=0).stop 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 shutdown_connections 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4508068380 0x7f450806a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f452c15ca90 0x7f452c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f452c1594f0 0x7f452c15bae0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 --2- 172.21.15.16:0/1935105797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f452c0712e0 0x7f452c0be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 >> 172.21.15.16:0/1935105797 conn(0x7f452c0ce2c0 msgr2=0x7f452c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 shutdown_connections 2024-04-26T20:17:10.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:10.205+0000 7f4531e00640 1 -- 172.21.15.16:0/1935105797 wait complete. 2024-04-26T20:17:10.224 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:12.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.373+0000 7fd414400640 1 Processor -- start 2024-04-26T20:17:12.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd414400640 1 -- start start 2024-04-26T20:17:12.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd414400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c0c7b80 0x7fd40c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd414400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd40c0c9010 0x7fd40c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd414400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40c0c99e0 con 0x7fd40c153af0 2024-04-26T20:17:12.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd414400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fd40c15dec0 con 0x7fd40c0c9010 2024-04-26T20:17:12.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd414400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c0ca630 con 0x7fd40c0c7b80 2024-04-26T20:17:12.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd40c153af0 0x7fd40c15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51188/0 (socket says 172.21.15.16:51188) 2024-04-26T20:17:12.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411a00640 1 -- 172.21.15.16:0/1705692190 learned_addr learned my addr 172.21.15.16:0/1705692190 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd412400640 1 --2- 172.21.15.16:0/1705692190 >> v2:172.21.15.192:3300/0 conn(0x7fd40c0c9010 0x7fd40c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411000640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c0c7b80 0x7fd40c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112457111 0 0) 0x7fd400001120 con 0x7fd40c153af0 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f4003530 con 0x7fd40c153af0 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 923771041 0 0) 0x7fd3f4003530 con 0x7fd40c153af0 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c0c7b80 msgr2=0x7fd40c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c0c7b80 0x7fd40c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 >> v2:172.21.15.192:3300/0 conn(0x7fd40c0c9010 msgr2=0x7fd40c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 --2- 172.21.15.16:0/1705692190 >> v2:172.21.15.192:3300/0 conn(0x7fd40c0c9010 0x7fd40c0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c0c9d90 con 0x7fd40c153af0 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fd400001850 con 0x7fd40c153af0 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 >> v1:172.21.15.16:6789/0 conn(0x7fd40c153af0 legacy=0x7fd40c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:12.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3f40039c0 0x7fd3f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd3f4004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f4004f00 0x7fd3f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c15dec0 con 0x7fd3f40043b0 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c0ca630 con 0x7fd3f4004f00 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f400bf10 con 0x7fd3f40039c0 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411000640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd3f4004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd412400640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f4004f00 0x7fd3f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411a00640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3f40039c0 0x7fd3f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411000640 1 -- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3f40039c0 msgr2=0x7fd3f4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411000640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3f40039c0 0x7fd3f4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411000640 1 -- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f4004f00 msgr2=0x7fd3f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411000640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f4004f00 0x7fd3f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.377+0000 7fd411000640 1 -- 172.21.15.16:0/1705692190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f4003530 con 0x7fd3f40043b0 2024-04-26T20:17:12.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd411000640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd3f4004890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80099a0 tx=0x7fd3f801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b90f9e6a7cad64c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:12.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80b2070 con 0x7fd3f40043b0 2024-04-26T20:17:12.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f80a5520 con 0x7fd3f40043b0 2024-04-26T20:17:12.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd40be00640 1 -- 172.21.15.16:0/1705692190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8009670 con 0x7fd3f40043b0 2024-04-26T20:17:12.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd414400640 1 -- 172.21.15.16:0/1705692190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 msgr2=0x7fd3f4004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:12.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd414400640 1 --2- 172.21.15.16:0/1705692190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd3f4004890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80099a0 tx=0x7fd3f801c930 comp rx=0 tx=0).stop 2024-04-26T20:17:12.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd412400640 1 -- 172.21.15.16:0/1705692190 reap_dead start 2024-04-26T20:17:12.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd414400640 1 -- 172.21.15.16:0/1705692190 shutdown_connections 2024-04-26T20:17:12.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd414400640 1 -- 172.21.15.16:0/1705692190 >> 172.21.15.16:0/1705692190 conn(0x7fd40c06c380 msgr2=0x7fd40c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:12.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd414400640 1 -- 172.21.15.16:0/1705692190 shutdown_connections 2024-04-26T20:17:12.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.381+0000 7fd414400640 1 -- 172.21.15.16:0/1705692190 wait complete. 2024-04-26T20:17:12.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 Processor -- start 2024-04-26T20:17:12.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 -- start start 2024-04-26T20:17:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd40c1f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c1f2f40 0x7fd40c14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40c0c5120 0x7fd40c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c15cfb0 con 0x7fd3f40043b0 2024-04-26T20:17:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c0ca350 con 0x7fd40c0c5120 2024-04-26T20:17:12.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c15d290 con 0x7fd40c1f2f40 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd40c1f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd40c1f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45534/0 (socket says 172.21.15.16:45534) 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 -- 172.21.15.16:0/3733858918 learned_addr learned my addr 172.21.15.16:0/3733858918 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd412400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40c0c5120 0x7fd40c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411000640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c1f2f40 0x7fd40c14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 -- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c1f2f40 msgr2=0x7fd40c14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c1f2f40 0x7fd40c14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 -- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40c0c5120 msgr2=0x7fd40c14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40c0c5120 0x7fd40c14fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 -- 172.21.15.16:0/3733858918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c1f3480 con 0x7fd3f40043b0 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd412400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40c0c5120 0x7fd40c14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411000640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c1f2f40 0x7fd40c14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd411a00640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd40c1f2a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd40000e7b0 tx=0x7fd40000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd409600640 1 -- 172.21.15.16:0/3733858918 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40000c660 con 0x7fd3f40043b0 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd409600640 1 -- 172.21.15.16:0/3733858918 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd400018070 con 0x7fd3f40043b0 2024-04-26T20:17:12.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd409600640 1 -- 172.21.15.16:0/3733858918 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40000ca80 con 0x7fd3f40043b0 2024-04-26T20:17:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c14edf0 con 0x7fd3f40043b0 2024-04-26T20:17:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c14f3b0 con 0x7fd3f40043b0 2024-04-26T20:17:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.385+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40c077c20 con 0x7fd3f40043b0 2024-04-26T20:17:12.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.389+0000 7fd409600640 1 -- 172.21.15.16:0/3733858918 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd40000cc20 con 0x7fd3f40043b0 2024-04-26T20:17:12.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.389+0000 7fd409600640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd3ec0683b0 0x7fd3ec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:12.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.389+0000 7fd409600640 1 -- 172.21.15.16:0/3733858918 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fd400086920 con 0x7fd3f40043b0 2024-04-26T20:17:12.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.389+0000 7fd411000640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd3ec0683b0 0x7fd3ec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:12.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.389+0000 7fd411000640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd3ec0683b0 0x7fd3ec06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80af000 tx=0x7fd3f80046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:12.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.393+0000 7fd409600640 1 -- 172.21.15.16:0/3733858918 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd40c0c99e0 con 0x7fd3f40043b0 2024-04-26T20:17:12.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.597+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd40c14f580 con 0x7fd3f40043b0 2024-04-26T20:17:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.597+0000 7fd409600640 1 -- 172.21.15.16:0/3733858918 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7fd400056a70 con 0x7fd3f40043b0 2024-04-26T20:17:12.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:12.601 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:11.155743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":48,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:17:12.601 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T20:17:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd3ec0683b0 msgr2=0x7fd3ec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd3ec0683b0 0x7fd3ec06a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80af000 tx=0x7fd3f80046d0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 msgr2=0x7fd40c1f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd40c1f2a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd40000e7b0 tx=0x7fd40000ebb0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 shutdown_connections 2024-04-26T20:17:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd3ec0683b0 0x7fd3ec06a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40c0c5120 0x7fd40c14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40c1f2f40 0x7fd40c14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 --2- 172.21.15.16:0/3733858918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f40043b0 0x7fd40c1f2a00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 >> 172.21.15.16:0/3733858918 conn(0x7fd40c06c380 msgr2=0x7fd40c0cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 shutdown_connections 2024-04-26T20:17:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:12.601+0000 7fd414400640 1 -- 172.21.15.16:0/3733858918 wait complete. 2024-04-26T20:17:12.628 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:14.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:14.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.769+0000 7fdeebe00640 1 Processor -- start 2024-04-26T20:17:14.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.769+0000 7fdeebe00640 1 -- start start 2024-04-26T20:17:14.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeebe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdeec153a80 0x7fdeec0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeebe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdeec06e040 0x7fdeec0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeebe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec06f590 0x7fdeec0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeebe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdeec0c8ef0 con 0x7fdeec06e040 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeebe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fdeec0c8bc0 con 0x7fdeec153a80 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeebe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdeec06fb60 con 0x7fdeec06f590 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdeec06e040 0x7fdeec0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdeec06e040 0x7fdeec0c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45538/0 (socket says 172.21.15.16:45538) 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 -- 172.21.15.16:0/3575623629 learned_addr learned my addr 172.21.15.16:0/3575623629 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeeaa00640 1 --2- 172.21.15.16:0/3575623629 >> v2:172.21.15.192:3300/0 conn(0x7fdeec153a80 0x7fdeec0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdeeb400640 1 --2- 172.21.15.16:0/3575623629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec06f590 0x7fdeec0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 -- 172.21.15.16:0/3575623629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec06f590 msgr2=0x7fdeec0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 --2- 172.21.15.16:0/3575623629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec06f590 0x7fdeec0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 -- 172.21.15.16:0/3575623629 >> v2:172.21.15.192:3300/0 conn(0x7fdeec153a80 msgr2=0x7fdeec0702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:14.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 --2- 172.21.15.16:0/3575623629 >> v2:172.21.15.192:3300/0 conn(0x7fdeec153a80 0x7fdeec0702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 -- 172.21.15.16:0/3575623629 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec06c420 con 0x7fdeec06e040 2024-04-26T20:17:14.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.773+0000 7fdee3e00640 1 --2- 172.21.15.16:0/3575623629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec0c7830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0716b0 tx=0x7fded401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e611f4ceb17a2d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:14.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeea000640 1 -- 172.21.15.16:0/3575623629 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded40b5070 con 0x7fdeec06e040 2024-04-26T20:17:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeea000640 1 -- 172.21.15.16:0/3575623629 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded40a89d0 con 0x7fdeec06e040 2024-04-26T20:17:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeea000640 1 -- 172.21.15.16:0/3575623629 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded40a8da0 con 0x7fdeec06e040 2024-04-26T20:17:14.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- 172.21.15.16:0/3575623629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 msgr2=0x7fdeec0c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 --2- 172.21.15.16:0/3575623629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec0c7830 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0716b0 tx=0x7fded401ed10 comp rx=0 tx=0).stop 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- 172.21.15.16:0/3575623629 shutdown_connections 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 --2- 172.21.15.16:0/3575623629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec06f590 0x7fdeec0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 --2- 172.21.15.16:0/3575623629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec0c7830 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 --2- 172.21.15.16:0/3575623629 >> v2:172.21.15.192:3300/0 conn(0x7fdeec153a80 0x7fdeec0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- 172.21.15.16:0/3575623629 >> 172.21.15.16:0/3575623629 conn(0x7fdeec073470 msgr2=0x7fdeec070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- 172.21.15.16:0/3575623629 shutdown_connections 2024-04-26T20:17:14.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- 172.21.15.16:0/3575623629 wait complete. 2024-04-26T20:17:14.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 Processor -- start 2024-04-26T20:17:14.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- start start 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec06f590 0x7fdeec15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec153a80 0x7fdeec15c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec06c9e0 con 0x7fdeec06e040 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec06cb60 con 0x7fdeec06f590 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeebe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdeec153e60 con 0x7fdeec153a80 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45552/0 (socket says 172.21.15.16:45552) 2024-04-26T20:17:14.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeaa00640 1 -- 172.21.15.16:0/4186480078 learned_addr learned my addr 172.21.15.16:0/4186480078 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdee3e00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec06f590 0x7fdeec15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeb400640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec153a80 0x7fdeec15c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeaa00640 1 -- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec153a80 msgr2=0x7fdeec15c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeaa00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec153a80 0x7fdeec15c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeaa00640 1 -- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec06f590 msgr2=0x7fdeec15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.777+0000 7fdeeaa00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec06f590 0x7fdeec15c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdeeaa00640 1 -- 172.21.15.16:0/4186480078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec145e80 con 0x7fdeec06e040 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdee3e00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec06f590 0x7fdeec15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdeeaa00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec144490 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00d800 tx=0x7fdedc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdee2a00640 1 -- 172.21.15.16:0/4186480078 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00b6c0 con 0x7fdeec06e040 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdee2a00640 1 -- 172.21.15.16:0/4186480078 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc019070 con 0x7fdeec06e040 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdee2a00640 1 -- 172.21.15.16:0/4186480078 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00ba60 con 0x7fdeec06e040 2024-04-26T20:17:14.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec1543f0 con 0x7fdeec06e040 2024-04-26T20:17:14.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec15bf00 con 0x7fdeec06e040 2024-04-26T20:17:14.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeec0506d0 con 0x7fdeec06e040 2024-04-26T20:17:14.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdee2a00640 1 -- 172.21.15.16:0/4186480078 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdedc00bc00 con 0x7fdeec06e040 2024-04-26T20:17:14.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdee2a00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdec80683b0 0x7fdec806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:14.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.781+0000 7fdee2a00640 1 -- 172.21.15.16:0/4186480078 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fdedc087340 con 0x7fdeec06e040 2024-04-26T20:17:14.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.785+0000 7fdee3e00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdec80683b0 0x7fdec806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:14.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.785+0000 7fdee3e00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdec80683b0 0x7fdec806a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fded40b2000 tx=0x7fded4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:14.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.785+0000 7fdee2a00640 1 -- 172.21.15.16:0/4186480078 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdedc057400 con 0x7fdeec06e040 2024-04-26T20:17:14.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdeec0700b0 con 0x7fdeec06e040 2024-04-26T20:17:14.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdee2a00640 1 -- 172.21.15.16:0/4186480078 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7fdedc056d00 con 0x7fdeec06e040 2024-04-26T20:17:14.986 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:14.987 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:11.155743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":48,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:17:14.987 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T20:17:14.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdec80683b0 msgr2=0x7fdec806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:14.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdec80683b0 0x7fdec806a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fded40b2000 tx=0x7fded4008040 comp rx=0 tx=0).stop 2024-04-26T20:17:14.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 msgr2=0x7fdeec144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:14.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec144490 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00d800 tx=0x7fdedc00dcc0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 shutdown_connections 2024-04-26T20:17:14.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdec80683b0 0x7fdec806a870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdeec153a80 0x7fdeec15c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec06f590 0x7fdeec15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 --2- 172.21.15.16:0/4186480078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec06e040 0x7fdeec144490 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:14.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 >> 172.21.15.16:0/4186480078 conn(0x7fdeec073470 msgr2=0x7fdeec14f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:14.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 shutdown_connections 2024-04-26T20:17:14.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:14.985+0000 7fdeebe00640 1 -- 172.21.15.16:0/4186480078 wait complete. 2024-04-26T20:17:15.008 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4261": { "addr": "172.21.15.192:6838/2295577139", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6836", "nonce": 2295577139, "type": "v2" }, { "addr": "172.21.15.192:6838", "nonce": 2295577139, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4261, "incarnation": 15, "join_fscid": -1, "name": "b", "rank": 2, "state": "up:reconnect", "state_seq": 48 }, "gid_4276": { "addr": "172.21.15.16:6836/1882507975", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6834", "nonce": 1882507975, "type": "v2" }, { "addr": "172.21.15.16:6836", "nonce": 1882507975, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4276, "incarnation": 9, "join_fscid": -1, "name": "c", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4279": { "addr": "172.21.15.16:6837/1962586875", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6835", "nonce": 1962586875, "type": "v2" }, { "addr": "172.21.15.16:6837", "nonce": 1962586875, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4279, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 5 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:17:11.155743+0000", "qdb_cluster": [ 4276, 4279 ], "qdb_leader": 4279, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4279, "mds_1": 4276, "mds_2": 4261 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:17:16.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:17:16.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:17:17.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:17.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dde00640 1 Processor -- start 2024-04-26T20:17:17.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dde00640 1 -- start start 2024-04-26T20:17:17.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dde00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f24d8155b70 0x7f24d815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:17.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dde00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8073f30 0x7f24d8073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:17.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dde00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d8072960 con 0x7f24d8155f50 2024-04-26T20:17:17.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dde00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f24d8068140 con 0x7f24d8155b70 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dde00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f24d8068370 con 0x7f24d8073f30 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f24d8155b70 0x7f24d815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f24d8155b70 0x7f24d815f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33912/0 (socket says 172.21.15.16:33912) 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dca00640 1 -- 172.21.15.16:0/291720400 learned_addr learned my addr 172.21.15.16:0/291720400 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24d7e00640 1 --2- 172.21.15.16:0/291720400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8073f30 0x7f24d8073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dca00640 1 -- 172.21.15.16:0/291720400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8073f30 msgr2=0x7f24d8073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dca00640 1 --2- 172.21.15.16:0/291720400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8073f30 0x7f24d8073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dca00640 1 -- 172.21.15.16:0/291720400 >> v1:172.21.15.192:6789/0 conn(0x7f24d8155f50 legacy=0x7f24d815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:17.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.160+0000 7f24dca00640 1 -- 172.21.15.16:0/291720400 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8068650 con 0x7f24d8155b70 2024-04-26T20:17:17.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dca00640 1 --2- 172.21.15.16:0/291720400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8155b70 0x7f24d815f9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009870 tx=0x7f24cc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9daa39482e8715ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:17.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24d7400640 1 -- 172.21.15.16:0/291720400 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0b5070 con 0x7f24d8155b70 2024-04-26T20:17:17.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24d7400640 1 -- 172.21.15.16:0/291720400 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc0a8a50 con 0x7f24d8155b70 2024-04-26T20:17:17.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24d7400640 1 -- 172.21.15.16:0/291720400 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0a8e20 con 0x7f24d8155b70 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 -- 172.21.15.16:0/291720400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8155b70 msgr2=0x7f24d815f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 --2- 172.21.15.16:0/291720400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8155b70 0x7f24d815f9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009870 tx=0x7f24cc01ed50 comp rx=0 tx=0).stop 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 -- 172.21.15.16:0/291720400 shutdown_connections 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 --2- 172.21.15.16:0/291720400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8073f30 0x7f24d8073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 --2- 172.21.15.16:0/291720400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8155b70 0x7f24d815f9f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 -- 172.21.15.16:0/291720400 >> 172.21.15.16:0/291720400 conn(0x7f24d80cdc10 msgr2=0x7f24d80cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 -- 172.21.15.16:0/291720400 shutdown_connections 2024-04-26T20:17:17.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 -- 172.21.15.16:0/291720400 wait complete. 2024-04-26T20:17:17.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 Processor -- start 2024-04-26T20:17:17.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.164+0000 7f24dde00640 1 -- start start 2024-04-26T20:17:17.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8073f30 0x7f24d814f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:17.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8155b70 0x7f24d80c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:17.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d8155f50 0x7f24d81f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:17.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24d815c5d0 con 0x7f24d8073f30 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8072f00 con 0x7f24d8155f50 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f24d815c750 con 0x7f24d8155b70 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8073f30 0x7f24d814f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8073f30 0x7f24d814f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33924/0 (socket says 172.21.15.16:33924) 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 -- 172.21.15.16:0/69612996 learned_addr learned my addr 172.21.15.16:0/69612996 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24d7e00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8155b70 0x7f24d80c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dd400640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d8155f50 0x7f24d81f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 -- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8155b70 msgr2=0x7f24d80c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8155b70 0x7f24d80c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 -- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d8155f50 msgr2=0x7f24d81f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d8155f50 0x7f24d81f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 -- 172.21.15.16:0/69612996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8156370 con 0x7f24d8073f30 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dd400640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d8155f50 0x7f24d81f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:17:17.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dca00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8073f30 0x7f24d814f360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0b3040 tx=0x7f24cc01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:17.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24d4c00640 1 -- 172.21.15.16:0/69612996 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0c0070 con 0x7f24d8073f30 2024-04-26T20:17:17.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24d4c00640 1 -- 172.21.15.16:0/69612996 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc0bb440 con 0x7f24d8073f30 2024-04-26T20:17:17.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24d4c00640 1 -- 172.21.15.16:0/69612996 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0b5070 con 0x7f24d8073f30 2024-04-26T20:17:17.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d81588d0 con 0x7f24d8073f30 2024-04-26T20:17:17.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d8156630 con 0x7f24d8073f30 2024-04-26T20:17:17.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.168+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d80506d0 con 0x7f24d8073f30 2024-04-26T20:17:17.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.172+0000 7f24d4c00640 1 -- 172.21.15.16:0/69612996 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24cc0c3070 con 0x7f24d8073f30 2024-04-26T20:17:17.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.172+0000 7f24d4c00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f24b80683b0 0x7f24b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:17.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.172+0000 7f24d4c00640 1 -- 172.21.15.16:0/69612996 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f24cc1243b0 con 0x7f24d8073f30 2024-04-26T20:17:17.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.172+0000 7f24d7e00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f24b80683b0 0x7f24b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:17.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.172+0000 7f24d7e00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f24b80683b0 0x7f24b806a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24d81ef430 tx=0x7f24c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:17.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.176+0000 7f24d4c00640 1 -- 172.21.15.16:0/69612996 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f24cc0188b0 con 0x7f24d8073f30 2024-04-26T20:17:17.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.376+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24d80cab50 con 0x7f24d8073f30 2024-04-26T20:17:17.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24d4c00640 1 -- 172.21.15.16:0/69612996 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7f24cc0f4460 con 0x7f24d8073f30 2024-04-26T20:17:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:17.381 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:11.155743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":48,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:17:17.381 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T20:17:17.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f24b80683b0 msgr2=0x7f24b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:17.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f24b80683b0 0x7f24b806a870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24d81ef430 tx=0x7f24c4008040 comp rx=0 tx=0).stop 2024-04-26T20:17:17.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8073f30 msgr2=0x7f24d814f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:17.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8073f30 0x7f24d814f360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0b3040 tx=0x7f24cc01baf0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 shutdown_connections 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f24b80683b0 0x7f24b806a870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24d8155f50 0x7f24d81f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24d8155b70 0x7f24d80c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 --2- 172.21.15.16:0/69612996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d8073f30 0x7f24d814f360 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 >> 172.21.15.16:0/69612996 conn(0x7f24d80cdc10 msgr2=0x7f24d80c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 shutdown_connections 2024-04-26T20:17:17.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:17.380+0000 7f24dde00640 1 -- 172.21.15.16:0/69612996 wait complete. 2024-04-26T20:17:17.407 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:19.408 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 Processor -- start 2024-04-26T20:17:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 -- start start 2024-04-26T20:17:19.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2eac153af0 0x7f2eac15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2eac0c7b80 0x7f2eac0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac0c9010 0x7f2eac0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac0ca630 con 0x7f2eac0c7b80 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac0c99c0 con 0x7f2eac153af0 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eb1800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac0c9d90 con 0x7f2eac0c9010 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2eac0c7b80 0x7f2eac0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2eac0c7b80 0x7f2eac0c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33932/0 (socket says 172.21.15.16:33932) 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 -- 172.21.15.16:0/2049220567 learned_addr learned my addr 172.21.15.16:0/2049220567 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eaaa00640 1 --2- 172.21.15.16:0/2049220567 >> v2:172.21.15.192:3300/0 conn(0x7f2eac153af0 0x7f2eac15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eab400640 1 --2- 172.21.15.16:0/2049220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac0c9010 0x7f2eac0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 -- 172.21.15.16:0/2049220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac0c9010 msgr2=0x7f2eac0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 --2- 172.21.15.16:0/2049220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac0c9010 0x7f2eac0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 -- 172.21.15.16:0/2049220567 >> v2:172.21.15.192:3300/0 conn(0x7f2eac153af0 msgr2=0x7f2eac15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 --2- 172.21.15.16:0/2049220567 >> v2:172.21.15.192:3300/0 conn(0x7f2eac153af0 0x7f2eac15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2ea2000640 1 -- 172.21.15.16:0/2049220567 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac0ca070 con 0x7f2eac0c7b80 2024-04-26T20:17:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eaaa00640 1 --2- 172.21.15.16:0/2049220567 >> v2:172.21.15.192:3300/0 conn(0x7f2eac153af0 0x7f2eac15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.560+0000 7f2eab400640 1 --2- 172.21.15.16:0/2049220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac0c9010 0x7f2eac0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2ea2000640 1 --2- 172.21.15.16:0/2049220567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c7b80 0x7f2eac0c7f80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0745d0 tx=0x7f2e9401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62589632c278ef38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eaa000640 1 -- 172.21.15.16:0/2049220567 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e940b4070 con 0x7f2eac0c7b80 2024-04-26T20:17:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eaa000640 1 -- 172.21.15.16:0/2049220567 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e940af400 con 0x7f2eac0c7b80 2024-04-26T20:17:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eaa000640 1 -- 172.21.15.16:0/2049220567 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e940af7d0 con 0x7f2eac0c7b80 2024-04-26T20:17:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 -- 172.21.15.16:0/2049220567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c7b80 msgr2=0x7f2eac0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2049220567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c7b80 0x7f2eac0c7f80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0745d0 tx=0x7f2e9401f1e0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 -- 172.21.15.16:0/2049220567 shutdown_connections 2024-04-26T20:17:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2049220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac0c9010 0x7f2eac0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2049220567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c7b80 0x7f2eac0c7f80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2049220567 >> v2:172.21.15.192:3300/0 conn(0x7f2eac153af0 0x7f2eac15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 -- 172.21.15.16:0/2049220567 >> 172.21.15.16:0/2049220567 conn(0x7f2eac06c380 msgr2=0x7f2eac06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:19.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 -- 172.21.15.16:0/2049220567 shutdown_connections 2024-04-26T20:17:19.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.564+0000 7f2eb1800640 1 -- 172.21.15.16:0/2049220567 wait complete. 2024-04-26T20:17:19.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 Processor -- start 2024-04-26T20:17:19.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 -- start start 2024-04-26T20:17:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac0c7b80 0x7f2eac1f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c9010 0x7f2eac073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac153af0 0x7f2eac0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac15d290 con 0x7f2eac0c9010 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac15cfb0 con 0x7f2eac0c7b80 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac153ed0 con 0x7f2eac153af0 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c9010 0x7f2eac073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c9010 0x7f2eac073ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33946/0 (socket says 172.21.15.16:33946) 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 -- 172.21.15.16:0/2669519193 learned_addr learned my addr 172.21.15.16:0/2669519193 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eab400640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac153af0 0x7f2eac0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eaaa00640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac0c7b80 0x7f2eac1f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 -- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac153af0 msgr2=0x7f2eac0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac153af0 0x7f2eac0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 -- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac0c7b80 msgr2=0x7f2eac1f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:19.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac0c7b80 0x7f2eac1f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 -- 172.21.15.16:0/2669519193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac0740e0 con 0x7f2eac0c9010 2024-04-26T20:17:19.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eaaa00640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac0c7b80 0x7f2eac1f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:19.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea2000640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c9010 0x7f2eac073ba0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e9401d890 tx=0x7f2e9401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:19.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea3400640 1 -- 172.21.15.16:0/2669519193 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e940b4040 con 0x7f2eac0c9010 2024-04-26T20:17:19.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea3400640 1 -- 172.21.15.16:0/2669519193 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e940c0070 con 0x7f2eac0c9010 2024-04-26T20:17:19.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac0c59c0 con 0x7f2eac0c9010 2024-04-26T20:17:19.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2ea3400640 1 -- 172.21.15.16:0/2669519193 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94009510 con 0x7f2eac0c9010 2024-04-26T20:17:19.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.568+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac1f1ce0 con 0x7f2eac0c9010 2024-04-26T20:17:19.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.572+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eac077c20 con 0x7f2eac0c9010 2024-04-26T20:17:19.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.572+0000 7f2ea3400640 1 -- 172.21.15.16:0/2669519193 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e940ba660 con 0x7f2eac0c9010 2024-04-26T20:17:19.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.572+0000 7f2ea3400640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:19.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.572+0000 7f2ea3400640 1 -- 172.21.15.16:0/2669519193 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f2e94124ff0 con 0x7f2eac0c9010 2024-04-26T20:17:19.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.572+0000 7f2eaaa00640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:19.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.576+0000 7f2eaaa00640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2e88068380 0x7f2e8806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0098f0 tx=0x7f2e9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:19.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.576+0000 7f2ea3400640 1 -- 172.21.15.16:0/2669519193 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2e94018d40 con 0x7f2eac0c9010 2024-04-26T20:17:19.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2eac0c8670 con 0x7f2eac0c9010 2024-04-26T20:17:19.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2ea3400640 1 -- 172.21.15.16:0/2669519193 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6053 (secure 0 0 0) 0x7f2e940f5260 con 0x7f2eac0c9010 2024-04-26T20:17:19.790 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:19.790 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:11.155743+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":48,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:17:19.790 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2e88068380 msgr2=0x7f2e8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2e88068380 0x7f2e8806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0098f0 tx=0x7f2e9c008040 comp rx=0 tx=0).stop 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c9010 msgr2=0x7f2eac073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c9010 0x7f2eac073ba0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e9401d890 tx=0x7f2e9401bf80 comp rx=0 tx=0).stop 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 shutdown_connections 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2e88068380 0x7f2e8806a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eac153af0 0x7f2eac0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eac0c9010 0x7f2eac073ba0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 --2- 172.21.15.16:0/2669519193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac0c7b80 0x7f2eac1f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:19.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 >> 172.21.15.16:0/2669519193 conn(0x7f2eac06c380 msgr2=0x7f2eac15c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:19.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 shutdown_connections 2024-04-26T20:17:19.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:19.788+0000 7f2eb1800640 1 -- 172.21.15.16:0/2669519193 wait complete. 2024-04-26T20:17:19.812 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:21.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:21.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2344a00640 1 Processor -- start 2024-04-26T20:17:21.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2344a00640 1 -- start start 2024-04-26T20:17:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2344a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c7b80 0x7f23400c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2344a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f23400c9010 0x7f23400c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2344a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400c99e0 con 0x7f2340153af0 2024-04-26T20:17:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2344a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f234015dec0 con 0x7f23400c9010 2024-04-26T20:17:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2344a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f23400ca630 con 0x7f23400c7b80 2024-04-26T20:17:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2337e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c7b80 0x7f23400c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f233e800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f23400c9010 0x7f23400c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2337e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c7b80 0x7f23400c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:41498/0 (socket says 172.21.15.16:41498) 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.964+0000 7f2337e00640 1 -- 172.21.15.16:0/3824961206 learned_addr learned my addr 172.21.15.16:0/3824961206 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f2337e00640 1 -- 172.21.15.16:0/3824961206 >> v2:172.21.15.192:3300/0 conn(0x7f23400c9010 msgr2=0x7f23400c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f2337e00640 1 --2- 172.21.15.16:0/3824961206 >> v2:172.21.15.192:3300/0 conn(0x7f23400c9010 0x7f23400c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f2337e00640 1 -- 172.21.15.16:0/3824961206 >> v1:172.21.15.192:6789/0 conn(0x7f2340153af0 legacy=0x7f234015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f2337e00640 1 -- 172.21.15.16:0/3824961206 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400c9d90 con 0x7f23400c7b80 2024-04-26T20:17:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f233e800640 1 --2- 172.21.15.16:0/3824961206 >> v2:172.21.15.192:3300/0 conn(0x7f23400c9010 0x7f23400c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:17:21.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f2337e00640 1 --2- 172.21.15.16:0/3824961206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c7b80 0x7f23400c7f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2328009870 tx=0x7f232801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c13b7aab4e8e4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f233d400640 1 -- 172.21.15.16:0/3824961206 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280b5070 con 0x7f23400c7b80 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f233d400640 1 -- 172.21.15.16:0/3824961206 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23280a8a50 con 0x7f23400c7b80 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f233d400640 1 -- 172.21.15.16:0/3824961206 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280a8e20 con 0x7f23400c7b80 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f2344a00640 1 -- 172.21.15.16:0/3824961206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c7b80 msgr2=0x7f23400c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.968+0000 7f2344a00640 1 --2- 172.21.15.16:0/3824961206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c7b80 0x7f23400c7f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2328009870 tx=0x7f232801ed50 comp rx=0 tx=0).stop 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- 172.21.15.16:0/3824961206 shutdown_connections 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 --2- 172.21.15.16:0/3824961206 >> v2:172.21.15.192:3300/0 conn(0x7f23400c9010 0x7f23400c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 --2- 172.21.15.16:0/3824961206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c7b80 0x7f23400c7f80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- 172.21.15.16:0/3824961206 >> 172.21.15.16:0/3824961206 conn(0x7f234006c380 msgr2=0x7f234006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- 172.21.15.16:0/3824961206 shutdown_connections 2024-04-26T20:17:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- 172.21.15.16:0/3824961206 wait complete. 2024-04-26T20:17:21.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 Processor -- start 2024-04-26T20:17:21.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- start start 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23400c7b80 0x7f23401e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c9010 0x7f23400729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2340153af0 0x7f2340072f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f234015cfb0 con 0x7f23400c7b80 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f23400ca350 con 0x7f2340153af0 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2344a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f234015d290 con 0x7f23400c9010 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23400c7b80 0x7f23401e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23400c7b80 0x7f23401e4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33952/0 (socket says 172.21.15.16:33952) 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 -- 172.21.15.16:0/1151335246 learned_addr learned my addr 172.21.15.16:0/1151335246 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f2337e00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c9010 0x7f23400729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233e800640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2340153af0 0x7f2340072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 -- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c9010 msgr2=0x7f23400729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c9010 0x7f23400729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 -- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2340153af0 msgr2=0x7f2340072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2340153af0 0x7f2340072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 -- 172.21.15.16:0/1151335246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234006d1a0 con 0x7f23400c7b80 2024-04-26T20:17:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.972+0000 7f233de00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23400c7b80 0x7f23401e4fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f233000c3a0 tx=0x7f233000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2336000640 1 -- 172.21.15.16:0/1151335246 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23300052d0 con 0x7f23400c7b80 2024-04-26T20:17:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2336000640 1 -- 172.21.15.16:0/1151335246 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2330005470 con 0x7f23400c7b80 2024-04-26T20:17:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2336000640 1 -- 172.21.15.16:0/1151335246 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330007260 con 0x7f23400c7b80 2024-04-26T20:17:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23400cb590 con 0x7f23400c7b80 2024-04-26T20:17:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23400741a0 con 0x7f23400c7b80 2024-04-26T20:17:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2340077c20 con 0x7f23400c7b80 2024-04-26T20:17:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2336000640 1 -- 172.21.15.16:0/1151335246 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2330007400 con 0x7f23400c7b80 2024-04-26T20:17:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2336000640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f231c0683b0 0x7f231c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2336000640 1 -- 172.21.15.16:0/1151335246 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f2330086270 con 0x7f23400c7b80 2024-04-26T20:17:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.976+0000 7f2337e00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f231c0683b0 0x7f231c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.980+0000 7f2337e00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f231c0683b0 0x7f231c06a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f23280b2000 tx=0x7f2328009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:21.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:21.980+0000 7f2336000640 1 -- 172.21.15.16:0/1151335246 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f23400c99e0 con 0x7f23400c7b80 2024-04-26T20:17:22.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.192+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23400c8670 con 0x7f23400c7b80 2024-04-26T20:17:22.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.192+0000 7f2336000640 1 -- 172.21.15.16:0/1151335246 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6050 (secure 0 0 0) 0x7f2330055c60 con 0x7f23400c7b80 2024-04-26T20:17:22.194 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:22.195 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:20.183441+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:rejoin","state_seq":51,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:17:22.195 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 18 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.192+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f231c0683b0 msgr2=0x7f231c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.192+0000 7f2344a00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f231c0683b0 0x7f231c06a870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f23280b2000 tx=0x7f2328009040 comp rx=0 tx=0).stop 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.192+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23400c7b80 msgr2=0x7f23401e4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.192+0000 7f2344a00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23400c7b80 0x7f23401e4fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f233000c3a0 tx=0x7f233000c7a0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 shutdown_connections 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f231c0683b0 0x7f231c06a870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2340153af0 0x7f2340072f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23400c9010 0x7f23400729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 --2- 172.21.15.16:0/1151335246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23400c7b80 0x7f23401e4fd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 >> 172.21.15.16:0/1151335246 conn(0x7f234006c380 msgr2=0x7f234015bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 shutdown_connections 2024-04-26T20:17:22.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:22.196+0000 7f2344a00640 1 -- 172.21.15.16:0/1151335246 wait complete. 2024-04-26T20:17:22.216 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:24.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:24.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.356+0000 7fdb17200640 1 Processor -- start 2024-04-26T20:17:24.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.356+0000 7fdb17200640 1 -- start start 2024-04-26T20:17:24.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.356+0000 7fdb17200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb18155dd0 0x7fdb180cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:24.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb17200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb180cb7f0 con 0x7fdb180b1fe0 2024-04-26T20:17:24.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb17200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb180cbad0 con 0x7fdb1815c840 2024-04-26T20:17:24.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb17200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdb1815bd60 con 0x7fdb18155dd0 2024-04-26T20:17:24.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb18155dd0 0x7fdb180cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:24.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb0d400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdb180b1fe0 0x7fdb1806fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39764/0 (socket says 172.21.15.16:39764) 2024-04-26T20:17:24.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb0d400640 1 -- 172.21.15.16:0/774031348 learned_addr learned my addr 172.21.15.16:0/774031348 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:17:24.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15e00640 1 -- 172.21.15.16:0/774031348 >> v1:172.21.15.192:6789/0 conn(0x7fdb1815c840 legacy=0x7fdb181664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:24.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15e00640 1 -- 172.21.15.16:0/774031348 >> v1:172.21.15.16:6789/0 conn(0x7fdb180b1fe0 legacy=0x7fdb1806fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15e00640 1 -- 172.21.15.16:0/774031348 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1815c040 con 0x7fdb18155dd0 2024-04-26T20:17:24.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15400640 1 -- 172.21.15.16:0/774031348 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92246613 0 0) 0x7fdb180cb7f0 con 0x7fdb180b1fe0 2024-04-26T20:17:24.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15e00640 1 --2- 172.21.15.16:0/774031348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180cb140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdb080097c0 tx=0x7fdb0801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f946bcb34182da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15400640 1 -- 172.21.15.16:0/774031348 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb080b5070 con 0x7fdb18155dd0 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15400640 1 -- 172.21.15.16:0/774031348 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb080a8990 con 0x7fdb18155dd0 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.360+0000 7fdb15400640 1 -- 172.21.15.16:0/774031348 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb080a8d60 con 0x7fdb18155dd0 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- 172.21.15.16:0/774031348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 msgr2=0x7fdb180cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 --2- 172.21.15.16:0/774031348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180cb140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdb080097c0 tx=0x7fdb0801ec90 comp rx=0 tx=0).stop 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- 172.21.15.16:0/774031348 shutdown_connections 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 --2- 172.21.15.16:0/774031348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180cb140 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- 172.21.15.16:0/774031348 >> 172.21.15.16:0/774031348 conn(0x7fdb18068140 msgr2=0x7fdb18068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- 172.21.15.16:0/774031348 shutdown_connections 2024-04-26T20:17:24.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- 172.21.15.16:0/774031348 wait complete. 2024-04-26T20:17:24.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 Processor -- start 2024-04-26T20:17:24.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- start start 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb180b1fe0 0x7fdb1814dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb1815c840 0x7fdb181534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb180705e0 con 0x7fdb18155dd0 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181561b0 con 0x7fdb1815c840 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb17200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdb18070760 con 0x7fdb180b1fe0 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33966/0 (socket says 172.21.15.16:33966) 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 -- 172.21.15.16:0/1324363908 learned_addr learned my addr 172.21.15.16:0/1324363908 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb15e00640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb180b1fe0 0x7fdb1814dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb16800640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb1815c840 0x7fdb181534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:24.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 -- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb180b1fe0 msgr2=0x7fdb1814dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb180b1fe0 0x7fdb1814dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 -- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb1815c840 msgr2=0x7fdb181534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb1815c840 0x7fdb181534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 -- 172.21.15.16:0/1324363908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1814e210 con 0x7fdb18155dd0 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.364+0000 7fdb0d400640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180b12f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c790 tx=0x7fdb0000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb0ea00640 1 -- 172.21.15.16:0/1324363908 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb00017070 con 0x7fdb18155dd0 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb0ea00640 1 -- 172.21.15.16:0/1324363908 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0000a640 con 0x7fdb18155dd0 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb0ea00640 1 -- 172.21.15.16:0/1324363908 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000aa10 con 0x7fdb18155dd0 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1814c4e0 con 0x7fdb18155dd0 2024-04-26T20:17:24.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1814caa0 con 0x7fdb18155dd0 2024-04-26T20:17:24.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb180506d0 con 0x7fdb18155dd0 2024-04-26T20:17:24.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb0ea00640 1 -- 172.21.15.16:0/1324363908 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb0001a070 con 0x7fdb18155dd0 2024-04-26T20:17:24.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb0ea00640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdaf4068380 0x7fdaf406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:24.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb0ea00640 1 -- 172.21.15.16:0/1324363908 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fdb00086580 con 0x7fdb18155dd0 2024-04-26T20:17:24.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.368+0000 7fdb15e00640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdaf4068380 0x7fdaf406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:24.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.372+0000 7fdb15e00640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdaf4068380 0x7fdaf406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb080b2000 tx=0x7fdb08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:24.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.372+0000 7fdb0ea00640 1 -- 172.21.15.16:0/1324363908 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdb00056640 con 0x7fdb18155dd0 2024-04-26T20:17:24.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.580+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb18154cf0 con 0x7fdb18155dd0 2024-04-26T20:17:24.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.580+0000 7fdb0ea00640 1 -- 172.21.15.16:0/1324363908 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6050 (secure 0 0 0) 0x7fdb00055f40 con 0x7fdb18155dd0 2024-04-26T20:17:24.584 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:24.584 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:20.183441+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:rejoin","state_seq":51,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:17:24.584 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 18 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdaf4068380 msgr2=0x7fdaf406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdaf4068380 0x7fdaf406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb080b2000 tx=0x7fdb08008040 comp rx=0 tx=0).stop 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 msgr2=0x7fdb180b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180b12f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c790 tx=0x7fdb0000cc50 comp rx=0 tx=0).stop 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 shutdown_connections 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fdaf4068380 0x7fdaf406a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb1815c840 0x7fdb181534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb18155dd0 0x7fdb180b12f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 --2- 172.21.15.16:0/1324363908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb180b1fe0 0x7fdb1814dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 >> 172.21.15.16:0/1324363908 conn(0x7fdb18068140 msgr2=0x7fdb180c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 shutdown_connections 2024-04-26T20:17:24.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:24.584+0000 7fdb17200640 1 -- 172.21.15.16:0/1324363908 wait complete. 2024-04-26T20:17:24.606 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:17:26.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.956+0000 7fac1b600640 1 Processor -- start 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.956+0000 7fac1b600640 1 -- start start 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac1b600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14151e70 0x7fac14073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac1b600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fac14073ad0 0x7fac1415b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac1b600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1415b260 con 0x7fac1415bc50 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac1b600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fac14074370 con 0x7fac14073ad0 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac1b600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fac1415c0a0 con 0x7fac14151e70 2024-04-26T20:17:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac19600640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fac1415bc50 0x7fac140c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42170/0 (socket says 172.21.15.16:42170) 2024-04-26T20:17:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac19600640 1 -- 172.21.15.16:0/1750431775 learned_addr learned my addr 172.21.15.16:0/1750431775 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:17:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.960+0000 7fac13e00640 1 --2- 172.21.15.16:0/1750431775 >> v2:172.21.15.192:3300/0 conn(0x7fac14073ad0 0x7fac1415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.964+0000 7fac18c00640 1 --2- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14151e70 0x7fac14073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:26.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.964+0000 7fac13400640 1 -- 172.21.15.16:0/1750431775 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803822164 0 0) 0x7fac1415b260 con 0x7fac1415bc50 2024-04-26T20:17:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.964+0000 7fac13400640 1 -- 172.21.15.16:0/1750431775 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf8003450 con 0x7fac1415bc50 2024-04-26T20:17:26.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.964+0000 7fac13e00640 1 -- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14151e70 msgr2=0x7fac14073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.964+0000 7fac13e00640 1 --2- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14151e70 0x7fac14073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.964+0000 7fac13e00640 1 -- 172.21.15.16:0/1750431775 >> v1:172.21.15.16:6789/0 conn(0x7fac1415bc50 legacy=0x7fac140c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.964+0000 7fac13e00640 1 -- 172.21.15.16:0/1750431775 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac14157f80 con 0x7fac14073ad0 2024-04-26T20:17:26.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.968+0000 7fac18c00640 1 --2- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14151e70 0x7fac14073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:17:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.972+0000 7fac13e00640 1 --2- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14073ad0 0x7fac1415b710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac040097c0 tx=0x7fac0401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=875f63557169cd9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:26.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.972+0000 7fac13400640 1 -- 172.21.15.16:0/1750431775 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040b5070 con 0x7fac14073ad0 2024-04-26T20:17:26.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.972+0000 7fac13400640 1 -- 172.21.15.16:0/1750431775 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac040a8990 con 0x7fac14073ad0 2024-04-26T20:17:26.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.972+0000 7fac13400640 1 -- 172.21.15.16:0/1750431775 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040a8d60 con 0x7fac14073ad0 2024-04-26T20:17:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.980+0000 7fac1b600640 1 -- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14073ad0 msgr2=0x7fac1415b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:26.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.980+0000 7fac1b600640 1 --2- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14073ad0 0x7fac1415b710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fac040097c0 tx=0x7fac0401ecb0 comp rx=0 tx=0).stop 2024-04-26T20:17:26.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.984+0000 7fac1b600640 1 -- 172.21.15.16:0/1750431775 shutdown_connections 2024-04-26T20:17:26.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.984+0000 7fac1b600640 1 --2- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14073ad0 0x7fac1415b710 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:26.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.984+0000 7fac1b600640 1 --2- 172.21.15.16:0/1750431775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14151e70 0x7fac14073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:26.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.984+0000 7fac1b600640 1 -- 172.21.15.16:0/1750431775 >> 172.21.15.16:0/1750431775 conn(0x7fac1406c380 msgr2=0x7fac1406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:26.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.984+0000 7fac1b600640 1 -- 172.21.15.16:0/1750431775 shutdown_connections 2024-04-26T20:17:26.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.988+0000 7fac1b600640 1 -- 172.21.15.16:0/1750431775 wait complete. 2024-04-26T20:17:26.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.996+0000 7fac1b600640 1 Processor -- start 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:26.996+0000 7fac1b600640 1 -- start start 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.004+0000 7fac1b600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14073ad0 0x7fac141f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.004+0000 7fac1b600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac14151e70 0x7fac140c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.004+0000 7fac1b600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac1415bc50 0x7fac141fa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.004+0000 7fac1b600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac14158820 con 0x7fac14151e70 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.004+0000 7fac1b600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fac14158540 con 0x7fac1415bc50 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.004+0000 7fac1b600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fac14157c50 con 0x7fac14073ad0 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac13e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac14151e70 0x7fac140c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14073ad0 0x7fac141f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14073ad0 0x7fac141f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:47092/0 (socket says 172.21.15.16:47092) 2024-04-26T20:17:27.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 -- 172.21.15.16:0/2137216691 learned_addr learned my addr 172.21.15.16:0/2137216691 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:27.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 -- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac1415bc50 msgr2=0x7fac141fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:27.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac1415bc50 0x7fac141fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 -- 172.21.15.16:0/2137216691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac14151e70 msgr2=0x7fac140c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:27.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac14151e70 0x7fac140c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 -- 172.21.15.16:0/2137216691 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1414f770 con 0x7fac14073ad0 2024-04-26T20:17:27.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac18c00640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14073ad0 0x7fac141f6d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00efc0 tx=0x7fac0c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:27.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac10c00640 1 -- 172.21.15.16:0/2137216691 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c018020 con 0x7fac14073ad0 2024-04-26T20:17:27.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac10c00640 1 -- 172.21.15.16:0/2137216691 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c014680 con 0x7fac14073ad0 2024-04-26T20:17:27.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.008+0000 7fac10c00640 1 -- 172.21.15.16:0/2137216691 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c014a50 con 0x7fac14073ad0 2024-04-26T20:17:27.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.016+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac141f6220 con 0x7fac14073ad0 2024-04-26T20:17:27.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.016+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1414fa50 con 0x7fac14073ad0 2024-04-26T20:17:27.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.016+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac14077c20 con 0x7fac14073ad0 2024-04-26T20:17:27.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.024+0000 7fac10c00640 1 -- 172.21.15.16:0/2137216691 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac0c01b020 con 0x7fac14073ad0 2024-04-26T20:17:27.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.024+0000 7fac10c00640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fabf4068480 0x7fabf406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:27.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.024+0000 7fac10c00640 1 -- 172.21.15.16:0/2137216691 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fac0c087d40 con 0x7fac14073ad0 2024-04-26T20:17:27.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.028+0000 7fac13e00640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fabf4068480 0x7fabf406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:27.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.036+0000 7fac13e00640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fabf4068480 0x7fabf406a940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac040b2000 tx=0x7fac040aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.040+0000 7fac10c00640 1 -- 172.21.15.16:0/2137216691 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fac0c022020 con 0x7fac14073ad0 2024-04-26T20:17:27.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.688+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac14155d40 con 0x7fac14073ad0 2024-04-26T20:17:27.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.692+0000 7fac10c00640 1 -- 172.21.15.16:0/2137216691 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6055 (secure 0 0 0) 0x7fac0c010040 con 0x7fac14073ad0 2024-04-26T20:17:27.694 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:27.695 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4261,4276,4279]},"id":1}]} 2024-04-26T20:17:27.695 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-04-26T20:17:27.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.696+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fabf4068480 msgr2=0x7fabf406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:27.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.696+0000 7fac1b600640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fabf4068480 0x7fabf406a940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac040b2000 tx=0x7fac040aa070 comp rx=0 tx=0).stop 2024-04-26T20:17:27.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.696+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14073ad0 msgr2=0x7fac141f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:27.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14073ad0 0x7fac141f6d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00efc0 tx=0x7fac0c00c490 comp rx=0 tx=0).stop 2024-04-26T20:17:27.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 shutdown_connections 2024-04-26T20:17:27.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fabf4068480 0x7fabf406a940 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac1415bc50 0x7fac141fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac14151e70 0x7fac140c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 --2- 172.21.15.16:0/2137216691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac14073ad0 0x7fac141f6d00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:27.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 >> 172.21.15.16:0/2137216691 conn(0x7fac1406c380 msgr2=0x7fac141e33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:27.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 shutdown_connections 2024-04-26T20:17:27.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:27.700+0000 7fac1b600640 1 -- 172.21.15.16:0/2137216691 wait complete. 2024-04-26T20:17:27.758 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=2, replacing gid=4267 2024-04-26T20:17:27.758 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 6 secs before reviving mds.a 2024-04-26T20:17:28.066 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-26T20:17:28.064+0000 7f31e9800640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T20:17:33.759 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2024-04-26T20:17:33.759 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T20:17:33.759 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T20:17:33.762 INFO:tasks.ceph.mds.a:Started 2024-04-26T20:17:33.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:17:33.848 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T20:17:33.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f48a1200640 1 Processor -- start 2024-04-26T20:17:33.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f48a1200640 1 -- start start 2024-04-26T20:17:33.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f48a1200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f489c0b47e0 0x7f489c06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f48a1200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f489c0c63f0 0x7f489c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f48a1200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f489c0cb7f0 con 0x7f489c1574b0 2024-04-26T20:17:33.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f48a1200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f489c0ccd80 con 0x7f489c0c63f0 2024-04-26T20:17:33.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f48a1200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f489c0c9e80 con 0x7f489c0b47e0 2024-04-26T20:17:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f489a800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f489c0c63f0 0x7f489c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f489a800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f489c0c63f0 0x7f489c0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50704/0 (socket says 172.21.15.16:50704) 2024-04-26T20:17:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f489a800640 1 -- 172.21.15.16:0/966316743 learned_addr learned my addr 172.21.15.16:0/966316743 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f4899400640 1 --2- 172.21.15.16:0/966316743 >> v2:172.21.15.192:3300/0 conn(0x7f489c0b47e0 0x7f489c06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f489a800640 1 -- 172.21.15.16:0/966316743 >> v2:172.21.15.192:3300/0 conn(0x7f489c0b47e0 msgr2=0x7f489c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:17:33.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f489a800640 1 --2- 172.21.15.16:0/966316743 >> v2:172.21.15.192:3300/0 conn(0x7f489c0b47e0 0x7f489c06feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f489a800640 1 -- 172.21.15.16:0/966316743 >> v1:172.21.15.192:6789/0 conn(0x7f489c1574b0 legacy=0x7f489c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:33.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.904+0000 7f489a800640 1 -- 172.21.15.16:0/966316743 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c0ca0d0 con 0x7f489c0c63f0 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f489a800640 1 --2- 172.21.15.16:0/966316743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0c63f0 0x7f489c0703f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f489c068a20 tx=0x7f489401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2448a699aa7c9a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f4898a00640 1 -- 172.21.15.16:0/966316743 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48940a57a0 con 0x7f489c0c63f0 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f4898a00640 1 -- 172.21.15.16:0/966316743 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48940a5940 con 0x7f489c0c63f0 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f4898a00640 1 -- 172.21.15.16:0/966316743 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48940a5d10 con 0x7f489c0c63f0 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 -- 172.21.15.16:0/966316743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0c63f0 msgr2=0x7f489c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 --2- 172.21.15.16:0/966316743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0c63f0 0x7f489c0703f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f489c068a20 tx=0x7f489401c9f0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 -- 172.21.15.16:0/966316743 shutdown_connections 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 --2- 172.21.15.16:0/966316743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0c63f0 0x7f489c0703f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 --2- 172.21.15.16:0/966316743 >> v2:172.21.15.192:3300/0 conn(0x7f489c0b47e0 0x7f489c06feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 -- 172.21.15.16:0/966316743 >> 172.21.15.16:0/966316743 conn(0x7f489c071160 msgr2=0x7f489c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 -- 172.21.15.16:0/966316743 shutdown_connections 2024-04-26T20:17:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.908+0000 7f48a1200640 1 -- 172.21.15.16:0/966316743 wait complete. 2024-04-26T20:17:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 Processor -- start 2024-04-26T20:17:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 -- start start 2024-04-26T20:17:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0b47e0 0x7f489c06ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489c0c63f0 0x7f489c147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f489c1574b0 0x7f489c148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f489c166ec0 con 0x7f489c0b47e0 2024-04-26T20:17:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f489c166d40 con 0x7f489c0c63f0 2024-04-26T20:17:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f489c167040 con 0x7f489c1574b0 2024-04-26T20:17:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0b47e0 0x7f489c06ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0b47e0 0x7f489c06ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50712/0 (socket says 172.21.15.16:50712) 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 -- 172.21.15.16:0/818012812 learned_addr learned my addr 172.21.15.16:0/818012812 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f489a800640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f489c1574b0 0x7f489c148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899400640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489c0c63f0 0x7f489c147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 -- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f489c1574b0 msgr2=0x7f489c148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f489c1574b0 0x7f489c148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 -- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489c0c63f0 msgr2=0x7f489c147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489c0c63f0 0x7f489c147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 -- 172.21.15.16:0/818012812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c148e80 con 0x7f489c0b47e0 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f489a800640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f489c1574b0 0x7f489c148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899400640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489c0c63f0 0x7f489c147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:17:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4899e00640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0b47e0 0x7f489c06ece0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c3a0 tx=0x7f488c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4892000640 1 -- 172.21.15.16:0/818012812 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c0052d0 con 0x7f489c0b47e0 2024-04-26T20:17:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4892000640 1 -- 172.21.15.16:0/818012812 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f488c005470 con 0x7f489c0b47e0 2024-04-26T20:17:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f4892000640 1 -- 172.21.15.16:0/818012812 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c007260 con 0x7f489c0b47e0 2024-04-26T20:17:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489c14e820 con 0x7f489c0b47e0 2024-04-26T20:17:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489c14ede0 con 0x7f489c0b47e0 2024-04-26T20:17:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.912+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f489c077c20 con 0x7f489c0b47e0 2024-04-26T20:17:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.916+0000 7f4892000640 1 -- 172.21.15.16:0/818012812 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f488c007400 con 0x7f489c0b47e0 2024-04-26T20:17:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.916+0000 7f4892000640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f487c068380 0x7f487c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:17:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.916+0000 7f4892000640 1 -- 172.21.15.16:0/818012812 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f488c086320 con 0x7f489c0b47e0 2024-04-26T20:17:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.916+0000 7f4899400640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f487c068380 0x7f487c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:17:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.916+0000 7f4899400640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f487c068380 0x7f487c06a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f489c06f5f0 tx=0x7f4888008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:17:33.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:33.920+0000 7f4892000640 1 -- 172.21.15.16:0/818012812 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f488c0563e0 con 0x7f489c0b47e0 2024-04-26T20:17:34.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.128+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f489c0d01a0 con 0x7f489c0b47e0 2024-04-26T20:17:34.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.128+0000 7f4892000640 1 -- 172.21.15.16:0/818012812 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7f488c055ce0 con 0x7f489c0b47e0 2024-04-26T20:17:34.131 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:17:34.131 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:17:34.131 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f487c068380 msgr2=0x7f487c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f487c068380 0x7f487c06a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f489c06f5f0 tx=0x7f4888008040 comp rx=0 tx=0).stop 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0b47e0 msgr2=0x7f489c06ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0b47e0 0x7f489c06ece0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c3a0 tx=0x7f488c00c860 comp rx=0 tx=0).stop 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 shutdown_connections 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f487c068380 0x7f487c06a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f489c1574b0 0x7f489c148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489c0c63f0 0x7f489c147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 --2- 172.21.15.16:0/818012812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f489c0b47e0 0x7f489c06ece0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:17:34.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 >> 172.21.15.16:0/818012812 conn(0x7f489c071160 msgr2=0x7f489c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:17:34.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 shutdown_connections 2024-04-26T20:17:34.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:17:34.132+0000 7f48a1200640 1 -- 172.21.15.16:0/818012812 wait complete. 2024-04-26T20:17:34.151 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2024-04-26T20:17:34.152 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 69 secs before thrashing 2024-04-26T20:17:46.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:17:46.571 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:18:16.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:18:16.625 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:18:29.463 INFO:tasks.workunit.client.0.smithi016.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T20:18:29.464 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T20:18:29.465 INFO:tasks.workunit.client.0.smithi016.stderr:+ make 2024-04-26T20:18:29.581 INFO:tasks.workunit.client.0.smithi016.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T20:18:29.842 INFO:tasks.workunit.client.0.smithi016.stderr:++ readlink -f fsstress 2024-04-26T20:18:29.843 INFO:tasks.workunit.client.0.smithi016.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T20:18:29.843 INFO:tasks.workunit.client.0.smithi016.stderr:+ popd 2024-04-26T20:18:29.844 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T20:18:29.844 INFO:tasks.workunit.client.0.smithi016.stderr:+ popd 2024-04-26T20:18:29.844 INFO:tasks.workunit.client.0.smithi016.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T20:18:29.844 INFO:tasks.workunit.client.0.smithi016.stderr:++ mktemp -d -p . 2024-04-26T20:18:29.846 INFO:tasks.workunit.client.0.smithi016.stderr:+ T=./tmp.PykkLdafQs 2024-04-26T20:18:29.846 INFO:tasks.workunit.client.0.smithi016.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.PykkLdafQs -l 1 -n 1000 -p 10 -v 2024-04-26T20:18:29.848 INFO:tasks.workunit.client.0.smithi016.stdout:seed = 1713436385 2024-04-26T20:18:29.851 INFO:tasks.workunit.client.0.smithi016.stdout:0/0: unlink - no file 2024-04-26T20:18:29.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/1: chown . 947 1 2024-04-26T20:18:29.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/2: read - no filename 2024-04-26T20:18:29.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/3: dwrite - no filename 2024-04-26T20:18:29.852 INFO:tasks.workunit.client.0.smithi016.stdout:1/0: link - no file 2024-04-26T20:18:29.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/4: creat f0 x:0 0 0 2024-04-26T20:18:29.853 INFO:tasks.workunit.client.0.smithi016.stdout:0/5: write f0 [185171,76128] 0 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:0/6: truncate f0 648461 0 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/0: rmdir - no directory 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/1: dread - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/2: dread - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/3: rename - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/4: write - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/5: chown . 15 1 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/6: rename - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/7: dwrite - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/8: write - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/9: dread - no filename 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:1/1: mknod c0 0 2024-04-26T20:18:29.854 INFO:tasks.workunit.client.0.smithi016.stdout:1/2: fsync - no filename 2024-04-26T20:18:29.855 INFO:tasks.workunit.client.0.smithi016.stdout:2/0: stat - no entries 2024-04-26T20:18:29.855 INFO:tasks.workunit.client.0.smithi016.stdout:0/7: creat f1 x:0 0 0 2024-04-26T20:18:29.855 INFO:tasks.workunit.client.0.smithi016.stdout:0/8: truncate f0 1230029 0 2024-04-26T20:18:29.856 INFO:tasks.workunit.client.0.smithi016.stdout:9/10: creat f0 x:0 0 0 2024-04-26T20:18:29.856 INFO:tasks.workunit.client.0.smithi016.stdout:9/11: write f0 [378494,89111] 0 2024-04-26T20:18:29.856 INFO:tasks.workunit.client.0.smithi016.stdout:1/3: mknod c1 0 2024-04-26T20:18:29.856 INFO:tasks.workunit.client.0.smithi016.stdout:1/4: dwrite - no filename 2024-04-26T20:18:29.856 INFO:tasks.workunit.client.0.smithi016.stdout:3/0: chown . 237 1 2024-04-26T20:18:29.857 INFO:tasks.workunit.client.0.smithi016.stdout:9/12: write f0 [144362,13681] 0 2024-04-26T20:18:29.857 INFO:tasks.workunit.client.0.smithi016.stdout:2/1: mknod c0 0 2024-04-26T20:18:29.858 INFO:tasks.workunit.client.0.smithi016.stdout:1/5: creat f2 x:0 0 0 2024-04-26T20:18:29.860 INFO:tasks.workunit.client.0.smithi016.stdout:4/0: write - no filename 2024-04-26T20:18:29.860 INFO:tasks.workunit.client.0.smithi016.stdout:4/1: dwrite - no filename 2024-04-26T20:18:29.860 INFO:tasks.workunit.client.0.smithi016.stdout:4/2: getdents . 0 2024-04-26T20:18:29.861 INFO:tasks.workunit.client.0.smithi016.stdout:3/1: creat f0 x:0 0 0 2024-04-26T20:18:29.861 INFO:tasks.workunit.client.0.smithi016.stdout:3/2: dread - f0 zero size 2024-04-26T20:18:29.861 INFO:tasks.workunit.client.0.smithi016.stdout:3/3: dread - f0 zero size 2024-04-26T20:18:29.861 INFO:tasks.workunit.client.0.smithi016.stdout:9/13: mkdir d1 0 2024-04-26T20:18:29.861 INFO:tasks.workunit.client.0.smithi016.stdout:9/14: getdents d1 0 2024-04-26T20:18:29.862 INFO:tasks.workunit.client.0.smithi016.stdout:5/0: getdents . 0 2024-04-26T20:18:29.863 INFO:tasks.workunit.client.0.smithi016.stdout:4/3: mkdir d0 0 2024-04-26T20:18:29.863 INFO:tasks.workunit.client.0.smithi016.stdout:3/4: symlink l1 0 2024-04-26T20:18:29.865 INFO:tasks.workunit.client.0.smithi016.stdout:6/0: rename - no filename 2024-04-26T20:18:29.865 INFO:tasks.workunit.client.0.smithi016.stdout:6/1: dread - no filename 2024-04-26T20:18:29.865 INFO:tasks.workunit.client.0.smithi016.stdout:6/2: fdatasync - no filename 2024-04-26T20:18:29.865 INFO:tasks.workunit.client.0.smithi016.stdout:6/3: rename - no filename 2024-04-26T20:18:29.865 INFO:tasks.workunit.client.0.smithi016.stdout:6/4: rmdir - no directory 2024-04-26T20:18:29.865 INFO:tasks.workunit.client.0.smithi016.stdout:5/1: creat f0 x:0 0 0 2024-04-26T20:18:29.866 INFO:tasks.workunit.client.0.smithi016.stdout:4/4: creat d0/f1 x:0 0 0 2024-04-26T20:18:29.866 INFO:tasks.workunit.client.0.smithi016.stdout:4/5: dread - d0/f1 zero size 2024-04-26T20:18:29.868 INFO:tasks.workunit.client.0.smithi016.stdout:6/5: creat f0 x:0 0 0 2024-04-26T20:18:29.868 INFO:tasks.workunit.client.0.smithi016.stdout:6/6: dread - f0 zero size 2024-04-26T20:18:29.868 INFO:tasks.workunit.client.0.smithi016.stdout:6/7: chown f0 3401 1 2024-04-26T20:18:29.869 INFO:tasks.workunit.client.0.smithi016.stdout:7/0: mkdir d0 0 2024-04-26T20:18:29.869 INFO:tasks.workunit.client.0.smithi016.stdout:7/1: dread - no filename 2024-04-26T20:18:29.869 INFO:tasks.workunit.client.0.smithi016.stdout:7/2: write - no filename 2024-04-26T20:18:29.870 INFO:tasks.workunit.client.0.smithi016.stdout:8/0: getdents . 0 2024-04-26T20:18:29.873 INFO:tasks.workunit.client.0.smithi016.stdout:6/8: mkdir d1 0 2024-04-26T20:18:29.873 INFO:tasks.workunit.client.0.smithi016.stdout:6/9: write f0 [145386,118657] 0 2024-04-26T20:18:29.873 INFO:tasks.workunit.client.0.smithi016.stdout:7/3: mkdir d0/d1 0 2024-04-26T20:18:29.873 INFO:tasks.workunit.client.0.smithi016.stdout:7/4: fdatasync - no filename 2024-04-26T20:18:29.875 INFO:tasks.workunit.client.0.smithi016.stdout:8/1: symlink l0 0 2024-04-26T20:18:29.947 INFO:tasks.workunit.client.0.smithi016.stdout:0/9: fsync f0 0 2024-04-26T20:18:29.958 INFO:tasks.workunit.client.0.smithi016.stdout:2/2: getdents . 0 2024-04-26T20:18:29.985 INFO:tasks.workunit.client.0.smithi016.stdout:0/10: mkdir d2 0 2024-04-26T20:18:29.985 INFO:tasks.workunit.client.0.smithi016.stdout:0/11: stat f1 0 2024-04-26T20:18:29.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/2: getdents . 0 2024-04-26T20:18:30.001 INFO:tasks.workunit.client.0.smithi016.stdout:4/6: fsync d0/f1 0 2024-04-26T20:18:30.001 INFO:tasks.workunit.client.0.smithi016.stdout:4/7: read - d0/f1 zero size 2024-04-26T20:18:30.014 INFO:tasks.workunit.client.0.smithi016.stdout:1/6: dwrite f2 [0,4194304] 0 2024-04-26T20:18:30.060 INFO:tasks.workunit.client.0.smithi016.stdout:1/7: dread f2 [0,4194304] 0 2024-04-26T20:18:30.060 INFO:tasks.workunit.client.0.smithi016.stdout:1/8: chown f2 34627034 1 2024-04-26T20:18:30.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/8: getdents d0 0 2024-04-26T20:18:30.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/9: dread - d0/f1 zero size 2024-04-26T20:18:30.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/10: fdatasync d0/f1 0 2024-04-26T20:18:30.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/11: chown d0 788114 1 2024-04-26T20:18:30.076 INFO:tasks.workunit.client.0.smithi016.stdout:4/12: truncate d0/f1 557471 0 2024-04-26T20:18:30.079 INFO:tasks.workunit.client.0.smithi016.stdout:5/3: write f0 [818267,56706] 0 2024-04-26T20:18:30.079 INFO:tasks.workunit.client.0.smithi016.stdout:5/4: write f0 [894731,50139] 0 2024-04-26T20:18:30.082 INFO:tasks.workunit.client.0.smithi016.stdout:9/15: dwrite f0 [0,4194304] 0 2024-04-26T20:18:30.082 INFO:tasks.workunit.client.0.smithi016.stdout:9/16: truncate f0 4366829 0 2024-04-26T20:18:30.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/17: dread f0 [0,4194304] 0 2024-04-26T20:18:30.122 INFO:tasks.workunit.client.0.smithi016.stdout:9/18: dread f0 [0,4194304] 0 2024-04-26T20:18:30.126 INFO:tasks.workunit.client.0.smithi016.stdout:0/12: dread f0 [0,4194304] 0 2024-04-26T20:18:30.176 INFO:tasks.workunit.client.0.smithi016.stdout:1/9: write f2 [4807767,69008] 0 2024-04-26T20:18:30.188 INFO:tasks.workunit.client.0.smithi016.stdout:4/13: symlink d0/l2 0 2024-04-26T20:18:30.188 INFO:tasks.workunit.client.0.smithi016.stdout:4/14: truncate d0/f1 1440338 0 2024-04-26T20:18:30.190 INFO:tasks.workunit.client.0.smithi016.stdout:2/3: creat f1 x:0 0 0 2024-04-26T20:18:30.192 INFO:tasks.workunit.client.0.smithi016.stdout:5/5: mkdir d1 0 2024-04-26T20:18:30.211 INFO:tasks.workunit.client.0.smithi016.stdout:5/6: dread f0 [0,4194304] 0 2024-04-26T20:18:30.211 INFO:tasks.workunit.client.0.smithi016.stdout:5/7: fdatasync f0 0 2024-04-26T20:18:30.226 INFO:tasks.workunit.client.0.smithi016.stdout:9/19: mkdir d1/d2 0 2024-04-26T20:18:30.230 INFO:tasks.workunit.client.0.smithi016.stdout:0/13: rename f1 to d2/f3 0 2024-04-26T20:18:30.231 INFO:tasks.workunit.client.0.smithi016.stdout:1/10: mkdir d3 0 2024-04-26T20:18:30.232 INFO:tasks.workunit.client.0.smithi016.stdout:4/15: mknod d0/c3 0 2024-04-26T20:18:30.236 INFO:tasks.workunit.client.0.smithi016.stdout:0/14: symlink d2/l4 0 2024-04-26T20:18:30.237 INFO:tasks.workunit.client.0.smithi016.stdout:4/16: mknod d0/c4 0 2024-04-26T20:18:30.247 INFO:tasks.workunit.client.0.smithi016.stdout:9/20: dread f0 [0,4194304] 0 2024-04-26T20:18:30.250 INFO:tasks.workunit.client.0.smithi016.stdout:9/21: link f0 d1/d2/f3 0 2024-04-26T20:18:30.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/4: dwrite f1 [0,4194304] 0 2024-04-26T20:18:30.260 INFO:tasks.workunit.client.0.smithi016.stdout:2/5: creat f2 x:0 0 0 2024-04-26T20:18:30.272 INFO:tasks.workunit.client.0.smithi016.stdout:5/8: dwrite f0 [0,4194304] 0 2024-04-26T20:18:30.273 INFO:tasks.workunit.client.0.smithi016.stdout:9/22: write d1/d2/f3 [1058986,60518] 0 2024-04-26T20:18:30.280 INFO:tasks.workunit.client.0.smithi016.stdout:5/9: creat d1/f2 x:0 0 0 2024-04-26T20:18:30.280 INFO:tasks.workunit.client.0.smithi016.stdout:5/10: chown d1 157582 1 2024-04-26T20:18:30.280 INFO:tasks.workunit.client.0.smithi016.stdout:5/11: readlink - no filename 2024-04-26T20:18:30.281 INFO:tasks.workunit.client.0.smithi016.stdout:6/10: dread f0 [0,4194304] 0 2024-04-26T20:18:30.291 INFO:tasks.workunit.client.0.smithi016.stdout:2/6: write f1 [2807559,75878] 0 2024-04-26T20:18:30.296 INFO:tasks.workunit.client.0.smithi016.stdout:9/23: link d1/d2/f3 d1/f4 0 2024-04-26T20:18:30.297 INFO:tasks.workunit.client.0.smithi016.stdout:5/12: mknod d1/c3 0 2024-04-26T20:18:30.297 INFO:tasks.workunit.client.0.smithi016.stdout:5/13: dread - d1/f2 zero size 2024-04-26T20:18:30.297 INFO:tasks.workunit.client.0.smithi016.stdout:6/11: creat d1/f2 x:0 0 0 2024-04-26T20:18:30.300 INFO:tasks.workunit.client.0.smithi016.stdout:6/12: symlink d1/l3 0 2024-04-26T20:18:30.301 INFO:tasks.workunit.client.0.smithi016.stdout:9/24: rmdir d1 39 2024-04-26T20:18:30.306 INFO:tasks.workunit.client.0.smithi016.stdout:6/13: creat d1/f4 x:0 0 0 2024-04-26T20:18:30.351 INFO:tasks.workunit.client.0.smithi016.stdout:0/15: dwrite d2/f3 [0,4194304] 0 2024-04-26T20:18:30.352 INFO:tasks.workunit.client.0.smithi016.stdout:1/11: dwrite f2 [0,4194304] 0 2024-04-26T20:18:30.369 INFO:tasks.workunit.client.0.smithi016.stdout:1/12: dread f2 [0,4194304] 0 2024-04-26T20:18:30.557 INFO:tasks.workunit.client.0.smithi016.stdout:6/14: creat d1/f5 x:0 0 0 2024-04-26T20:18:30.561 INFO:tasks.workunit.client.0.smithi016.stdout:5/14: fsync d1/f2 0 2024-04-26T20:18:30.561 INFO:tasks.workunit.client.0.smithi016.stdout:9/25: fsync d1/d2/f3 0 2024-04-26T20:18:30.562 INFO:tasks.workunit.client.0.smithi016.stdout:0/16: unlink f0 0 2024-04-26T20:18:30.562 INFO:tasks.workunit.client.0.smithi016.stdout:1/13: creat d3/f4 x:0 0 0 2024-04-26T20:18:30.562 INFO:tasks.workunit.client.0.smithi016.stdout:2/7: truncate f1 2339077 0 2024-04-26T20:18:30.563 INFO:tasks.workunit.client.0.smithi016.stdout:6/15: creat d1/f6 x:0 0 0 2024-04-26T20:18:30.563 INFO:tasks.workunit.client.0.smithi016.stdout:6/16: dread - d1/f4 zero size 2024-04-26T20:18:30.564 INFO:tasks.workunit.client.0.smithi016.stdout:6/17: chown d1/f4 1023 1 2024-04-26T20:18:30.564 INFO:tasks.workunit.client.0.smithi016.stdout:6/18: dread - d1/f5 zero size 2024-04-26T20:18:30.564 INFO:tasks.workunit.client.0.smithi016.stdout:9/26: creat d1/d2/f5 x:0 0 0 2024-04-26T20:18:30.564 INFO:tasks.workunit.client.0.smithi016.stdout:9/27: write f0 [823723,123644] 0 2024-04-26T20:18:30.564 INFO:tasks.workunit.client.0.smithi016.stdout:9/28: chown d1 1170 1 2024-04-26T20:18:30.565 INFO:tasks.workunit.client.0.smithi016.stdout:0/17: mknod d2/c5 0 2024-04-26T20:18:30.566 INFO:tasks.workunit.client.0.smithi016.stdout:6/19: creat d1/f7 x:0 0 0 2024-04-26T20:18:30.566 INFO:tasks.workunit.client.0.smithi016.stdout:6/20: dread - d1/f5 zero size 2024-04-26T20:18:30.567 INFO:tasks.workunit.client.0.smithi016.stdout:9/29: creat d1/d2/f6 x:0 0 0 2024-04-26T20:18:30.568 INFO:tasks.workunit.client.0.smithi016.stdout:0/18: rename d2/f3 to d2/f6 0 2024-04-26T20:18:30.569 INFO:tasks.workunit.client.0.smithi016.stdout:6/21: mkdir d1/d8 0 2024-04-26T20:18:30.580 INFO:tasks.workunit.client.0.smithi016.stdout:1/14: dread f2 [0,4194304] 0 2024-04-26T20:18:30.606 INFO:tasks.workunit.client.0.smithi016.stdout:0/19: write d2/f6 [3942702,73369] 0 2024-04-26T20:18:30.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/15: read f2 [3270157,99961] 0 2024-04-26T20:18:30.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/16: stat c0 0 2024-04-26T20:18:30.615 INFO:tasks.workunit.client.0.smithi016.stdout:1/17: stat c0 0 2024-04-26T20:18:30.617 INFO:tasks.workunit.client.0.smithi016.stdout:1/18: mkdir d3/d5 0 2024-04-26T20:18:30.617 INFO:tasks.workunit.client.0.smithi016.stdout:1/19: chown d3 19636617 1 2024-04-26T20:18:30.620 INFO:tasks.workunit.client.0.smithi016.stdout:1/20: mkdir d3/d5/d6 0 2024-04-26T20:18:30.620 INFO:tasks.workunit.client.0.smithi016.stdout:1/21: chown c1 577255688 1 2024-04-26T20:18:30.620 INFO:tasks.workunit.client.0.smithi016.stdout:6/22: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:30.620 INFO:tasks.workunit.client.0.smithi016.stdout:6/23: write d1/f5 [771898,69447] 0 2024-04-26T20:18:30.635 INFO:tasks.workunit.client.0.smithi016.stdout:6/24: creat d1/f9 x:0 0 0 2024-04-26T20:18:30.635 INFO:tasks.workunit.client.0.smithi016.stdout:0/20: truncate d2/f6 2820438 0 2024-04-26T20:18:30.635 INFO:tasks.workunit.client.0.smithi016.stdout:6/25: rename d1/f9 to d1/fa 0 2024-04-26T20:18:30.641 INFO:tasks.workunit.client.0.smithi016.stdout:5/15: dwrite f0 [0,4194304] 0 2024-04-26T20:18:30.641 INFO:tasks.workunit.client.0.smithi016.stdout:5/16: fdatasync d1/f2 0 2024-04-26T20:18:30.643 INFO:tasks.workunit.client.0.smithi016.stdout:2/8: dwrite f1 [0,4194304] 0 2024-04-26T20:18:30.643 INFO:tasks.workunit.client.0.smithi016.stdout:9/30: dwrite d1/d2/f3 [0,4194304] 0 2024-04-26T20:18:30.646 INFO:tasks.workunit.client.0.smithi016.stdout:5/17: getdents d1 0 2024-04-26T20:18:30.646 INFO:tasks.workunit.client.0.smithi016.stdout:5/18: dread - d1/f2 zero size 2024-04-26T20:18:30.646 INFO:tasks.workunit.client.0.smithi016.stdout:5/19: fdatasync f0 0 2024-04-26T20:18:30.646 INFO:tasks.workunit.client.0.smithi016.stdout:2/9: mknod c3 0 2024-04-26T20:18:30.651 INFO:tasks.workunit.client.0.smithi016.stdout:2/10: rename f2 to f4 0 2024-04-26T20:18:30.651 INFO:tasks.workunit.client.0.smithi016.stdout:5/20: unlink d1/c3 0 2024-04-26T20:18:30.651 INFO:tasks.workunit.client.0.smithi016.stdout:2/11: write f4 [104279,32156] 0 2024-04-26T20:18:30.653 INFO:tasks.workunit.client.0.smithi016.stdout:5/21: rmdir d1 39 2024-04-26T20:18:30.654 INFO:tasks.workunit.client.0.smithi016.stdout:2/12: creat f5 x:0 0 0 2024-04-26T20:18:30.654 INFO:tasks.workunit.client.0.smithi016.stdout:2/13: chown f1 53153 1 2024-04-26T20:18:30.654 INFO:tasks.workunit.client.0.smithi016.stdout:2/14: truncate f4 1082100 0 2024-04-26T20:18:30.661 INFO:tasks.workunit.client.0.smithi016.stdout:1/22: dwrite f2 [4194304,4194304] 0 2024-04-26T20:18:30.662 INFO:tasks.workunit.client.0.smithi016.stdout:5/22: getdents d1 0 2024-04-26T20:18:30.670 INFO:tasks.workunit.client.0.smithi016.stdout:0/21: dread d2/f6 [0,4194304] 0 2024-04-26T20:18:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:1/23: link c1 d3/d5/d6/c7 0 2024-04-26T20:18:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:5/23: mknod d1/c4 0 2024-04-26T20:18:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:5/24: chown d1/f2 126402440 1 2024-04-26T20:18:30.671 INFO:tasks.workunit.client.0.smithi016.stdout:5/25: chown d1/c4 1013 1 2024-04-26T20:18:30.672 INFO:tasks.workunit.client.0.smithi016.stdout:0/22: creat d2/f7 x:0 0 0 2024-04-26T20:18:30.674 INFO:tasks.workunit.client.0.smithi016.stdout:1/24: mknod d3/c8 0 2024-04-26T20:18:30.674 INFO:tasks.workunit.client.0.smithi016.stdout:0/23: rmdir d2 39 2024-04-26T20:18:30.675 INFO:tasks.workunit.client.0.smithi016.stdout:0/24: mkdir d2/d8 0 2024-04-26T20:18:30.689 INFO:tasks.workunit.client.0.smithi016.stdout:5/26: write f0 [2686812,106035] 0 2024-04-26T20:18:30.692 INFO:tasks.workunit.client.0.smithi016.stdout:5/27: mkdir d1/d5 0 2024-04-26T20:18:30.692 INFO:tasks.workunit.client.0.smithi016.stdout:5/28: write f0 [2534013,22675] 0 2024-04-26T20:18:30.692 INFO:tasks.workunit.client.0.smithi016.stdout:0/25: fsync d2/f7 0 2024-04-26T20:18:30.693 INFO:tasks.workunit.client.0.smithi016.stdout:0/26: write d2/f7 [888438,34449] 0 2024-04-26T20:18:30.694 INFO:tasks.workunit.client.0.smithi016.stdout:5/29: symlink d1/d5/l6 0 2024-04-26T20:18:30.696 INFO:tasks.workunit.client.0.smithi016.stdout:0/27: link d2/f7 d2/d8/f9 0 2024-04-26T20:18:30.696 INFO:tasks.workunit.client.0.smithi016.stdout:0/28: chown d2/f7 3315 1 2024-04-26T20:18:30.696 INFO:tasks.workunit.client.0.smithi016.stdout:0/29: write d2/d8/f9 [1455493,124332] 0 2024-04-26T20:18:30.698 INFO:tasks.workunit.client.0.smithi016.stdout:0/30: creat d2/fa x:0 0 0 2024-04-26T20:18:30.699 INFO:tasks.workunit.client.0.smithi016.stdout:0/31: link d2/fa d2/fb 0 2024-04-26T20:18:30.700 INFO:tasks.workunit.client.0.smithi016.stdout:0/32: fdatasync d2/fb 0 2024-04-26T20:18:30.710 INFO:tasks.workunit.client.0.smithi016.stdout:0/33: fsync d2/fb 0 2024-04-26T20:18:30.712 INFO:tasks.workunit.client.0.smithi016.stdout:0/34: mkdir d2/dc 0 2024-04-26T20:18:30.712 INFO:tasks.workunit.client.0.smithi016.stdout:0/35: read - d2/fb zero size 2024-04-26T20:18:30.713 INFO:tasks.workunit.client.0.smithi016.stdout:0/36: creat d2/fd x:0 0 0 2024-04-26T20:18:30.713 INFO:tasks.workunit.client.0.smithi016.stdout:0/37: stat d2/l4 0 2024-04-26T20:18:30.713 INFO:tasks.workunit.client.0.smithi016.stdout:0/38: chown d2/fd 2783 1 2024-04-26T20:18:30.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/25: dwrite f2 [4194304,4194304] 0 2024-04-26T20:18:30.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/26: write d3/f4 [569936,37624] 0 2024-04-26T20:18:30.722 INFO:tasks.workunit.client.0.smithi016.stdout:2/15: dwrite f1 [4194304,4194304] 0 2024-04-26T20:18:30.734 INFO:tasks.workunit.client.0.smithi016.stdout:2/16: symlink l6 0 2024-04-26T20:18:30.762 INFO:tasks.workunit.client.0.smithi016.stdout:5/30: dwrite d1/f2 [0,4194304] 0 2024-04-26T20:18:30.767 INFO:tasks.workunit.client.0.smithi016.stdout:5/31: rename d1/c4 to d1/d5/c7 0 2024-04-26T20:18:30.767 INFO:tasks.workunit.client.0.smithi016.stdout:5/32: fsync d1/f2 0 2024-04-26T20:18:30.768 INFO:tasks.workunit.client.0.smithi016.stdout:5/33: write f0 [680860,20132] 0 2024-04-26T20:18:30.768 INFO:tasks.workunit.client.0.smithi016.stdout:5/34: rename d1 to d1/d8 22 2024-04-26T20:18:30.769 INFO:tasks.workunit.client.0.smithi016.stdout:5/35: readlink d1/d5/l6 0 2024-04-26T20:18:30.778 INFO:tasks.workunit.client.0.smithi016.stdout:0/39: dwrite d2/fd [0,4194304] 0 2024-04-26T20:18:30.779 INFO:tasks.workunit.client.0.smithi016.stdout:5/36: getdents d1/d5 0 2024-04-26T20:18:30.782 INFO:tasks.workunit.client.0.smithi016.stdout:0/40: creat d2/d8/fe x:0 0 0 2024-04-26T20:18:30.791 INFO:tasks.workunit.client.0.smithi016.stdout:5/37: dread f0 [0,4194304] 0 2024-04-26T20:18:30.802 INFO:tasks.workunit.client.0.smithi016.stdout:5/38: write d1/f2 [465054,41287] 0 2024-04-26T20:18:30.802 INFO:tasks.workunit.client.0.smithi016.stdout:5/39: write d1/f2 [1697928,52604] 0 2024-04-26T20:18:30.815 INFO:tasks.workunit.client.0.smithi016.stdout:5/40: dread d1/f2 [0,4194304] 0 2024-04-26T20:18:30.815 INFO:tasks.workunit.client.0.smithi016.stdout:5/41: read d1/f2 [583840,108603] 0 2024-04-26T20:18:30.816 INFO:tasks.workunit.client.0.smithi016.stdout:5/42: mkdir d1/d9 0 2024-04-26T20:18:30.817 INFO:tasks.workunit.client.0.smithi016.stdout:5/43: rename d1/d5/l6 to d1/d5/la 0 2024-04-26T20:18:30.818 INFO:tasks.workunit.client.0.smithi016.stdout:5/44: symlink d1/lb 0 2024-04-26T20:18:30.818 INFO:tasks.workunit.client.0.smithi016.stdout:5/45: fdatasync f0 0 2024-04-26T20:18:30.818 INFO:tasks.workunit.client.0.smithi016.stdout:5/46: chown d1/f2 21022847 1 2024-04-26T20:18:30.821 INFO:tasks.workunit.client.0.smithi016.stdout:5/47: creat d1/d9/fc x:0 0 0 2024-04-26T20:18:30.821 INFO:tasks.workunit.client.0.smithi016.stdout:5/48: read f0 [2061030,74051] 0 2024-04-26T20:18:30.822 INFO:tasks.workunit.client.0.smithi016.stdout:5/49: write d1/d9/fc [934927,495] 0 2024-04-26T20:18:30.870 INFO:tasks.workunit.client.0.smithi016.stdout:1/27: dwrite d3/f4 [0,4194304] 0 2024-04-26T20:18:30.870 INFO:tasks.workunit.client.0.smithi016.stdout:0/41: dread d2/d8/f9 [0,4194304] 0 2024-04-26T20:18:30.871 INFO:tasks.workunit.client.0.smithi016.stdout:0/42: symlink d2/d8/lf 0 2024-04-26T20:18:30.872 INFO:tasks.workunit.client.0.smithi016.stdout:0/43: creat d2/f10 x:0 0 0 2024-04-26T20:18:30.873 INFO:tasks.workunit.client.0.smithi016.stdout:5/50: dwrite d1/f2 [0,4194304] 0 2024-04-26T20:18:30.873 INFO:tasks.workunit.client.0.smithi016.stdout:5/51: fdatasync f0 0 2024-04-26T20:18:30.874 INFO:tasks.workunit.client.0.smithi016.stdout:0/44: rename d2/f10 to d2/d8/f11 0 2024-04-26T20:18:30.875 INFO:tasks.workunit.client.0.smithi016.stdout:0/45: write d2/fa [494003,63200] 0 2024-04-26T20:18:30.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/52: creat d1/d5/fd x:0 0 0 2024-04-26T20:18:30.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/53: chown d1/f2 1814895 1 2024-04-26T20:18:30.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/54: chown f0 1630 1 2024-04-26T20:18:30.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/55: write d1/d5/fd [80310,100474] 0 2024-04-26T20:18:30.876 INFO:tasks.workunit.client.0.smithi016.stdout:0/46: mknod d2/dc/c12 0 2024-04-26T20:18:30.877 INFO:tasks.workunit.client.0.smithi016.stdout:0/47: truncate d2/d8/f9 1724824 0 2024-04-26T20:18:30.877 INFO:tasks.workunit.client.0.smithi016.stdout:0/48: write d2/d8/fe [511043,130036] 0 2024-04-26T20:18:30.877 INFO:tasks.workunit.client.0.smithi016.stdout:5/56: mknod d1/d9/ce 0 2024-04-26T20:18:30.877 INFO:tasks.workunit.client.0.smithi016.stdout:0/49: symlink d2/dc/l13 0 2024-04-26T20:18:30.878 INFO:tasks.workunit.client.0.smithi016.stdout:5/57: creat d1/d5/ff x:0 0 0 2024-04-26T20:18:30.878 INFO:tasks.workunit.client.0.smithi016.stdout:0/50: write d2/f7 [1674555,63824] 0 2024-04-26T20:18:30.879 INFO:tasks.workunit.client.0.smithi016.stdout:0/51: read d2/fa [459952,104759] 0 2024-04-26T20:18:30.879 INFO:tasks.workunit.client.0.smithi016.stdout:0/52: write d2/fa [1140455,22981] 0 2024-04-26T20:18:30.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/53: write d2/fa [701629,38174] 0 2024-04-26T20:18:30.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/54: read d2/f6 [2787473,112111] 0 2024-04-26T20:18:30.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/55: creat d2/f14 x:0 0 0 2024-04-26T20:18:30.881 INFO:tasks.workunit.client.0.smithi016.stdout:0/56: creat d2/f15 x:0 0 0 2024-04-26T20:18:30.888 INFO:tasks.workunit.client.0.smithi016.stdout:1/28: dread d3/f4 [0,4194304] 0 2024-04-26T20:18:30.897 INFO:tasks.workunit.client.0.smithi016.stdout:0/57: dread d2/fd [0,4194304] 0 2024-04-26T20:18:30.897 INFO:tasks.workunit.client.0.smithi016.stdout:0/58: chown d2/fd 30900 1 2024-04-26T20:18:30.897 INFO:tasks.workunit.client.0.smithi016.stdout:0/59: mknod d2/c16 0 2024-04-26T20:18:30.898 INFO:tasks.workunit.client.0.smithi016.stdout:0/60: dread - d2/d8/f11 zero size 2024-04-26T20:18:30.903 INFO:tasks.workunit.client.0.smithi016.stdout:1/29: dread d3/f4 [0,4194304] 0 2024-04-26T20:18:30.926 INFO:tasks.workunit.client.0.smithi016.stdout:1/30: dread f2 [4194304,4194304] 0 2024-04-26T20:18:30.927 INFO:tasks.workunit.client.0.smithi016.stdout:1/31: getdents d3 0 2024-04-26T20:18:30.965 INFO:tasks.workunit.client.0.smithi016.stdout:0/61: dwrite d2/d8/fe [0,4194304] 0 2024-04-26T20:18:30.969 INFO:tasks.workunit.client.0.smithi016.stdout:1/32: dwrite d3/f4 [0,4194304] 0 2024-04-26T20:18:30.970 INFO:tasks.workunit.client.0.smithi016.stdout:0/62: write d2/d8/f9 [1082021,117745] 0 2024-04-26T20:18:30.973 INFO:tasks.workunit.client.0.smithi016.stdout:5/58: fsync d1/d9/fc 0 2024-04-26T20:18:30.973 INFO:tasks.workunit.client.0.smithi016.stdout:5/59: chown d1/d5/la 66274 1 2024-04-26T20:18:30.980 INFO:tasks.workunit.client.0.smithi016.stdout:5/60: dread d1/d5/fd [0,4194304] 0 2024-04-26T20:18:30.981 INFO:tasks.workunit.client.0.smithi016.stdout:5/61: link d1/d5/fd d1/d9/f10 0 2024-04-26T20:18:30.981 INFO:tasks.workunit.client.0.smithi016.stdout:5/62: mkdir d1/d9/d11 0 2024-04-26T20:18:30.983 INFO:tasks.workunit.client.0.smithi016.stdout:5/63: rename d1/d5/ff to d1/d5/f12 0 2024-04-26T20:18:30.983 INFO:tasks.workunit.client.0.smithi016.stdout:5/64: write d1/d9/f10 [748983,19558] 0 2024-04-26T20:18:30.985 INFO:tasks.workunit.client.0.smithi016.stdout:1/33: dread f2 [0,4194304] 0 2024-04-26T20:18:30.986 INFO:tasks.workunit.client.0.smithi016.stdout:1/34: mkdir d3/d5/d6/d9 0 2024-04-26T20:18:30.996 INFO:tasks.workunit.client.0.smithi016.stdout:5/65: dread d1/f2 [0,4194304] 0 2024-04-26T20:18:30.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/66: getdents d1 0 2024-04-26T20:18:30.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/67: dread - d1/d5/f12 zero size 2024-04-26T20:18:31.006 INFO:tasks.workunit.client.0.smithi016.stdout:1/35: write d3/f4 [1502381,129082] 0 2024-04-26T20:18:31.043 INFO:tasks.workunit.client.0.smithi016.stdout:5/68: dwrite d1/d5/fd [0,4194304] 0 2024-04-26T20:18:31.045 INFO:tasks.workunit.client.0.smithi016.stdout:5/69: mknod d1/d5/c13 0 2024-04-26T20:18:31.062 INFO:tasks.workunit.client.0.smithi016.stdout:1/36: dwrite f2 [0,4194304] 0 2024-04-26T20:18:31.086 INFO:tasks.workunit.client.0.smithi016.stdout:0/63: dwrite d2/d8/fe [4194304,4194304] 0 2024-04-26T20:18:31.313 INFO:tasks.workunit.client.0.smithi016.stdout:1/37: mkdir d3/d5/da 0 2024-04-26T20:18:31.314 INFO:tasks.workunit.client.0.smithi016.stdout:0/64: creat d2/dc/f17 x:0 0 0 2024-04-26T20:18:31.314 INFO:tasks.workunit.client.0.smithi016.stdout:0/65: read - d2/d8/f11 zero size 2024-04-26T20:18:31.314 INFO:tasks.workunit.client.0.smithi016.stdout:1/38: mkdir d3/d5/d6/d9/db 0 2024-04-26T20:18:31.315 INFO:tasks.workunit.client.0.smithi016.stdout:0/66: unlink d2/f7 0 2024-04-26T20:18:31.316 INFO:tasks.workunit.client.0.smithi016.stdout:0/67: readlink d2/l4 0 2024-04-26T20:18:31.316 INFO:tasks.workunit.client.0.smithi016.stdout:1/39: creat d3/d5/da/fc x:0 0 0 2024-04-26T20:18:31.317 INFO:tasks.workunit.client.0.smithi016.stdout:0/68: unlink d2/f6 0 2024-04-26T20:18:31.317 INFO:tasks.workunit.client.0.smithi016.stdout:0/69: dread - d2/f14 zero size 2024-04-26T20:18:31.318 INFO:tasks.workunit.client.0.smithi016.stdout:1/40: unlink d3/c8 0 2024-04-26T20:18:31.318 INFO:tasks.workunit.client.0.smithi016.stdout:1/41: read d3/f4 [2225197,49417] 0 2024-04-26T20:18:31.320 INFO:tasks.workunit.client.0.smithi016.stdout:1/42: creat d3/d5/d6/fd x:0 0 0 2024-04-26T20:18:31.377 INFO:tasks.workunit.client.0.smithi016.stdout:1/43: dwrite f2 [0,4194304] 0 2024-04-26T20:18:31.377 INFO:tasks.workunit.client.0.smithi016.stdout:1/44: readlink - no filename 2024-04-26T20:18:31.377 INFO:tasks.workunit.client.0.smithi016.stdout:1/45: write d3/f4 [1603809,94824] 0 2024-04-26T20:18:31.377 INFO:tasks.workunit.client.0.smithi016.stdout:1/46: symlink d3/d5/d6/le 0 2024-04-26T20:18:31.378 INFO:tasks.workunit.client.0.smithi016.stdout:1/47: symlink d3/d5/d6/d9/db/lf 0 2024-04-26T20:18:31.449 INFO:tasks.workunit.client.0.smithi016.stdout:1/48: dwrite d3/f4 [0,4194304] 0 2024-04-26T20:18:31.451 INFO:tasks.workunit.client.0.smithi016.stdout:1/49: symlink d3/d5/l10 0 2024-04-26T20:18:31.452 INFO:tasks.workunit.client.0.smithi016.stdout:1/50: rename c1 to d3/d5/c11 0 2024-04-26T20:18:31.453 INFO:tasks.workunit.client.0.smithi016.stdout:1/51: mkdir d3/d5/d6/d9/d12 0 2024-04-26T20:18:31.454 INFO:tasks.workunit.client.0.smithi016.stdout:1/52: creat d3/d5/f13 x:0 0 0 2024-04-26T20:18:31.473 INFO:tasks.workunit.client.0.smithi016.stdout:1/53: dread f2 [0,4194304] 0 2024-04-26T20:18:31.474 INFO:tasks.workunit.client.0.smithi016.stdout:1/54: creat d3/d5/d6/f14 x:0 0 0 2024-04-26T20:18:31.484 INFO:tasks.workunit.client.0.smithi016.stdout:1/55: dread f2 [4194304,4194304] 0 2024-04-26T20:18:31.489 INFO:tasks.workunit.client.0.smithi016.stdout:5/70: getdents d1/d9 0 2024-04-26T20:18:31.490 INFO:tasks.workunit.client.0.smithi016.stdout:5/71: rmdir d1/d9 39 2024-04-26T20:18:31.490 INFO:tasks.workunit.client.0.smithi016.stdout:5/72: truncate d1/d5/fd 4622574 0 2024-04-26T20:18:31.491 INFO:tasks.workunit.client.0.smithi016.stdout:5/73: creat d1/d9/f14 x:0 0 0 2024-04-26T20:18:31.498 INFO:tasks.workunit.client.0.smithi016.stdout:5/74: dread d1/d9/fc [0,4194304] 0 2024-04-26T20:18:31.498 INFO:tasks.workunit.client.0.smithi016.stdout:5/75: chown d1/d5/f12 1951 1 2024-04-26T20:18:31.499 INFO:tasks.workunit.client.0.smithi016.stdout:5/76: chown d1/d9/ce 88735 1 2024-04-26T20:18:31.500 INFO:tasks.workunit.client.0.smithi016.stdout:5/77: unlink d1/lb 0 2024-04-26T20:18:31.500 INFO:tasks.workunit.client.0.smithi016.stdout:5/78: fsync d1/d5/f12 0 2024-04-26T20:18:31.500 INFO:tasks.workunit.client.0.smithi016.stdout:5/79: getdents d1/d9/d11 0 2024-04-26T20:18:31.501 INFO:tasks.workunit.client.0.smithi016.stdout:5/80: symlink d1/l15 0 2024-04-26T20:18:31.501 INFO:tasks.workunit.client.0.smithi016.stdout:5/81: creat d1/d9/f16 x:0 0 0 2024-04-26T20:18:31.501 INFO:tasks.workunit.client.0.smithi016.stdout:5/82: chown f0 255191 1 2024-04-26T20:18:31.502 INFO:tasks.workunit.client.0.smithi016.stdout:5/83: write f0 [1286547,66372] 0 2024-04-26T20:18:31.529 INFO:tasks.workunit.client.0.smithi016.stdout:1/56: getdents d3/d5/d6 0 2024-04-26T20:18:31.547 INFO:tasks.workunit.client.0.smithi016.stdout:5/84: dwrite d1/d9/f16 [0,4194304] 0 2024-04-26T20:18:31.570 INFO:tasks.workunit.client.0.smithi016.stdout:5/85: dread d1/d9/f16 [0,4194304] 0 2024-04-26T20:18:31.575 INFO:tasks.workunit.client.0.smithi016.stdout:1/57: dwrite d3/f4 [4194304,4194304] 0 2024-04-26T20:18:31.578 INFO:tasks.workunit.client.0.smithi016.stdout:1/58: unlink d3/d5/d6/d9/db/lf 0 2024-04-26T20:18:31.578 INFO:tasks.workunit.client.0.smithi016.stdout:1/59: read - d3/d5/da/fc zero size 2024-04-26T20:18:31.580 INFO:tasks.workunit.client.0.smithi016.stdout:1/60: unlink d3/d5/c11 0 2024-04-26T20:18:31.582 INFO:tasks.workunit.client.0.smithi016.stdout:1/61: symlink d3/d5/d6/l15 0 2024-04-26T20:18:31.582 INFO:tasks.workunit.client.0.smithi016.stdout:1/62: chown c0 1682824 1 2024-04-26T20:18:31.582 INFO:tasks.workunit.client.0.smithi016.stdout:1/63: read - d3/d5/f13 zero size 2024-04-26T20:18:31.583 INFO:tasks.workunit.client.0.smithi016.stdout:1/64: mknod d3/d5/d6/d9/c16 0 2024-04-26T20:18:31.583 INFO:tasks.workunit.client.0.smithi016.stdout:1/65: write d3/d5/d6/f14 [947190,89944] 0 2024-04-26T20:18:31.583 INFO:tasks.workunit.client.0.smithi016.stdout:1/66: write d3/d5/d6/fd [4605,125278] 0 2024-04-26T20:18:31.583 INFO:tasks.workunit.client.0.smithi016.stdout:5/86: write d1/d5/fd [3077605,84923] 0 2024-04-26T20:18:31.590 INFO:tasks.workunit.client.0.smithi016.stdout:1/67: fdatasync d3/d5/d6/f14 0 2024-04-26T20:18:31.593 INFO:tasks.workunit.client.0.smithi016.stdout:1/68: dread d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:31.593 INFO:tasks.workunit.client.0.smithi016.stdout:1/69: readlink d3/d5/d6/l15 0 2024-04-26T20:18:32.371 INFO:tasks.workunit.client.0.smithi016.stdout:5/87: unlink d1/d5/la 0 2024-04-26T20:18:32.422 INFO:tasks.workunit.client.0.smithi016.stdout:5/88: dwrite d1/d9/f14 [0,4194304] 0 2024-04-26T20:18:32.445 INFO:tasks.workunit.client.0.smithi016.stdout:5/89: write d1/d9/f14 [41539,43397] 0 2024-04-26T20:18:32.454 INFO:tasks.workunit.client.0.smithi016.stdout:5/90: dread d1/f2 [0,4194304] 0 2024-04-26T20:18:32.454 INFO:tasks.workunit.client.0.smithi016.stdout:5/91: readlink d1/l15 0 2024-04-26T20:18:33.113 INFO:tasks.workunit.client.0.smithi016.stdout:5/92: symlink d1/l17 0 2024-04-26T20:18:33.113 INFO:tasks.workunit.client.0.smithi016.stdout:5/93: readlink d1/l17 0 2024-04-26T20:18:33.113 INFO:tasks.workunit.client.0.smithi016.stdout:5/94: write f0 [4351241,118820] 0 2024-04-26T20:18:33.123 INFO:tasks.workunit.client.0.smithi016.stdout:5/95: dread d1/d5/fd [0,4194304] 0 2024-04-26T20:18:33.124 INFO:tasks.workunit.client.0.smithi016.stdout:5/96: truncate d1/d9/f16 2503987 0 2024-04-26T20:18:33.124 INFO:tasks.workunit.client.0.smithi016.stdout:5/97: chown d1/d5/c13 19 1 2024-04-26T20:18:33.124 INFO:tasks.workunit.client.0.smithi016.stdout:5/98: write d1/d9/f10 [1457327,121257] 0 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/5: sync 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/6: truncate - no filename 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:6/26: sync 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:0/70: sync 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/7: chown d0/d1 626 1 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/8: dread - no filename 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/9: unlink - no file 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/10: dread - no filename 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/11: write - no filename 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:4/17: sync 2024-04-26T20:18:33.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/12: truncate - no filename 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:7/13: dwrite - no filename 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:2/17: sync 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:6/27: truncate d1/f7 5059639 0 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/2: sync 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/3: rmdir - no directory 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:1/70: sync 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:3/5: sync 2024-04-26T20:18:33.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/31: sync 2024-04-26T20:18:33.129 INFO:tasks.workunit.client.0.smithi016.stdout:7/14: mknod d0/c2 0 2024-04-26T20:18:33.129 INFO:tasks.workunit.client.0.smithi016.stdout:7/15: chown d0 473 1 2024-04-26T20:18:33.132 INFO:tasks.workunit.client.0.smithi016.stdout:2/18: creat f7 x:0 0 0 2024-04-26T20:18:33.132 INFO:tasks.workunit.client.0.smithi016.stdout:5/99: dread d1/d9/fc [0,4194304] 0 2024-04-26T20:18:33.132 INFO:tasks.workunit.client.0.smithi016.stdout:4/18: write d0/f1 [1340427,2715] 0 2024-04-26T20:18:33.133 INFO:tasks.workunit.client.0.smithi016.stdout:4/19: write d0/f1 [1920149,120918] 0 2024-04-26T20:18:33.133 INFO:tasks.workunit.client.0.smithi016.stdout:4/20: readlink d0/l2 0 2024-04-26T20:18:33.134 INFO:tasks.workunit.client.0.smithi016.stdout:8/4: link l0 l1 0 2024-04-26T20:18:33.136 INFO:tasks.workunit.client.0.smithi016.stdout:9/32: mkdir d1/d7 0 2024-04-26T20:18:33.137 INFO:tasks.workunit.client.0.smithi016.stdout:7/16: unlink d0/c2 0 2024-04-26T20:18:33.137 INFO:tasks.workunit.client.0.smithi016.stdout:7/17: link - no file 2024-04-26T20:18:33.137 INFO:tasks.workunit.client.0.smithi016.stdout:7/18: fsync - no filename 2024-04-26T20:18:33.138 INFO:tasks.workunit.client.0.smithi016.stdout:5/100: link d1/d9/fc d1/d9/d11/f18 0 2024-04-26T20:18:33.139 INFO:tasks.workunit.client.0.smithi016.stdout:5/101: fdatasync d1/d5/f12 0 2024-04-26T20:18:33.139 INFO:tasks.workunit.client.0.smithi016.stdout:4/21: getdents d0 0 2024-04-26T20:18:33.140 INFO:tasks.workunit.client.0.smithi016.stdout:8/5: symlink l2 0 2024-04-26T20:18:33.141 INFO:tasks.workunit.client.0.smithi016.stdout:1/71: mknod d3/d5/d6/c17 0 2024-04-26T20:18:33.142 INFO:tasks.workunit.client.0.smithi016.stdout:9/33: rename d1/f4 to d1/f8 0 2024-04-26T20:18:33.143 INFO:tasks.workunit.client.0.smithi016.stdout:7/19: creat d0/f3 x:0 0 0 2024-04-26T20:18:33.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/6: rename l0 to l3 0 2024-04-26T20:18:33.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/7: write - no filename 2024-04-26T20:18:33.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/8: rmdir - no directory 2024-04-26T20:18:33.146 INFO:tasks.workunit.client.0.smithi016.stdout:1/72: creat d3/d5/f18 x:0 0 0 2024-04-26T20:18:33.147 INFO:tasks.workunit.client.0.smithi016.stdout:9/34: creat d1/d7/f9 x:0 0 0 2024-04-26T20:18:33.147 INFO:tasks.workunit.client.0.smithi016.stdout:9/35: readlink - no filename 2024-04-26T20:18:33.147 INFO:tasks.workunit.client.0.smithi016.stdout:9/36: fsync d1/d2/f6 0 2024-04-26T20:18:33.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/20: link d0/f3 d0/d1/f4 0 2024-04-26T20:18:33.150 INFO:tasks.workunit.client.0.smithi016.stdout:8/9: mknod c4 0 2024-04-26T20:18:33.150 INFO:tasks.workunit.client.0.smithi016.stdout:8/10: dread - no filename 2024-04-26T20:18:33.150 INFO:tasks.workunit.client.0.smithi016.stdout:8/11: rmdir - no directory 2024-04-26T20:18:33.151 INFO:tasks.workunit.client.0.smithi016.stdout:1/73: mkdir d3/d19 0 2024-04-26T20:18:33.154 INFO:tasks.workunit.client.0.smithi016.stdout:8/12: creat f5 x:0 0 0 2024-04-26T20:18:33.160 INFO:tasks.workunit.client.0.smithi016.stdout:5/102: fsync d1/d9/d11/f18 0 2024-04-26T20:18:33.163 INFO:tasks.workunit.client.0.smithi016.stdout:5/103: symlink d1/l19 0 2024-04-26T20:18:33.184 INFO:tasks.workunit.client.0.smithi016.stdout:6/28: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:33.184 INFO:tasks.workunit.client.0.smithi016.stdout:6/29: write d1/f7 [4854081,118746] 0 2024-04-26T20:18:33.185 INFO:tasks.workunit.client.0.smithi016.stdout:6/30: write d1/f2 [611108,63769] 0 2024-04-26T20:18:33.185 INFO:tasks.workunit.client.0.smithi016.stdout:6/31: stat d1/f2 0 2024-04-26T20:18:33.185 INFO:tasks.workunit.client.0.smithi016.stdout:6/32: write f0 [1254333,67311] 0 2024-04-26T20:18:33.185 INFO:tasks.workunit.client.0.smithi016.stdout:6/33: readlink d1/l3 0 2024-04-26T20:18:33.187 INFO:tasks.workunit.client.0.smithi016.stdout:4/22: fsync d0/f1 0 2024-04-26T20:18:33.189 INFO:tasks.workunit.client.0.smithi016.stdout:1/74: creat d3/d5/d6/d9/db/f1a x:0 0 0 2024-04-26T20:18:33.189 INFO:tasks.workunit.client.0.smithi016.stdout:1/75: readlink d3/d5/l10 0 2024-04-26T20:18:33.190 INFO:tasks.workunit.client.0.smithi016.stdout:1/76: write d3/d5/da/fc [373439,3675] 0 2024-04-26T20:18:33.192 INFO:tasks.workunit.client.0.smithi016.stdout:6/34: creat d1/d8/fb x:0 0 0 2024-04-26T20:18:33.202 INFO:tasks.workunit.client.0.smithi016.stdout:7/21: dwrite d0/d1/f4 [0,4194304] 0 2024-04-26T20:18:33.203 INFO:tasks.workunit.client.0.smithi016.stdout:4/23: mknod d0/c5 0 2024-04-26T20:18:33.217 INFO:tasks.workunit.client.0.smithi016.stdout:0/71: dwrite d2/fb [0,4194304] 0 2024-04-26T20:18:33.217 INFO:tasks.workunit.client.0.smithi016.stdout:0/72: dread - d2/dc/f17 zero size 2024-04-26T20:18:33.219 INFO:tasks.workunit.client.0.smithi016.stdout:7/22: rmdir d0 39 2024-04-26T20:18:33.219 INFO:tasks.workunit.client.0.smithi016.stdout:7/23: rename d0 to d0/d1/d5 22 2024-04-26T20:18:33.221 INFO:tasks.workunit.client.0.smithi016.stdout:2/19: dwrite f7 [0,4194304] 0 2024-04-26T20:18:33.224 INFO:tasks.workunit.client.0.smithi016.stdout:4/24: rename d0/c5 to d0/c6 0 2024-04-26T20:18:33.229 INFO:tasks.workunit.client.0.smithi016.stdout:7/24: mkdir d0/d1/d6 0 2024-04-26T20:18:33.230 INFO:tasks.workunit.client.0.smithi016.stdout:7/25: write d0/d1/f4 [5118646,99094] 0 2024-04-26T20:18:33.230 INFO:tasks.workunit.client.0.smithi016.stdout:1/77: dwrite d3/d5/d6/d9/db/f1a [0,4194304] 0 2024-04-26T20:18:33.230 INFO:tasks.workunit.client.0.smithi016.stdout:1/78: fsync f2 0 2024-04-26T20:18:33.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/25: mkdir d0/d7 0 2024-04-26T20:18:33.242 INFO:tasks.workunit.client.0.smithi016.stdout:9/37: dwrite d1/d2/f5 [0,4194304] 0 2024-04-26T20:18:33.248 INFO:tasks.workunit.client.0.smithi016.stdout:2/20: write f1 [6787795,60067] 0 2024-04-26T20:18:33.248 INFO:tasks.workunit.client.0.smithi016.stdout:1/79: rmdir d3/d19 0 2024-04-26T20:18:33.248 INFO:tasks.workunit.client.0.smithi016.stdout:1/80: chown d3 15 1 2024-04-26T20:18:33.258 INFO:tasks.workunit.client.0.smithi016.stdout:9/38: creat d1/fa x:0 0 0 2024-04-26T20:18:33.280 INFO:tasks.workunit.client.0.smithi016.stdout:5/104: dwrite d1/d9/f16 [0,4194304] 0 2024-04-26T20:18:33.290 INFO:tasks.workunit.client.0.smithi016.stdout:9/39: creat d1/d7/fb x:0 0 0 2024-04-26T20:18:33.295 INFO:tasks.workunit.client.0.smithi016.stdout:7/26: dwrite d0/d1/f4 [0,4194304] 0 2024-04-26T20:18:33.296 INFO:tasks.workunit.client.0.smithi016.stdout:6/35: dwrite d1/fa [0,4194304] 0 2024-04-26T20:18:33.297 INFO:tasks.workunit.client.0.smithi016.stdout:9/40: rmdir d1 39 2024-04-26T20:18:33.303 INFO:tasks.workunit.client.0.smithi016.stdout:1/81: dwrite f2 [0,4194304] 0 2024-04-26T20:18:33.304 INFO:tasks.workunit.client.0.smithi016.stdout:6/36: rmdir d1/d8 39 2024-04-26T20:18:33.312 INFO:tasks.workunit.client.0.smithi016.stdout:7/27: write d0/f3 [1527356,12542] 0 2024-04-26T20:18:33.312 INFO:tasks.workunit.client.0.smithi016.stdout:7/28: chown d0/d1 2589 1 2024-04-26T20:18:33.313 INFO:tasks.workunit.client.0.smithi016.stdout:7/29: getdents d0/d1/d6 0 2024-04-26T20:18:33.314 INFO:tasks.workunit.client.0.smithi016.stdout:4/26: dwrite d0/f1 [0,4194304] 0 2024-04-26T20:18:33.314 INFO:tasks.workunit.client.0.smithi016.stdout:4/27: readlink d0/l2 0 2024-04-26T20:18:33.315 INFO:tasks.workunit.client.0.smithi016.stdout:7/30: creat d0/f7 x:0 0 0 2024-04-26T20:18:33.316 INFO:tasks.workunit.client.0.smithi016.stdout:9/41: truncate d1/d2/f5 3530393 0 2024-04-26T20:18:33.316 INFO:tasks.workunit.client.0.smithi016.stdout:1/82: mknod d3/d5/d6/c1b 0 2024-04-26T20:18:33.319 INFO:tasks.workunit.client.0.smithi016.stdout:4/28: rmdir d0/d7 0 2024-04-26T20:18:33.320 INFO:tasks.workunit.client.0.smithi016.stdout:7/31: getdents d0 0 2024-04-26T20:18:33.333 INFO:tasks.workunit.client.0.smithi016.stdout:2/21: dwrite f4 [0,4194304] 0 2024-04-26T20:18:33.333 INFO:tasks.workunit.client.0.smithi016.stdout:2/22: truncate f5 25685 0 2024-04-26T20:18:33.333 INFO:tasks.workunit.client.0.smithi016.stdout:2/23: truncate f5 940327 0 2024-04-26T20:18:33.362 INFO:tasks.workunit.client.0.smithi016.stdout:6/37: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:33.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/24: dread f7 [0,4194304] 0 2024-04-26T20:18:33.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/25: fdatasync f4 0 2024-04-26T20:18:33.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/26: chown f7 451934292 1 2024-04-26T20:18:33.371 INFO:tasks.workunit.client.0.smithi016.stdout:2/27: dread f7 [0,4194304] 0 2024-04-26T20:18:33.574 INFO:tasks.workunit.client.0.smithi016.stdout:4/29: creat d0/f8 x:0 0 0 2024-04-26T20:18:33.574 INFO:tasks.workunit.client.0.smithi016.stdout:7/32: symlink d0/l8 0 2024-04-26T20:18:33.576 INFO:tasks.workunit.client.0.smithi016.stdout:6/38: link d1/f7 d1/d8/fc 0 2024-04-26T20:18:33.577 INFO:tasks.workunit.client.0.smithi016.stdout:2/28: rename c3 to c8 0 2024-04-26T20:18:33.579 INFO:tasks.workunit.client.0.smithi016.stdout:1/83: dread d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:33.579 INFO:tasks.workunit.client.0.smithi016.stdout:1/84: getdents d3/d5/d6/d9/d12 0 2024-04-26T20:18:33.581 INFO:tasks.workunit.client.0.smithi016.stdout:6/39: creat d1/fd x:0 0 0 2024-04-26T20:18:33.582 INFO:tasks.workunit.client.0.smithi016.stdout:2/29: mkdir d9 0 2024-04-26T20:18:33.583 INFO:tasks.workunit.client.0.smithi016.stdout:6/40: mkdir d1/de 0 2024-04-26T20:18:33.583 INFO:tasks.workunit.client.0.smithi016.stdout:6/41: chown d1/f7 1922023 1 2024-04-26T20:18:33.585 INFO:tasks.workunit.client.0.smithi016.stdout:2/30: rmdir d9 0 2024-04-26T20:18:33.586 INFO:tasks.workunit.client.0.smithi016.stdout:1/85: mknod d3/d5/d6/c1c 0 2024-04-26T20:18:33.587 INFO:tasks.workunit.client.0.smithi016.stdout:6/42: creat d1/d8/ff x:0 0 0 2024-04-26T20:18:33.589 INFO:tasks.workunit.client.0.smithi016.stdout:1/86: truncate d3/d5/d6/d9/db/f1a 2425865 0 2024-04-26T20:18:33.597 INFO:tasks.workunit.client.0.smithi016.stdout:9/42: read d1/d2/f5 [776731,103748] 0 2024-04-26T20:18:33.597 INFO:tasks.workunit.client.0.smithi016.stdout:9/43: dread - d1/d2/f6 zero size 2024-04-26T20:18:33.633 INFO:tasks.workunit.client.0.smithi016.stdout:7/33: dwrite d0/f3 [4194304,4194304] 0 2024-04-26T20:18:33.640 INFO:tasks.workunit.client.0.smithi016.stdout:2/31: dwrite f1 [4194304,4194304] 0 2024-04-26T20:18:33.640 INFO:tasks.workunit.client.0.smithi016.stdout:2/32: stat f1 0 2024-04-26T20:18:33.641 INFO:tasks.workunit.client.0.smithi016.stdout:4/30: dwrite d0/f8 [0,4194304] 0 2024-04-26T20:18:33.642 INFO:tasks.workunit.client.0.smithi016.stdout:2/33: rename f1 to fa 0 2024-04-26T20:18:33.645 INFO:tasks.workunit.client.0.smithi016.stdout:4/31: creat d0/f9 x:0 0 0 2024-04-26T20:18:33.645 INFO:tasks.workunit.client.0.smithi016.stdout:4/32: chown d0/f9 123347 1 2024-04-26T20:18:33.645 INFO:tasks.workunit.client.0.smithi016.stdout:1/87: truncate d3/d5/d6/d9/db/f1a 123000 0 2024-04-26T20:18:33.649 INFO:tasks.workunit.client.0.smithi016.stdout:1/88: rmdir d3/d5/d6/d9/d12 0 2024-04-26T20:18:33.650 INFO:tasks.workunit.client.0.smithi016.stdout:9/44: dwrite d1/d7/f9 [0,4194304] 0 2024-04-26T20:18:33.650 INFO:tasks.workunit.client.0.smithi016.stdout:7/34: dread d0/d1/f4 [0,4194304] 0 2024-04-26T20:18:33.654 INFO:tasks.workunit.client.0.smithi016.stdout:9/45: truncate f0 3942358 0 2024-04-26T20:18:33.655 INFO:tasks.workunit.client.0.smithi016.stdout:2/34: dread fa [4194304,4194304] 0 2024-04-26T20:18:33.661 INFO:tasks.workunit.client.0.smithi016.stdout:7/35: rename d0/f7 to d0/d1/d6/f9 0 2024-04-26T20:18:33.661 INFO:tasks.workunit.client.0.smithi016.stdout:1/89: unlink d3/d5/d6/fd 0 2024-04-26T20:18:33.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/90: chown d3/d5/l10 217748066 1 2024-04-26T20:18:33.662 INFO:tasks.workunit.client.0.smithi016.stdout:9/46: symlink d1/d2/lc 0 2024-04-26T20:18:33.662 INFO:tasks.workunit.client.0.smithi016.stdout:9/47: chown d1/d2/lc 37884957 1 2024-04-26T20:18:33.662 INFO:tasks.workunit.client.0.smithi016.stdout:2/35: truncate f5 591145 0 2024-04-26T20:18:33.662 INFO:tasks.workunit.client.0.smithi016.stdout:2/36: rename l6 to lb 0 2024-04-26T20:18:33.662 INFO:tasks.workunit.client.0.smithi016.stdout:6/43: dwrite d1/f2 [0,4194304] 0 2024-04-26T20:18:33.669 INFO:tasks.workunit.client.0.smithi016.stdout:2/37: fsync f5 0 2024-04-26T20:18:33.671 INFO:tasks.workunit.client.0.smithi016.stdout:2/38: unlink lb 0 2024-04-26T20:18:33.707 INFO:tasks.workunit.client.0.smithi016.stdout:7/36: dwrite d0/d1/d6/f9 [0,4194304] 0 2024-04-26T20:18:33.708 INFO:tasks.workunit.client.0.smithi016.stdout:7/37: chown d0/d1/d6/f9 2423537 1 2024-04-26T20:18:33.711 INFO:tasks.workunit.client.0.smithi016.stdout:2/39: dwrite fa [0,4194304] 0 2024-04-26T20:18:33.727 INFO:tasks.workunit.client.0.smithi016.stdout:7/38: read d0/f3 [5656747,59820] 0 2024-04-26T20:18:33.748 INFO:tasks.workunit.client.0.smithi016.stdout:7/39: dread d0/f3 [4194304,4194304] 0 2024-04-26T20:18:33.748 INFO:tasks.workunit.client.0.smithi016.stdout:7/40: write d0/f3 [4423388,29304] 0 2024-04-26T20:18:33.750 INFO:tasks.workunit.client.0.smithi016.stdout:7/41: getdents d0/d1 0 2024-04-26T20:18:33.752 INFO:tasks.workunit.client.0.smithi016.stdout:7/42: link d0/f3 d0/d1/d6/fa 0 2024-04-26T20:18:33.752 INFO:tasks.workunit.client.0.smithi016.stdout:7/43: readlink d0/l8 0 2024-04-26T20:18:33.758 INFO:tasks.workunit.client.0.smithi016.stdout:7/44: truncate d0/d1/d6/f9 1532218 0 2024-04-26T20:18:33.770 INFO:tasks.workunit.client.0.smithi016.stdout:2/40: dwrite f4 [4194304,4194304] 0 2024-04-26T20:18:33.776 INFO:tasks.workunit.client.0.smithi016.stdout:7/45: dread d0/d1/f4 [4194304,4194304] 0 2024-04-26T20:18:33.776 INFO:tasks.workunit.client.0.smithi016.stdout:7/46: readlink d0/l8 0 2024-04-26T20:18:33.789 INFO:tasks.workunit.client.0.smithi016.stdout:2/41: write f7 [910680,5501] 0 2024-04-26T20:18:33.790 INFO:tasks.workunit.client.0.smithi016.stdout:2/42: chown c8 18569 1 2024-04-26T20:18:33.794 INFO:tasks.workunit.client.0.smithi016.stdout:6/44: dwrite d1/d8/ff [0,4194304] 0 2024-04-26T20:18:33.794 INFO:tasks.workunit.client.0.smithi016.stdout:1/91: write d3/f4 [3894318,55942] 0 2024-04-26T20:18:33.796 INFO:tasks.workunit.client.0.smithi016.stdout:6/45: unlink d1/f5 0 2024-04-26T20:18:33.797 INFO:tasks.workunit.client.0.smithi016.stdout:7/47: dread d0/d1/d6/fa [0,4194304] 0 2024-04-26T20:18:33.797 INFO:tasks.workunit.client.0.smithi016.stdout:1/92: mknod d3/d5/d6/d9/db/c1d 0 2024-04-26T20:18:33.797 INFO:tasks.workunit.client.0.smithi016.stdout:1/93: read - d3/d5/f13 zero size 2024-04-26T20:18:33.797 INFO:tasks.workunit.client.0.smithi016.stdout:1/94: truncate d3/d5/f13 447591 0 2024-04-26T20:18:33.798 INFO:tasks.workunit.client.0.smithi016.stdout:6/46: mknod d1/d8/c10 0 2024-04-26T20:18:33.799 INFO:tasks.workunit.client.0.smithi016.stdout:7/48: creat d0/fb x:0 0 0 2024-04-26T20:18:33.799 INFO:tasks.workunit.client.0.smithi016.stdout:7/49: write d0/f3 [2551995,82177] 0 2024-04-26T20:18:33.799 INFO:tasks.workunit.client.0.smithi016.stdout:7/50: write d0/f3 [6401073,38285] 0 2024-04-26T20:18:33.799 INFO:tasks.workunit.client.0.smithi016.stdout:7/51: readlink d0/l8 0 2024-04-26T20:18:33.800 INFO:tasks.workunit.client.0.smithi016.stdout:1/95: unlink d3/d5/d6/c17 0 2024-04-26T20:18:33.804 INFO:tasks.workunit.client.0.smithi016.stdout:6/47: rename d1/f2 to d1/de/f11 0 2024-04-26T20:18:33.804 INFO:tasks.workunit.client.0.smithi016.stdout:6/48: fsync d1/f4 0 2024-04-26T20:18:33.804 INFO:tasks.workunit.client.0.smithi016.stdout:1/96: mknod d3/d5/d6/d9/c1e 0 2024-04-26T20:18:33.818 INFO:tasks.workunit.client.0.smithi016.stdout:1/97: truncate f2 4818909 0 2024-04-26T20:18:33.818 INFO:tasks.workunit.client.0.smithi016.stdout:1/98: dread - d3/d5/f18 zero size 2024-04-26T20:18:33.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/99: write d3/d5/da/fc [225874,69108] 0 2024-04-26T20:18:33.825 INFO:tasks.workunit.client.0.smithi016.stdout:1/100: fdatasync d3/d5/da/fc 0 2024-04-26T20:18:33.898 INFO:tasks.workunit.client.0.smithi016.stdout:1/101: unlink d3/d5/d6/d9/c1e 0 2024-04-26T20:18:33.913 INFO:tasks.workunit.client.0.smithi016.stdout:6/49: dwrite f0 [0,4194304] 0 2024-04-26T20:18:33.922 INFO:tasks.workunit.client.0.smithi016.stdout:8/13: sync 2024-04-26T20:18:33.923 INFO:tasks.workunit.client.0.smithi016.stdout:0/73: sync 2024-04-26T20:18:33.923 INFO:tasks.workunit.client.0.smithi016.stdout:3/6: sync 2024-04-26T20:18:33.923 INFO:tasks.workunit.client.0.smithi016.stdout:3/7: chown l1 27460151 1 2024-04-26T20:18:33.923 INFO:tasks.workunit.client.0.smithi016.stdout:5/105: sync 2024-04-26T20:18:33.923 INFO:tasks.workunit.client.0.smithi016.stdout:5/106: fsync d1/d9/f16 0 2024-04-26T20:18:33.923 INFO:tasks.workunit.client.0.smithi016.stdout:3/8: write f0 [764530,95813] 0 2024-04-26T20:18:33.924 INFO:tasks.workunit.client.0.smithi016.stdout:8/14: rename l1 to l6 0 2024-04-26T20:18:33.924 INFO:tasks.workunit.client.0.smithi016.stdout:8/15: dread - f5 zero size 2024-04-26T20:18:33.925 INFO:tasks.workunit.client.0.smithi016.stdout:0/74: getdents d2/d8 0 2024-04-26T20:18:33.930 INFO:tasks.workunit.client.0.smithi016.stdout:5/107: truncate d1/d9/f16 669783 0 2024-04-26T20:18:33.930 INFO:tasks.workunit.client.0.smithi016.stdout:5/108: readlink d1/l17 0 2024-04-26T20:18:33.931 INFO:tasks.workunit.client.0.smithi016.stdout:0/75: mkdir d2/dc/d18 0 2024-04-26T20:18:33.932 INFO:tasks.workunit.client.0.smithi016.stdout:0/76: truncate d2/f14 38794 0 2024-04-26T20:18:33.932 INFO:tasks.workunit.client.0.smithi016.stdout:0/77: write d2/dc/f17 [185117,16496] 0 2024-04-26T20:18:33.937 INFO:tasks.workunit.client.0.smithi016.stdout:0/78: fdatasync d2/dc/f17 0 2024-04-26T20:18:33.938 INFO:tasks.workunit.client.0.smithi016.stdout:5/109: mknod d1/c1a 0 2024-04-26T20:18:33.939 INFO:tasks.workunit.client.0.smithi016.stdout:1/102: dwrite d3/f4 [4194304,4194304] 0 2024-04-26T20:18:33.940 INFO:tasks.workunit.client.0.smithi016.stdout:3/9: dread f0 [0,4194304] 0 2024-04-26T20:18:33.941 INFO:tasks.workunit.client.0.smithi016.stdout:0/79: link d2/d8/lf d2/l19 0 2024-04-26T20:18:33.941 INFO:tasks.workunit.client.0.smithi016.stdout:5/110: rmdir d1/d9/d11 39 2024-04-26T20:18:33.948 INFO:tasks.workunit.client.0.smithi016.stdout:0/80: getdents d2 0 2024-04-26T20:18:33.959 INFO:tasks.workunit.client.0.smithi016.stdout:1/103: rename d3/d5/l10 to d3/d5/d6/l1f 0 2024-04-26T20:18:33.959 INFO:tasks.workunit.client.0.smithi016.stdout:1/104: dread - d3/d5/f18 zero size 2024-04-26T20:18:33.960 INFO:tasks.workunit.client.0.smithi016.stdout:0/81: creat d2/dc/d18/f1a x:0 0 0 2024-04-26T20:18:33.978 INFO:tasks.workunit.client.0.smithi016.stdout:5/111: dwrite d1/d9/f14 [4194304,4194304] 0 2024-04-26T20:18:33.982 INFO:tasks.workunit.client.0.smithi016.stdout:5/112: link d1/d9/f14 d1/f1b 0 2024-04-26T20:18:33.990 INFO:tasks.workunit.client.0.smithi016.stdout:6/50: dwrite d1/f4 [0,4194304] 0 2024-04-26T20:18:33.990 INFO:tasks.workunit.client.0.smithi016.stdout:6/51: dread - d1/fd zero size 2024-04-26T20:18:33.991 INFO:tasks.workunit.client.0.smithi016.stdout:0/82: dwrite d2/d8/fe [4194304,4194304] 0 2024-04-26T20:18:33.992 INFO:tasks.workunit.client.0.smithi016.stdout:1/105: symlink d3/d5/d6/l20 0 2024-04-26T20:18:33.993 INFO:tasks.workunit.client.0.smithi016.stdout:6/52: mkdir d1/d12 0 2024-04-26T20:18:33.994 INFO:tasks.workunit.client.0.smithi016.stdout:0/83: mknod d2/dc/c1b 0 2024-04-26T20:18:33.994 INFO:tasks.workunit.client.0.smithi016.stdout:0/84: dread - d2/d8/f11 zero size 2024-04-26T20:18:33.995 INFO:tasks.workunit.client.0.smithi016.stdout:1/106: rename d3/d5/f13 to d3/d5/da/f21 0 2024-04-26T20:18:33.996 INFO:tasks.workunit.client.0.smithi016.stdout:6/53: creat d1/f13 x:0 0 0 2024-04-26T20:18:33.996 INFO:tasks.workunit.client.0.smithi016.stdout:0/85: rmdir d2/dc 39 2024-04-26T20:18:33.998 INFO:tasks.workunit.client.0.smithi016.stdout:1/107: mkdir d3/d5/d6/d9/d22 0 2024-04-26T20:18:33.998 INFO:tasks.workunit.client.0.smithi016.stdout:1/108: fdatasync f2 0 2024-04-26T20:18:33.998 INFO:tasks.workunit.client.0.smithi016.stdout:1/109: truncate d3/d5/da/fc 791747 0 2024-04-26T20:18:33.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/113: read d1/d9/fc [736977,29492] 0 2024-04-26T20:18:33.999 INFO:tasks.workunit.client.0.smithi016.stdout:5/114: chown d1/d5/fd 39 1 2024-04-26T20:18:33.999 INFO:tasks.workunit.client.0.smithi016.stdout:6/54: mknod d1/de/c14 0 2024-04-26T20:18:34.003 INFO:tasks.workunit.client.0.smithi016.stdout:5/115: mkdir d1/d9/d1c 0 2024-04-26T20:18:34.003 INFO:tasks.workunit.client.0.smithi016.stdout:8/16: dwrite f5 [0,4194304] 0 2024-04-26T20:18:34.006 INFO:tasks.workunit.client.0.smithi016.stdout:8/17: creat f7 x:0 0 0 2024-04-26T20:18:34.011 INFO:tasks.workunit.client.0.smithi016.stdout:6/55: getdents d1 0 2024-04-26T20:18:34.020 INFO:tasks.workunit.client.0.smithi016.stdout:5/116: truncate d1/d9/f14 2565428 0 2024-04-26T20:18:34.021 INFO:tasks.workunit.client.0.smithi016.stdout:8/18: creat f8 x:0 0 0 2024-04-26T20:18:34.021 INFO:tasks.workunit.client.0.smithi016.stdout:1/110: write f2 [2287040,39187] 0 2024-04-26T20:18:34.022 INFO:tasks.workunit.client.0.smithi016.stdout:5/117: rename d1/f2 to d1/d5/f1d 0 2024-04-26T20:18:34.023 INFO:tasks.workunit.client.0.smithi016.stdout:8/19: unlink f7 0 2024-04-26T20:18:34.023 INFO:tasks.workunit.client.0.smithi016.stdout:5/118: read d1/f1b [2134297,50839] 0 2024-04-26T20:18:34.024 INFO:tasks.workunit.client.0.smithi016.stdout:1/111: mknod d3/d5/d6/d9/d22/c23 0 2024-04-26T20:18:34.025 INFO:tasks.workunit.client.0.smithi016.stdout:8/20: mkdir d9 0 2024-04-26T20:18:34.027 INFO:tasks.workunit.client.0.smithi016.stdout:5/119: creat d1/d5/f1e x:0 0 0 2024-04-26T20:18:34.028 INFO:tasks.workunit.client.0.smithi016.stdout:8/21: creat d9/fa x:0 0 0 2024-04-26T20:18:34.032 INFO:tasks.workunit.client.0.smithi016.stdout:1/112: symlink d3/d5/d6/l24 0 2024-04-26T20:18:34.044 INFO:tasks.workunit.client.0.smithi016.stdout:0/86: dwrite d2/fb [0,4194304] 0 2024-04-26T20:18:34.045 INFO:tasks.workunit.client.0.smithi016.stdout:0/87: creat d2/dc/f1c x:0 0 0 2024-04-26T20:18:34.080 INFO:tasks.workunit.client.0.smithi016.stdout:1/113: dwrite d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:34.080 INFO:tasks.workunit.client.0.smithi016.stdout:1/114: truncate d3/d5/d6/d9/db/f1a 754059 0 2024-04-26T20:18:34.081 INFO:tasks.workunit.client.0.smithi016.stdout:8/22: rename d9/fa to d9/fb 0 2024-04-26T20:18:34.081 INFO:tasks.workunit.client.0.smithi016.stdout:8/23: truncate d9/fb 852429 0 2024-04-26T20:18:34.083 INFO:tasks.workunit.client.0.smithi016.stdout:1/115: mkdir d3/d5/d6/d9/d22/d25 0 2024-04-26T20:18:34.086 INFO:tasks.workunit.client.0.smithi016.stdout:1/116: dread d3/d5/d6/d9/db/f1a [0,4194304] 0 2024-04-26T20:18:34.086 INFO:tasks.workunit.client.0.smithi016.stdout:1/117: fdatasync d3/d5/f18 0 2024-04-26T20:18:34.086 INFO:tasks.workunit.client.0.smithi016.stdout:1/118: fdatasync d3/d5/f18 0 2024-04-26T20:18:34.086 INFO:tasks.workunit.client.0.smithi016.stdout:1/119: chown d3/d5/da/fc 4128761 1 2024-04-26T20:18:34.087 INFO:tasks.workunit.client.0.smithi016.stdout:1/120: fdatasync d3/d5/d6/f14 0 2024-04-26T20:18:34.117 INFO:tasks.workunit.client.0.smithi016.stdout:5/120: dwrite d1/d5/f12 [0,4194304] 0 2024-04-26T20:18:34.117 INFO:tasks.workunit.client.0.smithi016.stdout:8/24: truncate f5 184157 0 2024-04-26T20:18:34.118 INFO:tasks.workunit.client.0.smithi016.stdout:5/121: creat d1/f1f x:0 0 0 2024-04-26T20:18:34.119 INFO:tasks.workunit.client.0.smithi016.stdout:8/25: creat d9/fc x:0 0 0 2024-04-26T20:18:34.127 INFO:tasks.workunit.client.0.smithi016.stdout:8/26: write f5 [967342,124860] 0 2024-04-26T20:18:34.127 INFO:tasks.workunit.client.0.smithi016.stdout:5/122: getdents d1/d9/d11 0 2024-04-26T20:18:34.133 INFO:tasks.workunit.client.0.smithi016.stdout:0/88: dwrite d2/fa [4194304,4194304] 0 2024-04-26T20:18:34.133 INFO:tasks.workunit.client.0.smithi016.stdout:0/89: truncate d2/dc/d18/f1a 191588 0 2024-04-26T20:18:34.136 INFO:tasks.workunit.client.0.smithi016.stdout:1/121: dwrite d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:34.136 INFO:tasks.workunit.client.0.smithi016.stdout:5/123: link d1/d9/ce d1/d9/d11/c20 0 2024-04-26T20:18:34.136 INFO:tasks.workunit.client.0.smithi016.stdout:5/124: write d1/d9/f16 [1366947,36714] 0 2024-04-26T20:18:34.136 INFO:tasks.workunit.client.0.smithi016.stdout:5/125: write d1/d5/f1e [127950,46947] 0 2024-04-26T20:18:34.137 INFO:tasks.workunit.client.0.smithi016.stdout:0/90: creat d2/dc/f1d x:0 0 0 2024-04-26T20:18:34.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/27: read f5 [102237,56952] 0 2024-04-26T20:18:34.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/28: dread - d9/fc zero size 2024-04-26T20:18:34.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/29: read f5 [704200,8650] 0 2024-04-26T20:18:34.151 INFO:tasks.workunit.client.0.smithi016.stdout:5/126: symlink d1/l21 0 2024-04-26T20:18:34.160 INFO:tasks.workunit.client.0.smithi016.stdout:5/127: creat d1/f22 x:0 0 0 2024-04-26T20:18:34.164 INFO:tasks.workunit.client.0.smithi016.stdout:5/128: dread d1/d9/fc [0,4194304] 0 2024-04-26T20:18:34.165 INFO:tasks.workunit.client.0.smithi016.stdout:1/122: dwrite d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:34.165 INFO:tasks.workunit.client.0.smithi016.stdout:1/123: chown d3/d5/f18 1513059 1 2024-04-26T20:18:34.166 INFO:tasks.workunit.client.0.smithi016.stdout:5/129: creat d1/d9/d11/f23 x:0 0 0 2024-04-26T20:18:34.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/91: dwrite d2/d8/fe [4194304,4194304] 0 2024-04-26T20:18:34.180 INFO:tasks.workunit.client.0.smithi016.stdout:5/130: dread d1/d9/f10 [0,4194304] 0 2024-04-26T20:18:34.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/92: chown d2/dc/f17 7 1 2024-04-26T20:18:34.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/93: truncate d2/f15 464498 0 2024-04-26T20:18:34.181 INFO:tasks.workunit.client.0.smithi016.stdout:1/124: creat d3/d5/da/f26 x:0 0 0 2024-04-26T20:18:34.181 INFO:tasks.workunit.client.0.smithi016.stdout:1/125: chown f2 551 1 2024-04-26T20:18:34.183 INFO:tasks.workunit.client.0.smithi016.stdout:5/131: link d1/d9/d11/c20 d1/d9/d11/c24 0 2024-04-26T20:18:34.183 INFO:tasks.workunit.client.0.smithi016.stdout:5/132: getdents d1/d9/d1c 0 2024-04-26T20:18:34.188 INFO:tasks.workunit.client.0.smithi016.stdout:0/94: truncate d2/fb 3373541 0 2024-04-26T20:18:34.228 INFO:tasks.workunit.client.0.smithi016.stdout:1/126: dwrite f2 [0,4194304] 0 2024-04-26T20:18:34.228 INFO:tasks.workunit.client.0.smithi016.stdout:5/133: mkdir d1/d9/d25 0 2024-04-26T20:18:34.232 INFO:tasks.workunit.client.0.smithi016.stdout:1/127: creat d3/f27 x:0 0 0 2024-04-26T20:18:34.233 INFO:tasks.workunit.client.0.smithi016.stdout:5/134: mknod d1/d5/c26 0 2024-04-26T20:18:34.237 INFO:tasks.workunit.client.0.smithi016.stdout:4/33: sync 2024-04-26T20:18:34.237 INFO:tasks.workunit.client.0.smithi016.stdout:7/52: sync 2024-04-26T20:18:34.237 INFO:tasks.workunit.client.0.smithi016.stdout:2/43: sync 2024-04-26T20:18:34.237 INFO:tasks.workunit.client.0.smithi016.stdout:9/48: sync 2024-04-26T20:18:34.238 INFO:tasks.workunit.client.0.smithi016.stdout:5/135: getdents d1/d5 0 2024-04-26T20:18:34.239 INFO:tasks.workunit.client.0.smithi016.stdout:4/34: creat d0/fa x:0 0 0 2024-04-26T20:18:34.240 INFO:tasks.workunit.client.0.smithi016.stdout:1/128: truncate f2 589345 0 2024-04-26T20:18:34.241 INFO:tasks.workunit.client.0.smithi016.stdout:2/44: symlink lc 0 2024-04-26T20:18:34.242 INFO:tasks.workunit.client.0.smithi016.stdout:7/53: truncate d0/f3 8269114 0 2024-04-26T20:18:34.243 INFO:tasks.workunit.client.0.smithi016.stdout:9/49: creat d1/d2/fd x:0 0 0 2024-04-26T20:18:34.245 INFO:tasks.workunit.client.0.smithi016.stdout:2/45: creat fd x:0 0 0 2024-04-26T20:18:34.248 INFO:tasks.workunit.client.0.smithi016.stdout:7/54: rename d0/d1/d6/f9 to d0/fc 0 2024-04-26T20:18:34.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/50: mkdir d1/d7/de 0 2024-04-26T20:18:34.251 INFO:tasks.workunit.client.0.smithi016.stdout:5/136: mknod d1/d9/d11/c27 0 2024-04-26T20:18:34.251 INFO:tasks.workunit.client.0.smithi016.stdout:5/137: getdents d1/d9/d1c 0 2024-04-26T20:18:34.252 INFO:tasks.workunit.client.0.smithi016.stdout:1/129: mknod d3/d5/d6/c28 0 2024-04-26T20:18:34.256 INFO:tasks.workunit.client.0.smithi016.stdout:2/46: creat fe x:0 0 0 2024-04-26T20:18:34.256 INFO:tasks.workunit.client.0.smithi016.stdout:2/47: dread - fe zero size 2024-04-26T20:18:34.257 INFO:tasks.workunit.client.0.smithi016.stdout:7/55: dread d0/fc [0,4194304] 0 2024-04-26T20:18:34.259 INFO:tasks.workunit.client.0.smithi016.stdout:4/35: dread d0/f1 [0,4194304] 0 2024-04-26T20:18:34.259 INFO:tasks.workunit.client.0.smithi016.stdout:5/138: dread d1/d9/fc [0,4194304] 0 2024-04-26T20:18:34.262 INFO:tasks.workunit.client.0.smithi016.stdout:9/51: creat d1/d7/ff x:0 0 0 2024-04-26T20:18:34.262 INFO:tasks.workunit.client.0.smithi016.stdout:9/52: read - d1/d2/f6 zero size 2024-04-26T20:18:34.263 INFO:tasks.workunit.client.0.smithi016.stdout:7/56: rename d0/f3 to d0/d1/fd 0 2024-04-26T20:18:34.263 INFO:tasks.workunit.client.0.smithi016.stdout:4/36: creat d0/fb x:0 0 0 2024-04-26T20:18:34.267 INFO:tasks.workunit.client.0.smithi016.stdout:9/53: creat d1/d2/f10 x:0 0 0 2024-04-26T20:18:34.272 INFO:tasks.workunit.client.0.smithi016.stdout:7/57: getdents d0/d1 0 2024-04-26T20:18:34.272 INFO:tasks.workunit.client.0.smithi016.stdout:7/58: fdatasync d0/d1/fd 0 2024-04-26T20:18:34.273 INFO:tasks.workunit.client.0.smithi016.stdout:9/54: symlink d1/d7/l11 0 2024-04-26T20:18:34.273 INFO:tasks.workunit.client.0.smithi016.stdout:9/55: chown d1/d7/f9 59 1 2024-04-26T20:18:34.282 INFO:tasks.workunit.client.0.smithi016.stdout:5/139: write d1/d5/f12 [701877,49049] 0 2024-04-26T20:18:34.283 INFO:tasks.workunit.client.0.smithi016.stdout:7/59: mknod d0/ce 0 2024-04-26T20:18:34.294 INFO:tasks.workunit.client.0.smithi016.stdout:7/60: dread d0/d1/f4 [0,4194304] 0 2024-04-26T20:18:34.295 INFO:tasks.workunit.client.0.smithi016.stdout:5/140: symlink d1/d9/l28 0 2024-04-26T20:18:34.295 INFO:tasks.workunit.client.0.smithi016.stdout:5/141: chown d1/d9/f16 197 1 2024-04-26T20:18:34.296 INFO:tasks.workunit.client.0.smithi016.stdout:7/61: rmdir d0/d1/d6 39 2024-04-26T20:18:34.298 INFO:tasks.workunit.client.0.smithi016.stdout:5/142: creat d1/d9/f29 x:0 0 0 2024-04-26T20:18:34.299 INFO:tasks.workunit.client.0.smithi016.stdout:5/143: readlink d1/l21 0 2024-04-26T20:18:34.300 INFO:tasks.workunit.client.0.smithi016.stdout:7/62: creat d0/d1/ff x:0 0 0 2024-04-26T20:18:34.300 INFO:tasks.workunit.client.0.smithi016.stdout:1/130: dwrite d3/f27 [0,4194304] 0 2024-04-26T20:18:34.300 INFO:tasks.workunit.client.0.smithi016.stdout:5/144: creat d1/d9/d25/f2a x:0 0 0 2024-04-26T20:18:34.304 INFO:tasks.workunit.client.0.smithi016.stdout:1/131: creat d3/d5/da/f29 x:0 0 0 2024-04-26T20:18:34.304 INFO:tasks.workunit.client.0.smithi016.stdout:1/132: write d3/d5/da/f29 [965608,29217] 0 2024-04-26T20:18:34.304 INFO:tasks.workunit.client.0.smithi016.stdout:1/133: write d3/d5/da/f21 [894052,57260] 0 2024-04-26T20:18:34.304 INFO:tasks.workunit.client.0.smithi016.stdout:7/63: truncate d0/d1/d6/fa 2382924 0 2024-04-26T20:18:34.305 INFO:tasks.workunit.client.0.smithi016.stdout:7/64: chown d0/d1/f4 282543528 1 2024-04-26T20:18:34.305 INFO:tasks.workunit.client.0.smithi016.stdout:5/145: symlink d1/d9/d1c/l2b 0 2024-04-26T20:18:34.311 INFO:tasks.workunit.client.0.smithi016.stdout:1/134: dread d3/d5/d6/d9/db/f1a [0,4194304] 0 2024-04-26T20:18:34.319 INFO:tasks.workunit.client.0.smithi016.stdout:4/37: dwrite d0/f9 [0,4194304] 0 2024-04-26T20:18:34.319 INFO:tasks.workunit.client.0.smithi016.stdout:2/48: write fa [7183543,39007] 0 2024-04-26T20:18:34.322 INFO:tasks.workunit.client.0.smithi016.stdout:5/146: mknod d1/d9/d1c/c2c 0 2024-04-26T20:18:34.322 INFO:tasks.workunit.client.0.smithi016.stdout:5/147: stat d1/c1a 0 2024-04-26T20:18:34.330 INFO:tasks.workunit.client.0.smithi016.stdout:1/135: dread d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:34.331 INFO:tasks.workunit.client.0.smithi016.stdout:4/38: creat d0/fc x:0 0 0 2024-04-26T20:18:34.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/65: truncate d0/d1/d6/fa 2223679 0 2024-04-26T20:18:34.335 INFO:tasks.workunit.client.0.smithi016.stdout:1/136: rename d3/d5/d6/d9/d22/d25 to d3/d5/d6/d9/d2a 0 2024-04-26T20:18:34.335 INFO:tasks.workunit.client.0.smithi016.stdout:1/137: truncate d3/d5/da/f29 1259328 0 2024-04-26T20:18:34.335 INFO:tasks.workunit.client.0.smithi016.stdout:1/138: chown d3/d5/f18 90 1 2024-04-26T20:18:34.338 INFO:tasks.workunit.client.0.smithi016.stdout:9/56: dwrite d1/f8 [0,4194304] 0 2024-04-26T20:18:34.338 INFO:tasks.workunit.client.0.smithi016.stdout:9/57: rename d1/d7 to d1/d7/d12 22 2024-04-26T20:18:34.338 INFO:tasks.workunit.client.0.smithi016.stdout:9/58: fsync d1/f8 0 2024-04-26T20:18:34.339 INFO:tasks.workunit.client.0.smithi016.stdout:1/139: mknod d3/d5/d6/d9/c2b 0 2024-04-26T20:18:34.341 INFO:tasks.workunit.client.0.smithi016.stdout:9/59: mkdir d1/d7/de/d13 0 2024-04-26T20:18:34.342 INFO:tasks.workunit.client.0.smithi016.stdout:1/140: rename d3/f27 to d3/d5/d6/d9/f2c 0 2024-04-26T20:18:34.342 INFO:tasks.workunit.client.0.smithi016.stdout:1/141: readlink d3/d5/d6/l20 0 2024-04-26T20:18:34.344 INFO:tasks.workunit.client.0.smithi016.stdout:9/60: link d1/fa d1/f14 0 2024-04-26T20:18:34.352 INFO:tasks.workunit.client.0.smithi016.stdout:1/142: link d3/d5/d6/l24 d3/l2d 0 2024-04-26T20:18:34.354 INFO:tasks.workunit.client.0.smithi016.stdout:7/66: rename d0/d1/f4 to d0/d1/f10 0 2024-04-26T20:18:34.355 INFO:tasks.workunit.client.0.smithi016.stdout:9/61: creat d1/f15 x:0 0 0 2024-04-26T20:18:34.355 INFO:tasks.workunit.client.0.smithi016.stdout:9/62: fdatasync d1/f14 0 2024-04-26T20:18:34.357 INFO:tasks.workunit.client.0.smithi016.stdout:1/143: getdents d3/d5/d6/d9/db 0 2024-04-26T20:18:34.364 INFO:tasks.workunit.client.0.smithi016.stdout:4/39: write d0/f8 [1858500,71190] 0 2024-04-26T20:18:34.365 INFO:tasks.workunit.client.0.smithi016.stdout:9/63: symlink d1/d7/de/d13/l16 0 2024-04-26T20:18:34.366 INFO:tasks.workunit.client.0.smithi016.stdout:4/40: mkdir d0/dd 0 2024-04-26T20:18:34.367 INFO:tasks.workunit.client.0.smithi016.stdout:9/64: rename d1/d7/ff to d1/d7/f17 0 2024-04-26T20:18:34.373 INFO:tasks.workunit.client.0.smithi016.stdout:9/65: symlink d1/d7/de/d13/l18 0 2024-04-26T20:18:34.374 INFO:tasks.workunit.client.0.smithi016.stdout:9/66: dread - d1/f14 zero size 2024-04-26T20:18:34.374 INFO:tasks.workunit.client.0.smithi016.stdout:9/67: truncate d1/d7/fb 589092 0 2024-04-26T20:18:34.374 INFO:tasks.workunit.client.0.smithi016.stdout:9/68: dread - d1/d2/f10 zero size 2024-04-26T20:18:34.374 INFO:tasks.workunit.client.0.smithi016.stdout:5/148: dwrite d1/d9/d25/f2a [0,4194304] 0 2024-04-26T20:18:34.376 INFO:tasks.workunit.client.0.smithi016.stdout:9/69: unlink d1/d2/lc 0 2024-04-26T20:18:34.378 INFO:tasks.workunit.client.0.smithi016.stdout:4/41: getdents d0 0 2024-04-26T20:18:34.382 INFO:tasks.workunit.client.0.smithi016.stdout:9/70: getdents d1/d7 0 2024-04-26T20:18:34.382 INFO:tasks.workunit.client.0.smithi016.stdout:5/149: link d1/d9/l28 d1/d9/l2d 0 2024-04-26T20:18:34.384 INFO:tasks.workunit.client.0.smithi016.stdout:9/71: creat d1/d7/de/d13/f19 x:0 0 0 2024-04-26T20:18:34.386 INFO:tasks.workunit.client.0.smithi016.stdout:9/72: mknod d1/d7/de/c1a 0 2024-04-26T20:18:34.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/150: mknod d1/d9/d11/c2e 0 2024-04-26T20:18:34.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/151: chown d1/d9/f14 899 1 2024-04-26T20:18:34.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/152: chown d1/d9/d11/c24 1 1 2024-04-26T20:18:34.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/153: write d1/f1b [1391360,124953] 0 2024-04-26T20:18:34.388 INFO:tasks.workunit.client.0.smithi016.stdout:9/73: mkdir d1/d1b 0 2024-04-26T20:18:34.389 INFO:tasks.workunit.client.0.smithi016.stdout:9/74: symlink d1/d1b/l1c 0 2024-04-26T20:18:34.390 INFO:tasks.workunit.client.0.smithi016.stdout:9/75: symlink d1/d7/de/d13/l1d 0 2024-04-26T20:18:34.392 INFO:tasks.workunit.client.0.smithi016.stdout:5/154: rmdir d1/d9 39 2024-04-26T20:18:34.392 INFO:tasks.workunit.client.0.smithi016.stdout:5/155: stat d1/d9/d11/c2e 0 2024-04-26T20:18:34.392 INFO:tasks.workunit.client.0.smithi016.stdout:2/49: dwrite f4 [4194304,4194304] 0 2024-04-26T20:18:34.394 INFO:tasks.workunit.client.0.smithi016.stdout:4/42: dread d0/f9 [0,4194304] 0 2024-04-26T20:18:34.394 INFO:tasks.workunit.client.0.smithi016.stdout:9/76: write d1/d7/fb [426766,58193] 0 2024-04-26T20:18:34.394 INFO:tasks.workunit.client.0.smithi016.stdout:4/43: rename d0 to d0/dd/de 22 2024-04-26T20:18:34.394 INFO:tasks.workunit.client.0.smithi016.stdout:9/77: write d1/d2/f6 [388178,10898] 0 2024-04-26T20:18:34.394 INFO:tasks.workunit.client.0.smithi016.stdout:2/50: rename fd to ff 0 2024-04-26T20:18:34.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/44: unlink d0/c4 0 2024-04-26T20:18:34.399 INFO:tasks.workunit.client.0.smithi016.stdout:4/45: mknod d0/dd/cf 0 2024-04-26T20:18:34.399 INFO:tasks.workunit.client.0.smithi016.stdout:4/46: chown d0/fc 5839961 1 2024-04-26T20:18:34.399 INFO:tasks.workunit.client.0.smithi016.stdout:2/51: link fe f10 0 2024-04-26T20:18:34.400 INFO:tasks.workunit.client.0.smithi016.stdout:4/47: creat d0/f10 x:0 0 0 2024-04-26T20:18:34.401 INFO:tasks.workunit.client.0.smithi016.stdout:4/48: creat d0/f11 x:0 0 0 2024-04-26T20:18:34.402 INFO:tasks.workunit.client.0.smithi016.stdout:4/49: rename d0/f8 to d0/dd/f12 0 2024-04-26T20:18:34.403 INFO:tasks.workunit.client.0.smithi016.stdout:4/50: write d0/f10 [543538,47182] 0 2024-04-26T20:18:34.404 INFO:tasks.workunit.client.0.smithi016.stdout:4/51: symlink d0/dd/l13 0 2024-04-26T20:18:34.404 INFO:tasks.workunit.client.0.smithi016.stdout:4/52: write d0/dd/f12 [2579851,84912] 0 2024-04-26T20:18:34.404 INFO:tasks.workunit.client.0.smithi016.stdout:4/53: stat d0/f11 0 2024-04-26T20:18:34.405 INFO:tasks.workunit.client.0.smithi016.stdout:4/54: rmdir d0/dd 39 2024-04-26T20:18:34.412 INFO:tasks.workunit.client.0.smithi016.stdout:1/144: dwrite d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:34.414 INFO:tasks.workunit.client.0.smithi016.stdout:1/145: getdents d3 0 2024-04-26T20:18:34.420 INFO:tasks.workunit.client.0.smithi016.stdout:2/52: dread f4 [4194304,4194304] 0 2024-04-26T20:18:34.420 INFO:tasks.workunit.client.0.smithi016.stdout:2/53: write fe [876940,42396] 0 2024-04-26T20:18:34.420 INFO:tasks.workunit.client.0.smithi016.stdout:2/54: chown ff 4 1 2024-04-26T20:18:34.424 INFO:tasks.workunit.client.0.smithi016.stdout:5/156: dread d1/d9/f14 [0,4194304] 0 2024-04-26T20:18:34.424 INFO:tasks.workunit.client.0.smithi016.stdout:5/157: fdatasync d1/d9/f29 0 2024-04-26T20:18:34.425 INFO:tasks.workunit.client.0.smithi016.stdout:5/158: mknod d1/d9/d1c/c2f 0 2024-04-26T20:18:34.446 INFO:tasks.workunit.client.0.smithi016.stdout:9/78: dwrite d1/d7/de/d13/f19 [0,4194304] 0 2024-04-26T20:18:34.448 INFO:tasks.workunit.client.0.smithi016.stdout:5/159: dread d1/d9/f14 [0,4194304] 0 2024-04-26T20:18:34.451 INFO:tasks.workunit.client.0.smithi016.stdout:5/160: symlink d1/d9/d11/l30 0 2024-04-26T20:18:34.486 INFO:tasks.workunit.client.0.smithi016.stdout:1/146: dwrite d3/d5/f18 [0,4194304] 0 2024-04-26T20:18:34.486 INFO:tasks.workunit.client.0.smithi016.stdout:1/147: truncate d3/d5/da/f26 856481 0 2024-04-26T20:18:34.486 INFO:tasks.workunit.client.0.smithi016.stdout:1/148: write f2 [925007,46733] 0 2024-04-26T20:18:34.487 INFO:tasks.workunit.client.0.smithi016.stdout:2/55: dread fa [0,4194304] 0 2024-04-26T20:18:34.489 INFO:tasks.workunit.client.0.smithi016.stdout:2/56: creat f11 x:0 0 0 2024-04-26T20:18:34.489 INFO:tasks.workunit.client.0.smithi016.stdout:1/149: creat d3/d5/d6/d9/d22/f2e x:0 0 0 2024-04-26T20:18:34.489 INFO:tasks.workunit.client.0.smithi016.stdout:1/150: write d3/d5/da/f21 [1626686,17999] 0 2024-04-26T20:18:34.495 INFO:tasks.workunit.client.0.smithi016.stdout:4/55: dwrite d0/fb [0,4194304] 0 2024-04-26T20:18:34.495 INFO:tasks.workunit.client.0.smithi016.stdout:2/57: creat f12 x:0 0 0 2024-04-26T20:18:34.496 INFO:tasks.workunit.client.0.smithi016.stdout:1/151: symlink d3/d5/d6/l2f 0 2024-04-26T20:18:34.496 INFO:tasks.workunit.client.0.smithi016.stdout:1/152: chown c0 16216632 1 2024-04-26T20:18:34.496 INFO:tasks.workunit.client.0.smithi016.stdout:2/58: creat f13 x:0 0 0 2024-04-26T20:18:34.496 INFO:tasks.workunit.client.0.smithi016.stdout:2/59: dread - f11 zero size 2024-04-26T20:18:34.498 INFO:tasks.workunit.client.0.smithi016.stdout:1/153: creat d3/d5/da/f30 x:0 0 0 2024-04-26T20:18:34.499 INFO:tasks.workunit.client.0.smithi016.stdout:1/154: truncate d3/d5/da/f30 20146 0 2024-04-26T20:18:34.499 INFO:tasks.workunit.client.0.smithi016.stdout:2/60: creat f14 x:0 0 0 2024-04-26T20:18:34.499 INFO:tasks.workunit.client.0.smithi016.stdout:2/61: fdatasync fa 0 2024-04-26T20:18:34.502 INFO:tasks.workunit.client.0.smithi016.stdout:1/155: rename d3/d5/d6/d9/d22/f2e to d3/d5/d6/d9/d22/f31 0 2024-04-26T20:18:34.509 INFO:tasks.workunit.client.0.smithi016.stdout:9/79: dwrite d1/d7/de/d13/f19 [0,4194304] 0 2024-04-26T20:18:34.517 INFO:tasks.workunit.client.0.smithi016.stdout:4/56: dread d0/fb [0,4194304] 0 2024-04-26T20:18:34.519 INFO:tasks.workunit.client.0.smithi016.stdout:4/57: getdents d0/dd 0 2024-04-26T20:18:34.519 INFO:tasks.workunit.client.0.smithi016.stdout:4/58: read - d0/f11 zero size 2024-04-26T20:18:34.521 INFO:tasks.workunit.client.0.smithi016.stdout:1/156: write f2 [8313,109310] 0 2024-04-26T20:18:34.521 INFO:tasks.workunit.client.0.smithi016.stdout:1/157: fdatasync d3/d5/da/fc 0 2024-04-26T20:18:34.546 INFO:tasks.workunit.client.0.smithi016.stdout:5/161: dwrite d1/f1f [0,4194304] 0 2024-04-26T20:18:34.547 INFO:tasks.workunit.client.0.smithi016.stdout:2/62: dwrite f7 [0,4194304] 0 2024-04-26T20:18:34.558 INFO:tasks.workunit.client.0.smithi016.stdout:2/63: rename lc to l15 0 2024-04-26T20:18:34.558 INFO:tasks.workunit.client.0.smithi016.stdout:2/64: dread - ff zero size 2024-04-26T20:18:34.560 INFO:tasks.workunit.client.0.smithi016.stdout:4/59: truncate d0/dd/f12 1728632 0 2024-04-26T20:18:34.563 INFO:tasks.workunit.client.0.smithi016.stdout:1/158: dwrite d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:34.563 INFO:tasks.workunit.client.0.smithi016.stdout:1/159: fsync d3/d5/da/f21 0 2024-04-26T20:18:34.564 INFO:tasks.workunit.client.0.smithi016.stdout:2/65: link c0 c16 0 2024-04-26T20:18:34.565 INFO:tasks.workunit.client.0.smithi016.stdout:4/60: creat d0/dd/f14 x:0 0 0 2024-04-26T20:18:34.566 INFO:tasks.workunit.client.0.smithi016.stdout:9/80: dwrite d1/f15 [0,4194304] 0 2024-04-26T20:18:34.567 INFO:tasks.workunit.client.0.smithi016.stdout:1/160: creat d3/d5/d6/d9/d2a/f32 x:0 0 0 2024-04-26T20:18:34.572 INFO:tasks.workunit.client.0.smithi016.stdout:9/81: rmdir d1/d2 39 2024-04-26T20:18:34.572 INFO:tasks.workunit.client.0.smithi016.stdout:5/162: dread d1/d9/d25/f2a [0,4194304] 0 2024-04-26T20:18:34.573 INFO:tasks.workunit.client.0.smithi016.stdout:1/161: unlink d3/d5/d6/c28 0 2024-04-26T20:18:34.576 INFO:tasks.workunit.client.0.smithi016.stdout:0/95: sync 2024-04-26T20:18:34.576 INFO:tasks.workunit.client.0.smithi016.stdout:0/96: fsync d2/dc/d18/f1a 0 2024-04-26T20:18:34.577 INFO:tasks.workunit.client.0.smithi016.stdout:8/30: sync 2024-04-26T20:18:34.578 INFO:tasks.workunit.client.0.smithi016.stdout:8/31: fdatasync f8 0 2024-04-26T20:18:34.578 INFO:tasks.workunit.client.0.smithi016.stdout:1/162: rmdir d3 39 2024-04-26T20:18:34.578 INFO:tasks.workunit.client.0.smithi016.stdout:1/163: truncate d3/d5/d6/d9/d2a/f32 201554 0 2024-04-26T20:18:34.578 INFO:tasks.workunit.client.0.smithi016.stdout:1/164: truncate d3/d5/d6/d9/d2a/f32 1042639 0 2024-04-26T20:18:34.578 INFO:tasks.workunit.client.0.smithi016.stdout:6/56: sync 2024-04-26T20:18:34.582 INFO:tasks.workunit.client.0.smithi016.stdout:0/97: mkdir d2/dc/d1e 0 2024-04-26T20:18:34.582 INFO:tasks.workunit.client.0.smithi016.stdout:6/57: truncate d1/f4 2253015 0 2024-04-26T20:18:34.582 INFO:tasks.workunit.client.0.smithi016.stdout:3/10: sync 2024-04-26T20:18:34.582 INFO:tasks.workunit.client.0.smithi016.stdout:3/11: stat f0 0 2024-04-26T20:18:34.587 INFO:tasks.workunit.client.0.smithi016.stdout:6/58: truncate d1/f7 1946190 0 2024-04-26T20:18:34.591 INFO:tasks.workunit.client.0.smithi016.stdout:2/66: getdents . 0 2024-04-26T20:18:34.591 INFO:tasks.workunit.client.0.smithi016.stdout:2/67: fsync fa 0 2024-04-26T20:18:34.593 INFO:tasks.workunit.client.0.smithi016.stdout:9/82: write d1/d7/de/d13/f19 [671096,104757] 0 2024-04-26T20:18:34.593 INFO:tasks.workunit.client.0.smithi016.stdout:9/83: fdatasync d1/d7/f17 0 2024-04-26T20:18:34.593 INFO:tasks.workunit.client.0.smithi016.stdout:9/84: truncate d1/f8 5074551 0 2024-04-26T20:18:34.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/12: creat f2 x:0 0 0 2024-04-26T20:18:34.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/13: fdatasync f0 0 2024-04-26T20:18:34.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/14: dread - f2 zero size 2024-04-26T20:18:34.602 INFO:tasks.workunit.client.0.smithi016.stdout:7/67: sync 2024-04-26T20:18:34.602 INFO:tasks.workunit.client.0.smithi016.stdout:7/68: truncate d0/fb 281984 0 2024-04-26T20:18:34.603 INFO:tasks.workunit.client.0.smithi016.stdout:9/85: symlink d1/d7/de/d13/l1e 0 2024-04-26T20:18:34.603 INFO:tasks.workunit.client.0.smithi016.stdout:9/86: creat d1/d7/de/f1f x:0 0 0 2024-04-26T20:18:34.603 INFO:tasks.workunit.client.0.smithi016.stdout:9/87: fdatasync d1/d2/f3 0 2024-04-26T20:18:34.607 INFO:tasks.workunit.client.0.smithi016.stdout:0/98: read d2/fa [1365814,63974] 0 2024-04-26T20:18:34.623 INFO:tasks.workunit.client.0.smithi016.stdout:7/69: write d0/fc [753008,32042] 0 2024-04-26T20:18:34.624 INFO:tasks.workunit.client.0.smithi016.stdout:7/70: dread - d0/d1/ff zero size 2024-04-26T20:18:34.628 INFO:tasks.workunit.client.0.smithi016.stdout:5/163: dread d1/d9/f14 [0,4194304] 0 2024-04-26T20:18:34.634 INFO:tasks.workunit.client.0.smithi016.stdout:4/61: dwrite d0/f10 [0,4194304] 0 2024-04-26T20:18:34.635 INFO:tasks.workunit.client.0.smithi016.stdout:4/62: write d0/dd/f12 [1811137,50537] 0 2024-04-26T20:18:34.639 INFO:tasks.workunit.client.0.smithi016.stdout:7/71: dread d0/d1/f10 [0,4194304] 0 2024-04-26T20:18:34.641 INFO:tasks.workunit.client.0.smithi016.stdout:6/59: dwrite d1/de/f11 [4194304,4194304] 0 2024-04-26T20:18:34.644 INFO:tasks.workunit.client.0.smithi016.stdout:7/72: creat d0/d1/d6/f11 x:0 0 0 2024-04-26T20:18:34.644 INFO:tasks.workunit.client.0.smithi016.stdout:7/73: write d0/d1/ff [171397,17004] 0 2024-04-26T20:18:34.644 INFO:tasks.workunit.client.0.smithi016.stdout:7/74: write d0/d1/fd [947932,116522] 0 2024-04-26T20:18:34.647 INFO:tasks.workunit.client.0.smithi016.stdout:6/60: symlink d1/d12/l15 0 2024-04-26T20:18:34.650 INFO:tasks.workunit.client.0.smithi016.stdout:7/75: rename d0/ce to d0/d1/c12 0 2024-04-26T20:18:34.650 INFO:tasks.workunit.client.0.smithi016.stdout:7/76: dread - d0/d1/d6/f11 zero size 2024-04-26T20:18:34.651 INFO:tasks.workunit.client.0.smithi016.stdout:6/61: unlink d1/l3 0 2024-04-26T20:18:34.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/77: link d0/l8 d0/l13 0 2024-04-26T20:18:34.653 INFO:tasks.workunit.client.0.smithi016.stdout:7/78: rename d0/d1/d6/f11 to d0/f14 0 2024-04-26T20:18:34.653 INFO:tasks.workunit.client.0.smithi016.stdout:7/79: dread - d0/f14 zero size 2024-04-26T20:18:34.665 INFO:tasks.workunit.client.0.smithi016.stdout:8/32: dwrite f5 [0,4194304] 0 2024-04-26T20:18:34.668 INFO:tasks.workunit.client.0.smithi016.stdout:8/33: symlink d9/ld 0 2024-04-26T20:18:34.669 INFO:tasks.workunit.client.0.smithi016.stdout:8/34: mknod d9/ce 0 2024-04-26T20:18:34.669 INFO:tasks.workunit.client.0.smithi016.stdout:8/35: dread - f8 zero size 2024-04-26T20:18:34.670 INFO:tasks.workunit.client.0.smithi016.stdout:8/36: dread d9/fb [0,4194304] 0 2024-04-26T20:18:34.673 INFO:tasks.workunit.client.0.smithi016.stdout:8/37: symlink d9/lf 0 2024-04-26T20:18:34.674 INFO:tasks.workunit.client.0.smithi016.stdout:8/38: chown d9/fb 1124733 1 2024-04-26T20:18:34.675 INFO:tasks.workunit.client.0.smithi016.stdout:6/62: write d1/fa [2203539,101397] 0 2024-04-26T20:18:34.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/63: unlink d1/d12/l15 0 2024-04-26T20:18:34.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/64: dread - d1/fd zero size 2024-04-26T20:18:34.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/65: write d1/f6 [627421,95715] 0 2024-04-26T20:18:34.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/66: chown d1 115857081 1 2024-04-26T20:18:34.679 INFO:tasks.workunit.client.0.smithi016.stdout:1/165: dwrite f2 [0,4194304] 0 2024-04-26T20:18:34.679 INFO:tasks.workunit.client.0.smithi016.stdout:1/166: fsync d3/d5/da/f21 0 2024-04-26T20:18:34.679 INFO:tasks.workunit.client.0.smithi016.stdout:6/67: creat d1/d12/f16 x:0 0 0 2024-04-26T20:18:34.681 INFO:tasks.workunit.client.0.smithi016.stdout:1/167: getdents d3/d5/d6/d9/d2a 0 2024-04-26T20:18:34.682 INFO:tasks.workunit.client.0.smithi016.stdout:4/63: write d0/f9 [2332442,90819] 0 2024-04-26T20:18:34.684 INFO:tasks.workunit.client.0.smithi016.stdout:4/64: rename d0/fc to d0/f15 0 2024-04-26T20:18:34.684 INFO:tasks.workunit.client.0.smithi016.stdout:4/65: write d0/f15 [231738,103734] 0 2024-04-26T20:18:34.685 INFO:tasks.workunit.client.0.smithi016.stdout:2/68: dwrite f7 [0,4194304] 0 2024-04-26T20:18:34.685 INFO:tasks.workunit.client.0.smithi016.stdout:2/69: chown f10 98 1 2024-04-26T20:18:34.692 INFO:tasks.workunit.client.0.smithi016.stdout:4/66: unlink d0/dd/f14 0 2024-04-26T20:18:34.692 INFO:tasks.workunit.client.0.smithi016.stdout:4/67: chown d0/f11 1042502 1 2024-04-26T20:18:34.692 INFO:tasks.workunit.client.0.smithi016.stdout:9/88: dwrite d1/d2/f3 [0,4194304] 0 2024-04-26T20:18:34.693 INFO:tasks.workunit.client.0.smithi016.stdout:9/89: chown d1/d7/de 4 1 2024-04-26T20:18:34.693 INFO:tasks.workunit.client.0.smithi016.stdout:9/90: dread - d1/d2/fd zero size 2024-04-26T20:18:34.693 INFO:tasks.workunit.client.0.smithi016.stdout:3/15: dwrite f0 [0,4194304] 0 2024-04-26T20:18:34.693 INFO:tasks.workunit.client.0.smithi016.stdout:0/99: write d2/fd [687813,59372] 0 2024-04-26T20:18:34.695 INFO:tasks.workunit.client.0.smithi016.stdout:9/91: rename d1/d7/de to d1/d2/d20 0 2024-04-26T20:18:34.695 INFO:tasks.workunit.client.0.smithi016.stdout:9/92: truncate d1/d2/d20/f1f 905514 0 2024-04-26T20:18:34.695 INFO:tasks.workunit.client.0.smithi016.stdout:9/93: fdatasync d1/d7/fb 0 2024-04-26T20:18:34.706 INFO:tasks.workunit.client.0.smithi016.stdout:1/168: dread d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:34.713 INFO:tasks.workunit.client.0.smithi016.stdout:7/80: truncate d0/d1/f10 396734 0 2024-04-26T20:18:34.716 INFO:tasks.workunit.client.0.smithi016.stdout:6/68: dread d1/f7 [0,4194304] 0 2024-04-26T20:18:34.716 INFO:tasks.workunit.client.0.smithi016.stdout:6/69: write d1/fa [320769,37895] 0 2024-04-26T20:18:34.722 INFO:tasks.workunit.client.0.smithi016.stdout:8/39: getdents d9 0 2024-04-26T20:18:34.724 INFO:tasks.workunit.client.0.smithi016.stdout:8/40: creat d9/f10 x:0 0 0 2024-04-26T20:18:34.726 INFO:tasks.workunit.client.0.smithi016.stdout:8/41: creat d9/f11 x:0 0 0 2024-04-26T20:18:34.727 INFO:tasks.workunit.client.0.smithi016.stdout:8/42: creat d9/f12 x:0 0 0 2024-04-26T20:18:34.729 INFO:tasks.workunit.client.0.smithi016.stdout:5/164: dwrite d1/f1b [0,4194304] 0 2024-04-26T20:18:34.730 INFO:tasks.workunit.client.0.smithi016.stdout:5/165: read - d1/d9/d11/f23 zero size 2024-04-26T20:18:34.730 INFO:tasks.workunit.client.0.smithi016.stdout:8/43: creat d9/f13 x:0 0 0 2024-04-26T20:18:34.730 INFO:tasks.workunit.client.0.smithi016.stdout:4/68: dwrite d0/fa [0,4194304] 0 2024-04-26T20:18:34.741 INFO:tasks.workunit.client.0.smithi016.stdout:4/69: getdents d0/dd 0 2024-04-26T20:18:34.741 INFO:tasks.workunit.client.0.smithi016.stdout:4/70: write d0/f9 [1795199,67763] 0 2024-04-26T20:18:34.742 INFO:tasks.workunit.client.0.smithi016.stdout:4/71: link d0/dd/l13 d0/dd/l16 0 2024-04-26T20:18:34.744 INFO:tasks.workunit.client.0.smithi016.stdout:6/70: write d1/d8/ff [2930261,6083] 0 2024-04-26T20:18:34.744 INFO:tasks.workunit.client.0.smithi016.stdout:6/71: chown d1/d8/ff 4106705 1 2024-04-26T20:18:34.747 INFO:tasks.workunit.client.0.smithi016.stdout:7/81: truncate d0/d1/fd 1184693 0 2024-04-26T20:18:34.749 INFO:tasks.workunit.client.0.smithi016.stdout:6/72: mknod d1/de/c17 0 2024-04-26T20:18:34.751 INFO:tasks.workunit.client.0.smithi016.stdout:7/82: creat d0/f15 x:0 0 0 2024-04-26T20:18:34.760 INFO:tasks.workunit.client.0.smithi016.stdout:6/73: creat d1/de/f18 x:0 0 0 2024-04-26T20:18:34.760 INFO:tasks.workunit.client.0.smithi016.stdout:2/70: dwrite f11 [0,4194304] 0 2024-04-26T20:18:34.760 INFO:tasks.workunit.client.0.smithi016.stdout:2/71: fdatasync fe 0 2024-04-26T20:18:34.761 INFO:tasks.workunit.client.0.smithi016.stdout:2/72: dread - f13 zero size 2024-04-26T20:18:34.761 INFO:tasks.workunit.client.0.smithi016.stdout:2/73: chown f11 636 1 2024-04-26T20:18:34.761 INFO:tasks.workunit.client.0.smithi016.stdout:5/166: dread d1/d5/f12 [0,4194304] 0 2024-04-26T20:18:34.761 INFO:tasks.workunit.client.0.smithi016.stdout:2/74: symlink l17 0 2024-04-26T20:18:34.768 INFO:tasks.workunit.client.0.smithi016.stdout:4/72: truncate d0/f9 2640447 0 2024-04-26T20:18:34.770 INFO:tasks.workunit.client.0.smithi016.stdout:1/169: read d3/d5/d6/d9/db/f1a [274301,22781] 0 2024-04-26T20:18:34.770 INFO:tasks.workunit.client.0.smithi016.stdout:5/167: creat d1/f31 x:0 0 0 2024-04-26T20:18:34.770 INFO:tasks.workunit.client.0.smithi016.stdout:5/168: stat d1 0 2024-04-26T20:18:34.770 INFO:tasks.workunit.client.0.smithi016.stdout:5/169: stat d1/d5 0 2024-04-26T20:18:34.770 INFO:tasks.workunit.client.0.smithi016.stdout:1/170: write d3/d5/da/f30 [87917,83936] 0 2024-04-26T20:18:34.775 INFO:tasks.workunit.client.0.smithi016.stdout:2/75: creat f18 x:0 0 0 2024-04-26T20:18:34.776 INFO:tasks.workunit.client.0.smithi016.stdout:2/76: fdatasync f18 0 2024-04-26T20:18:34.780 INFO:tasks.workunit.client.0.smithi016.stdout:5/170: creat d1/d5/f32 x:0 0 0 2024-04-26T20:18:34.780 INFO:tasks.workunit.client.0.smithi016.stdout:5/171: chown d1/l17 198687367 1 2024-04-26T20:18:34.781 INFO:tasks.workunit.client.0.smithi016.stdout:1/171: creat d3/d5/f33 x:0 0 0 2024-04-26T20:18:34.784 INFO:tasks.workunit.client.0.smithi016.stdout:0/100: dwrite d2/d8/fe [4194304,4194304] 0 2024-04-26T20:18:34.787 INFO:tasks.workunit.client.0.smithi016.stdout:2/77: mknod c19 0 2024-04-26T20:18:34.788 INFO:tasks.workunit.client.0.smithi016.stdout:2/78: truncate fe 1586939 0 2024-04-26T20:18:34.788 INFO:tasks.workunit.client.0.smithi016.stdout:7/83: read d0/d1/f10 [362557,87205] 0 2024-04-26T20:18:34.788 INFO:tasks.workunit.client.0.smithi016.stdout:7/84: chown d0/d1/d6 72653 1 2024-04-26T20:18:34.789 INFO:tasks.workunit.client.0.smithi016.stdout:5/172: mknod d1/c33 0 2024-04-26T20:18:34.789 INFO:tasks.workunit.client.0.smithi016.stdout:5/173: truncate d1/d5/f32 844423 0 2024-04-26T20:18:34.789 INFO:tasks.workunit.client.0.smithi016.stdout:5/174: chown d1 2312 1 2024-04-26T20:18:34.791 INFO:tasks.workunit.client.0.smithi016.stdout:1/172: unlink d3/d5/d6/d9/d22/f31 0 2024-04-26T20:18:34.791 INFO:tasks.workunit.client.0.smithi016.stdout:1/173: truncate d3/d5/d6/d9/f2c 4429439 0 2024-04-26T20:18:34.792 INFO:tasks.workunit.client.0.smithi016.stdout:0/101: creat d2/dc/d1e/f1f x:0 0 0 2024-04-26T20:18:34.792 INFO:tasks.workunit.client.0.smithi016.stdout:0/102: dread - d2/dc/d1e/f1f zero size 2024-04-26T20:18:34.792 INFO:tasks.workunit.client.0.smithi016.stdout:2/79: symlink l1a 0 2024-04-26T20:18:34.793 INFO:tasks.workunit.client.0.smithi016.stdout:7/85: unlink d0/d1/f10 0 2024-04-26T20:18:34.793 INFO:tasks.workunit.client.0.smithi016.stdout:4/73: write d0/f10 [1943442,84266] 0 2024-04-26T20:18:34.794 INFO:tasks.workunit.client.0.smithi016.stdout:5/175: creat d1/d9/d11/f34 x:0 0 0 2024-04-26T20:18:34.794 INFO:tasks.workunit.client.0.smithi016.stdout:5/176: write d1/d9/f16 [1433691,32083] 0 2024-04-26T20:18:34.795 INFO:tasks.workunit.client.0.smithi016.stdout:0/103: mkdir d2/d20 0 2024-04-26T20:18:34.796 INFO:tasks.workunit.client.0.smithi016.stdout:2/80: creat f1b x:0 0 0 2024-04-26T20:18:34.796 INFO:tasks.workunit.client.0.smithi016.stdout:2/81: write f12 [955180,12683] 0 2024-04-26T20:18:34.796 INFO:tasks.workunit.client.0.smithi016.stdout:7/86: rmdir d0 39 2024-04-26T20:18:34.797 INFO:tasks.workunit.client.0.smithi016.stdout:4/74: symlink d0/dd/l17 0 2024-04-26T20:18:34.798 INFO:tasks.workunit.client.0.smithi016.stdout:5/177: mknod d1/d9/d1c/c35 0 2024-04-26T20:18:34.798 INFO:tasks.workunit.client.0.smithi016.stdout:5/178: chown d1/l19 928284819 1 2024-04-26T20:18:34.798 INFO:tasks.workunit.client.0.smithi016.stdout:5/179: fdatasync d1/d9/d11/f34 0 2024-04-26T20:18:34.800 INFO:tasks.workunit.client.0.smithi016.stdout:2/82: creat f1c x:0 0 0 2024-04-26T20:18:34.800 INFO:tasks.workunit.client.0.smithi016.stdout:0/104: mkdir d2/d21 0 2024-04-26T20:18:34.802 INFO:tasks.workunit.client.0.smithi016.stdout:4/75: truncate d0/f1 3557873 0 2024-04-26T20:18:34.803 INFO:tasks.workunit.client.0.smithi016.stdout:6/74: read d1/de/f11 [7107168,95727] 0 2024-04-26T20:18:34.803 INFO:tasks.workunit.client.0.smithi016.stdout:5/180: symlink d1/d9/l36 0 2024-04-26T20:18:34.804 INFO:tasks.workunit.client.0.smithi016.stdout:6/75: fsync d1/f7 0 2024-04-26T20:18:34.804 INFO:tasks.workunit.client.0.smithi016.stdout:5/181: write d1/d5/f1e [838255,117860] 0 2024-04-26T20:18:34.806 INFO:tasks.workunit.client.0.smithi016.stdout:6/76: write d1/fd [493768,113759] 0 2024-04-26T20:18:34.807 INFO:tasks.workunit.client.0.smithi016.stdout:2/83: mkdir d1d 0 2024-04-26T20:18:34.808 INFO:tasks.workunit.client.0.smithi016.stdout:8/44: dwrite d9/fc [0,4194304] 0 2024-04-26T20:18:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:8/45: creat d9/f14 x:0 0 0 2024-04-26T20:18:34.813 INFO:tasks.workunit.client.0.smithi016.stdout:8/46: truncate d9/fb 1351210 0 2024-04-26T20:18:34.822 INFO:tasks.workunit.client.0.smithi016.stdout:8/47: creat d9/f15 x:0 0 0 2024-04-26T20:18:34.824 INFO:tasks.workunit.client.0.smithi016.stdout:4/76: unlink d0/f9 0 2024-04-26T20:18:34.824 INFO:tasks.workunit.client.0.smithi016.stdout:3/16: dwrite f0 [4194304,4194304] 0 2024-04-26T20:18:34.825 INFO:tasks.workunit.client.0.smithi016.stdout:8/48: rename d9/f10 to d9/f16 0 2024-04-26T20:18:34.827 INFO:tasks.workunit.client.0.smithi016.stdout:2/84: write f10 [461941,44711] 0 2024-04-26T20:18:34.827 INFO:tasks.workunit.client.0.smithi016.stdout:2/85: dread - f14 zero size 2024-04-26T20:18:34.827 INFO:tasks.workunit.client.0.smithi016.stdout:4/77: rename d0/dd/l17 to d0/dd/l18 0 2024-04-26T20:18:34.832 INFO:tasks.workunit.client.0.smithi016.stdout:8/49: mknod d9/c17 0 2024-04-26T20:18:34.839 INFO:tasks.workunit.client.0.smithi016.stdout:2/86: symlink d1d/l1e 0 2024-04-26T20:18:34.842 INFO:tasks.workunit.client.0.smithi016.stdout:0/105: truncate d2/d8/fe 3017134 0 2024-04-26T20:18:34.850 INFO:tasks.workunit.client.0.smithi016.stdout:2/87: dread f4 [4194304,4194304] 0 2024-04-26T20:18:34.850 INFO:tasks.workunit.client.0.smithi016.stdout:2/88: truncate f14 862657 0 2024-04-26T20:18:34.850 INFO:tasks.workunit.client.0.smithi016.stdout:2/89: fsync fa 0 2024-04-26T20:18:34.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/50: getdents d9 0 2024-04-26T20:18:34.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/51: dread - d9/f13 zero size 2024-04-26T20:18:34.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/106: mknod d2/d20/c22 0 2024-04-26T20:18:34.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/107: dread - d2/d8/f11 zero size 2024-04-26T20:18:34.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/90: creat d1d/f1f x:0 0 0 2024-04-26T20:18:34.857 INFO:tasks.workunit.client.0.smithi016.stdout:2/91: dread fe [0,4194304] 0 2024-04-26T20:18:34.857 INFO:tasks.workunit.client.0.smithi016.stdout:2/92: truncate f1c 299202 0 2024-04-26T20:18:34.882 INFO:tasks.workunit.client.0.smithi016.stdout:1/174: dwrite d3/d5/da/f26 [0,4194304] 0 2024-04-26T20:18:34.885 INFO:tasks.workunit.client.0.smithi016.stdout:0/108: symlink d2/d20/l23 0 2024-04-26T20:18:34.885 INFO:tasks.workunit.client.0.smithi016.stdout:0/109: chown d2/d20/l23 70983 1 2024-04-26T20:18:34.885 INFO:tasks.workunit.client.0.smithi016.stdout:0/110: chown d2/dc/f17 67453308 1 2024-04-26T20:18:34.885 INFO:tasks.workunit.client.0.smithi016.stdout:0/111: write d2/f15 [1466624,55421] 0 2024-04-26T20:18:34.885 INFO:tasks.workunit.client.0.smithi016.stdout:0/112: chown d2/f14 0 1 2024-04-26T20:18:34.886 INFO:tasks.workunit.client.0.smithi016.stdout:8/52: creat d9/f18 x:0 0 0 2024-04-26T20:18:34.887 INFO:tasks.workunit.client.0.smithi016.stdout:5/182: dread d1/d5/f1d [0,4194304] 0 2024-04-26T20:18:34.890 INFO:tasks.workunit.client.0.smithi016.stdout:1/175: symlink d3/d5/d6/d9/db/l34 0 2024-04-26T20:18:34.890 INFO:tasks.workunit.client.0.smithi016.stdout:0/113: rename d2/d21 to d2/dc/d18/d24 0 2024-04-26T20:18:34.891 INFO:tasks.workunit.client.0.smithi016.stdout:8/53: truncate d9/f11 159720 0 2024-04-26T20:18:34.891 INFO:tasks.workunit.client.0.smithi016.stdout:8/54: chown f8 989812228 1 2024-04-26T20:18:34.894 INFO:tasks.workunit.client.0.smithi016.stdout:0/114: mkdir d2/dc/d1e/d25 0 2024-04-26T20:18:34.895 INFO:tasks.workunit.client.0.smithi016.stdout:5/183: mkdir d1/d9/d37 0 2024-04-26T20:18:34.895 INFO:tasks.workunit.client.0.smithi016.stdout:5/184: readlink d1/d9/d1c/l2b 0 2024-04-26T20:18:34.895 INFO:tasks.workunit.client.0.smithi016.stdout:5/185: chown d1/l21 170455 1 2024-04-26T20:18:34.897 INFO:tasks.workunit.client.0.smithi016.stdout:0/115: read d2/dc/d18/f1a [28739,23901] 0 2024-04-26T20:18:34.897 INFO:tasks.workunit.client.0.smithi016.stdout:3/17: dread f0 [0,4194304] 0 2024-04-26T20:18:34.898 INFO:tasks.workunit.client.0.smithi016.stdout:5/186: getdents d1 0 2024-04-26T20:18:34.901 INFO:tasks.workunit.client.0.smithi016.stdout:6/77: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:34.901 INFO:tasks.workunit.client.0.smithi016.stdout:6/78: truncate d1/fa 4931304 0 2024-04-26T20:18:34.902 INFO:tasks.workunit.client.0.smithi016.stdout:6/79: truncate d1/d12/f16 386958 0 2024-04-26T20:18:34.902 INFO:tasks.workunit.client.0.smithi016.stdout:8/55: unlink d9/f12 0 2024-04-26T20:18:34.902 INFO:tasks.workunit.client.0.smithi016.stdout:0/116: rmdir d2 39 2024-04-26T20:18:34.903 INFO:tasks.workunit.client.0.smithi016.stdout:3/18: mkdir d3 0 2024-04-26T20:18:34.905 INFO:tasks.workunit.client.0.smithi016.stdout:6/80: rename d1/de/f11 to d1/d8/f19 0 2024-04-26T20:18:34.905 INFO:tasks.workunit.client.0.smithi016.stdout:6/81: write d1/f4 [2506772,86037] 0 2024-04-26T20:18:34.907 INFO:tasks.workunit.client.0.smithi016.stdout:3/19: creat d3/f4 x:0 0 0 2024-04-26T20:18:34.907 INFO:tasks.workunit.client.0.smithi016.stdout:3/20: fsync f0 0 2024-04-26T20:18:34.907 INFO:tasks.workunit.client.0.smithi016.stdout:3/21: chown d3/f4 0 1 2024-04-26T20:18:34.908 INFO:tasks.workunit.client.0.smithi016.stdout:8/56: mkdir d9/d19 0 2024-04-26T20:18:34.912 INFO:tasks.workunit.client.0.smithi016.stdout:1/176: write d3/d5/da/f26 [2710459,69809] 0 2024-04-26T20:18:34.913 INFO:tasks.workunit.client.0.smithi016.stdout:3/22: link f0 d3/f5 0 2024-04-26T20:18:34.913 INFO:tasks.workunit.client.0.smithi016.stdout:3/23: chown f2 2834792 1 2024-04-26T20:18:34.917 INFO:tasks.workunit.client.0.smithi016.stdout:5/187: dread d1/d5/f12 [0,4194304] 0 2024-04-26T20:18:34.918 INFO:tasks.workunit.client.0.smithi016.stdout:3/24: symlink d3/l6 0 2024-04-26T20:18:34.921 INFO:tasks.workunit.client.0.smithi016.stdout:6/82: write d1/fd [125494,39032] 0 2024-04-26T20:18:34.921 INFO:tasks.workunit.client.0.smithi016.stdout:6/83: fdatasync d1/f6 0 2024-04-26T20:18:34.921 INFO:tasks.workunit.client.0.smithi016.stdout:6/84: dread - d1/f13 zero size 2024-04-26T20:18:34.923 INFO:tasks.workunit.client.0.smithi016.stdout:5/188: creat d1/d9/f38 x:0 0 0 2024-04-26T20:18:34.947 INFO:tasks.workunit.client.0.smithi016.stdout:5/189: dread d1/d9/f10 [0,4194304] 0 2024-04-26T20:18:34.951 INFO:tasks.workunit.client.0.smithi016.stdout:6/85: symlink d1/l1a 0 2024-04-26T20:18:34.951 INFO:tasks.workunit.client.0.smithi016.stdout:6/86: fdatasync d1/d8/fb 0 2024-04-26T20:18:34.952 INFO:tasks.workunit.client.0.smithi016.stdout:6/87: write d1/d12/f16 [597112,120375] 0 2024-04-26T20:18:34.954 INFO:tasks.workunit.client.0.smithi016.stdout:5/190: creat d1/d9/d37/f39 x:0 0 0 2024-04-26T20:18:34.954 INFO:tasks.workunit.client.0.smithi016.stdout:5/191: stat d1/d9/d1c/c35 0 2024-04-26T20:18:34.955 INFO:tasks.workunit.client.0.smithi016.stdout:6/88: mknod d1/de/c1b 0 2024-04-26T20:18:34.958 INFO:tasks.workunit.client.0.smithi016.stdout:5/192: symlink d1/d9/d1c/l3a 0 2024-04-26T20:18:34.963 INFO:tasks.workunit.client.0.smithi016.stdout:6/89: mkdir d1/de/d1c 0 2024-04-26T20:18:34.963 INFO:tasks.workunit.client.0.smithi016.stdout:0/117: dwrite d2/dc/f17 [0,4194304] 0 2024-04-26T20:18:34.965 INFO:tasks.workunit.client.0.smithi016.stdout:5/193: mknod d1/d9/c3b 0 2024-04-26T20:18:34.965 INFO:tasks.workunit.client.0.smithi016.stdout:5/194: truncate d1/d9/d11/f23 343593 0 2024-04-26T20:18:34.965 INFO:tasks.workunit.client.0.smithi016.stdout:6/90: symlink d1/de/l1d 0 2024-04-26T20:18:34.972 INFO:tasks.workunit.client.0.smithi016.stdout:3/25: dwrite d3/f5 [0,4194304] 0 2024-04-26T20:18:34.972 INFO:tasks.workunit.client.0.smithi016.stdout:3/26: read - f2 zero size 2024-04-26T20:18:34.975 INFO:tasks.workunit.client.0.smithi016.stdout:6/91: symlink d1/l1e 0 2024-04-26T20:18:34.994 INFO:tasks.workunit.client.0.smithi016.stdout:3/27: unlink d3/f5 0 2024-04-26T20:18:35.005 INFO:tasks.workunit.client.0.smithi016.stdout:8/57: dwrite d9/f15 [0,4194304] 0 2024-04-26T20:18:35.017 INFO:tasks.workunit.client.0.smithi016.stdout:0/118: dwrite d2/d8/fe [0,4194304] 0 2024-04-26T20:18:35.017 INFO:tasks.workunit.client.0.smithi016.stdout:1/177: dwrite d3/f4 [0,4194304] 0 2024-04-26T20:18:35.018 INFO:tasks.workunit.client.0.smithi016.stdout:0/119: rename d2/fa to d2/dc/d1e/f26 0 2024-04-26T20:18:35.019 INFO:tasks.workunit.client.0.smithi016.stdout:0/120: write d2/dc/d1e/f1f [286574,77044] 0 2024-04-26T20:18:35.019 INFO:tasks.workunit.client.0.smithi016.stdout:1/178: chown d3/d5/d6/le 1700706688 1 2024-04-26T20:18:35.020 INFO:tasks.workunit.client.0.smithi016.stdout:0/121: unlink d2/fd 0 2024-04-26T20:18:35.021 INFO:tasks.workunit.client.0.smithi016.stdout:1/179: creat d3/d5/d6/d9/db/f35 x:0 0 0 2024-04-26T20:18:35.023 INFO:tasks.workunit.client.0.smithi016.stdout:3/28: write f0 [8358188,70861] 0 2024-04-26T20:18:35.025 INFO:tasks.workunit.client.0.smithi016.stdout:0/122: creat d2/d20/f27 x:0 0 0 2024-04-26T20:18:35.031 INFO:tasks.workunit.client.0.smithi016.stdout:1/180: write d3/d5/da/f29 [725382,38405] 0 2024-04-26T20:18:35.034 INFO:tasks.workunit.client.0.smithi016.stdout:1/181: dread d3/d5/d6/d9/db/f1a [0,4194304] 0 2024-04-26T20:18:35.041 INFO:tasks.workunit.client.0.smithi016.stdout:0/123: creat d2/dc/d1e/d25/f28 x:0 0 0 2024-04-26T20:18:35.049 INFO:tasks.workunit.client.0.smithi016.stdout:0/124: dread d2/fb [0,4194304] 0 2024-04-26T20:18:35.077 INFO:tasks.workunit.client.0.smithi016.stdout:5/195: dwrite d1/d9/d11/f18 [0,4194304] 0 2024-04-26T20:18:35.101 INFO:tasks.workunit.client.0.smithi016.stdout:3/29: dwrite f2 [0,4194304] 0 2024-04-26T20:18:35.101 INFO:tasks.workunit.client.0.smithi016.stdout:5/196: write d1/d9/f14 [4194031,69581] 0 2024-04-26T20:18:35.104 INFO:tasks.workunit.client.0.smithi016.stdout:0/125: dwrite d2/dc/d1e/d25/f28 [0,4194304] 0 2024-04-26T20:18:35.111 INFO:tasks.workunit.client.0.smithi016.stdout:5/197: dread d1/d5/fd [0,4194304] 0 2024-04-26T20:18:35.124 INFO:tasks.workunit.client.0.smithi016.stdout:1/182: truncate d3/f4 3832682 0 2024-04-26T20:18:35.135 INFO:tasks.workunit.client.0.smithi016.stdout:0/126: dwrite d2/dc/d1e/f1f [0,4194304] 0 2024-04-26T20:18:35.137 INFO:tasks.workunit.client.0.smithi016.stdout:5/198: truncate d1/d9/f16 1139670 0 2024-04-26T20:18:35.138 INFO:tasks.workunit.client.0.smithi016.stdout:1/183: truncate d3/d5/da/f26 1940035 0 2024-04-26T20:18:35.138 INFO:tasks.workunit.client.0.smithi016.stdout:1/184: read - d3/d5/f33 zero size 2024-04-26T20:18:35.319 INFO:tasks.workunit.client.0.smithi016.stdout:5/199: mknod d1/d9/d1c/c3c 0 2024-04-26T20:18:35.319 INFO:tasks.workunit.client.0.smithi016.stdout:5/200: chown d1/d9/d37 245 1 2024-04-26T20:18:35.367 INFO:tasks.workunit.client.0.smithi016.stdout:5/201: dwrite d1/d5/f1d [0,4194304] 0 2024-04-26T20:18:35.368 INFO:tasks.workunit.client.0.smithi016.stdout:1/185: mkdir d3/d5/da/d36 0 2024-04-26T20:18:35.369 INFO:tasks.workunit.client.0.smithi016.stdout:5/202: getdents d1/d5 0 2024-04-26T20:18:35.369 INFO:tasks.workunit.client.0.smithi016.stdout:5/203: write d1/d9/f16 [2042749,41836] 0 2024-04-26T20:18:35.370 INFO:tasks.workunit.client.0.smithi016.stdout:1/186: rmdir d3/d5/d6/d9/db 39 2024-04-26T20:18:35.370 INFO:tasks.workunit.client.0.smithi016.stdout:1/187: chown d3/d5/d6/d9/f2c 389 1 2024-04-26T20:18:35.370 INFO:tasks.workunit.client.0.smithi016.stdout:1/188: write d3/d5/da/f30 [1174416,110625] 0 2024-04-26T20:18:35.372 INFO:tasks.workunit.client.0.smithi016.stdout:5/204: link d1/d9/d11/f23 d1/d9/f3d 0 2024-04-26T20:18:35.372 INFO:tasks.workunit.client.0.smithi016.stdout:5/205: write d1/d9/f38 [45465,103001] 0 2024-04-26T20:18:35.374 INFO:tasks.workunit.client.0.smithi016.stdout:1/189: rmdir d3/d5/da/d36 0 2024-04-26T20:18:35.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/206: truncate d1/d5/fd 1913366 0 2024-04-26T20:18:35.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/207: chown d1/d9/d25 124 1 2024-04-26T20:18:35.377 INFO:tasks.workunit.client.0.smithi016.stdout:5/208: dread d1/d9/f3d [0,4194304] 0 2024-04-26T20:18:35.378 INFO:tasks.workunit.client.0.smithi016.stdout:5/209: truncate d1/d5/f12 4377610 0 2024-04-26T20:18:35.378 INFO:tasks.workunit.client.0.smithi016.stdout:1/190: symlink d3/d5/d6/d9/db/l37 0 2024-04-26T20:18:35.379 INFO:tasks.workunit.client.0.smithi016.stdout:5/210: getdents d1/d9/d11 0 2024-04-26T20:18:35.380 INFO:tasks.workunit.client.0.smithi016.stdout:1/191: creat d3/d5/d6/d9/f38 x:0 0 0 2024-04-26T20:18:35.380 INFO:tasks.workunit.client.0.smithi016.stdout:1/192: read d3/d5/da/f29 [863452,108978] 0 2024-04-26T20:18:35.381 INFO:tasks.workunit.client.0.smithi016.stdout:1/193: write d3/d5/da/f30 [229849,102999] 0 2024-04-26T20:18:35.382 INFO:tasks.workunit.client.0.smithi016.stdout:5/211: mknod d1/d9/d25/c3e 0 2024-04-26T20:18:35.383 INFO:tasks.workunit.client.0.smithi016.stdout:5/212: symlink d1/d9/d11/l3f 0 2024-04-26T20:18:35.444 INFO:tasks.workunit.client.0.smithi016.stdout:5/213: dwrite f0 [4194304,4194304] 0 2024-04-26T20:18:35.445 INFO:tasks.workunit.client.0.smithi016.stdout:1/194: link d3/d5/d6/l24 d3/d5/d6/l39 0 2024-04-26T20:18:35.446 INFO:tasks.workunit.client.0.smithi016.stdout:5/214: link d1/d9/l28 d1/l40 0 2024-04-26T20:18:35.446 INFO:tasks.workunit.client.0.smithi016.stdout:5/215: readlink d1/l19 0 2024-04-26T20:18:35.465 INFO:tasks.workunit.client.0.smithi016.stdout:3/30: dwrite f0 [4194304,4194304] 0 2024-04-26T20:18:35.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/195: unlink d3/d5/d6/d9/c16 0 2024-04-26T20:18:35.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/196: fsync d3/d5/da/f21 0 2024-04-26T20:18:35.467 INFO:tasks.workunit.client.0.smithi016.stdout:1/197: dread d3/d5/d6/d9/d2a/f32 [0,4194304] 0 2024-04-26T20:18:35.468 INFO:tasks.workunit.client.0.smithi016.stdout:3/31: creat d3/f7 x:0 0 0 2024-04-26T20:18:35.469 INFO:tasks.workunit.client.0.smithi016.stdout:3/32: truncate f2 3251711 0 2024-04-26T20:18:35.476 INFO:tasks.workunit.client.0.smithi016.stdout:0/127: dwrite d2/f14 [0,4194304] 0 2024-04-26T20:18:35.478 INFO:tasks.workunit.client.0.smithi016.stdout:1/198: rename d3/d5/d6/l24 to d3/d5/d6/l3a 0 2024-04-26T20:18:35.480 INFO:tasks.workunit.client.0.smithi016.stdout:5/216: dwrite d1/d9/f29 [0,4194304] 0 2024-04-26T20:18:35.480 INFO:tasks.workunit.client.0.smithi016.stdout:5/217: write d1/d5/f12 [737427,54292] 0 2024-04-26T20:18:35.483 INFO:tasks.workunit.client.0.smithi016.stdout:0/128: link d2/dc/f17 d2/dc/d18/f29 0 2024-04-26T20:18:35.483 INFO:tasks.workunit.client.0.smithi016.stdout:0/129: stat d2/d20/c22 0 2024-04-26T20:18:35.483 INFO:tasks.workunit.client.0.smithi016.stdout:1/199: mkdir d3/d5/d6/d9/d2a/d3b 0 2024-04-26T20:18:35.483 INFO:tasks.workunit.client.0.smithi016.stdout:1/200: write d3/d5/da/fc [4252003,110254] 0 2024-04-26T20:18:35.485 INFO:tasks.workunit.client.0.smithi016.stdout:5/218: rename d1/d9/d25/c3e to d1/d9/c41 0 2024-04-26T20:18:35.548 INFO:tasks.workunit.client.0.smithi016.stdout:8/58: sync 2024-04-26T20:18:35.548 INFO:tasks.workunit.client.0.smithi016.stdout:6/92: sync 2024-04-26T20:18:35.548 INFO:tasks.workunit.client.0.smithi016.stdout:9/94: sync 2024-04-26T20:18:35.548 INFO:tasks.workunit.client.0.smithi016.stdout:2/93: sync 2024-04-26T20:18:35.548 INFO:tasks.workunit.client.0.smithi016.stdout:7/87: sync 2024-04-26T20:18:35.548 INFO:tasks.workunit.client.0.smithi016.stdout:4/78: sync 2024-04-26T20:18:35.549 INFO:tasks.workunit.client.0.smithi016.stdout:9/95: symlink d1/l21 0 2024-04-26T20:18:35.549 INFO:tasks.workunit.client.0.smithi016.stdout:9/96: readlink d1/d7/l11 0 2024-04-26T20:18:35.550 INFO:tasks.workunit.client.0.smithi016.stdout:9/97: write d1/d2/f10 [775921,65191] 0 2024-04-26T20:18:35.550 INFO:tasks.workunit.client.0.smithi016.stdout:6/93: creat d1/f1f x:0 0 0 2024-04-26T20:18:35.550 INFO:tasks.workunit.client.0.smithi016.stdout:6/94: chown d1/f4 0 1 2024-04-26T20:18:35.551 INFO:tasks.workunit.client.0.smithi016.stdout:7/88: stat d0/d1/fd 0 2024-04-26T20:18:35.551 INFO:tasks.workunit.client.0.smithi016.stdout:7/89: chown d0/l8 12 1 2024-04-26T20:18:35.552 INFO:tasks.workunit.client.0.smithi016.stdout:2/94: mkdir d1d/d20 0 2024-04-26T20:18:35.553 INFO:tasks.workunit.client.0.smithi016.stdout:9/98: write d1/d2/f6 [261974,112796] 0 2024-04-26T20:18:35.555 INFO:tasks.workunit.client.0.smithi016.stdout:1/201: rename d3/d5/d6/d9/f2c to d3/d5/d6/f3c 0 2024-04-26T20:18:35.556 INFO:tasks.workunit.client.0.smithi016.stdout:7/90: getdents d0/d1 0 2024-04-26T20:18:35.556 INFO:tasks.workunit.client.0.smithi016.stdout:7/91: fdatasync d0/d1/ff 0 2024-04-26T20:18:35.593 INFO:tasks.workunit.client.0.smithi016.stdout:1/202: dwrite d3/d5/d6/d9/db/f35 [0,4194304] 0 2024-04-26T20:18:35.595 INFO:tasks.workunit.client.0.smithi016.stdout:1/203: dread d3/d5/d6/d9/db/f1a [0,4194304] 0 2024-04-26T20:18:35.661 INFO:tasks.workunit.client.0.smithi016.stdout:1/204: dwrite d3/d5/d6/d9/d2a/f32 [0,4194304] 0 2024-04-26T20:18:35.661 INFO:tasks.workunit.client.0.smithi016.stdout:1/205: fdatasync d3/d5/f18 0 2024-04-26T20:18:35.665 INFO:tasks.workunit.client.0.smithi016.stdout:1/206: dread d3/d5/da/f26 [0,4194304] 0 2024-04-26T20:18:35.805 INFO:tasks.workunit.client.0.smithi016.stdout:2/95: truncate f7 1681804 0 2024-04-26T20:18:35.806 INFO:tasks.workunit.client.0.smithi016.stdout:9/99: symlink d1/d2/d20/d13/l22 0 2024-04-26T20:18:35.806 INFO:tasks.workunit.client.0.smithi016.stdout:5/219: rename d1/d5/f1e to d1/d9/d25/f42 0 2024-04-26T20:18:35.807 INFO:tasks.workunit.client.0.smithi016.stdout:9/100: write d1/d2/d20/d13/f19 [3543592,101205] 0 2024-04-26T20:18:35.807 INFO:tasks.workunit.client.0.smithi016.stdout:7/92: symlink d0/d1/d6/l16 0 2024-04-26T20:18:35.807 INFO:tasks.workunit.client.0.smithi016.stdout:5/220: write d1/d9/d25/f42 [1282359,113025] 0 2024-04-26T20:18:35.807 INFO:tasks.workunit.client.0.smithi016.stdout:5/221: stat d1/f31 0 2024-04-26T20:18:35.807 INFO:tasks.workunit.client.0.smithi016.stdout:5/222: dread - d1/f22 zero size 2024-04-26T20:18:35.807 INFO:tasks.workunit.client.0.smithi016.stdout:7/93: write d0/d1/fd [1993248,124141] 0 2024-04-26T20:18:35.810 INFO:tasks.workunit.client.0.smithi016.stdout:1/207: mkdir d3/d5/d6/d9/d2a/d3d 0 2024-04-26T20:18:35.811 INFO:tasks.workunit.client.0.smithi016.stdout:8/59: rename c4 to d9/c1a 0 2024-04-26T20:18:35.812 INFO:tasks.workunit.client.0.smithi016.stdout:8/60: truncate d9/f13 944906 0 2024-04-26T20:18:35.814 INFO:tasks.workunit.client.0.smithi016.stdout:0/130: dwrite d2/d8/f9 [0,4194304] 0 2024-04-26T20:18:35.814 INFO:tasks.workunit.client.0.smithi016.stdout:8/61: dread - d9/f16 zero size 2024-04-26T20:18:35.815 INFO:tasks.workunit.client.0.smithi016.stdout:8/62: write d9/f11 [422854,53890] 0 2024-04-26T20:18:35.815 INFO:tasks.workunit.client.0.smithi016.stdout:6/95: rename d1/de/f18 to d1/de/d1c/f20 0 2024-04-26T20:18:35.820 INFO:tasks.workunit.client.0.smithi016.stdout:0/131: symlink d2/dc/l2a 0 2024-04-26T20:18:35.821 INFO:tasks.workunit.client.0.smithi016.stdout:5/223: dread d1/d9/f10 [0,4194304] 0 2024-04-26T20:18:35.821 INFO:tasks.workunit.client.0.smithi016.stdout:5/224: write d1/d5/fd [698762,90419] 0 2024-04-26T20:18:35.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/208: rename d3/l2d to d3/d5/d6/d9/d2a/d3d/l3e 0 2024-04-26T20:18:35.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/209: fsync d3/d5/d6/d9/f38 0 2024-04-26T20:18:35.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/210: write d3/d5/d6/d9/f38 [157689,83578] 0 2024-04-26T20:18:35.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/211: write d3/d5/da/f26 [2527455,43962] 0 2024-04-26T20:18:35.822 INFO:tasks.workunit.client.0.smithi016.stdout:2/96: dread f7 [0,4194304] 0 2024-04-26T20:18:35.825 INFO:tasks.workunit.client.0.smithi016.stdout:5/225: rename d1/d9/d37 to d1/d9/d1c/d43 0 2024-04-26T20:18:35.827 INFO:tasks.workunit.client.0.smithi016.stdout:2/97: mknod d1d/c21 0 2024-04-26T20:18:35.827 INFO:tasks.workunit.client.0.smithi016.stdout:2/98: chown f1b 162 1 2024-04-26T20:18:35.827 INFO:tasks.workunit.client.0.smithi016.stdout:2/99: write f14 [978099,53047] 0 2024-04-26T20:18:35.827 INFO:tasks.workunit.client.0.smithi016.stdout:2/100: getdents d1d/d20 0 2024-04-26T20:18:35.828 INFO:tasks.workunit.client.0.smithi016.stdout:5/226: link d1/d9/f16 d1/d9/d1c/d43/f44 0 2024-04-26T20:18:35.829 INFO:tasks.workunit.client.0.smithi016.stdout:9/101: dread d1/d2/f3 [0,4194304] 0 2024-04-26T20:18:35.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/227: creat d1/d9/d1c/f45 x:0 0 0 2024-04-26T20:18:35.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/228: chown d1/d9/f10 72713689 1 2024-04-26T20:18:35.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/229: fdatasync d1/d9/fc 0 2024-04-26T20:18:35.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/230: chown d1/d5 682 1 2024-04-26T20:18:35.838 INFO:tasks.workunit.client.0.smithi016.stdout:9/102: link d1/d1b/l1c d1/l23 0 2024-04-26T20:18:35.838 INFO:tasks.workunit.client.0.smithi016.stdout:9/103: write d1/d2/f10 [1289899,70443] 0 2024-04-26T20:18:35.838 INFO:tasks.workunit.client.0.smithi016.stdout:9/104: write d1/fa [84273,116939] 0 2024-04-26T20:18:35.840 INFO:tasks.workunit.client.0.smithi016.stdout:6/96: getdents d1/de/d1c 0 2024-04-26T20:18:35.843 INFO:tasks.workunit.client.0.smithi016.stdout:6/97: mkdir d1/d21 0 2024-04-26T20:18:35.844 INFO:tasks.workunit.client.0.smithi016.stdout:9/105: creat d1/d1b/f24 x:0 0 0 2024-04-26T20:18:35.848 INFO:tasks.workunit.client.0.smithi016.stdout:9/106: write d1/f14 [679132,70487] 0 2024-04-26T20:18:35.848 INFO:tasks.workunit.client.0.smithi016.stdout:9/107: chown d1/d1b/f24 28317 1 2024-04-26T20:18:35.848 INFO:tasks.workunit.client.0.smithi016.stdout:9/108: stat d1/f14 0 2024-04-26T20:18:35.848 INFO:tasks.workunit.client.0.smithi016.stdout:6/98: mknod d1/d21/c22 0 2024-04-26T20:18:35.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/109: fsync d1/d2/d20/f1f 0 2024-04-26T20:18:35.849 INFO:tasks.workunit.client.0.smithi016.stdout:6/99: mkdir d1/de/d1c/d23 0 2024-04-26T20:18:35.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/110: mkdir d1/d25 0 2024-04-26T20:18:35.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/231: dread d1/d9/d25/f42 [0,4194304] 0 2024-04-26T20:18:35.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/232: write d1/d9/d25/f42 [1650624,1829] 0 2024-04-26T20:18:35.851 INFO:tasks.workunit.client.0.smithi016.stdout:9/111: truncate d1/d7/f9 1898130 0 2024-04-26T20:18:35.851 INFO:tasks.workunit.client.0.smithi016.stdout:9/112: readlink d1/d2/d20/d13/l22 0 2024-04-26T20:18:35.851 INFO:tasks.workunit.client.0.smithi016.stdout:1/212: dread d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:35.851 INFO:tasks.workunit.client.0.smithi016.stdout:7/94: dwrite d0/f14 [0,4194304] 0 2024-04-26T20:18:35.852 INFO:tasks.workunit.client.0.smithi016.stdout:5/233: mknod d1/d9/d25/c46 0 2024-04-26T20:18:35.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/113: rename d1/d2/d20/d13/f19 to d1/d1b/f26 0 2024-04-26T20:18:35.855 INFO:tasks.workunit.client.0.smithi016.stdout:1/213: creat d3/d5/d6/d9/d22/f3f x:0 0 0 2024-04-26T20:18:35.858 INFO:tasks.workunit.client.0.smithi016.stdout:7/95: creat d0/f17 x:0 0 0 2024-04-26T20:18:35.859 INFO:tasks.workunit.client.0.smithi016.stdout:9/114: mknod d1/d1b/c27 0 2024-04-26T20:18:35.859 INFO:tasks.workunit.client.0.smithi016.stdout:9/115: write d1/d2/fd [113531,20820] 0 2024-04-26T20:18:35.861 INFO:tasks.workunit.client.0.smithi016.stdout:5/234: rename d1/d9/d11/f23 to d1/d9/d25/f47 0 2024-04-26T20:18:35.863 INFO:tasks.workunit.client.0.smithi016.stdout:7/96: mknod d0/d1/c18 0 2024-04-26T20:18:35.864 INFO:tasks.workunit.client.0.smithi016.stdout:9/116: mkdir d1/d2/d20/d13/d28 0 2024-04-26T20:18:35.864 INFO:tasks.workunit.client.0.smithi016.stdout:9/117: stat d1/d2/d20/d13/l18 0 2024-04-26T20:18:35.873 INFO:tasks.workunit.client.0.smithi016.stdout:5/235: link d1/d9/d1c/l2b d1/l48 0 2024-04-26T20:18:35.873 INFO:tasks.workunit.client.0.smithi016.stdout:4/79: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:35.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/33: dwrite f2 [0,4194304] 0 2024-04-26T20:18:35.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/34: write d3/f7 [323340,25117] 0 2024-04-26T20:18:35.874 INFO:tasks.workunit.client.0.smithi016.stdout:9/118: mkdir d1/d29 0 2024-04-26T20:18:35.874 INFO:tasks.workunit.client.0.smithi016.stdout:9/119: readlink d1/d2/d20/d13/l1e 0 2024-04-26T20:18:35.876 INFO:tasks.workunit.client.0.smithi016.stdout:1/214: rename d3/d5/d6/c7 to d3/d5/c40 0 2024-04-26T20:18:35.880 INFO:tasks.workunit.client.0.smithi016.stdout:7/97: dread d0/f14 [0,4194304] 0 2024-04-26T20:18:35.883 INFO:tasks.workunit.client.0.smithi016.stdout:5/236: creat d1/d9/f49 x:0 0 0 2024-04-26T20:18:35.885 INFO:tasks.workunit.client.0.smithi016.stdout:3/35: creat d3/f8 x:0 0 0 2024-04-26T20:18:35.885 INFO:tasks.workunit.client.0.smithi016.stdout:3/36: write d3/f8 [176389,108687] 0 2024-04-26T20:18:35.885 INFO:tasks.workunit.client.0.smithi016.stdout:3/37: write d3/f8 [493348,96870] 0 2024-04-26T20:18:35.886 INFO:tasks.workunit.client.0.smithi016.stdout:1/215: rmdir d3/d5/d6/d9 39 2024-04-26T20:18:35.887 INFO:tasks.workunit.client.0.smithi016.stdout:1/216: readlink d3/d5/d6/l39 0 2024-04-26T20:18:35.896 INFO:tasks.workunit.client.0.smithi016.stdout:9/120: rename d1/d2/d20/d13/d28 to d1/d29/d2a 0 2024-04-26T20:18:35.896 INFO:tasks.workunit.client.0.smithi016.stdout:9/121: truncate d1/d2/f6 1157391 0 2024-04-26T20:18:35.896 INFO:tasks.workunit.client.0.smithi016.stdout:7/98: creat d0/f19 x:0 0 0 2024-04-26T20:18:35.896 INFO:tasks.workunit.client.0.smithi016.stdout:5/237: symlink d1/d9/d1c/l4a 0 2024-04-26T20:18:35.896 INFO:tasks.workunit.client.0.smithi016.stdout:5/238: fdatasync d1/f31 0 2024-04-26T20:18:35.897 INFO:tasks.workunit.client.0.smithi016.stdout:3/38: mkdir d3/d9 0 2024-04-26T20:18:35.900 INFO:tasks.workunit.client.0.smithi016.stdout:1/217: creat d3/d5/d6/d9/d2a/d3b/f41 x:0 0 0 2024-04-26T20:18:35.900 INFO:tasks.workunit.client.0.smithi016.stdout:1/218: readlink d3/d5/d6/le 0 2024-04-26T20:18:35.904 INFO:tasks.workunit.client.0.smithi016.stdout:3/39: symlink d3/la 0 2024-04-26T20:18:35.909 INFO:tasks.workunit.client.0.smithi016.stdout:8/63: dwrite d9/f15 [4194304,4194304] 0 2024-04-26T20:18:35.910 INFO:tasks.workunit.client.0.smithi016.stdout:7/99: dread d0/fb [0,4194304] 0 2024-04-26T20:18:35.915 INFO:tasks.workunit.client.0.smithi016.stdout:0/132: dwrite d2/d20/f27 [0,4194304] 0 2024-04-26T20:18:35.915 INFO:tasks.workunit.client.0.smithi016.stdout:0/133: read - d2/dc/f1c zero size 2024-04-26T20:18:35.920 INFO:tasks.workunit.client.0.smithi016.stdout:8/64: write d9/fb [1342066,66355] 0 2024-04-26T20:18:35.920 INFO:tasks.workunit.client.0.smithi016.stdout:0/134: creat d2/dc/d18/d24/f2b x:0 0 0 2024-04-26T20:18:35.921 INFO:tasks.workunit.client.0.smithi016.stdout:8/65: creat d9/f1b x:0 0 0 2024-04-26T20:18:35.925 INFO:tasks.workunit.client.0.smithi016.stdout:0/135: symlink d2/d8/l2c 0 2024-04-26T20:18:35.925 INFO:tasks.workunit.client.0.smithi016.stdout:0/136: truncate d2/dc/f17 4804008 0 2024-04-26T20:18:35.956 INFO:tasks.workunit.client.0.smithi016.stdout:2/101: dwrite f5 [0,4194304] 0 2024-04-26T20:18:35.959 INFO:tasks.workunit.client.0.smithi016.stdout:2/102: read f14 [869563,20965] 0 2024-04-26T20:18:35.960 INFO:tasks.workunit.client.0.smithi016.stdout:8/66: rmdir d9 39 2024-04-26T20:18:35.962 INFO:tasks.workunit.client.0.smithi016.stdout:2/103: mkdir d1d/d20/d22 0 2024-04-26T20:18:35.962 INFO:tasks.workunit.client.0.smithi016.stdout:2/104: chown d1d/d20 4086 1 2024-04-26T20:18:35.964 INFO:tasks.workunit.client.0.smithi016.stdout:2/105: rmdir d1d/d20 39 2024-04-26T20:18:36.013 INFO:tasks.workunit.client.0.smithi016.stdout:9/122: dwrite d1/d7/f17 [0,4194304] 0 2024-04-26T20:18:36.024 INFO:tasks.workunit.client.0.smithi016.stdout:8/67: mknod d9/c1c 0 2024-04-26T20:18:36.024 INFO:tasks.workunit.client.0.smithi016.stdout:7/100: dwrite d0/d1/fd [0,4194304] 0 2024-04-26T20:18:36.027 INFO:tasks.workunit.client.0.smithi016.stdout:9/123: symlink d1/d2/l2b 0 2024-04-26T20:18:36.039 INFO:tasks.workunit.client.0.smithi016.stdout:5/239: dwrite d1/d9/d11/f34 [0,4194304] 0 2024-04-26T20:18:36.039 INFO:tasks.workunit.client.0.smithi016.stdout:5/240: stat d1/c33 0 2024-04-26T20:18:36.043 INFO:tasks.workunit.client.0.smithi016.stdout:8/68: rename d9/ld to d9/d19/l1d 0 2024-04-26T20:18:36.043 INFO:tasks.workunit.client.0.smithi016.stdout:8/69: write d9/fb [1204150,11470] 0 2024-04-26T20:18:36.044 INFO:tasks.workunit.client.0.smithi016.stdout:7/101: dread d0/f14 [0,4194304] 0 2024-04-26T20:18:36.044 INFO:tasks.workunit.client.0.smithi016.stdout:8/70: creat d9/d19/f1e x:0 0 0 2024-04-26T20:18:36.047 INFO:tasks.workunit.client.0.smithi016.stdout:5/241: rename d1/d9/d1c/d43 to d1/d9/d4b 0 2024-04-26T20:18:36.051 INFO:tasks.workunit.client.0.smithi016.stdout:5/242: getdents d1 0 2024-04-26T20:18:36.053 INFO:tasks.workunit.client.0.smithi016.stdout:4/80: dwrite d0/dd/f12 [0,4194304] 0 2024-04-26T20:18:36.055 INFO:tasks.workunit.client.0.smithi016.stdout:6/100: dwrite d1/d8/fb [0,4194304] 0 2024-04-26T20:18:36.056 INFO:tasks.workunit.client.0.smithi016.stdout:4/81: truncate d0/f15 496027 0 2024-04-26T20:18:36.058 INFO:tasks.workunit.client.0.smithi016.stdout:8/71: rename d9/fc to d9/f1f 0 2024-04-26T20:18:36.058 INFO:tasks.workunit.client.0.smithi016.stdout:8/72: truncate d9/d19/f1e 168973 0 2024-04-26T20:18:36.067 INFO:tasks.workunit.client.0.smithi016.stdout:4/82: unlink d0/c6 0 2024-04-26T20:18:36.068 INFO:tasks.workunit.client.0.smithi016.stdout:8/73: write d9/f14 [1008538,34033] 0 2024-04-26T20:18:36.068 INFO:tasks.workunit.client.0.smithi016.stdout:8/74: chown d9/f16 2 1 2024-04-26T20:18:36.068 INFO:tasks.workunit.client.0.smithi016.stdout:7/102: dread d0/d1/fd [0,4194304] 0 2024-04-26T20:18:36.070 INFO:tasks.workunit.client.0.smithi016.stdout:4/83: mkdir d0/dd/d19 0 2024-04-26T20:18:36.074 INFO:tasks.workunit.client.0.smithi016.stdout:7/103: rmdir d0/d1/d6 39 2024-04-26T20:18:36.074 INFO:tasks.workunit.client.0.smithi016.stdout:7/104: write d0/fc [707359,61584] 0 2024-04-26T20:18:36.077 INFO:tasks.workunit.client.0.smithi016.stdout:8/75: creat d9/f20 x:0 0 0 2024-04-26T20:18:36.078 INFO:tasks.workunit.client.0.smithi016.stdout:4/84: unlink d0/dd/l18 0 2024-04-26T20:18:36.088 INFO:tasks.workunit.client.0.smithi016.stdout:7/105: truncate d0/f14 1907980 0 2024-04-26T20:18:36.094 INFO:tasks.workunit.client.0.smithi016.stdout:8/76: mknod d9/d19/c21 0 2024-04-26T20:18:36.097 INFO:tasks.workunit.client.0.smithi016.stdout:8/77: write d9/f14 [634763,45080] 0 2024-04-26T20:18:36.100 INFO:tasks.workunit.client.0.smithi016.stdout:7/106: mknod d0/d1/c1a 0 2024-04-26T20:18:36.108 INFO:tasks.workunit.client.0.smithi016.stdout:7/107: mkdir d0/d1/d6/d1b 0 2024-04-26T20:18:36.108 INFO:tasks.workunit.client.0.smithi016.stdout:7/108: fdatasync d0/fb 0 2024-04-26T20:18:36.108 INFO:tasks.workunit.client.0.smithi016.stdout:7/109: stat d0/d1 0 2024-04-26T20:18:36.112 INFO:tasks.workunit.client.0.smithi016.stdout:8/78: rename d9/c1c to d9/d19/c22 0 2024-04-26T20:18:36.112 INFO:tasks.workunit.client.0.smithi016.stdout:8/79: fsync d9/f20 0 2024-04-26T20:18:36.112 INFO:tasks.workunit.client.0.smithi016.stdout:1/219: dwrite d3/d5/d6/d9/d2a/f32 [0,4194304] 0 2024-04-26T20:18:36.116 INFO:tasks.workunit.client.0.smithi016.stdout:7/110: creat d0/d1/d6/f1c x:0 0 0 2024-04-26T20:18:36.116 INFO:tasks.workunit.client.0.smithi016.stdout:7/111: write d0/f17 [18535,88959] 0 2024-04-26T20:18:36.118 INFO:tasks.workunit.client.0.smithi016.stdout:8/80: rmdir d9/d19 39 2024-04-26T20:18:36.119 INFO:tasks.workunit.client.0.smithi016.stdout:1/220: rename d3/d5/d6/l20 to d3/d5/d6/d9/l42 0 2024-04-26T20:18:36.121 INFO:tasks.workunit.client.0.smithi016.stdout:7/112: symlink d0/d1/l1d 0 2024-04-26T20:18:36.121 INFO:tasks.workunit.client.0.smithi016.stdout:7/113: truncate d0/d1/ff 707311 0 2024-04-26T20:18:36.126 INFO:tasks.workunit.client.0.smithi016.stdout:7/114: symlink d0/l1e 0 2024-04-26T20:18:36.129 INFO:tasks.workunit.client.0.smithi016.stdout:8/81: mkdir d9/d23 0 2024-04-26T20:18:36.129 INFO:tasks.workunit.client.0.smithi016.stdout:8/82: fdatasync d9/f1f 0 2024-04-26T20:18:36.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/40: dwrite d3/f7 [0,4194304] 0 2024-04-26T20:18:36.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/41: fdatasync d3/f7 0 2024-04-26T20:18:36.143 INFO:tasks.workunit.client.0.smithi016.stdout:7/115: mknod d0/d1/d6/d1b/c1f 0 2024-04-26T20:18:36.150 INFO:tasks.workunit.client.0.smithi016.stdout:7/116: creat d0/d1/f20 x:0 0 0 2024-04-26T20:18:36.158 INFO:tasks.workunit.client.0.smithi016.stdout:1/221: dwrite d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:36.167 INFO:tasks.workunit.client.0.smithi016.stdout:7/117: dread d0/d1/d6/fa [0,4194304] 0 2024-04-26T20:18:36.167 INFO:tasks.workunit.client.0.smithi016.stdout:5/243: dwrite d1/d9/d25/f47 [0,4194304] 0 2024-04-26T20:18:36.167 INFO:tasks.workunit.client.0.smithi016.stdout:7/118: fsync d0/f19 0 2024-04-26T20:18:36.170 INFO:tasks.workunit.client.0.smithi016.stdout:5/244: rename d1/d9/ce to d1/d9/d11/c4c 0 2024-04-26T20:18:36.172 INFO:tasks.workunit.client.0.smithi016.stdout:7/119: link d0/f15 d0/f21 0 2024-04-26T20:18:36.172 INFO:tasks.workunit.client.0.smithi016.stdout:7/120: dread - d0/f19 zero size 2024-04-26T20:18:36.173 INFO:tasks.workunit.client.0.smithi016.stdout:5/245: mkdir d1/d9/d11/d4d 0 2024-04-26T20:18:36.173 INFO:tasks.workunit.client.0.smithi016.stdout:5/246: chown d1/d5/c13 548655638 1 2024-04-26T20:18:36.173 INFO:tasks.workunit.client.0.smithi016.stdout:5/247: dread - d1/f22 zero size 2024-04-26T20:18:36.175 INFO:tasks.workunit.client.0.smithi016.stdout:7/121: mkdir d0/d1/d6/d1b/d22 0 2024-04-26T20:18:36.178 INFO:tasks.workunit.client.0.smithi016.stdout:5/248: mknod d1/d9/d11/d4d/c4e 0 2024-04-26T20:18:36.187 INFO:tasks.workunit.client.0.smithi016.stdout:7/122: unlink d0/d1/ff 0 2024-04-26T20:18:36.187 INFO:tasks.workunit.client.0.smithi016.stdout:7/123: write d0/fc [1015910,20387] 0 2024-04-26T20:18:36.187 INFO:tasks.workunit.client.0.smithi016.stdout:7/124: fdatasync d0/f15 0 2024-04-26T20:18:36.187 INFO:tasks.workunit.client.0.smithi016.stdout:7/125: readlink d0/d1/d6/l16 0 2024-04-26T20:18:36.187 INFO:tasks.workunit.client.0.smithi016.stdout:7/126: chown d0/d1/f20 302211 1 2024-04-26T20:18:36.201 INFO:tasks.workunit.client.0.smithi016.stdout:0/137: dwrite d2/d8/fe [0,4194304] 0 2024-04-26T20:18:36.204 INFO:tasks.workunit.client.0.smithi016.stdout:7/127: symlink d0/d1/l23 0 2024-04-26T20:18:36.204 INFO:tasks.workunit.client.0.smithi016.stdout:7/128: dread - d0/f19 zero size 2024-04-26T20:18:36.205 INFO:tasks.workunit.client.0.smithi016.stdout:8/83: dread d9/d19/f1e [0,4194304] 0 2024-04-26T20:18:36.215 INFO:tasks.workunit.client.0.smithi016.stdout:7/129: fsync d0/f21 0 2024-04-26T20:18:36.216 INFO:tasks.workunit.client.0.smithi016.stdout:5/249: dwrite d1/d5/fd [0,4194304] 0 2024-04-26T20:18:36.216 INFO:tasks.workunit.client.0.smithi016.stdout:5/250: chown d1/f1b 44665397 1 2024-04-26T20:18:36.216 INFO:tasks.workunit.client.0.smithi016.stdout:7/130: write d0/f21 [722533,123477] 0 2024-04-26T20:18:36.218 INFO:tasks.workunit.client.0.smithi016.stdout:1/222: dwrite d3/d5/d6/f3c [4194304,4194304] 0 2024-04-26T20:18:36.219 INFO:tasks.workunit.client.0.smithi016.stdout:4/85: dread d0/f10 [0,4194304] 0 2024-04-26T20:18:36.219 INFO:tasks.workunit.client.0.smithi016.stdout:4/86: getdents d0/dd/d19 0 2024-04-26T20:18:36.220 INFO:tasks.workunit.client.0.smithi016.stdout:4/87: chown d0/dd/d19 788874912 1 2024-04-26T20:18:36.220 INFO:tasks.workunit.client.0.smithi016.stdout:5/251: link d1/d5/f1d d1/d5/f4f 0 2024-04-26T20:18:36.220 INFO:tasks.workunit.client.0.smithi016.stdout:5/252: readlink d1/d9/d11/l30 0 2024-04-26T20:18:36.220 INFO:tasks.workunit.client.0.smithi016.stdout:1/223: getdents d3/d5/d6/d9/d22 0 2024-04-26T20:18:36.221 INFO:tasks.workunit.client.0.smithi016.stdout:1/224: stat d3/d5/d6/f14 0 2024-04-26T20:18:36.224 INFO:tasks.workunit.client.0.smithi016.stdout:5/253: getdents d1/d9/d1c 0 2024-04-26T20:18:36.224 INFO:tasks.workunit.client.0.smithi016.stdout:6/101: dread d1/f4 [0,4194304] 0 2024-04-26T20:18:36.227 INFO:tasks.workunit.client.0.smithi016.stdout:1/225: readlink d3/d5/d6/l15 0 2024-04-26T20:18:36.233 INFO:tasks.workunit.client.0.smithi016.stdout:4/88: dread d0/fb [0,4194304] 0 2024-04-26T20:18:36.233 INFO:tasks.workunit.client.0.smithi016.stdout:4/89: read d0/f10 [3851217,46172] 0 2024-04-26T20:18:36.233 INFO:tasks.workunit.client.0.smithi016.stdout:4/90: readlink d0/l2 0 2024-04-26T20:18:36.234 INFO:tasks.workunit.client.0.smithi016.stdout:9/124: dwrite d1/d7/fb [0,4194304] 0 2024-04-26T20:18:36.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/91: mknod d0/dd/d19/c1a 0 2024-04-26T20:18:36.235 INFO:tasks.workunit.client.0.smithi016.stdout:6/102: creat d1/de/f24 x:0 0 0 2024-04-26T20:18:36.236 INFO:tasks.workunit.client.0.smithi016.stdout:9/125: symlink d1/d2/l2c 0 2024-04-26T20:18:36.237 INFO:tasks.workunit.client.0.smithi016.stdout:4/92: getdents d0 0 2024-04-26T20:18:36.241 INFO:tasks.workunit.client.0.smithi016.stdout:5/254: read d1/d9/d25/f47 [3214811,65076] 0 2024-04-26T20:18:36.241 INFO:tasks.workunit.client.0.smithi016.stdout:5/255: dread - d1/f31 zero size 2024-04-26T20:18:36.241 INFO:tasks.workunit.client.0.smithi016.stdout:5/256: fsync d1/d9/f29 0 2024-04-26T20:18:36.241 INFO:tasks.workunit.client.0.smithi016.stdout:5/257: fdatasync d1/f22 0 2024-04-26T20:18:36.244 INFO:tasks.workunit.client.0.smithi016.stdout:6/103: mkdir d1/de/d25 0 2024-04-26T20:18:36.244 INFO:tasks.workunit.client.0.smithi016.stdout:6/104: dread - d1/de/d1c/f20 zero size 2024-04-26T20:18:36.249 INFO:tasks.workunit.client.0.smithi016.stdout:8/84: dread d9/d19/f1e [0,4194304] 0 2024-04-26T20:18:36.250 INFO:tasks.workunit.client.0.smithi016.stdout:5/258: rename d1/c33 to d1/d9/d4b/c50 0 2024-04-26T20:18:36.251 INFO:tasks.workunit.client.0.smithi016.stdout:5/259: chown d1/d9/d11/c27 32762301 1 2024-04-26T20:18:36.251 INFO:tasks.workunit.client.0.smithi016.stdout:5/260: chown d1/d9/f16 1997 1 2024-04-26T20:18:36.251 INFO:tasks.workunit.client.0.smithi016.stdout:5/261: rename d1/d9/d11 to d1/d9/d11/d51 22 2024-04-26T20:18:36.262 INFO:tasks.workunit.client.0.smithi016.stdout:0/138: write d2/d8/fe [2176053,2306] 0 2024-04-26T20:18:36.262 INFO:tasks.workunit.client.0.smithi016.stdout:0/139: fsync d2/dc/d1e/f1f 0 2024-04-26T20:18:36.265 INFO:tasks.workunit.client.0.smithi016.stdout:5/262: mkdir d1/d9/d1c/d52 0 2024-04-26T20:18:36.268 INFO:tasks.workunit.client.0.smithi016.stdout:6/105: rename d1/de to d1/d21/d26 0 2024-04-26T20:18:36.270 INFO:tasks.workunit.client.0.smithi016.stdout:5/263: symlink d1/d9/l53 0 2024-04-26T20:18:36.276 INFO:tasks.workunit.client.0.smithi016.stdout:6/106: creat d1/f27 x:0 0 0 2024-04-26T20:18:36.280 INFO:tasks.workunit.client.0.smithi016.stdout:1/226: dwrite d3/d5/d6/d9/db/f1a [0,4194304] 0 2024-04-26T20:18:36.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/264: creat d1/d9/d25/f54 x:0 0 0 2024-04-26T20:18:36.282 INFO:tasks.workunit.client.0.smithi016.stdout:1/227: creat d3/d5/f43 x:0 0 0 2024-04-26T20:18:36.284 INFO:tasks.workunit.client.0.smithi016.stdout:1/228: creat d3/d5/d6/d9/db/f44 x:0 0 0 2024-04-26T20:18:36.291 INFO:tasks.workunit.client.0.smithi016.stdout:3/42: dwrite f2 [0,4194304] 0 2024-04-26T20:18:36.311 INFO:tasks.workunit.client.0.smithi016.stdout:5/265: write d1/d5/f4f [2584790,101453] 0 2024-04-26T20:18:36.312 INFO:tasks.workunit.client.0.smithi016.stdout:0/140: dwrite d2/f14 [4194304,4194304] 0 2024-04-26T20:18:36.312 INFO:tasks.workunit.client.0.smithi016.stdout:5/266: symlink d1/d9/d1c/l55 0 2024-04-26T20:18:36.312 INFO:tasks.workunit.client.0.smithi016.stdout:5/267: truncate d1/f31 764559 0 2024-04-26T20:18:36.313 INFO:tasks.workunit.client.0.smithi016.stdout:0/141: symlink d2/d20/l2d 0 2024-04-26T20:18:36.331 INFO:tasks.workunit.client.0.smithi016.stdout:1/229: dwrite d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:36.331 INFO:tasks.workunit.client.0.smithi016.stdout:1/230: rename d3/d5/c40 to d3/d5/d6/d9/d22/c45 0 2024-04-26T20:18:36.331 INFO:tasks.workunit.client.0.smithi016.stdout:1/231: rmdir d3/d5/d6 39 2024-04-26T20:18:36.333 INFO:tasks.workunit.client.0.smithi016.stdout:1/232: creat d3/d5/da/f46 x:0 0 0 2024-04-26T20:18:36.334 INFO:tasks.workunit.client.0.smithi016.stdout:1/233: creat d3/d5/d6/d9/d2a/d3d/f47 x:0 0 0 2024-04-26T20:18:36.334 INFO:tasks.workunit.client.0.smithi016.stdout:1/234: dread - d3/d5/da/f46 zero size 2024-04-26T20:18:36.334 INFO:tasks.workunit.client.0.smithi016.stdout:1/235: dread - d3/d5/d6/d9/d2a/d3d/f47 zero size 2024-04-26T20:18:36.334 INFO:tasks.workunit.client.0.smithi016.stdout:1/236: readlink d3/d5/d6/l15 0 2024-04-26T20:18:36.334 INFO:tasks.workunit.client.0.smithi016.stdout:1/237: truncate d3/d5/da/f30 2187595 0 2024-04-26T20:18:36.407 INFO:tasks.workunit.client.0.smithi016.stdout:7/131: dwrite d0/d1/d6/f1c [0,4194304] 0 2024-04-26T20:18:36.407 INFO:tasks.workunit.client.0.smithi016.stdout:7/132: fsync d0/d1/f20 0 2024-04-26T20:18:36.416 INFO:tasks.workunit.client.0.smithi016.stdout:7/133: fsync d0/fc 0 2024-04-26T20:18:36.416 INFO:tasks.workunit.client.0.smithi016.stdout:7/134: readlink d0/d1/l1d 0 2024-04-26T20:18:36.421 INFO:tasks.workunit.client.0.smithi016.stdout:5/268: dwrite d1/d9/d25/f47 [0,4194304] 0 2024-04-26T20:18:36.421 INFO:tasks.workunit.client.0.smithi016.stdout:5/269: write d1/d9/f16 [2564280,113111] 0 2024-04-26T20:18:36.422 INFO:tasks.workunit.client.0.smithi016.stdout:5/270: readlink d1/d9/d1c/l4a 0 2024-04-26T20:18:36.445 INFO:tasks.workunit.client.0.smithi016.stdout:5/271: dread d1/f1f [0,4194304] 0 2024-04-26T20:18:36.463 INFO:tasks.workunit.client.0.smithi016.stdout:5/272: read d1/f1f [1007534,54007] 0 2024-04-26T20:18:36.471 INFO:tasks.workunit.client.0.smithi016.stdout:4/93: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:36.471 INFO:tasks.workunit.client.0.smithi016.stdout:3/43: dread f2 [0,4194304] 0 2024-04-26T20:18:36.478 INFO:tasks.workunit.client.0.smithi016.stdout:8/85: write f5 [2391428,32147] 0 2024-04-26T20:18:36.478 INFO:tasks.workunit.client.0.smithi016.stdout:8/86: truncate f8 130130 0 2024-04-26T20:18:36.479 INFO:tasks.workunit.client.0.smithi016.stdout:8/87: mknod d9/c24 0 2024-04-26T20:18:36.480 INFO:tasks.workunit.client.0.smithi016.stdout:8/88: truncate d9/f13 995789 0 2024-04-26T20:18:36.482 INFO:tasks.workunit.client.0.smithi016.stdout:9/126: dwrite d1/d2/f5 [0,4194304] 0 2024-04-26T20:18:36.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/107: dread d1/f4 [0,4194304] 0 2024-04-26T20:18:36.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/108: truncate d1/d8/f19 8653841 0 2024-04-26T20:18:36.482 INFO:tasks.workunit.client.0.smithi016.stdout:8/89: unlink d9/ce 0 2024-04-26T20:18:36.488 INFO:tasks.workunit.client.0.smithi016.stdout:0/142: dwrite d2/f15 [0,4194304] 0 2024-04-26T20:18:36.488 INFO:tasks.workunit.client.0.smithi016.stdout:0/143: chown d2/d20 0 1 2024-04-26T20:18:36.497 INFO:tasks.workunit.client.0.smithi016.stdout:6/109: symlink d1/d21/l28 0 2024-04-26T20:18:36.497 INFO:tasks.workunit.client.0.smithi016.stdout:6/110: chown d1/l1a 56 1 2024-04-26T20:18:36.497 INFO:tasks.workunit.client.0.smithi016.stdout:6/111: chown d1/f27 36 1 2024-04-26T20:18:36.497 INFO:tasks.workunit.client.0.smithi016.stdout:8/90: creat d9/f25 x:0 0 0 2024-04-26T20:18:36.497 INFO:tasks.workunit.client.0.smithi016.stdout:0/144: unlink d2/dc/l13 0 2024-04-26T20:18:36.498 INFO:tasks.workunit.client.0.smithi016.stdout:6/112: symlink d1/d12/l29 0 2024-04-26T20:18:36.499 INFO:tasks.workunit.client.0.smithi016.stdout:6/113: fdatasync d1/f1f 0 2024-04-26T20:18:36.499 INFO:tasks.workunit.client.0.smithi016.stdout:8/91: write d9/f13 [472116,74231] 0 2024-04-26T20:18:36.502 INFO:tasks.workunit.client.0.smithi016.stdout:6/114: creat d1/d21/f2a x:0 0 0 2024-04-26T20:18:36.502 INFO:tasks.workunit.client.0.smithi016.stdout:8/92: mkdir d9/d23/d26 0 2024-04-26T20:18:36.502 INFO:tasks.workunit.client.0.smithi016.stdout:8/93: write d9/f13 [1540363,54700] 0 2024-04-26T20:18:36.502 INFO:tasks.workunit.client.0.smithi016.stdout:8/94: chown d9/f11 47897 1 2024-04-26T20:18:36.502 INFO:tasks.workunit.client.0.smithi016.stdout:8/95: dread - d9/f25 zero size 2024-04-26T20:18:36.512 INFO:tasks.workunit.client.0.smithi016.stdout:2/106: sync 2024-04-26T20:18:36.512 INFO:tasks.workunit.client.0.smithi016.stdout:6/115: creat d1/d21/d26/f2b x:0 0 0 2024-04-26T20:18:36.512 INFO:tasks.workunit.client.0.smithi016.stdout:8/96: readlink d9/lf 0 2024-04-26T20:18:36.512 INFO:tasks.workunit.client.0.smithi016.stdout:8/97: mkdir d9/d23/d27 0 2024-04-26T20:18:36.516 INFO:tasks.workunit.client.0.smithi016.stdout:0/145: dread d2/f14 [4194304,4194304] 0 2024-04-26T20:18:36.516 INFO:tasks.workunit.client.0.smithi016.stdout:0/146: readlink d2/l19 0 2024-04-26T20:18:36.516 INFO:tasks.workunit.client.0.smithi016.stdout:6/116: unlink d1/d8/f19 0 2024-04-26T20:18:36.516 INFO:tasks.workunit.client.0.smithi016.stdout:0/147: truncate d2/dc/f1c 601417 0 2024-04-26T20:18:36.523 INFO:tasks.workunit.client.0.smithi016.stdout:8/98: symlink d9/d23/l28 0 2024-04-26T20:18:36.524 INFO:tasks.workunit.client.0.smithi016.stdout:1/238: dwrite d3/d5/d6/f3c [8388608,4194304] 0 2024-04-26T20:18:36.524 INFO:tasks.workunit.client.0.smithi016.stdout:1/239: rename d3/d5 to d3/d5/d6/d9/d22/d48 22 2024-04-26T20:18:36.525 INFO:tasks.workunit.client.0.smithi016.stdout:0/148: symlink d2/dc/d1e/l2e 0 2024-04-26T20:18:36.526 INFO:tasks.workunit.client.0.smithi016.stdout:8/99: mknod d9/d23/d27/c29 0 2024-04-26T20:18:36.527 INFO:tasks.workunit.client.0.smithi016.stdout:1/240: mkdir d3/d5/d6/d9/d49 0 2024-04-26T20:18:36.528 INFO:tasks.workunit.client.0.smithi016.stdout:0/149: creat d2/d20/f2f x:0 0 0 2024-04-26T20:18:36.528 INFO:tasks.workunit.client.0.smithi016.stdout:0/150: dread - d2/dc/d18/d24/f2b zero size 2024-04-26T20:18:36.528 INFO:tasks.workunit.client.0.smithi016.stdout:0/151: chown d2/d8/fe 504639 1 2024-04-26T20:18:36.529 INFO:tasks.workunit.client.0.smithi016.stdout:3/44: dread d3/f7 [0,4194304] 0 2024-04-26T20:18:36.529 INFO:tasks.workunit.client.0.smithi016.stdout:8/100: rmdir d9/d19 39 2024-04-26T20:18:36.529 INFO:tasks.workunit.client.0.smithi016.stdout:8/101: chown d9/lf 7 1 2024-04-26T20:18:36.534 INFO:tasks.workunit.client.0.smithi016.stdout:1/241: creat d3/d5/d6/d9/d22/f4a x:0 0 0 2024-04-26T20:18:36.534 INFO:tasks.workunit.client.0.smithi016.stdout:3/45: unlink d3/f8 0 2024-04-26T20:18:36.534 INFO:tasks.workunit.client.0.smithi016.stdout:8/102: link d9/f16 d9/d23/d26/f2a 0 2024-04-26T20:18:36.534 INFO:tasks.workunit.client.0.smithi016.stdout:8/103: write d9/f25 [872421,107166] 0 2024-04-26T20:18:36.534 INFO:tasks.workunit.client.0.smithi016.stdout:8/104: stat d9/f1f 0 2024-04-26T20:18:36.565 INFO:tasks.workunit.client.0.smithi016.stdout:8/105: getdents d9/d23/d27 0 2024-04-26T20:18:36.565 INFO:tasks.workunit.client.0.smithi016.stdout:8/106: chown d9/d23/l28 74945 1 2024-04-26T20:18:36.565 INFO:tasks.workunit.client.0.smithi016.stdout:8/107: stat d9/d19/f1e 0 2024-04-26T20:18:36.565 INFO:tasks.workunit.client.0.smithi016.stdout:8/108: fdatasync d9/f1f 0 2024-04-26T20:18:36.565 INFO:tasks.workunit.client.0.smithi016.stdout:8/109: truncate d9/f16 772539 0 2024-04-26T20:18:36.565 INFO:tasks.workunit.client.0.smithi016.stdout:8/110: fsync d9/f18 0 2024-04-26T20:18:36.567 INFO:tasks.workunit.client.0.smithi016.stdout:2/107: dwrite f4 [0,4194304] 0 2024-04-26T20:18:36.570 INFO:tasks.workunit.client.0.smithi016.stdout:4/94: dwrite d0/dd/f12 [4194304,4194304] 0 2024-04-26T20:18:36.574 INFO:tasks.workunit.client.0.smithi016.stdout:4/95: mkdir d0/dd/d1b 0 2024-04-26T20:18:36.576 INFO:tasks.workunit.client.0.smithi016.stdout:0/152: dwrite d2/fb [0,4194304] 0 2024-04-26T20:18:36.578 INFO:tasks.workunit.client.0.smithi016.stdout:0/153: mknod d2/c30 0 2024-04-26T20:18:36.579 INFO:tasks.workunit.client.0.smithi016.stdout:0/154: symlink d2/dc/d18/l31 0 2024-04-26T20:18:36.584 INFO:tasks.workunit.client.0.smithi016.stdout:4/96: dread d0/fb [0,4194304] 0 2024-04-26T20:18:36.585 INFO:tasks.workunit.client.0.smithi016.stdout:4/97: mknod d0/dd/c1c 0 2024-04-26T20:18:36.586 INFO:tasks.workunit.client.0.smithi016.stdout:4/98: symlink d0/dd/d19/l1d 0 2024-04-26T20:18:36.587 INFO:tasks.workunit.client.0.smithi016.stdout:4/99: mkdir d0/d1e 0 2024-04-26T20:18:36.588 INFO:tasks.workunit.client.0.smithi016.stdout:4/100: mkdir d0/dd/d19/d1f 0 2024-04-26T20:18:36.594 INFO:tasks.workunit.client.0.smithi016.stdout:9/127: dwrite d1/d2/f6 [0,4194304] 0 2024-04-26T20:18:36.594 INFO:tasks.workunit.client.0.smithi016.stdout:6/117: write d1/d8/fb [1492806,40231] 0 2024-04-26T20:18:36.596 INFO:tasks.workunit.client.0.smithi016.stdout:6/118: getdents d1/d12 0 2024-04-26T20:18:36.596 INFO:tasks.workunit.client.0.smithi016.stdout:6/119: write d1/d21/d26/f24 [501844,26212] 0 2024-04-26T20:18:36.615 INFO:tasks.workunit.client.0.smithi016.stdout:9/128: dread d1/f15 [0,4194304] 0 2024-04-26T20:18:36.615 INFO:tasks.workunit.client.0.smithi016.stdout:9/129: readlink d1/d1b/l1c 0 2024-04-26T20:18:36.625 INFO:tasks.workunit.client.0.smithi016.stdout:9/130: dread d1/d2/f10 [0,4194304] 0 2024-04-26T20:18:36.627 INFO:tasks.workunit.client.0.smithi016.stdout:9/131: read d1/f14 [613850,16493] 0 2024-04-26T20:18:36.628 INFO:tasks.workunit.client.0.smithi016.stdout:9/132: link d1/d7/l11 d1/d29/l2d 0 2024-04-26T20:18:36.628 INFO:tasks.workunit.client.0.smithi016.stdout:9/133: truncate d1/d2/d20/f1f 1521765 0 2024-04-26T20:18:36.630 INFO:tasks.workunit.client.0.smithi016.stdout:9/134: truncate d1/f14 631065 0 2024-04-26T20:18:36.630 INFO:tasks.workunit.client.0.smithi016.stdout:9/135: write d1/f15 [5179704,128691] 0 2024-04-26T20:18:36.639 INFO:tasks.workunit.client.0.smithi016.stdout:9/136: rename d1/d7 to d1/d2e 0 2024-04-26T20:18:36.642 INFO:tasks.workunit.client.0.smithi016.stdout:3/46: write f2 [4001544,84817] 0 2024-04-26T20:18:36.643 INFO:tasks.workunit.client.0.smithi016.stdout:3/47: creat d3/d9/fb x:0 0 0 2024-04-26T20:18:36.644 INFO:tasks.workunit.client.0.smithi016.stdout:3/48: stat d3/f4 0 2024-04-26T20:18:36.645 INFO:tasks.workunit.client.0.smithi016.stdout:3/49: symlink d3/d9/lc 0 2024-04-26T20:18:36.646 INFO:tasks.workunit.client.0.smithi016.stdout:3/50: creat d3/fd x:0 0 0 2024-04-26T20:18:36.646 INFO:tasks.workunit.client.0.smithi016.stdout:3/51: truncate d3/f4 162895 0 2024-04-26T20:18:36.648 INFO:tasks.workunit.client.0.smithi016.stdout:3/52: truncate f0 6111369 0 2024-04-26T20:18:36.649 INFO:tasks.workunit.client.0.smithi016.stdout:3/53: mknod d3/d9/ce 0 2024-04-26T20:18:36.650 INFO:tasks.workunit.client.0.smithi016.stdout:3/54: truncate d3/f4 918774 0 2024-04-26T20:18:36.651 INFO:tasks.workunit.client.0.smithi016.stdout:3/55: mkdir d3/df 0 2024-04-26T20:18:36.651 INFO:tasks.workunit.client.0.smithi016.stdout:3/56: dread - d3/d9/fb zero size 2024-04-26T20:18:36.655 INFO:tasks.workunit.client.0.smithi016.stdout:0/155: dread d2/d20/f27 [0,4194304] 0 2024-04-26T20:18:36.657 INFO:tasks.workunit.client.0.smithi016.stdout:0/156: rename d2/d8/l2c to d2/dc/d18/l32 0 2024-04-26T20:18:36.664 INFO:tasks.workunit.client.0.smithi016.stdout:2/108: read f11 [253791,125567] 0 2024-04-26T20:18:36.664 INFO:tasks.workunit.client.0.smithi016.stdout:2/109: truncate f10 2165175 0 2024-04-26T20:18:36.670 INFO:tasks.workunit.client.0.smithi016.stdout:3/57: truncate f0 4016507 0 2024-04-26T20:18:36.671 INFO:tasks.workunit.client.0.smithi016.stdout:4/101: write d0/dd/f12 [6751937,75805] 0 2024-04-26T20:18:36.671 INFO:tasks.workunit.client.0.smithi016.stdout:4/102: chown d0/f1 3809 1 2024-04-26T20:18:36.672 INFO:tasks.workunit.client.0.smithi016.stdout:4/103: chown d0/fa 5479 1 2024-04-26T20:18:36.672 INFO:tasks.workunit.client.0.smithi016.stdout:1/242: dwrite d3/d5/d6/f3c [8388608,4194304] 0 2024-04-26T20:18:36.672 INFO:tasks.workunit.client.0.smithi016.stdout:1/243: readlink d3/d5/d6/l39 0 2024-04-26T20:18:36.673 INFO:tasks.workunit.client.0.smithi016.stdout:9/137: write d1/f15 [3226403,57524] 0 2024-04-26T20:18:36.675 INFO:tasks.workunit.client.0.smithi016.stdout:3/58: symlink d3/d9/l10 0 2024-04-26T20:18:36.679 INFO:tasks.workunit.client.0.smithi016.stdout:9/138: symlink d1/d2e/l2f 0 2024-04-26T20:18:36.680 INFO:tasks.workunit.client.0.smithi016.stdout:1/244: mkdir d3/d5/d6/d4b 0 2024-04-26T20:18:36.691 INFO:tasks.workunit.client.0.smithi016.stdout:4/104: write d0/f1 [3067778,113379] 0 2024-04-26T20:18:36.691 INFO:tasks.workunit.client.0.smithi016.stdout:1/245: rename d3/d5/d6/d9/d2a/d3b/f41 to d3/d5/d6/d9/d49/f4c 0 2024-04-26T20:18:36.694 INFO:tasks.workunit.client.0.smithi016.stdout:8/111: dread f5 [0,4194304] 0 2024-04-26T20:18:36.695 INFO:tasks.workunit.client.0.smithi016.stdout:4/105: mknod d0/d1e/c20 0 2024-04-26T20:18:36.698 INFO:tasks.workunit.client.0.smithi016.stdout:1/246: unlink d3/d5/d6/d9/db/l34 0 2024-04-26T20:18:36.700 INFO:tasks.workunit.client.0.smithi016.stdout:8/112: truncate d9/f1f 129599 0 2024-04-26T20:18:36.708 INFO:tasks.workunit.client.0.smithi016.stdout:8/113: write d9/f25 [271523,2671] 0 2024-04-26T20:18:36.709 INFO:tasks.workunit.client.0.smithi016.stdout:0/157: dwrite d2/dc/d18/f1a [0,4194304] 0 2024-04-26T20:18:36.714 INFO:tasks.workunit.client.0.smithi016.stdout:3/59: dwrite d3/d9/fb [0,4194304] 0 2024-04-26T20:18:36.714 INFO:tasks.workunit.client.0.smithi016.stdout:3/60: readlink l1 0 2024-04-26T20:18:36.960 INFO:tasks.workunit.client.0.smithi016.stdout:8/114: creat d9/d23/d26/f2b x:0 0 0 2024-04-26T20:18:36.960 INFO:tasks.workunit.client.0.smithi016.stdout:8/115: read - d9/d23/d26/f2b zero size 2024-04-26T20:18:36.962 INFO:tasks.workunit.client.0.smithi016.stdout:1/247: getdents d3/d5/d6/d9/d2a/d3b 0 2024-04-26T20:18:36.962 INFO:tasks.workunit.client.0.smithi016.stdout:8/116: write d9/d23/d26/f2a [35509,46935] 0 2024-04-26T20:18:36.962 INFO:tasks.workunit.client.0.smithi016.stdout:8/117: chown d9/c24 96692443 1 2024-04-26T20:18:36.962 INFO:tasks.workunit.client.0.smithi016.stdout:8/118: write d9/f13 [2637877,16829] 0 2024-04-26T20:18:36.966 INFO:tasks.workunit.client.0.smithi016.stdout:3/61: mknod d3/d9/c11 0 2024-04-26T20:18:36.973 INFO:tasks.workunit.client.0.smithi016.stdout:8/119: truncate d9/f13 990258 0 2024-04-26T20:18:36.974 INFO:tasks.workunit.client.0.smithi016.stdout:1/248: dread d3/d5/d6/d9/db/f35 [0,4194304] 0 2024-04-26T20:18:36.975 INFO:tasks.workunit.client.0.smithi016.stdout:1/249: truncate d3/d5/da/fc 1948122 0 2024-04-26T20:18:36.975 INFO:tasks.workunit.client.0.smithi016.stdout:1/250: write d3/d5/d6/d9/d22/f3f [58009,8513] 0 2024-04-26T20:18:36.977 INFO:tasks.workunit.client.0.smithi016.stdout:1/251: rename d3/d5/d6/d9/d22/c23 to d3/d5/d6/d9/d22/c4d 0 2024-04-26T20:18:36.992 INFO:tasks.workunit.client.0.smithi016.stdout:8/120: dread d9/fb [0,4194304] 0 2024-04-26T20:18:36.992 INFO:tasks.workunit.client.0.smithi016.stdout:3/62: dread f2 [0,4194304] 0 2024-04-26T20:18:36.992 INFO:tasks.workunit.client.0.smithi016.stdout:8/121: fsync f8 0 2024-04-26T20:18:36.992 INFO:tasks.workunit.client.0.smithi016.stdout:8/122: readlink d9/lf 0 2024-04-26T20:18:36.992 INFO:tasks.workunit.client.0.smithi016.stdout:8/123: dread - d9/f18 zero size 2024-04-26T20:18:36.994 INFO:tasks.workunit.client.0.smithi016.stdout:1/252: dread d3/d5/d6/d9/d2a/f32 [0,4194304] 0 2024-04-26T20:18:37.012 INFO:tasks.workunit.client.0.smithi016.stdout:3/63: write d3/d9/fb [3120946,90198] 0 2024-04-26T20:18:37.047 INFO:tasks.workunit.client.0.smithi016.stdout:1/253: dwrite d3/d5/f43 [0,4194304] 0 2024-04-26T20:18:37.047 INFO:tasks.workunit.client.0.smithi016.stdout:1/254: dread - d3/d5/f33 zero size 2024-04-26T20:18:37.049 INFO:tasks.workunit.client.0.smithi016.stdout:1/255: getdents d3/d5 0 2024-04-26T20:18:37.058 INFO:tasks.workunit.client.0.smithi016.stdout:3/64: write d3/f7 [2431470,47121] 0 2024-04-26T20:18:37.059 INFO:tasks.workunit.client.0.smithi016.stdout:8/124: dwrite d9/f18 [0,4194304] 0 2024-04-26T20:18:37.063 INFO:tasks.workunit.client.0.smithi016.stdout:8/125: mkdir d9/d23/d26/d2c 0 2024-04-26T20:18:37.092 INFO:tasks.workunit.client.0.smithi016.stdout:1/256: dread d3/d5/da/f29 [0,4194304] 0 2024-04-26T20:18:37.093 INFO:tasks.workunit.client.0.smithi016.stdout:1/257: link d3/d5/d6/d9/d2a/f32 d3/d5/d6/d9/f4e 0 2024-04-26T20:18:37.107 INFO:tasks.workunit.client.0.smithi016.stdout:7/135: sync 2024-04-26T20:18:37.107 INFO:tasks.workunit.client.0.smithi016.stdout:7/136: write d0/f19 [636838,108991] 0 2024-04-26T20:18:37.108 INFO:tasks.workunit.client.0.smithi016.stdout:7/137: stat d0/d1 0 2024-04-26T20:18:37.108 INFO:tasks.workunit.client.0.smithi016.stdout:7/138: readlink d0/l13 0 2024-04-26T20:18:37.108 INFO:tasks.workunit.client.0.smithi016.stdout:1/258: fsync d3/d5/d6/d9/f4e 0 2024-04-26T20:18:37.108 INFO:tasks.workunit.client.0.smithi016.stdout:1/259: write d3/d5/da/fc [2640665,52314] 0 2024-04-26T20:18:37.109 INFO:tasks.workunit.client.0.smithi016.stdout:3/65: dwrite f2 [0,4194304] 0 2024-04-26T20:18:37.109 INFO:tasks.workunit.client.0.smithi016.stdout:3/66: chown d3/d9/fb 126561 1 2024-04-26T20:18:37.109 INFO:tasks.workunit.client.0.smithi016.stdout:3/67: write d3/fd [206079,5545] 0 2024-04-26T20:18:37.109 INFO:tasks.workunit.client.0.smithi016.stdout:3/68: readlink l1 0 2024-04-26T20:18:37.109 INFO:tasks.workunit.client.0.smithi016.stdout:1/260: creat d3/d5/f4f x:0 0 0 2024-04-26T20:18:37.111 INFO:tasks.workunit.client.0.smithi016.stdout:3/69: creat d3/d9/f12 x:0 0 0 2024-04-26T20:18:37.111 INFO:tasks.workunit.client.0.smithi016.stdout:3/70: write d3/f7 [3559176,14261] 0 2024-04-26T20:18:37.111 INFO:tasks.workunit.client.0.smithi016.stdout:3/71: chown d3/fd 1 1 2024-04-26T20:18:37.115 INFO:tasks.workunit.client.0.smithi016.stdout:1/261: mkdir d3/d5/d6/d50 0 2024-04-26T20:18:37.130 INFO:tasks.workunit.client.0.smithi016.stdout:3/72: dread f0 [0,4194304] 0 2024-04-26T20:18:37.152 INFO:tasks.workunit.client.0.smithi016.stdout:3/73: read d3/f4 [897766,57864] 0 2024-04-26T20:18:37.172 INFO:tasks.workunit.client.0.smithi016.stdout:1/262: dwrite d3/d5/d6/d9/d2a/d3d/f47 [0,4194304] 0 2024-04-26T20:18:37.178 INFO:tasks.workunit.client.0.smithi016.stdout:7/139: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:37.181 INFO:tasks.workunit.client.0.smithi016.stdout:7/140: mkdir d0/d24 0 2024-04-26T20:18:37.182 INFO:tasks.workunit.client.0.smithi016.stdout:1/263: dread d3/d5/da/f21 [0,4194304] 0 2024-04-26T20:18:37.184 INFO:tasks.workunit.client.0.smithi016.stdout:1/264: symlink d3/d5/d6/d9/db/l51 0 2024-04-26T20:18:37.184 INFO:tasks.workunit.client.0.smithi016.stdout:1/265: write d3/d5/f33 [460775,78487] 0 2024-04-26T20:18:37.185 INFO:tasks.workunit.client.0.smithi016.stdout:1/266: truncate d3/d5/da/f30 1702601 0 2024-04-26T20:18:37.187 INFO:tasks.workunit.client.0.smithi016.stdout:5/273: sync 2024-04-26T20:18:37.187 INFO:tasks.workunit.client.0.smithi016.stdout:6/120: sync 2024-04-26T20:18:37.187 INFO:tasks.workunit.client.0.smithi016.stdout:5/274: mknod d1/c56 0 2024-04-26T20:18:37.188 INFO:tasks.workunit.client.0.smithi016.stdout:5/275: write d1/d9/d11/f18 [4721808,18903] 0 2024-04-26T20:18:37.189 INFO:tasks.workunit.client.0.smithi016.stdout:6/121: rename d1/d21/d26/d1c/d23 to d1/d8/d2c 0 2024-04-26T20:18:37.189 INFO:tasks.workunit.client.0.smithi016.stdout:6/122: chown d1/d21/d26/d25 269243375 1 2024-04-26T20:18:37.190 INFO:tasks.workunit.client.0.smithi016.stdout:5/276: symlink d1/d9/d25/l57 0 2024-04-26T20:18:37.191 INFO:tasks.workunit.client.0.smithi016.stdout:5/277: fsync d1/d5/f12 0 2024-04-26T20:18:37.191 INFO:tasks.workunit.client.0.smithi016.stdout:5/278: truncate d1/d9/d4b/f39 211875 0 2024-04-26T20:18:37.192 INFO:tasks.workunit.client.0.smithi016.stdout:6/123: mknod d1/d8/c2d 0 2024-04-26T20:18:37.193 INFO:tasks.workunit.client.0.smithi016.stdout:5/279: truncate d1/d9/d4b/f44 698843 0 2024-04-26T20:18:37.194 INFO:tasks.workunit.client.0.smithi016.stdout:5/280: write d1/d9/d25/f54 [553773,120826] 0 2024-04-26T20:18:37.194 INFO:tasks.workunit.client.0.smithi016.stdout:6/124: unlink d1/d21/d26/f2b 0 2024-04-26T20:18:37.195 INFO:tasks.workunit.client.0.smithi016.stdout:5/281: rename d1/d5/f12 to d1/d9/d11/f58 0 2024-04-26T20:18:37.197 INFO:tasks.workunit.client.0.smithi016.stdout:6/125: unlink d1/d21/f2a 0 2024-04-26T20:18:37.198 INFO:tasks.workunit.client.0.smithi016.stdout:5/282: link d1/d9/d25/f42 d1/d9/d4b/f59 0 2024-04-26T20:18:37.198 INFO:tasks.workunit.client.0.smithi016.stdout:5/283: chown d1/d9/f16 7875 1 2024-04-26T20:18:37.199 INFO:tasks.workunit.client.0.smithi016.stdout:5/284: creat d1/f5a x:0 0 0 2024-04-26T20:18:37.201 INFO:tasks.workunit.client.0.smithi016.stdout:5/285: symlink d1/d9/d1c/l5b 0 2024-04-26T20:18:37.203 INFO:tasks.workunit.client.0.smithi016.stdout:1/267: dread d3/d5/f18 [0,4194304] 0 2024-04-26T20:18:37.203 INFO:tasks.workunit.client.0.smithi016.stdout:5/286: rename d1/d5/c26 to d1/d9/d4b/c5c 0 2024-04-26T20:18:37.203 INFO:tasks.workunit.client.0.smithi016.stdout:1/268: write d3/d5/d6/d9/d49/f4c [389316,886] 0 2024-04-26T20:18:37.204 INFO:tasks.workunit.client.0.smithi016.stdout:1/269: mkdir d3/d5/d6/d9/d2a/d3b/d52 0 2024-04-26T20:18:37.221 INFO:tasks.workunit.client.0.smithi016.stdout:5/287: dread d1/d9/d11/f58 [0,4194304] 0 2024-04-26T20:18:37.222 INFO:tasks.workunit.client.0.smithi016.stdout:7/141: dwrite d0/d1/d6/fa [0,4194304] 0 2024-04-26T20:18:37.223 INFO:tasks.workunit.client.0.smithi016.stdout:5/288: dread d1/f31 [0,4194304] 0 2024-04-26T20:18:37.223 INFO:tasks.workunit.client.0.smithi016.stdout:5/289: chown d1/c1a 208 1 2024-04-26T20:18:37.224 INFO:tasks.workunit.client.0.smithi016.stdout:7/142: mkdir d0/d1/d6/d1b/d25 0 2024-04-26T20:18:37.225 INFO:tasks.workunit.client.0.smithi016.stdout:7/143: truncate d0/f21 5240555 0 2024-04-26T20:18:37.225 INFO:tasks.workunit.client.0.smithi016.stdout:7/144: chown d0/d1/l1d 386 1 2024-04-26T20:18:37.225 INFO:tasks.workunit.client.0.smithi016.stdout:7/145: fsync d0/f21 0 2024-04-26T20:18:37.225 INFO:tasks.workunit.client.0.smithi016.stdout:5/290: mknod d1/d9/d25/c5d 0 2024-04-26T20:18:37.227 INFO:tasks.workunit.client.0.smithi016.stdout:7/146: creat d0/d1/d6/d1b/d25/f26 x:0 0 0 2024-04-26T20:18:37.228 INFO:tasks.workunit.client.0.smithi016.stdout:7/147: chown d0/f15 27023283 1 2024-04-26T20:18:37.229 INFO:tasks.workunit.client.0.smithi016.stdout:5/291: truncate d1/d9/d11/f58 2830455 0 2024-04-26T20:18:37.231 INFO:tasks.workunit.client.0.smithi016.stdout:7/148: unlink d0/f19 0 2024-04-26T20:18:37.251 INFO:tasks.workunit.client.0.smithi016.stdout:1/270: dread d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:37.252 INFO:tasks.workunit.client.0.smithi016.stdout:6/126: dwrite d1/f6 [0,4194304] 0 2024-04-26T20:18:37.253 INFO:tasks.workunit.client.0.smithi016.stdout:1/271: rename d3/d5/d6/d9/d22 to d3/d5/d6/d9/d2a/d3d/d53 0 2024-04-26T20:18:37.278 INFO:tasks.workunit.client.0.smithi016.stdout:7/149: dwrite d0/f21 [0,4194304] 0 2024-04-26T20:18:37.280 INFO:tasks.workunit.client.0.smithi016.stdout:7/150: link d0/f15 d0/f27 0 2024-04-26T20:18:37.281 INFO:tasks.workunit.client.0.smithi016.stdout:7/151: rmdir d0/d1/d6 39 2024-04-26T20:18:37.281 INFO:tasks.workunit.client.0.smithi016.stdout:7/152: write d0/f17 [66858,94393] 0 2024-04-26T20:18:37.298 INFO:tasks.workunit.client.0.smithi016.stdout:7/153: dread d0/d1/d6/f1c [0,4194304] 0 2024-04-26T20:18:37.302 INFO:tasks.workunit.client.0.smithi016.stdout:6/127: dwrite d1/d8/fc [4194304,4194304] 0 2024-04-26T20:18:37.305 INFO:tasks.workunit.client.0.smithi016.stdout:6/128: getdents d1/d21/d26/d1c 0 2024-04-26T20:18:37.313 INFO:tasks.workunit.client.0.smithi016.stdout:7/154: write d0/d1/d6/f1c [2327079,33670] 0 2024-04-26T20:18:37.315 INFO:tasks.workunit.client.0.smithi016.stdout:7/155: rmdir d0/d1/d6/d1b/d22 0 2024-04-26T20:18:37.315 INFO:tasks.workunit.client.0.smithi016.stdout:7/156: fsync d0/f15 0 2024-04-26T20:18:37.318 INFO:tasks.workunit.client.0.smithi016.stdout:7/157: getdents d0/d1/d6/d1b 0 2024-04-26T20:18:37.318 INFO:tasks.workunit.client.0.smithi016.stdout:7/158: truncate d0/d1/d6/d1b/d25/f26 983177 0 2024-04-26T20:18:37.319 INFO:tasks.workunit.client.0.smithi016.stdout:7/159: creat d0/f28 x:0 0 0 2024-04-26T20:18:37.320 INFO:tasks.workunit.client.0.smithi016.stdout:7/160: creat d0/f29 x:0 0 0 2024-04-26T20:18:37.332 INFO:tasks.workunit.client.0.smithi016.stdout:7/161: dread d0/d1/d6/fa [0,4194304] 0 2024-04-26T20:18:37.332 INFO:tasks.workunit.client.0.smithi016.stdout:7/162: chown d0/d1/d6/f1c 8313449 1 2024-04-26T20:18:37.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/163: symlink d0/d1/d6/d1b/d25/l2a 0 2024-04-26T20:18:37.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/164: rename d0/d1/d6 to d0/d1/d6/d1b/d25/d2b 22 2024-04-26T20:18:37.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/165: fsync d0/f17 0 2024-04-26T20:18:37.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/166: chown d0/f21 30936 1 2024-04-26T20:18:37.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/167: creat d0/d1/d6/d1b/f2c x:0 0 0 2024-04-26T20:18:37.333 INFO:tasks.workunit.client.0.smithi016.stdout:7/168: fsync d0/f27 0 2024-04-26T20:18:37.353 INFO:tasks.workunit.client.0.smithi016.stdout:4/106: sync 2024-04-26T20:18:37.353 INFO:tasks.workunit.client.0.smithi016.stdout:9/139: sync 2024-04-26T20:18:37.354 INFO:tasks.workunit.client.0.smithi016.stdout:2/110: sync 2024-04-26T20:18:37.354 INFO:tasks.workunit.client.0.smithi016.stdout:2/111: write f1b [1017788,10986] 0 2024-04-26T20:18:37.586 INFO:tasks.workunit.client.0.smithi016.stdout:7/169: creat d0/d1/d6/d1b/d25/f2d x:0 0 0 2024-04-26T20:18:37.587 INFO:tasks.workunit.client.0.smithi016.stdout:4/107: creat d0/d1e/f21 x:0 0 0 2024-04-26T20:18:37.587 INFO:tasks.workunit.client.0.smithi016.stdout:4/108: truncate d0/d1e/f21 531589 0 2024-04-26T20:18:37.587 INFO:tasks.workunit.client.0.smithi016.stdout:4/109: chown d0/c3 12470476 1 2024-04-26T20:18:37.587 INFO:tasks.workunit.client.0.smithi016.stdout:9/140: creat d1/d25/f30 x:0 0 0 2024-04-26T20:18:37.587 INFO:tasks.workunit.client.0.smithi016.stdout:9/141: write d1/d1b/f26 [8834,33868] 0 2024-04-26T20:18:37.588 INFO:tasks.workunit.client.0.smithi016.stdout:2/112: unlink ff 0 2024-04-26T20:18:37.590 INFO:tasks.workunit.client.0.smithi016.stdout:2/113: mknod d1d/d20/d22/c23 0 2024-04-26T20:18:37.592 INFO:tasks.workunit.client.0.smithi016.stdout:2/114: rename f14 to d1d/f24 0 2024-04-26T20:18:37.592 INFO:tasks.workunit.client.0.smithi016.stdout:2/115: readlink l17 0 2024-04-26T20:18:37.592 INFO:tasks.workunit.client.0.smithi016.stdout:2/116: truncate f18 890604 0 2024-04-26T20:18:37.592 INFO:tasks.workunit.client.0.smithi016.stdout:2/117: chown f10 26388244 1 2024-04-26T20:18:37.593 INFO:tasks.workunit.client.0.smithi016.stdout:2/118: unlink c8 0 2024-04-26T20:18:37.596 INFO:tasks.workunit.client.0.smithi016.stdout:0/158: sync 2024-04-26T20:18:37.596 INFO:tasks.workunit.client.0.smithi016.stdout:1/272: sync 2024-04-26T20:18:37.596 INFO:tasks.workunit.client.0.smithi016.stdout:6/129: sync 2024-04-26T20:18:37.597 INFO:tasks.workunit.client.0.smithi016.stdout:3/74: sync 2024-04-26T20:18:37.597 INFO:tasks.workunit.client.0.smithi016.stdout:8/126: sync 2024-04-26T20:18:37.597 INFO:tasks.workunit.client.0.smithi016.stdout:8/127: chown d9/c24 665681 1 2024-04-26T20:18:37.598 INFO:tasks.workunit.client.0.smithi016.stdout:5/292: sync 2024-04-26T20:18:37.599 INFO:tasks.workunit.client.0.smithi016.stdout:6/130: mkdir d1/d21/d26/d1c/d2e 0 2024-04-26T20:18:37.600 INFO:tasks.workunit.client.0.smithi016.stdout:3/75: getdents d3/d9 0 2024-04-26T20:18:37.600 INFO:tasks.workunit.client.0.smithi016.stdout:3/76: readlink d3/d9/lc 0 2024-04-26T20:18:37.604 INFO:tasks.workunit.client.0.smithi016.stdout:8/128: creat d9/d23/d26/f2d x:0 0 0 2024-04-26T20:18:37.604 INFO:tasks.workunit.client.0.smithi016.stdout:8/129: chown d9/d23/d27 4159816 1 2024-04-26T20:18:37.605 INFO:tasks.workunit.client.0.smithi016.stdout:5/293: symlink d1/d9/d1c/d52/l5e 0 2024-04-26T20:18:37.605 INFO:tasks.workunit.client.0.smithi016.stdout:6/131: link d1/d8/fb d1/d8/f2f 0 2024-04-26T20:18:37.606 INFO:tasks.workunit.client.0.smithi016.stdout:5/294: mkdir d1/d5/d5f 0 2024-04-26T20:18:37.637 INFO:tasks.workunit.client.0.smithi016.stdout:6/132: dread d1/d8/fc [0,4194304] 0 2024-04-26T20:18:37.637 INFO:tasks.workunit.client.0.smithi016.stdout:6/133: readlink d1/d21/d26/l1d 0 2024-04-26T20:18:37.637 INFO:tasks.workunit.client.0.smithi016.stdout:9/142: dwrite d1/d2/fd [0,4194304] 0 2024-04-26T20:18:37.645 INFO:tasks.workunit.client.0.smithi016.stdout:9/143: write d1/d2e/f9 [563839,37070] 0 2024-04-26T20:18:37.646 INFO:tasks.workunit.client.0.smithi016.stdout:9/144: write d1/d25/f30 [158761,53189] 0 2024-04-26T20:18:37.648 INFO:tasks.workunit.client.0.smithi016.stdout:9/145: rename d1/l23 to d1/d2e/l31 0 2024-04-26T20:18:37.710 INFO:tasks.workunit.client.0.smithi016.stdout:5/295: dread d1/d9/f3d [0,4194304] 0 2024-04-26T20:18:37.710 INFO:tasks.workunit.client.0.smithi016.stdout:1/273: read d3/d5/da/f21 [1615077,120598] 0 2024-04-26T20:18:37.710 INFO:tasks.workunit.client.0.smithi016.stdout:4/110: dwrite d0/f1 [0,4194304] 0 2024-04-26T20:18:37.715 INFO:tasks.workunit.client.0.smithi016.stdout:1/274: rename d3/d5/d6/d9/db to d3/d5/d6/d9/d54 0 2024-04-26T20:18:37.716 INFO:tasks.workunit.client.0.smithi016.stdout:1/275: mknod d3/d5/d6/d9/d2a/d3b/c55 0 2024-04-26T20:18:37.717 INFO:tasks.workunit.client.0.smithi016.stdout:1/276: symlink d3/d5/d6/d4b/l56 0 2024-04-26T20:18:37.717 INFO:tasks.workunit.client.0.smithi016.stdout:1/277: stat d3/d5/d6/l15 0 2024-04-26T20:18:37.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/278: truncate d3/d5/da/f30 1232936 0 2024-04-26T20:18:37.736 INFO:tasks.workunit.client.0.smithi016.stdout:5/296: write d1/d9/f3d [2701755,121721] 0 2024-04-26T20:18:37.738 INFO:tasks.workunit.client.0.smithi016.stdout:5/297: unlink d1/d9/d4b/c50 0 2024-04-26T20:18:37.741 INFO:tasks.workunit.client.0.smithi016.stdout:5/298: symlink d1/d5/l60 0 2024-04-26T20:18:37.744 INFO:tasks.workunit.client.0.smithi016.stdout:1/279: rename d3/d5/d6/d9/d54 to d3/d57 0 2024-04-26T20:18:37.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/299: creat d1/d9/d11/f61 x:0 0 0 2024-04-26T20:18:37.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/300: write d1/d9/f3d [2768069,104847] 0 2024-04-26T20:18:37.749 INFO:tasks.workunit.client.0.smithi016.stdout:5/301: link d1/l17 d1/d5/d5f/l62 0 2024-04-26T20:18:37.750 INFO:tasks.workunit.client.0.smithi016.stdout:5/302: creat d1/d9/d1c/d52/f63 x:0 0 0 2024-04-26T20:18:37.751 INFO:tasks.workunit.client.0.smithi016.stdout:0/159: read d2/d8/f9 [4115166,59180] 0 2024-04-26T20:18:37.751 INFO:tasks.workunit.client.0.smithi016.stdout:5/303: truncate d1/d9/d4b/f59 5780 0 2024-04-26T20:18:37.751 INFO:tasks.workunit.client.0.smithi016.stdout:0/160: chown d2/d20/f27 0 1 2024-04-26T20:18:37.754 INFO:tasks.workunit.client.0.smithi016.stdout:5/304: creat d1/d9/d25/f64 x:0 0 0 2024-04-26T20:18:37.756 INFO:tasks.workunit.client.0.smithi016.stdout:1/280: dread d3/d5/d6/d9/d2a/f32 [0,4194304] 0 2024-04-26T20:18:37.759 INFO:tasks.workunit.client.0.smithi016.stdout:6/134: write d1/f4 [941569,40912] 0 2024-04-26T20:18:37.759 INFO:tasks.workunit.client.0.smithi016.stdout:2/119: dwrite f5 [0,4194304] 0 2024-04-26T20:18:37.759 INFO:tasks.workunit.client.0.smithi016.stdout:2/120: fsync f11 0 2024-04-26T20:18:37.762 INFO:tasks.workunit.client.0.smithi016.stdout:2/121: symlink d1d/d20/d22/l25 0 2024-04-26T20:18:37.768 INFO:tasks.workunit.client.0.smithi016.stdout:3/77: dwrite f2 [0,4194304] 0 2024-04-26T20:18:37.768 INFO:tasks.workunit.client.0.smithi016.stdout:8/130: write d9/f18 [3442459,64034] 0 2024-04-26T20:18:37.768 INFO:tasks.workunit.client.0.smithi016.stdout:8/131: write d9/fb [1316465,9551] 0 2024-04-26T20:18:37.768 INFO:tasks.workunit.client.0.smithi016.stdout:9/146: dwrite d1/d2e/fb [0,4194304] 0 2024-04-26T20:18:37.771 INFO:tasks.workunit.client.0.smithi016.stdout:9/147: creat d1/d1b/f32 x:0 0 0 2024-04-26T20:18:37.772 INFO:tasks.workunit.client.0.smithi016.stdout:8/132: truncate d9/f15 2769150 0 2024-04-26T20:18:37.772 INFO:tasks.workunit.client.0.smithi016.stdout:9/148: getdents d1/d29/d2a 0 2024-04-26T20:18:37.772 INFO:tasks.workunit.client.0.smithi016.stdout:9/149: write d1/d25/f30 [747265,59130] 0 2024-04-26T20:18:37.772 INFO:tasks.workunit.client.0.smithi016.stdout:8/133: write d9/d19/f1e [519855,84986] 0 2024-04-26T20:18:37.780 INFO:tasks.workunit.client.0.smithi016.stdout:8/134: creat d9/d23/d26/f2e x:0 0 0 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/122: getdents d1d/d20/d22 0 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/123: readlink l15 0 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/124: write d1d/f24 [653032,33124] 0 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/125: chown d1d/f24 7697 1 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/126: write d1d/f1f [696473,89106] 0 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/127: fsync f5 0 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:2/128: chown d1d/d20 14584 1 2024-04-26T20:18:37.781 INFO:tasks.workunit.client.0.smithi016.stdout:1/281: write d3/d57/f1a [938194,110904] 0 2024-04-26T20:18:37.783 INFO:tasks.workunit.client.0.smithi016.stdout:1/282: mkdir d3/d5/d6/d50/d58 0 2024-04-26T20:18:37.783 INFO:tasks.workunit.client.0.smithi016.stdout:1/283: fdatasync d3/d5/d6/d9/f38 0 2024-04-26T20:18:37.783 INFO:tasks.workunit.client.0.smithi016.stdout:1/284: fdatasync d3/d5/d6/d9/f4e 0 2024-04-26T20:18:37.806 INFO:tasks.workunit.client.0.smithi016.stdout:5/305: read d1/d9/d11/f34 [3883229,22478] 0 2024-04-26T20:18:37.806 INFO:tasks.workunit.client.0.smithi016.stdout:0/161: dwrite d2/dc/d1e/f26 [0,4194304] 0 2024-04-26T20:18:37.806 INFO:tasks.workunit.client.0.smithi016.stdout:0/162: write d2/dc/d18/d24/f2b [916506,22551] 0 2024-04-26T20:18:37.807 INFO:tasks.workunit.client.0.smithi016.stdout:5/306: mknod d1/d9/d1c/d52/c65 0 2024-04-26T20:18:37.812 INFO:tasks.workunit.client.0.smithi016.stdout:0/163: link d2/d20/l2d d2/d8/l33 0 2024-04-26T20:18:37.812 INFO:tasks.workunit.client.0.smithi016.stdout:5/307: stat d1/d5/d5f/l62 0 2024-04-26T20:18:37.814 INFO:tasks.workunit.client.0.smithi016.stdout:0/164: rename d2/c16 to d2/d20/c34 0 2024-04-26T20:18:37.814 INFO:tasks.workunit.client.0.smithi016.stdout:0/165: chown d2/d8/f11 54 1 2024-04-26T20:18:37.815 INFO:tasks.workunit.client.0.smithi016.stdout:5/308: mknod d1/d9/d11/d4d/c66 0 2024-04-26T20:18:37.815 INFO:tasks.workunit.client.0.smithi016.stdout:0/166: mkdir d2/dc/d1e/d35 0 2024-04-26T20:18:37.816 INFO:tasks.workunit.client.0.smithi016.stdout:5/309: getdents d1/d5 0 2024-04-26T20:18:37.819 INFO:tasks.workunit.client.0.smithi016.stdout:2/129: dwrite f13 [0,4194304] 0 2024-04-26T20:18:37.821 INFO:tasks.workunit.client.0.smithi016.stdout:2/130: unlink c19 0 2024-04-26T20:18:37.823 INFO:tasks.workunit.client.0.smithi016.stdout:2/131: truncate f5 1196468 0 2024-04-26T20:18:37.837 INFO:tasks.workunit.client.0.smithi016.stdout:0/167: write d2/dc/d1e/f1f [3871012,7737] 0 2024-04-26T20:18:37.837 INFO:tasks.workunit.client.0.smithi016.stdout:0/168: dread - d2/d8/f11 zero size 2024-04-26T20:18:37.839 INFO:tasks.workunit.client.0.smithi016.stdout:0/169: rename d2/dc/d18/d24/f2b to d2/d8/f36 0 2024-04-26T20:18:37.852 INFO:tasks.workunit.client.0.smithi016.stdout:5/310: dwrite d1/d9/fc [4194304,4194304] 0 2024-04-26T20:18:37.854 INFO:tasks.workunit.client.0.smithi016.stdout:5/311: creat d1/d9/d25/f67 x:0 0 0 2024-04-26T20:18:37.863 INFO:tasks.workunit.client.0.smithi016.stdout:4/111: dwrite d0/f10 [0,4194304] 0 2024-04-26T20:18:37.890 INFO:tasks.workunit.client.0.smithi016.stdout:2/132: dread f18 [0,4194304] 0 2024-04-26T20:18:37.893 INFO:tasks.workunit.client.0.smithi016.stdout:7/170: sync 2024-04-26T20:18:37.895 INFO:tasks.workunit.client.0.smithi016.stdout:2/133: creat d1d/f26 x:0 0 0 2024-04-26T20:18:37.895 INFO:tasks.workunit.client.0.smithi016.stdout:7/171: creat d0/d24/f2e x:0 0 0 2024-04-26T20:18:37.896 INFO:tasks.workunit.client.0.smithi016.stdout:6/135: dwrite d1/fa [4194304,4194304] 0 2024-04-26T20:18:37.897 INFO:tasks.workunit.client.0.smithi016.stdout:7/172: mknod d0/d1/d6/d1b/c2f 0 2024-04-26T20:18:37.897 INFO:tasks.workunit.client.0.smithi016.stdout:2/134: mkdir d1d/d27 0 2024-04-26T20:18:37.898 INFO:tasks.workunit.client.0.smithi016.stdout:2/135: chown f10 279 1 2024-04-26T20:18:37.898 INFO:tasks.workunit.client.0.smithi016.stdout:6/136: symlink d1/d21/d26/d25/l30 0 2024-04-26T20:18:37.901 INFO:tasks.workunit.client.0.smithi016.stdout:4/112: write d0/f1 [1366507,565] 0 2024-04-26T20:18:37.901 INFO:tasks.workunit.client.0.smithi016.stdout:9/150: dwrite d1/d1b/f24 [0,4194304] 0 2024-04-26T20:18:37.901 INFO:tasks.workunit.client.0.smithi016.stdout:1/285: dread d3/d5/f33 [0,4194304] 0 2024-04-26T20:18:37.902 INFO:tasks.workunit.client.0.smithi016.stdout:5/312: dwrite d1/d5/fd [4194304,4194304] 0 2024-04-26T20:18:37.903 INFO:tasks.workunit.client.0.smithi016.stdout:7/173: rename d0/d1/fd to d0/d1/f30 0 2024-04-26T20:18:37.903 INFO:tasks.workunit.client.0.smithi016.stdout:6/137: creat d1/d21/f31 x:0 0 0 2024-04-26T20:18:37.903 INFO:tasks.workunit.client.0.smithi016.stdout:6/138: dread - d1/f1f zero size 2024-04-26T20:18:37.904 INFO:tasks.workunit.client.0.smithi016.stdout:2/136: symlink d1d/d20/d22/l28 0 2024-04-26T20:18:37.908 INFO:tasks.workunit.client.0.smithi016.stdout:5/313: dread d1/d9/f38 [0,4194304] 0 2024-04-26T20:18:37.908 INFO:tasks.workunit.client.0.smithi016.stdout:7/174: link d0/f15 d0/f31 0 2024-04-26T20:18:37.908 INFO:tasks.workunit.client.0.smithi016.stdout:7/175: read - d0/f29 zero size 2024-04-26T20:18:37.908 INFO:tasks.workunit.client.0.smithi016.stdout:7/176: write d0/d1/f20 [789340,1272] 0 2024-04-26T20:18:37.908 INFO:tasks.workunit.client.0.smithi016.stdout:4/113: symlink d0/dd/d19/d1f/l22 0 2024-04-26T20:18:37.910 INFO:tasks.workunit.client.0.smithi016.stdout:7/177: write d0/f21 [4571813,8660] 0 2024-04-26T20:18:37.910 INFO:tasks.workunit.client.0.smithi016.stdout:1/286: creat d3/d57/f59 x:0 0 0 2024-04-26T20:18:37.910 INFO:tasks.workunit.client.0.smithi016.stdout:7/178: fdatasync d0/d1/d6/d1b/d25/f2d 0 2024-04-26T20:18:37.910 INFO:tasks.workunit.client.0.smithi016.stdout:7/179: chown d0/d1/f30 85780 1 2024-04-26T20:18:37.914 INFO:tasks.workunit.client.0.smithi016.stdout:2/137: mkdir d1d/d20/d22/d29 0 2024-04-26T20:18:37.914 INFO:tasks.workunit.client.0.smithi016.stdout:4/114: mknod d0/dd/c23 0 2024-04-26T20:18:37.914 INFO:tasks.workunit.client.0.smithi016.stdout:6/139: mknod d1/d8/d2c/c32 0 2024-04-26T20:18:37.915 INFO:tasks.workunit.client.0.smithi016.stdout:7/180: unlink d0/f21 0 2024-04-26T20:18:37.915 INFO:tasks.workunit.client.0.smithi016.stdout:7/181: read d0/fc [1463037,49405] 0 2024-04-26T20:18:37.916 INFO:tasks.workunit.client.0.smithi016.stdout:4/115: write d0/d1e/f21 [38186,77791] 0 2024-04-26T20:18:37.917 INFO:tasks.workunit.client.0.smithi016.stdout:2/138: mkdir d1d/d2a 0 2024-04-26T20:18:37.917 INFO:tasks.workunit.client.0.smithi016.stdout:3/78: dwrite d3/fd [0,4194304] 0 2024-04-26T20:18:37.921 INFO:tasks.workunit.client.0.smithi016.stdout:6/140: unlink d1/d8/fb 0 2024-04-26T20:18:37.928 INFO:tasks.workunit.client.0.smithi016.stdout:5/314: dread d1/d9/d25/f2a [0,4194304] 0 2024-04-26T20:18:37.928 INFO:tasks.workunit.client.0.smithi016.stdout:7/182: unlink d0/d1/d6/d1b/d25/f2d 0 2024-04-26T20:18:37.928 INFO:tasks.workunit.client.0.smithi016.stdout:4/116: creat d0/dd/d19/f24 x:0 0 0 2024-04-26T20:18:37.930 INFO:tasks.workunit.client.0.smithi016.stdout:9/151: write d1/d2/fd [4086506,115988] 0 2024-04-26T20:18:37.932 INFO:tasks.workunit.client.0.smithi016.stdout:7/183: symlink d0/d1/l32 0 2024-04-26T20:18:37.934 INFO:tasks.workunit.client.0.smithi016.stdout:7/184: mknod d0/d24/c33 0 2024-04-26T20:18:37.935 INFO:tasks.workunit.client.0.smithi016.stdout:4/117: creat d0/dd/f25 x:0 0 0 2024-04-26T20:18:37.936 INFO:tasks.workunit.client.0.smithi016.stdout:4/118: getdents d0/d1e 0 2024-04-26T20:18:37.964 INFO:tasks.workunit.client.0.smithi016.stdout:9/152: dread f0 [0,4194304] 0 2024-04-26T20:18:37.969 INFO:tasks.workunit.client.0.smithi016.stdout:2/139: write f13 [647275,67197] 0 2024-04-26T20:18:37.970 INFO:tasks.workunit.client.0.smithi016.stdout:2/140: creat d1d/d20/f2b x:0 0 0 2024-04-26T20:18:37.978 INFO:tasks.workunit.client.0.smithi016.stdout:9/153: dread d1/d1b/f24 [0,4194304] 0 2024-04-26T20:18:37.978 INFO:tasks.workunit.client.0.smithi016.stdout:9/154: mkdir d1/d29/d2a/d33 0 2024-04-26T20:18:38.000 INFO:tasks.workunit.client.0.smithi016.stdout:2/141: dwrite f1b [0,4194304] 0 2024-04-26T20:18:38.000 INFO:tasks.workunit.client.0.smithi016.stdout:2/142: chown f11 6684690 1 2024-04-26T20:18:38.002 INFO:tasks.workunit.client.0.smithi016.stdout:2/143: creat d1d/d20/d22/f2c x:0 0 0 2024-04-26T20:18:38.003 INFO:tasks.workunit.client.0.smithi016.stdout:2/144: mkdir d1d/d27/d2d 0 2024-04-26T20:18:38.004 INFO:tasks.workunit.client.0.smithi016.stdout:2/145: stat f1c 0 2024-04-26T20:18:38.004 INFO:tasks.workunit.client.0.smithi016.stdout:2/146: fdatasync d1d/f24 0 2024-04-26T20:18:38.004 INFO:tasks.workunit.client.0.smithi016.stdout:2/147: chown d1d/d20/d22/l28 1881 1 2024-04-26T20:18:38.004 INFO:tasks.workunit.client.0.smithi016.stdout:2/148: creat d1d/d20/d22/f2e x:0 0 0 2024-04-26T20:18:38.004 INFO:tasks.workunit.client.0.smithi016.stdout:2/149: stat f10 0 2024-04-26T20:18:38.005 INFO:tasks.workunit.client.0.smithi016.stdout:2/150: creat d1d/d27/d2d/f2f x:0 0 0 2024-04-26T20:18:38.051 INFO:tasks.workunit.client.0.smithi016.stdout:5/315: dwrite d1/f31 [0,4194304] 0 2024-04-26T20:18:38.053 INFO:tasks.workunit.client.0.smithi016.stdout:5/316: getdents d1/d9 0 2024-04-26T20:18:38.053 INFO:tasks.workunit.client.0.smithi016.stdout:5/317: chown d1/d9/d25/f42 21 1 2024-04-26T20:18:38.053 INFO:tasks.workunit.client.0.smithi016.stdout:5/318: write d1/d9/d1c/f45 [316485,2291] 0 2024-04-26T20:18:38.059 INFO:tasks.workunit.client.0.smithi016.stdout:5/319: dread d1/d9/d25/f54 [0,4194304] 0 2024-04-26T20:18:38.066 INFO:tasks.workunit.client.0.smithi016.stdout:6/141: dwrite d1/d8/ff [0,4194304] 0 2024-04-26T20:18:38.066 INFO:tasks.workunit.client.0.smithi016.stdout:7/185: dwrite d0/fb [0,4194304] 0 2024-04-26T20:18:38.066 INFO:tasks.workunit.client.0.smithi016.stdout:7/186: stat d0/d1/d6/d1b/d25 0 2024-04-26T20:18:38.068 INFO:tasks.workunit.client.0.smithi016.stdout:6/142: creat d1/d21/d26/d1c/d2e/f33 x:0 0 0 2024-04-26T20:18:38.068 INFO:tasks.workunit.client.0.smithi016.stdout:6/143: fdatasync d1/f6 0 2024-04-26T20:18:38.071 INFO:tasks.workunit.client.0.smithi016.stdout:5/320: dread d1/d9/d11/f34 [0,4194304] 0 2024-04-26T20:18:38.085 INFO:tasks.workunit.client.0.smithi016.stdout:5/321: dread d1/d5/f1d [0,4194304] 0 2024-04-26T20:18:38.086 INFO:tasks.workunit.client.0.smithi016.stdout:5/322: fsync d1/d5/f32 0 2024-04-26T20:18:38.087 INFO:tasks.workunit.client.0.smithi016.stdout:5/323: rmdir d1/d9/d1c 39 2024-04-26T20:18:38.090 INFO:tasks.workunit.client.0.smithi016.stdout:2/151: dread f11 [0,4194304] 0 2024-04-26T20:18:38.092 INFO:tasks.workunit.client.0.smithi016.stdout:2/152: creat d1d/d27/d2d/f30 x:0 0 0 2024-04-26T20:18:38.092 INFO:tasks.workunit.client.0.smithi016.stdout:2/153: truncate d1d/f26 956048 0 2024-04-26T20:18:38.092 INFO:tasks.workunit.client.0.smithi016.stdout:2/154: write d1d/f1f [1272283,8423] 0 2024-04-26T20:18:38.096 INFO:tasks.workunit.client.0.smithi016.stdout:2/155: creat d1d/d2a/f31 x:0 0 0 2024-04-26T20:18:38.100 INFO:tasks.workunit.client.0.smithi016.stdout:4/119: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:38.101 INFO:tasks.workunit.client.0.smithi016.stdout:9/155: dread d1/d2e/fb [0,4194304] 0 2024-04-26T20:18:38.101 INFO:tasks.workunit.client.0.smithi016.stdout:4/120: read - d0/dd/f25 zero size 2024-04-26T20:18:38.102 INFO:tasks.workunit.client.0.smithi016.stdout:9/156: symlink d1/d29/d2a/l34 0 2024-04-26T20:18:38.102 INFO:tasks.workunit.client.0.smithi016.stdout:9/157: getdents d1/d29/d2a/d33 0 2024-04-26T20:18:38.103 INFO:tasks.workunit.client.0.smithi016.stdout:4/121: rename d0/c3 to d0/dd/d19/d1f/c26 0 2024-04-26T20:18:38.105 INFO:tasks.workunit.client.0.smithi016.stdout:9/158: creat d1/d2e/f35 x:0 0 0 2024-04-26T20:18:38.106 INFO:tasks.workunit.client.0.smithi016.stdout:6/144: dread d1/d8/ff [0,4194304] 0 2024-04-26T20:18:38.140 INFO:tasks.workunit.client.0.smithi016.stdout:5/324: dwrite d1/d9/d25/f42 [0,4194304] 0 2024-04-26T20:18:38.149 INFO:tasks.workunit.client.0.smithi016.stdout:2/156: dwrite f7 [0,4194304] 0 2024-04-26T20:18:38.149 INFO:tasks.workunit.client.0.smithi016.stdout:2/157: fdatasync f13 0 2024-04-26T20:18:38.149 INFO:tasks.workunit.client.0.smithi016.stdout:2/158: readlink d1d/d20/d22/l25 0 2024-04-26T20:18:38.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/187: truncate d0/fb 3651934 0 2024-04-26T20:18:38.150 INFO:tasks.workunit.client.0.smithi016.stdout:7/188: write d0/d1/d6/d1b/d25/f26 [16637,205] 0 2024-04-26T20:18:38.150 INFO:tasks.workunit.client.0.smithi016.stdout:7/189: chown d0/d24/f2e 377 1 2024-04-26T20:18:38.151 INFO:tasks.workunit.client.0.smithi016.stdout:2/159: creat d1d/d20/d22/d29/f32 x:0 0 0 2024-04-26T20:18:38.152 INFO:tasks.workunit.client.0.smithi016.stdout:2/160: write f18 [1659467,24648] 0 2024-04-26T20:18:38.152 INFO:tasks.workunit.client.0.smithi016.stdout:2/161: chown d1d/d20/d22/d29 5 1 2024-04-26T20:18:38.154 INFO:tasks.workunit.client.0.smithi016.stdout:2/162: rename f10 to d1d/d20/d22/f33 0 2024-04-26T20:18:38.156 INFO:tasks.workunit.client.0.smithi016.stdout:2/163: mkdir d1d/d2a/d34 0 2024-04-26T20:18:38.157 INFO:tasks.workunit.client.0.smithi016.stdout:2/164: write d1d/f24 [218626,81679] 0 2024-04-26T20:18:38.158 INFO:tasks.workunit.client.0.smithi016.stdout:4/122: dwrite d0/fa [0,4194304] 0 2024-04-26T20:18:38.161 INFO:tasks.workunit.client.0.smithi016.stdout:2/165: getdents d1d/d27 0 2024-04-26T20:18:38.226 INFO:tasks.workunit.client.0.smithi016.stdout:5/325: dwrite d1/d9/d11/f58 [0,4194304] 0 2024-04-26T20:18:38.227 INFO:tasks.workunit.client.0.smithi016.stdout:5/326: dread d1/d5/f32 [0,4194304] 0 2024-04-26T20:18:38.243 INFO:tasks.workunit.client.0.smithi016.stdout:5/327: dread d1/d9/f10 [4194304,4194304] 0 2024-04-26T20:18:38.246 INFO:tasks.workunit.client.0.smithi016.stdout:5/328: symlink d1/d9/d11/d4d/l68 0 2024-04-26T20:18:38.246 INFO:tasks.workunit.client.0.smithi016.stdout:5/329: symlink d1/d9/d1c/l69 0 2024-04-26T20:18:38.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/123: dread d0/f15 [0,4194304] 0 2024-04-26T20:18:38.247 INFO:tasks.workunit.client.0.smithi016.stdout:7/190: dwrite d0/f17 [0,4194304] 0 2024-04-26T20:18:38.247 INFO:tasks.workunit.client.0.smithi016.stdout:7/191: stat d0/l1e 0 2024-04-26T20:18:38.253 INFO:tasks.workunit.client.0.smithi016.stdout:7/192: dread d0/fc [0,4194304] 0 2024-04-26T20:18:38.253 INFO:tasks.workunit.client.0.smithi016.stdout:7/193: stat d0/d1/d6 0 2024-04-26T20:18:38.255 INFO:tasks.workunit.client.0.smithi016.stdout:7/194: rename d0/d1/d6/d1b to d0/d1/d34 0 2024-04-26T20:18:38.256 INFO:tasks.workunit.client.0.smithi016.stdout:2/166: dwrite f11 [0,4194304] 0 2024-04-26T20:18:38.258 INFO:tasks.workunit.client.0.smithi016.stdout:2/167: read d1d/f26 [367445,124425] 0 2024-04-26T20:18:38.260 INFO:tasks.workunit.client.0.smithi016.stdout:7/195: dread d0/d1/f20 [0,4194304] 0 2024-04-26T20:18:38.262 INFO:tasks.workunit.client.0.smithi016.stdout:7/196: symlink d0/d1/d6/l35 0 2024-04-26T20:18:38.263 INFO:tasks.workunit.client.0.smithi016.stdout:7/197: creat d0/d1/d34/d25/f36 x:0 0 0 2024-04-26T20:18:38.264 INFO:tasks.workunit.client.0.smithi016.stdout:7/198: chown d0/d1/d34/f2c 94511 1 2024-04-26T20:18:38.267 INFO:tasks.workunit.client.0.smithi016.stdout:2/168: dread fe [0,4194304] 0 2024-04-26T20:18:38.267 INFO:tasks.workunit.client.0.smithi016.stdout:7/199: symlink d0/d1/d34/d25/l37 0 2024-04-26T20:18:38.267 INFO:tasks.workunit.client.0.smithi016.stdout:7/200: write d0/d1/f20 [1416813,8243] 0 2024-04-26T20:18:38.267 INFO:tasks.workunit.client.0.smithi016.stdout:7/201: chown d0/d1/d6/f1c 6079 1 2024-04-26T20:18:38.267 INFO:tasks.workunit.client.0.smithi016.stdout:4/124: dread d0/f15 [0,4194304] 0 2024-04-26T20:18:38.268 INFO:tasks.workunit.client.0.smithi016.stdout:7/202: creat d0/f38 x:0 0 0 2024-04-26T20:18:38.270 INFO:tasks.workunit.client.0.smithi016.stdout:7/203: mknod d0/d24/c39 0 2024-04-26T20:18:38.286 INFO:tasks.workunit.client.0.smithi016.stdout:5/330: dwrite d1/d9/f49 [0,4194304] 0 2024-04-26T20:18:38.291 INFO:tasks.workunit.client.0.smithi016.stdout:2/169: write f11 [2858190,97494] 0 2024-04-26T20:18:38.292 INFO:tasks.workunit.client.0.smithi016.stdout:2/170: chown d1d/f1f 678 1 2024-04-26T20:18:38.292 INFO:tasks.workunit.client.0.smithi016.stdout:2/171: dread - d1d/d27/d2d/f30 zero size 2024-04-26T20:18:38.296 INFO:tasks.workunit.client.0.smithi016.stdout:5/331: getdents d1/d5/d5f 0 2024-04-26T20:18:38.299 INFO:tasks.workunit.client.0.smithi016.stdout:5/332: truncate d1/d9/d25/f47 1204369 0 2024-04-26T20:18:38.299 INFO:tasks.workunit.client.0.smithi016.stdout:5/333: fdatasync d1/d9/d11/f34 0 2024-04-26T20:18:38.308 INFO:tasks.workunit.client.0.smithi016.stdout:2/172: truncate f18 1431521 0 2024-04-26T20:18:38.311 INFO:tasks.workunit.client.0.smithi016.stdout:2/173: rename d1d/f26 to d1d/d20/d22/d29/f35 0 2024-04-26T20:18:38.313 INFO:tasks.workunit.client.0.smithi016.stdout:2/174: mknod d1d/d27/c36 0 2024-04-26T20:18:38.325 INFO:tasks.workunit.client.0.smithi016.stdout:7/204: dread d0/fb [0,4194304] 0 2024-04-26T20:18:38.325 INFO:tasks.workunit.client.0.smithi016.stdout:7/205: fdatasync d0/d1/d34/d25/f36 0 2024-04-26T20:18:38.325 INFO:tasks.workunit.client.0.smithi016.stdout:4/125: dwrite d0/dd/f25 [0,4194304] 0 2024-04-26T20:18:38.327 INFO:tasks.workunit.client.0.smithi016.stdout:7/206: getdents d0/d1/d6 0 2024-04-26T20:18:38.332 INFO:tasks.workunit.client.0.smithi016.stdout:4/126: creat d0/dd/d1b/f27 x:0 0 0 2024-04-26T20:18:38.334 INFO:tasks.workunit.client.0.smithi016.stdout:4/127: symlink d0/dd/d19/d1f/l28 0 2024-04-26T20:18:38.336 INFO:tasks.workunit.client.0.smithi016.stdout:4/128: symlink d0/d1e/l29 0 2024-04-26T20:18:38.337 INFO:tasks.workunit.client.0.smithi016.stdout:4/129: creat d0/dd/f2a x:0 0 0 2024-04-26T20:18:38.338 INFO:tasks.workunit.client.0.smithi016.stdout:4/130: mknod d0/c2b 0 2024-04-26T20:18:38.347 INFO:tasks.workunit.client.0.smithi016.stdout:5/334: dwrite d1/d9/d11/f18 [8388608,4194304] 0 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/335: dread d1/d9/d4b/f44 [0,4194304] 0 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/336: fsync d1/d9/d11/f18 0 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/337: readlink d1/l48 0 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/338: write d1/d9/f14 [2836822,91299] 0 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/339: fdatasync d1/d9/d1c/f45 0 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/340: truncate d1/f22 1006899 0 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/341: chown d1/l21 3709 1 2024-04-26T20:18:38.376 INFO:tasks.workunit.client.0.smithi016.stdout:5/342: chown d1/d5/c7 234329540 1 2024-04-26T20:18:38.377 INFO:tasks.workunit.client.0.smithi016.stdout:5/343: chown d1/l19 1 1 2024-04-26T20:18:38.377 INFO:tasks.workunit.client.0.smithi016.stdout:5/344: rename d1/d9/d1c/f45 to d1/d9/d4b/f6a 0 2024-04-26T20:18:38.379 INFO:tasks.workunit.client.0.smithi016.stdout:5/345: mknod d1/d5/d5f/c6b 0 2024-04-26T20:18:38.381 INFO:tasks.workunit.client.0.smithi016.stdout:5/346: truncate d1/d9/d25/f47 479247 0 2024-04-26T20:18:38.381 INFO:tasks.workunit.client.0.smithi016.stdout:5/347: stat d1/d9/d1c/d52/c65 0 2024-04-26T20:18:38.387 INFO:tasks.workunit.client.0.smithi016.stdout:4/131: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:38.387 INFO:tasks.workunit.client.0.smithi016.stdout:4/132: chown d0/dd/d19/d1f/c26 1972 1 2024-04-26T20:18:38.387 INFO:tasks.workunit.client.0.smithi016.stdout:4/133: dread - d0/dd/d1b/f27 zero size 2024-04-26T20:18:38.388 INFO:tasks.workunit.client.0.smithi016.stdout:4/134: unlink d0/dd/d19/d1f/c26 0 2024-04-26T20:18:38.389 INFO:tasks.workunit.client.0.smithi016.stdout:4/135: creat d0/dd/f2c x:0 0 0 2024-04-26T20:18:38.401 INFO:tasks.workunit.client.0.smithi016.stdout:8/135: sync 2024-04-26T20:18:38.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/136: fdatasync d9/d23/d26/f2a 0 2024-04-26T20:18:38.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/137: chown d9/f20 15429562 1 2024-04-26T20:18:38.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/138: readlink d9/d19/l1d 0 2024-04-26T20:18:38.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/139: rmdir d9/d19 39 2024-04-26T20:18:38.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/140: stat d9/f14 0 2024-04-26T20:18:38.402 INFO:tasks.workunit.client.0.smithi016.stdout:8/141: readlink l6 0 2024-04-26T20:18:38.403 INFO:tasks.workunit.client.0.smithi016.stdout:1/287: sync 2024-04-26T20:18:38.403 INFO:tasks.workunit.client.0.smithi016.stdout:3/79: sync 2024-04-26T20:18:38.403 INFO:tasks.workunit.client.0.smithi016.stdout:0/170: sync 2024-04-26T20:18:38.403 INFO:tasks.workunit.client.0.smithi016.stdout:0/171: chown d2/d8/l33 0 1 2024-04-26T20:18:38.403 INFO:tasks.workunit.client.0.smithi016.stdout:3/80: dread - d3/d9/f12 zero size 2024-04-26T20:18:38.403 INFO:tasks.workunit.client.0.smithi016.stdout:1/288: fdatasync d3/d5/f43 0 2024-04-26T20:18:38.403 INFO:tasks.workunit.client.0.smithi016.stdout:5/348: write d1/d9/fc [905605,27487] 0 2024-04-26T20:18:38.404 INFO:tasks.workunit.client.0.smithi016.stdout:5/349: dread - d1/d9/d1c/d52/f63 zero size 2024-04-26T20:18:38.405 INFO:tasks.workunit.client.0.smithi016.stdout:3/81: creat d3/df/f13 x:0 0 0 2024-04-26T20:18:38.405 INFO:tasks.workunit.client.0.smithi016.stdout:3/82: chown d3/d9/fb 71992331 1 2024-04-26T20:18:38.405 INFO:tasks.workunit.client.0.smithi016.stdout:3/83: dread - d3/d9/f12 zero size 2024-04-26T20:18:38.405 INFO:tasks.workunit.client.0.smithi016.stdout:3/84: chown d3/f4 389 1 2024-04-26T20:18:38.405 INFO:tasks.workunit.client.0.smithi016.stdout:3/85: chown d3/la 680657 1 2024-04-26T20:18:38.406 INFO:tasks.workunit.client.0.smithi016.stdout:5/350: mknod d1/d9/d11/d4d/c6c 0 2024-04-26T20:18:38.406 INFO:tasks.workunit.client.0.smithi016.stdout:5/351: write d1/d9/d11/f61 [969876,69094] 0 2024-04-26T20:18:38.408 INFO:tasks.workunit.client.0.smithi016.stdout:5/352: creat d1/d9/d11/d4d/f6d x:0 0 0 2024-04-26T20:18:38.408 INFO:tasks.workunit.client.0.smithi016.stdout:8/142: mkdir d9/d2f 0 2024-04-26T20:18:38.408 INFO:tasks.workunit.client.0.smithi016.stdout:4/136: dread d0/dd/f12 [4194304,4194304] 0 2024-04-26T20:18:38.410 INFO:tasks.workunit.client.0.smithi016.stdout:1/289: rename d3/d5/d6/d9/d2a/d3d/d53 to d3/d5/d6/d5a 0 2024-04-26T20:18:38.411 INFO:tasks.workunit.client.0.smithi016.stdout:5/353: symlink d1/d9/d25/l6e 0 2024-04-26T20:18:38.413 INFO:tasks.workunit.client.0.smithi016.stdout:5/354: rename d1/d9/d4b/f59 to d1/d5/d5f/f6f 0 2024-04-26T20:18:38.416 INFO:tasks.workunit.client.0.smithi016.stdout:5/355: mknod d1/d9/d11/c70 0 2024-04-26T20:18:38.422 INFO:tasks.workunit.client.0.smithi016.stdout:0/172: dread d2/dc/d18/f29 [0,4194304] 0 2024-04-26T20:18:38.425 INFO:tasks.workunit.client.0.smithi016.stdout:0/173: mkdir d2/d8/d37 0 2024-04-26T20:18:38.425 INFO:tasks.workunit.client.0.smithi016.stdout:0/174: fsync d2/d8/f36 0 2024-04-26T20:18:38.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/290: dread d3/d57/f35 [0,4194304] 0 2024-04-26T20:18:38.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/291: rename d3/d5/d6 to d3/d5/d6/d4b/d5b 22 2024-04-26T20:18:38.427 INFO:tasks.workunit.client.0.smithi016.stdout:0/175: creat d2/dc/d1e/f38 x:0 0 0 2024-04-26T20:18:38.427 INFO:tasks.workunit.client.0.smithi016.stdout:0/176: write d2/dc/d1e/f1f [302600,1640] 0 2024-04-26T20:18:38.428 INFO:tasks.workunit.client.0.smithi016.stdout:0/177: mknod d2/dc/d18/d24/c39 0 2024-04-26T20:18:38.429 INFO:tasks.workunit.client.0.smithi016.stdout:0/178: creat d2/dc/d1e/f3a x:0 0 0 2024-04-26T20:18:38.431 INFO:tasks.workunit.client.0.smithi016.stdout:0/179: mkdir d2/d8/d3b 0 2024-04-26T20:18:38.437 INFO:tasks.workunit.client.0.smithi016.stdout:0/180: rename d2/dc/d1e/l2e to d2/dc/d1e/d35/l3c 0 2024-04-26T20:18:38.439 INFO:tasks.workunit.client.0.smithi016.stdout:4/137: dread d0/f15 [0,4194304] 0 2024-04-26T20:18:38.445 INFO:tasks.workunit.client.0.smithi016.stdout:1/292: write d3/d5/f43 [1013092,38969] 0 2024-04-26T20:18:38.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/293: fsync d3/d5/da/f29 0 2024-04-26T20:18:38.454 INFO:tasks.workunit.client.0.smithi016.stdout:5/356: dread d1/f1b [0,4194304] 0 2024-04-26T20:18:38.457 INFO:tasks.workunit.client.0.smithi016.stdout:5/357: mknod d1/d9/d4b/c71 0 2024-04-26T20:18:38.458 INFO:tasks.workunit.client.0.smithi016.stdout:5/358: mkdir d1/d9/d11/d4d/d72 0 2024-04-26T20:18:38.460 INFO:tasks.workunit.client.0.smithi016.stdout:0/181: dread d2/d8/fe [0,4194304] 0 2024-04-26T20:18:38.460 INFO:tasks.workunit.client.0.smithi016.stdout:7/207: dwrite d0/f28 [0,4194304] 0 2024-04-26T20:18:38.462 INFO:tasks.workunit.client.0.smithi016.stdout:1/294: dread d3/d5/f18 [0,4194304] 0 2024-04-26T20:18:38.468 INFO:tasks.workunit.client.0.smithi016.stdout:0/182: creat d2/dc/d18/d24/f3d x:0 0 0 2024-04-26T20:18:38.468 INFO:tasks.workunit.client.0.smithi016.stdout:0/183: chown d2/l19 29 1 2024-04-26T20:18:38.468 INFO:tasks.workunit.client.0.smithi016.stdout:7/208: symlink d0/d1/l3a 0 2024-04-26T20:18:38.468 INFO:tasks.workunit.client.0.smithi016.stdout:7/209: fdatasync d0/d1/d34/f2c 0 2024-04-26T20:18:38.468 INFO:tasks.workunit.client.0.smithi016.stdout:1/295: mknod d3/d5/d6/d9/d49/c5c 0 2024-04-26T20:18:38.468 INFO:tasks.workunit.client.0.smithi016.stdout:1/296: fsync d3/d5/f4f 0 2024-04-26T20:18:38.470 INFO:tasks.workunit.client.0.smithi016.stdout:0/184: rmdir d2/d20 39 2024-04-26T20:18:38.475 INFO:tasks.workunit.client.0.smithi016.stdout:1/297: unlink d3/d5/d6/d9/l42 0 2024-04-26T20:18:38.475 INFO:tasks.workunit.client.0.smithi016.stdout:1/298: getdents d3/d5/d6/d9/d2a/d3b/d52 0 2024-04-26T20:18:38.476 INFO:tasks.workunit.client.0.smithi016.stdout:1/299: truncate d3/d5/d6/d9/d49/f4c 829903 0 2024-04-26T20:18:38.478 INFO:tasks.workunit.client.0.smithi016.stdout:0/185: mknod d2/dc/c3e 0 2024-04-26T20:18:38.479 INFO:tasks.workunit.client.0.smithi016.stdout:5/359: dread d1/d9/d4b/f44 [0,4194304] 0 2024-04-26T20:18:38.479 INFO:tasks.workunit.client.0.smithi016.stdout:5/360: chown d1/d9/d11/c2e 33958018 1 2024-04-26T20:18:38.479 INFO:tasks.workunit.client.0.smithi016.stdout:5/361: stat d1/d9/d11/d4d/l68 0 2024-04-26T20:18:38.481 INFO:tasks.workunit.client.0.smithi016.stdout:9/159: sync 2024-04-26T20:18:38.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/145: sync 2024-04-26T20:18:38.482 INFO:tasks.workunit.client.0.smithi016.stdout:9/160: write d1/f14 [1601253,110061] 0 2024-04-26T20:18:38.492 INFO:tasks.workunit.client.0.smithi016.stdout:9/161: mknod d1/d29/d2a/d33/c36 0 2024-04-26T20:18:38.492 INFO:tasks.workunit.client.0.smithi016.stdout:8/143: dwrite d9/d23/d26/f2d [0,4194304] 0 2024-04-26T20:18:38.492 INFO:tasks.workunit.client.0.smithi016.stdout:8/144: stat d9/f11 0 2024-04-26T20:18:38.495 INFO:tasks.workunit.client.0.smithi016.stdout:4/138: dwrite d0/dd/f2c [0,4194304] 0 2024-04-26T20:18:38.497 INFO:tasks.workunit.client.0.smithi016.stdout:4/139: mknod d0/dd/d19/c2d 0 2024-04-26T20:18:38.499 INFO:tasks.workunit.client.0.smithi016.stdout:4/140: mknod d0/dd/d19/c2e 0 2024-04-26T20:18:38.500 INFO:tasks.workunit.client.0.smithi016.stdout:4/141: chown d0/l2 34 1 2024-04-26T20:18:38.505 INFO:tasks.workunit.client.0.smithi016.stdout:1/300: write d3/d5/d6/f3c [11756571,10937] 0 2024-04-26T20:18:38.505 INFO:tasks.workunit.client.0.smithi016.stdout:1/301: readlink d3/d5/d6/l3a 0 2024-04-26T20:18:38.511 INFO:tasks.workunit.client.0.smithi016.stdout:1/302: creat d3/d5/d6/d5a/f5d x:0 0 0 2024-04-26T20:18:38.511 INFO:tasks.workunit.client.0.smithi016.stdout:1/303: chown d3/d5/d6/d4b/l56 131320355 1 2024-04-26T20:18:38.512 INFO:tasks.workunit.client.0.smithi016.stdout:1/304: symlink d3/d5/d6/d9/d2a/d3d/l5e 0 2024-04-26T20:18:38.513 INFO:tasks.workunit.client.0.smithi016.stdout:1/305: mknod d3/d5/d6/c5f 0 2024-04-26T20:18:38.531 INFO:tasks.workunit.client.0.smithi016.stdout:8/145: dread d9/f18 [0,4194304] 0 2024-04-26T20:18:38.533 INFO:tasks.workunit.client.0.smithi016.stdout:5/362: dwrite d1/d9/f38 [0,4194304] 0 2024-04-26T20:18:38.533 INFO:tasks.workunit.client.0.smithi016.stdout:1/306: dread d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:38.533 INFO:tasks.workunit.client.0.smithi016.stdout:1/307: stat d3/d57/c1d 0 2024-04-26T20:18:38.533 INFO:tasks.workunit.client.0.smithi016.stdout:5/363: write d1/d9/d25/f64 [834701,84906] 0 2024-04-26T20:18:38.533 INFO:tasks.workunit.client.0.smithi016.stdout:5/364: chown d1/f31 8 1 2024-04-26T20:18:38.536 INFO:tasks.workunit.client.0.smithi016.stdout:9/162: dread f0 [0,4194304] 0 2024-04-26T20:18:38.536 INFO:tasks.workunit.client.0.smithi016.stdout:9/163: chown d1/d25 65007 1 2024-04-26T20:18:38.536 INFO:tasks.workunit.client.0.smithi016.stdout:9/164: chown d1/d1b/c27 142811 1 2024-04-26T20:18:38.536 INFO:tasks.workunit.client.0.smithi016.stdout:9/165: stat d1/d2e/f17 0 2024-04-26T20:18:38.544 INFO:tasks.workunit.client.0.smithi016.stdout:5/365: link d1/d9/f14 d1/d9/f73 0 2024-04-26T20:18:38.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/186: dwrite d2/dc/d1e/d25/f28 [0,4194304] 0 2024-04-26T20:18:38.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/187: getdents d2 0 2024-04-26T20:18:38.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/188: unlink d2/dc/d18/d24/f3d 0 2024-04-26T20:18:38.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/189: symlink d2/l3f 0 2024-04-26T20:18:38.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/190: mkdir d2/d40 0 2024-04-26T20:18:38.552 INFO:tasks.workunit.client.0.smithi016.stdout:0/191: mkdir d2/d20/d41 0 2024-04-26T20:18:38.570 INFO:tasks.workunit.client.0.smithi016.stdout:1/308: dwrite d3/d5/da/f46 [0,4194304] 0 2024-04-26T20:18:38.573 INFO:tasks.workunit.client.0.smithi016.stdout:1/309: creat d3/d5/d6/d50/f60 x:0 0 0 2024-04-26T20:18:38.600 INFO:tasks.workunit.client.0.smithi016.stdout:5/366: dwrite d1/d9/f38 [0,4194304] 0 2024-04-26T20:18:38.600 INFO:tasks.workunit.client.0.smithi016.stdout:5/367: chown d1/d5/f32 3 1 2024-04-26T20:18:38.602 INFO:tasks.workunit.client.0.smithi016.stdout:5/368: rename d1/d5 to d1/d9/d1c/d52/d74 0 2024-04-26T20:18:38.603 INFO:tasks.workunit.client.0.smithi016.stdout:5/369: creat d1/d9/d1c/d52/f75 x:0 0 0 2024-04-26T20:18:38.609 INFO:tasks.workunit.client.0.smithi016.stdout:4/142: dwrite d0/fa [0,4194304] 0 2024-04-26T20:18:38.609 INFO:tasks.workunit.client.0.smithi016.stdout:4/143: truncate d0/f11 338658 0 2024-04-26T20:18:38.610 INFO:tasks.workunit.client.0.smithi016.stdout:8/146: dread d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:38.610 INFO:tasks.workunit.client.0.smithi016.stdout:8/147: write d9/f1f [338470,33825] 0 2024-04-26T20:18:38.611 INFO:tasks.workunit.client.0.smithi016.stdout:4/144: creat d0/d1e/f2f x:0 0 0 2024-04-26T20:18:38.615 INFO:tasks.workunit.client.0.smithi016.stdout:8/148: creat d9/d23/d27/f30 x:0 0 0 2024-04-26T20:18:38.616 INFO:tasks.workunit.client.0.smithi016.stdout:4/145: mkdir d0/d1e/d30 0 2024-04-26T20:18:38.616 INFO:tasks.workunit.client.0.smithi016.stdout:4/146: chown d0/dd/d1b/f27 1837 1 2024-04-26T20:18:38.616 INFO:tasks.workunit.client.0.smithi016.stdout:8/149: mkdir d9/d23/d31 0 2024-04-26T20:18:38.617 INFO:tasks.workunit.client.0.smithi016.stdout:8/150: rename d9/c24 to d9/c32 0 2024-04-26T20:18:38.618 INFO:tasks.workunit.client.0.smithi016.stdout:8/151: write d9/d23/d27/f30 [968309,57966] 0 2024-04-26T20:18:38.618 INFO:tasks.workunit.client.0.smithi016.stdout:8/152: getdents d9/d23/d26 0 2024-04-26T20:18:38.619 INFO:tasks.workunit.client.0.smithi016.stdout:8/153: creat d9/d19/f33 x:0 0 0 2024-04-26T20:18:38.656 INFO:tasks.workunit.client.0.smithi016.stdout:4/147: write d0/f11 [132279,62574] 0 2024-04-26T20:18:38.656 INFO:tasks.workunit.client.0.smithi016.stdout:0/192: dread d2/dc/f1c [0,4194304] 0 2024-04-26T20:18:38.656 INFO:tasks.workunit.client.0.smithi016.stdout:4/148: dread - d0/d1e/f2f zero size 2024-04-26T20:18:38.656 INFO:tasks.workunit.client.0.smithi016.stdout:4/149: rename d0/d1e to d0/d1e/d30/d31 22 2024-04-26T20:18:38.659 INFO:tasks.workunit.client.0.smithi016.stdout:4/150: rename d0/d1e/l29 to d0/d1e/d30/l32 0 2024-04-26T20:18:38.659 INFO:tasks.workunit.client.0.smithi016.stdout:4/151: rename d0/d1e/d30 to d0/d1e/d30/d33 22 2024-04-26T20:18:38.660 INFO:tasks.workunit.client.0.smithi016.stdout:4/152: mkdir d0/dd/d19/d34 0 2024-04-26T20:18:38.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/310: dread d3/d5/f43 [0,4194304] 0 2024-04-26T20:18:38.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/311: stat d3/d57/l51 0 2024-04-26T20:18:38.682 INFO:tasks.workunit.client.0.smithi016.stdout:4/153: dread d0/f1 [0,4194304] 0 2024-04-26T20:18:38.692 INFO:tasks.workunit.client.0.smithi016.stdout:9/166: dwrite d1/d2/f3 [0,4194304] 0 2024-04-26T20:18:38.693 INFO:tasks.workunit.client.0.smithi016.stdout:0/193: dread d2/f15 [0,4194304] 0 2024-04-26T20:18:38.693 INFO:tasks.workunit.client.0.smithi016.stdout:0/194: fdatasync d2/dc/d18/f29 0 2024-04-26T20:18:38.695 INFO:tasks.workunit.client.0.smithi016.stdout:0/195: creat d2/d8/d3b/f42 x:0 0 0 2024-04-26T20:18:38.698 INFO:tasks.workunit.client.0.smithi016.stdout:9/167: write d1/fa [1056718,36831] 0 2024-04-26T20:18:38.699 INFO:tasks.workunit.client.0.smithi016.stdout:9/168: symlink d1/d1b/l37 0 2024-04-26T20:18:38.699 INFO:tasks.workunit.client.0.smithi016.stdout:9/169: fdatasync d1/d2e/f9 0 2024-04-26T20:18:38.699 INFO:tasks.workunit.client.0.smithi016.stdout:9/170: chown d1/d2/d20/c1a 1 1 2024-04-26T20:18:38.702 INFO:tasks.workunit.client.0.smithi016.stdout:9/171: dread d1/d2/d20/f1f [0,4194304] 0 2024-04-26T20:18:38.702 INFO:tasks.workunit.client.0.smithi016.stdout:9/172: read d1/f14 [276475,62506] 0 2024-04-26T20:18:38.703 INFO:tasks.workunit.client.0.smithi016.stdout:9/173: symlink d1/d1b/l38 0 2024-04-26T20:18:38.703 INFO:tasks.workunit.client.0.smithi016.stdout:9/174: chown d1/d2e/l11 288692 1 2024-04-26T20:18:38.705 INFO:tasks.workunit.client.0.smithi016.stdout:9/175: creat d1/f39 x:0 0 0 2024-04-26T20:18:38.769 INFO:tasks.workunit.client.0.smithi016.stdout:9/176: dwrite d1/d2/fd [0,4194304] 0 2024-04-26T20:18:38.788 INFO:tasks.workunit.client.0.smithi016.stdout:9/177: dread d1/d1b/f24 [0,4194304] 0 2024-04-26T20:18:38.788 INFO:tasks.workunit.client.0.smithi016.stdout:9/178: fdatasync d1/d1b/f26 0 2024-04-26T20:18:38.788 INFO:tasks.workunit.client.0.smithi016.stdout:1/312: dwrite d3/d5/da/f26 [0,4194304] 0 2024-04-26T20:18:38.788 INFO:tasks.workunit.client.0.smithi016.stdout:8/154: dwrite d9/d23/d26/f2e [0,4194304] 0 2024-04-26T20:18:38.790 INFO:tasks.workunit.client.0.smithi016.stdout:9/179: symlink d1/d29/d2a/d33/l3a 0 2024-04-26T20:18:38.790 INFO:tasks.workunit.client.0.smithi016.stdout:9/180: write d1/f14 [319832,106497] 0 2024-04-26T20:18:38.797 INFO:tasks.workunit.client.0.smithi016.stdout:1/313: truncate f2 2961550 0 2024-04-26T20:18:38.798 INFO:tasks.workunit.client.0.smithi016.stdout:9/181: getdents d1/d2e 0 2024-04-26T20:18:38.799 INFO:tasks.workunit.client.0.smithi016.stdout:1/314: mknod d3/d5/d6/d9/c61 0 2024-04-26T20:18:38.799 INFO:tasks.workunit.client.0.smithi016.stdout:1/315: write d3/d5/d6/d9/f38 [605641,66081] 0 2024-04-26T20:18:38.802 INFO:tasks.workunit.client.0.smithi016.stdout:1/316: rename d3/d5/d6/d9/d2a/d3d/l5e to d3/d5/d6/d9/d2a/d3b/l62 0 2024-04-26T20:18:38.803 INFO:tasks.workunit.client.0.smithi016.stdout:1/317: chown d3/d57/c1d 614 1 2024-04-26T20:18:38.803 INFO:tasks.workunit.client.0.smithi016.stdout:1/318: truncate d3/d5/da/f30 682966 0 2024-04-26T20:18:38.809 INFO:tasks.workunit.client.0.smithi016.stdout:0/196: dwrite d2/d8/f36 [0,4194304] 0 2024-04-26T20:18:38.809 INFO:tasks.workunit.client.0.smithi016.stdout:0/197: readlink d2/d20/l2d 0 2024-04-26T20:18:38.809 INFO:tasks.workunit.client.0.smithi016.stdout:0/198: chown d2/d8/d3b/f42 990 1 2024-04-26T20:18:38.819 INFO:tasks.workunit.client.0.smithi016.stdout:1/319: write d3/d5/d6/d9/d2a/d3d/f47 [4000127,108174] 0 2024-04-26T20:18:38.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/320: symlink d3/l63 0 2024-04-26T20:18:38.824 INFO:tasks.workunit.client.0.smithi016.stdout:9/182: dread d1/d1b/f26 [0,4194304] 0 2024-04-26T20:18:38.824 INFO:tasks.workunit.client.0.smithi016.stdout:9/183: truncate d1/f39 938622 0 2024-04-26T20:18:38.824 INFO:tasks.workunit.client.0.smithi016.stdout:9/184: readlink d1/d2/d20/d13/l1d 0 2024-04-26T20:18:38.837 INFO:tasks.workunit.client.0.smithi016.stdout:4/154: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:38.837 INFO:tasks.workunit.client.0.smithi016.stdout:8/155: dread f5 [0,4194304] 0 2024-04-26T20:18:38.837 INFO:tasks.workunit.client.0.smithi016.stdout:4/155: chown d0/f1 30 1 2024-04-26T20:18:38.838 INFO:tasks.workunit.client.0.smithi016.stdout:9/185: symlink d1/d29/d2a/l3b 0 2024-04-26T20:18:38.838 INFO:tasks.workunit.client.0.smithi016.stdout:9/186: write d1/d2e/f9 [551925,41024] 0 2024-04-26T20:18:38.843 INFO:tasks.workunit.client.0.smithi016.stdout:8/156: write d9/f1f [122537,103232] 0 2024-04-26T20:18:38.843 INFO:tasks.workunit.client.0.smithi016.stdout:8/157: fdatasync d9/f25 0 2024-04-26T20:18:38.843 INFO:tasks.workunit.client.0.smithi016.stdout:4/156: symlink d0/d1e/d30/l35 0 2024-04-26T20:18:38.843 INFO:tasks.workunit.client.0.smithi016.stdout:4/157: stat d0/f15 0 2024-04-26T20:18:38.848 INFO:tasks.workunit.client.0.smithi016.stdout:8/158: link d9/f18 d9/d19/f34 0 2024-04-26T20:18:38.864 INFO:tasks.workunit.client.0.smithi016.stdout:1/321: dwrite d3/d5/da/f26 [4194304,4194304] 0 2024-04-26T20:18:38.866 INFO:tasks.workunit.client.0.smithi016.stdout:4/158: creat d0/f36 x:0 0 0 2024-04-26T20:18:38.867 INFO:tasks.workunit.client.0.smithi016.stdout:1/322: mknod d3/d5/d6/d9/d2a/d3d/c64 0 2024-04-26T20:18:38.867 INFO:tasks.workunit.client.0.smithi016.stdout:1/323: write d3/d5/f18 [4720583,25362] 0 2024-04-26T20:18:38.885 INFO:tasks.workunit.client.0.smithi016.stdout:4/159: unlink d0/dd/d19/d1f/l22 0 2024-04-26T20:18:38.892 INFO:tasks.workunit.client.0.smithi016.stdout:4/160: symlink d0/l37 0 2024-04-26T20:18:38.902 INFO:tasks.workunit.client.0.smithi016.stdout:9/187: dwrite d1/d2/fd [4194304,4194304] 0 2024-04-26T20:18:38.902 INFO:tasks.workunit.client.0.smithi016.stdout:9/188: getdents d1/d2e 0 2024-04-26T20:18:38.903 INFO:tasks.workunit.client.0.smithi016.stdout:4/161: creat d0/dd/d19/f38 x:0 0 0 2024-04-26T20:18:38.903 INFO:tasks.workunit.client.0.smithi016.stdout:4/162: readlink d0/d1e/d30/l35 0 2024-04-26T20:18:38.905 INFO:tasks.workunit.client.0.smithi016.stdout:9/189: write d1/d2/f10 [782043,109167] 0 2024-04-26T20:18:38.913 INFO:tasks.workunit.client.0.smithi016.stdout:8/159: dwrite d9/f14 [0,4194304] 0 2024-04-26T20:18:38.913 INFO:tasks.workunit.client.0.smithi016.stdout:8/160: write d9/f16 [1171384,111667] 0 2024-04-26T20:18:38.913 INFO:tasks.workunit.client.0.smithi016.stdout:8/161: write d9/f11 [480509,6959] 0 2024-04-26T20:18:38.919 INFO:tasks.workunit.client.0.smithi016.stdout:9/190: dread d1/d2/f10 [0,4194304] 0 2024-04-26T20:18:38.919 INFO:tasks.workunit.client.0.smithi016.stdout:9/191: fdatasync d1/f14 0 2024-04-26T20:18:38.920 INFO:tasks.workunit.client.0.smithi016.stdout:8/162: rmdir d9/d23/d31 0 2024-04-26T20:18:38.920 INFO:tasks.workunit.client.0.smithi016.stdout:8/163: fsync d9/f13 0 2024-04-26T20:18:38.920 INFO:tasks.workunit.client.0.smithi016.stdout:8/164: chown d9/d19/c21 1924272 1 2024-04-26T20:18:38.922 INFO:tasks.workunit.client.0.smithi016.stdout:9/192: mknod d1/d2e/c3c 0 2024-04-26T20:18:38.923 INFO:tasks.workunit.client.0.smithi016.stdout:8/165: mknod d9/d23/c35 0 2024-04-26T20:18:38.929 INFO:tasks.workunit.client.0.smithi016.stdout:9/193: symlink d1/d2/d20/l3d 0 2024-04-26T20:18:38.944 INFO:tasks.workunit.client.0.smithi016.stdout:9/194: write d1/d2e/f17 [1390399,52219] 0 2024-04-26T20:18:38.944 INFO:tasks.workunit.client.0.smithi016.stdout:9/195: fsync d1/fa 0 2024-04-26T20:18:38.944 INFO:tasks.workunit.client.0.smithi016.stdout:9/196: fsync d1/f39 0 2024-04-26T20:18:38.956 INFO:tasks.workunit.client.0.smithi016.stdout:9/197: dread d1/d1b/f24 [0,4194304] 0 2024-04-26T20:18:38.986 INFO:tasks.workunit.client.0.smithi016.stdout:9/198: write d1/d2/fd [1066451,12483] 0 2024-04-26T20:18:38.997 INFO:tasks.workunit.client.0.smithi016.stdout:9/199: mkdir d1/d29/d3e 0 2024-04-26T20:18:39.003 INFO:tasks.workunit.client.0.smithi016.stdout:2/175: sync 2024-04-26T20:18:39.003 INFO:tasks.workunit.client.0.smithi016.stdout:3/86: sync 2024-04-26T20:18:39.003 INFO:tasks.workunit.client.0.smithi016.stdout:3/87: truncate d3/d9/f12 234022 0 2024-04-26T20:18:39.004 INFO:tasks.workunit.client.0.smithi016.stdout:2/176: creat d1d/d20/d22/d29/f37 x:0 0 0 2024-04-26T20:18:39.024 INFO:tasks.workunit.client.0.smithi016.stdout:3/88: write d3/fd [2527478,129933] 0 2024-04-26T20:18:39.026 INFO:tasks.workunit.client.0.smithi016.stdout:3/89: dread d3/d9/f12 [0,4194304] 0 2024-04-26T20:18:39.027 INFO:tasks.workunit.client.0.smithi016.stdout:3/90: mknod d3/df/c14 0 2024-04-26T20:18:39.028 INFO:tasks.workunit.client.0.smithi016.stdout:3/91: rename d3/d9/l10 to d3/l15 0 2024-04-26T20:18:39.029 INFO:tasks.workunit.client.0.smithi016.stdout:3/92: rename d3/f4 to d3/f16 0 2024-04-26T20:18:39.044 INFO:tasks.workunit.client.0.smithi016.stdout:3/93: dread f2 [0,4194304] 0 2024-04-26T20:18:39.044 INFO:tasks.workunit.client.0.smithi016.stdout:3/94: truncate d3/df/f13 101372 0 2024-04-26T20:18:39.045 INFO:tasks.workunit.client.0.smithi016.stdout:3/95: creat d3/d9/f17 x:0 0 0 2024-04-26T20:18:39.045 INFO:tasks.workunit.client.0.smithi016.stdout:3/96: truncate d3/d9/f17 258719 0 2024-04-26T20:18:39.069 INFO:tasks.workunit.client.0.smithi016.stdout:2/177: dwrite f1c [0,4194304] 0 2024-04-26T20:18:39.069 INFO:tasks.workunit.client.0.smithi016.stdout:2/178: fdatasync f11 0 2024-04-26T20:18:39.078 INFO:tasks.workunit.client.0.smithi016.stdout:2/179: creat d1d/d20/d22/d29/f38 x:0 0 0 2024-04-26T20:18:39.078 INFO:tasks.workunit.client.0.smithi016.stdout:2/180: chown c0 505 1 2024-04-26T20:18:39.078 INFO:tasks.workunit.client.0.smithi016.stdout:2/181: readlink l17 0 2024-04-26T20:18:39.078 INFO:tasks.workunit.client.0.smithi016.stdout:2/182: write d1d/d27/d2d/f2f [27441,127470] 0 2024-04-26T20:18:39.082 INFO:tasks.workunit.client.0.smithi016.stdout:9/200: dwrite d1/d2e/f35 [0,4194304] 0 2024-04-26T20:18:39.087 INFO:tasks.workunit.client.0.smithi016.stdout:3/97: dwrite d3/d9/f17 [0,4194304] 0 2024-04-26T20:18:39.089 INFO:tasks.workunit.client.0.smithi016.stdout:3/98: mkdir d3/d9/d18 0 2024-04-26T20:18:39.090 INFO:tasks.workunit.client.0.smithi016.stdout:3/99: creat d3/f19 x:0 0 0 2024-04-26T20:18:39.091 INFO:tasks.workunit.client.0.smithi016.stdout:9/201: dread d1/f14 [0,4194304] 0 2024-04-26T20:18:39.093 INFO:tasks.workunit.client.0.smithi016.stdout:3/100: fsync d3/f16 0 2024-04-26T20:18:39.131 INFO:tasks.workunit.client.0.smithi016.stdout:3/101: dwrite d3/d9/f17 [0,4194304] 0 2024-04-26T20:18:39.131 INFO:tasks.workunit.client.0.smithi016.stdout:3/102: chown d3/f16 6681097 1 2024-04-26T20:18:39.133 INFO:tasks.workunit.client.0.smithi016.stdout:3/103: rename d3/d9/f12 to d3/d9/f1a 0 2024-04-26T20:18:39.134 INFO:tasks.workunit.client.0.smithi016.stdout:2/183: dwrite d1d/d20/d22/f33 [0,4194304] 0 2024-04-26T20:18:39.134 INFO:tasks.workunit.client.0.smithi016.stdout:2/184: fsync f5 0 2024-04-26T20:18:39.134 INFO:tasks.workunit.client.0.smithi016.stdout:2/185: readlink d1d/d20/d22/l28 0 2024-04-26T20:18:39.134 INFO:tasks.workunit.client.0.smithi016.stdout:2/186: chown c16 28384024 1 2024-04-26T20:18:39.134 INFO:tasks.workunit.client.0.smithi016.stdout:3/104: creat d3/f1b x:0 0 0 2024-04-26T20:18:39.134 INFO:tasks.workunit.client.0.smithi016.stdout:3/105: chown d3/f7 26 1 2024-04-26T20:18:39.134 INFO:tasks.workunit.client.0.smithi016.stdout:2/187: rmdir d1d/d20/d22/d29 39 2024-04-26T20:18:39.136 INFO:tasks.workunit.client.0.smithi016.stdout:2/188: rename d1d/d2a/d34 to d1d/d20/d22/d39 0 2024-04-26T20:18:39.137 INFO:tasks.workunit.client.0.smithi016.stdout:2/189: link f12 d1d/d27/d2d/f3a 0 2024-04-26T20:18:39.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/190: mkdir d1d/d2a/d3b 0 2024-04-26T20:18:39.142 INFO:tasks.workunit.client.0.smithi016.stdout:7/210: sync 2024-04-26T20:18:39.142 INFO:tasks.workunit.client.0.smithi016.stdout:6/146: sync 2024-04-26T20:18:39.142 INFO:tasks.workunit.client.0.smithi016.stdout:5/370: sync 2024-04-26T20:18:39.142 INFO:tasks.workunit.client.0.smithi016.stdout:6/147: write d1/d21/d26/d1c/d2e/f33 [589734,3517] 0 2024-04-26T20:18:39.143 INFO:tasks.workunit.client.0.smithi016.stdout:7/211: unlink d0/fb 0 2024-04-26T20:18:39.144 INFO:tasks.workunit.client.0.smithi016.stdout:5/371: creat d1/d9/d11/d4d/f76 x:0 0 0 2024-04-26T20:18:39.147 INFO:tasks.workunit.client.0.smithi016.stdout:7/212: mkdir d0/d1/d34/d3b 0 2024-04-26T20:18:39.147 INFO:tasks.workunit.client.0.smithi016.stdout:7/213: fsync d0/d1/d34/d25/f26 0 2024-04-26T20:18:39.147 INFO:tasks.workunit.client.0.smithi016.stdout:9/202: write d1/d1b/f24 [952942,57124] 0 2024-04-26T20:18:39.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/214: creat d0/d1/d34/d3b/f3c x:0 0 0 2024-04-26T20:18:39.149 INFO:tasks.workunit.client.0.smithi016.stdout:6/148: symlink d1/d21/d26/l34 0 2024-04-26T20:18:39.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/215: write d0/f14 [2479585,61763] 0 2024-04-26T20:18:39.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/216: write d0/d1/d34/d25/f36 [962661,76737] 0 2024-04-26T20:18:39.151 INFO:tasks.workunit.client.0.smithi016.stdout:9/203: truncate d1/d2e/f17 392051 0 2024-04-26T20:18:39.152 INFO:tasks.workunit.client.0.smithi016.stdout:6/149: creat d1/d21/d26/d25/f35 x:0 0 0 2024-04-26T20:18:39.152 INFO:tasks.workunit.client.0.smithi016.stdout:9/204: chown d1/d2/d20/f1f 55078 1 2024-04-26T20:18:39.152 INFO:tasks.workunit.client.0.smithi016.stdout:9/205: write d1/fa [244854,13282] 0 2024-04-26T20:18:39.152 INFO:tasks.workunit.client.0.smithi016.stdout:9/206: stat d1/d2/d20/d13/l16 0 2024-04-26T20:18:39.152 INFO:tasks.workunit.client.0.smithi016.stdout:9/207: write d1/d1b/f32 [52947,89501] 0 2024-04-26T20:18:39.153 INFO:tasks.workunit.client.0.smithi016.stdout:6/150: creat d1/d21/d26/d25/f36 x:0 0 0 2024-04-26T20:18:39.154 INFO:tasks.workunit.client.0.smithi016.stdout:9/208: truncate d1/d2/f5 293733 0 2024-04-26T20:18:39.160 INFO:tasks.workunit.client.0.smithi016.stdout:6/151: mknod d1/d21/d26/d25/c37 0 2024-04-26T20:18:39.161 INFO:tasks.workunit.client.0.smithi016.stdout:6/152: dread - d1/f1f zero size 2024-04-26T20:18:39.161 INFO:tasks.workunit.client.0.smithi016.stdout:6/153: fdatasync d1/f4 0 2024-04-26T20:18:39.161 INFO:tasks.workunit.client.0.smithi016.stdout:9/209: mknod d1/d29/d2a/c3f 0 2024-04-26T20:18:39.161 INFO:tasks.workunit.client.0.smithi016.stdout:7/217: write d0/f14 [1927001,83657] 0 2024-04-26T20:18:39.161 INFO:tasks.workunit.client.0.smithi016.stdout:7/218: chown d0 13 1 2024-04-26T20:18:39.161 INFO:tasks.workunit.client.0.smithi016.stdout:9/210: mkdir d1/d2e/d40 0 2024-04-26T20:18:39.162 INFO:tasks.workunit.client.0.smithi016.stdout:9/211: dread d1/d2/d20/f1f [0,4194304] 0 2024-04-26T20:18:39.162 INFO:tasks.workunit.client.0.smithi016.stdout:9/212: fsync d1/f15 0 2024-04-26T20:18:39.163 INFO:tasks.workunit.client.0.smithi016.stdout:9/213: fsync d1/d2/d20/f1f 0 2024-04-26T20:18:39.166 INFO:tasks.workunit.client.0.smithi016.stdout:7/219: write d0/f15 [4808805,94471] 0 2024-04-26T20:18:39.170 INFO:tasks.workunit.client.0.smithi016.stdout:9/214: creat d1/f41 x:0 0 0 2024-04-26T20:18:39.173 INFO:tasks.workunit.client.0.smithi016.stdout:7/220: creat d0/d1/d6/f3d x:0 0 0 2024-04-26T20:18:39.185 INFO:tasks.workunit.client.0.smithi016.stdout:2/191: dwrite d1d/d20/d22/f2e [0,4194304] 0 2024-04-26T20:18:39.186 INFO:tasks.workunit.client.0.smithi016.stdout:9/215: symlink d1/d2/l42 0 2024-04-26T20:18:39.190 INFO:tasks.workunit.client.0.smithi016.stdout:2/192: creat d1d/d2a/d3b/f3c x:0 0 0 2024-04-26T20:18:39.190 INFO:tasks.workunit.client.0.smithi016.stdout:2/193: write d1d/d27/d2d/f2f [902586,56714] 0 2024-04-26T20:18:39.191 INFO:tasks.workunit.client.0.smithi016.stdout:9/216: truncate d1/d1b/f26 3172033 0 2024-04-26T20:18:39.193 INFO:tasks.workunit.client.0.smithi016.stdout:2/194: mkdir d1d/d2a/d3d 0 2024-04-26T20:18:39.194 INFO:tasks.workunit.client.0.smithi016.stdout:2/195: write d1d/d27/d2d/f2f [1197696,55841] 0 2024-04-26T20:18:39.199 INFO:tasks.workunit.client.0.smithi016.stdout:9/217: mkdir d1/d2/d43 0 2024-04-26T20:18:39.199 INFO:tasks.workunit.client.0.smithi016.stdout:9/218: chown d1/d2e/f35 4623729 1 2024-04-26T20:18:39.205 INFO:tasks.workunit.client.0.smithi016.stdout:5/372: write d1/d9/f29 [1969176,76356] 0 2024-04-26T20:18:39.205 INFO:tasks.workunit.client.0.smithi016.stdout:5/373: readlink d1/d9/d25/l57 0 2024-04-26T20:18:39.205 INFO:tasks.workunit.client.0.smithi016.stdout:5/374: stat d1/l17 0 2024-04-26T20:18:39.207 INFO:tasks.workunit.client.0.smithi016.stdout:2/196: dread d1d/d20/d22/f2e [0,4194304] 0 2024-04-26T20:18:39.208 INFO:tasks.workunit.client.0.smithi016.stdout:9/219: mkdir d1/d29/d2a/d33/d44 0 2024-04-26T20:18:39.208 INFO:tasks.workunit.client.0.smithi016.stdout:9/220: fsync d1/d2/f10 0 2024-04-26T20:18:39.208 INFO:tasks.workunit.client.0.smithi016.stdout:9/221: chown d1/d2e/l11 887616 1 2024-04-26T20:18:39.214 INFO:tasks.workunit.client.0.smithi016.stdout:9/222: dread d1/d2e/f9 [0,4194304] 0 2024-04-26T20:18:39.216 INFO:tasks.workunit.client.0.smithi016.stdout:5/375: link d1/c56 d1/d9/c77 0 2024-04-26T20:18:39.216 INFO:tasks.workunit.client.0.smithi016.stdout:5/376: readlink d1/d9/d1c/l4a 0 2024-04-26T20:18:39.223 INFO:tasks.workunit.client.0.smithi016.stdout:9/223: stat d1/d2e/l31 0 2024-04-26T20:18:39.226 INFO:tasks.workunit.client.0.smithi016.stdout:6/154: write d1/fa [4630817,128872] 0 2024-04-26T20:18:39.242 INFO:tasks.workunit.client.0.smithi016.stdout:3/106: dwrite d3/fd [0,4194304] 0 2024-04-26T20:18:39.242 INFO:tasks.workunit.client.0.smithi016.stdout:7/221: dread d0/f15 [0,4194304] 0 2024-04-26T20:18:39.248 INFO:tasks.workunit.client.0.smithi016.stdout:9/224: read d1/d2e/f35 [2839231,49153] 0 2024-04-26T20:18:39.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/225: chown d1/d2/f3 15 1 2024-04-26T20:18:39.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/226: chown d1/d2e/f35 856675482 1 2024-04-26T20:18:39.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/227: write d1/d2e/f17 [152726,44088] 0 2024-04-26T20:18:39.254 INFO:tasks.workunit.client.0.smithi016.stdout:5/377: dwrite d1/d9/f49 [0,4194304] 0 2024-04-26T20:18:39.254 INFO:tasks.workunit.client.0.smithi016.stdout:5/378: chown d1/d9/d1c/c2c 2748 1 2024-04-26T20:18:39.256 INFO:tasks.workunit.client.0.smithi016.stdout:5/379: write d1/d9/d1c/d52/d74/f32 [1758520,44418] 0 2024-04-26T20:18:39.256 INFO:tasks.workunit.client.0.smithi016.stdout:5/380: readlink d1/d9/d25/l57 0 2024-04-26T20:18:39.271 INFO:tasks.workunit.client.0.smithi016.stdout:5/381: read d1/d9/d11/f58 [3950053,22048] 0 2024-04-26T20:18:39.271 INFO:tasks.workunit.client.0.smithi016.stdout:5/382: fdatasync d1/f5a 0 2024-04-26T20:18:39.271 INFO:tasks.workunit.client.0.smithi016.stdout:5/383: dread - d1/d9/d11/d4d/f6d zero size 2024-04-26T20:18:39.271 INFO:tasks.workunit.client.0.smithi016.stdout:5/384: stat d1/d9/d1c/c2c 0 2024-04-26T20:18:39.272 INFO:tasks.workunit.client.0.smithi016.stdout:5/385: chown d1/d9/d1c/d52/c65 326 1 2024-04-26T20:18:39.272 INFO:tasks.workunit.client.0.smithi016.stdout:5/386: dread - d1/d9/d1c/d52/f75 zero size 2024-04-26T20:18:39.272 INFO:tasks.workunit.client.0.smithi016.stdout:5/387: write d1/d9/d11/f34 [976780,36728] 0 2024-04-26T20:18:39.478 INFO:tasks.workunit.client.0.smithi016.stdout:6/155: mknod d1/d21/d26/d1c/c38 0 2024-04-26T20:18:39.479 INFO:tasks.workunit.client.0.smithi016.stdout:7/222: rmdir d0/d1 39 2024-04-26T20:18:39.479 INFO:tasks.workunit.client.0.smithi016.stdout:7/223: readlink d0/d1/l3a 0 2024-04-26T20:18:39.479 INFO:tasks.workunit.client.0.smithi016.stdout:7/224: chown d0/d1/d34/c1f 398726162 1 2024-04-26T20:18:39.480 INFO:tasks.workunit.client.0.smithi016.stdout:3/107: link d3/f1b d3/d9/d18/f1c 0 2024-04-26T20:18:39.481 INFO:tasks.workunit.client.0.smithi016.stdout:9/228: symlink d1/d2/l45 0 2024-04-26T20:18:39.483 INFO:tasks.workunit.client.0.smithi016.stdout:5/388: mkdir d1/d78 0 2024-04-26T20:18:39.483 INFO:tasks.workunit.client.0.smithi016.stdout:5/389: fsync d1/f1b 0 2024-04-26T20:18:39.486 INFO:tasks.workunit.client.0.smithi016.stdout:3/108: symlink d3/l1d 0 2024-04-26T20:18:39.488 INFO:tasks.workunit.client.0.smithi016.stdout:9/229: creat d1/d2/d43/f46 x:0 0 0 2024-04-26T20:18:39.488 INFO:tasks.workunit.client.0.smithi016.stdout:9/230: chown d1/f41 21761 1 2024-04-26T20:18:39.496 INFO:tasks.workunit.client.0.smithi016.stdout:9/231: mknod d1/d29/d2a/c47 0 2024-04-26T20:18:39.498 INFO:tasks.workunit.client.0.smithi016.stdout:9/232: mknod d1/d2e/c48 0 2024-04-26T20:18:39.498 INFO:tasks.workunit.client.0.smithi016.stdout:9/233: fdatasync d1/d2e/f35 0 2024-04-26T20:18:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:0/199: sync 2024-04-26T20:18:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:2/197: sync 2024-04-26T20:18:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:2/198: write f18 [2364652,96788] 0 2024-04-26T20:18:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:9/234: mkdir d1/d2/d20/d49 0 2024-04-26T20:18:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:9/235: chown d1/f39 24 1 2024-04-26T20:18:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:9/236: dread - d1/f41 zero size 2024-04-26T20:18:39.504 INFO:tasks.workunit.client.0.smithi016.stdout:8/166: sync 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:1/324: sync 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:2/199: mkdir d1d/d20/d22/d39/d3e 0 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:4/163: sync 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:2/200: chown d1d/d27/d2d/f3a 41540 1 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:4/164: fsync d0/f10 0 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:9/237: rename d1/f39 to d1/d29/d2a/d33/f4a 0 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:9/238: read d1/f15 [1686108,24267] 0 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:9/239: write d1/fa [2206501,113555] 0 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:9/240: chown d1/d1b 4243 1 2024-04-26T20:18:39.505 INFO:tasks.workunit.client.0.smithi016.stdout:9/241: fdatasync d1/d2e/f9 0 2024-04-26T20:18:39.506 INFO:tasks.workunit.client.0.smithi016.stdout:2/201: creat d1d/d27/f3f x:0 0 0 2024-04-26T20:18:39.506 INFO:tasks.workunit.client.0.smithi016.stdout:2/202: fdatasync d1d/d20/d22/f2c 0 2024-04-26T20:18:39.506 INFO:tasks.workunit.client.0.smithi016.stdout:2/203: readlink d1d/d20/d22/l25 0 2024-04-26T20:18:39.507 INFO:tasks.workunit.client.0.smithi016.stdout:5/390: dread d1/d9/fc [4194304,4194304] 0 2024-04-26T20:18:39.507 INFO:tasks.workunit.client.0.smithi016.stdout:5/391: write d1/d9/d1c/d52/d74/f32 [2064101,17501] 0 2024-04-26T20:18:39.507 INFO:tasks.workunit.client.0.smithi016.stdout:4/165: rename d0/dd/l16 to d0/dd/d19/d1f/l39 0 2024-04-26T20:18:39.508 INFO:tasks.workunit.client.0.smithi016.stdout:8/167: symlink d9/l36 0 2024-04-26T20:18:39.509 INFO:tasks.workunit.client.0.smithi016.stdout:5/392: creat d1/d9/d25/f79 x:0 0 0 2024-04-26T20:18:39.511 INFO:tasks.workunit.client.0.smithi016.stdout:8/168: link d9/l36 d9/d23/d26/d2c/l37 0 2024-04-26T20:18:39.514 INFO:tasks.workunit.client.0.smithi016.stdout:5/393: symlink d1/d9/d11/d4d/d72/l7a 0 2024-04-26T20:18:39.514 INFO:tasks.workunit.client.0.smithi016.stdout:8/169: truncate d9/f14 2889690 0 2024-04-26T20:18:39.516 INFO:tasks.workunit.client.0.smithi016.stdout:5/394: link d1/c56 d1/d9/d11/d4d/d72/c7b 0 2024-04-26T20:18:39.519 INFO:tasks.workunit.client.0.smithi016.stdout:8/170: link d9/c1a d9/c38 0 2024-04-26T20:18:39.521 INFO:tasks.workunit.client.0.smithi016.stdout:8/171: truncate f5 1120516 0 2024-04-26T20:18:39.521 INFO:tasks.workunit.client.0.smithi016.stdout:8/172: truncate d9/f1b 492109 0 2024-04-26T20:18:39.522 INFO:tasks.workunit.client.0.smithi016.stdout:8/173: rmdir d9/d19 39 2024-04-26T20:18:39.527 INFO:tasks.workunit.client.0.smithi016.stdout:1/325: write d3/d5/f18 [2320457,24011] 0 2024-04-26T20:18:39.527 INFO:tasks.workunit.client.0.smithi016.stdout:1/326: write d3/d5/d6/d5a/f3f [137219,78393] 0 2024-04-26T20:18:39.528 INFO:tasks.workunit.client.0.smithi016.stdout:7/225: dwrite d0/d1/d34/f2c [0,4194304] 0 2024-04-26T20:18:39.530 INFO:tasks.workunit.client.0.smithi016.stdout:7/226: mknod d0/d1/d6/c3e 0 2024-04-26T20:18:39.533 INFO:tasks.workunit.client.0.smithi016.stdout:7/227: mkdir d0/d1/d34/d25/d3f 0 2024-04-26T20:18:39.536 INFO:tasks.workunit.client.0.smithi016.stdout:7/228: write d0/d1/f20 [17008,8327] 0 2024-04-26T20:18:39.546 INFO:tasks.workunit.client.0.smithi016.stdout:6/156: dwrite d1/d8/f2f [4194304,4194304] 0 2024-04-26T20:18:39.572 INFO:tasks.workunit.client.0.smithi016.stdout:7/229: getdents d0/d1/d34/d3b 0 2024-04-26T20:18:39.572 INFO:tasks.workunit.client.0.smithi016.stdout:7/230: readlink d0/d1/d34/d25/l2a 0 2024-04-26T20:18:39.577 INFO:tasks.workunit.client.0.smithi016.stdout:6/157: rename d1/d21/f31 to d1/d21/f39 0 2024-04-26T20:18:39.644 INFO:tasks.workunit.client.0.smithi016.stdout:1/327: dread d3/d5/f18 [0,4194304] 0 2024-04-26T20:18:39.644 INFO:tasks.workunit.client.0.smithi016.stdout:4/166: dwrite d0/d1e/f21 [0,4194304] 0 2024-04-26T20:18:39.645 INFO:tasks.workunit.client.0.smithi016.stdout:4/167: rename d0/fb to d0/dd/d1b/f3a 0 2024-04-26T20:18:39.645 INFO:tasks.workunit.client.0.smithi016.stdout:4/168: fdatasync d0/dd/f12 0 2024-04-26T20:18:39.648 INFO:tasks.workunit.client.0.smithi016.stdout:4/169: creat d0/dd/f3b x:0 0 0 2024-04-26T20:18:39.651 INFO:tasks.workunit.client.0.smithi016.stdout:4/170: link d0/l2 d0/dd/d19/l3c 0 2024-04-26T20:18:39.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/231: mkdir d0/d1/d40 0 2024-04-26T20:18:39.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/232: truncate d0/d1/f20 1675172 0 2024-04-26T20:18:39.657 INFO:tasks.workunit.client.0.smithi016.stdout:7/233: creat d0/d1/f41 x:0 0 0 2024-04-26T20:18:39.662 INFO:tasks.workunit.client.0.smithi016.stdout:9/242: dread d1/d2e/fb [0,4194304] 0 2024-04-26T20:18:39.683 INFO:tasks.workunit.client.0.smithi016.stdout:9/243: link d1/d2/l2b d1/d2e/d40/l4b 0 2024-04-26T20:18:39.689 INFO:tasks.workunit.client.0.smithi016.stdout:1/328: dwrite d3/d5/d6/f14 [0,4194304] 0 2024-04-26T20:18:39.697 INFO:tasks.workunit.client.0.smithi016.stdout:7/234: creat d0/f42 x:0 0 0 2024-04-26T20:18:39.715 INFO:tasks.workunit.client.0.smithi016.stdout:7/235: dread d0/d1/d6/fa [0,4194304] 0 2024-04-26T20:18:39.717 INFO:tasks.workunit.client.0.smithi016.stdout:1/329: link d3/d5/d6/l1f d3/d5/d6/d9/d2a/d3b/d52/l65 0 2024-04-26T20:18:39.717 INFO:tasks.workunit.client.0.smithi016.stdout:7/236: symlink d0/d24/l43 0 2024-04-26T20:18:39.725 INFO:tasks.workunit.client.0.smithi016.stdout:0/200: dwrite d2/d8/f9 [0,4194304] 0 2024-04-26T20:18:39.725 INFO:tasks.workunit.client.0.smithi016.stdout:8/174: dwrite d9/d23/d26/f2b [0,4194304] 0 2024-04-26T20:18:39.727 INFO:tasks.workunit.client.0.smithi016.stdout:1/330: mkdir d3/d5/da/d66 0 2024-04-26T20:18:39.739 INFO:tasks.workunit.client.0.smithi016.stdout:4/171: dwrite d0/d1e/f21 [0,4194304] 0 2024-04-26T20:18:39.741 INFO:tasks.workunit.client.0.smithi016.stdout:0/201: mknod d2/d20/d41/c43 0 2024-04-26T20:18:39.742 INFO:tasks.workunit.client.0.smithi016.stdout:1/331: dread d3/d5/da/f46 [0,4194304] 0 2024-04-26T20:18:39.742 INFO:tasks.workunit.client.0.smithi016.stdout:1/332: dread - d3/d57/f44 zero size 2024-04-26T20:18:39.742 INFO:tasks.workunit.client.0.smithi016.stdout:1/333: write d3/d57/f59 [669254,122419] 0 2024-04-26T20:18:39.742 INFO:tasks.workunit.client.0.smithi016.stdout:1/334: fdatasync d3/f4 0 2024-04-26T20:18:39.743 INFO:tasks.workunit.client.0.smithi016.stdout:4/172: mknod d0/dd/d19/d34/c3d 0 2024-04-26T20:18:39.743 INFO:tasks.workunit.client.0.smithi016.stdout:0/202: creat d2/dc/f44 x:0 0 0 2024-04-26T20:18:39.746 INFO:tasks.workunit.client.0.smithi016.stdout:1/335: unlink f2 0 2024-04-26T20:18:39.748 INFO:tasks.workunit.client.0.smithi016.stdout:0/203: unlink d2/dc/d1e/f26 0 2024-04-26T20:18:39.750 INFO:tasks.workunit.client.0.smithi016.stdout:1/336: unlink d3/d57/f59 0 2024-04-26T20:18:39.780 INFO:tasks.workunit.client.0.smithi016.stdout:3/109: write d3/d9/f17 [3596696,94396] 0 2024-04-26T20:18:39.789 INFO:tasks.workunit.client.0.smithi016.stdout:7/237: dwrite d0/d24/f2e [0,4194304] 0 2024-04-26T20:18:39.789 INFO:tasks.workunit.client.0.smithi016.stdout:7/238: truncate d0/f42 969434 0 2024-04-26T20:18:39.817 INFO:tasks.workunit.client.0.smithi016.stdout:4/173: dread d0/f15 [0,4194304] 0 2024-04-26T20:18:39.817 INFO:tasks.workunit.client.0.smithi016.stdout:6/158: dwrite d1/f4 [0,4194304] 0 2024-04-26T20:18:39.817 INFO:tasks.workunit.client.0.smithi016.stdout:9/244: read d1/d2/f5 [268163,37330] 0 2024-04-26T20:18:39.866 INFO:tasks.workunit.client.0.smithi016.stdout:0/204: dwrite d2/d20/f27 [0,4194304] 0 2024-04-26T20:18:39.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/174: dwrite d0/d1e/f2f [0,4194304] 0 2024-04-26T20:18:39.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/175: readlink d0/d1e/d30/l35 0 2024-04-26T20:18:39.885 INFO:tasks.workunit.client.0.smithi016.stdout:4/176: fsync d0/d1e/f2f 0 2024-04-26T20:18:39.885 INFO:tasks.workunit.client.0.smithi016.stdout:4/177: chown d0/dd/c23 5 1 2024-04-26T20:18:39.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/175: dwrite d9/f11 [0,4194304] 0 2024-04-26T20:18:40.535 INFO:tasks.workunit.client.0.smithi016.stdout:3/110: truncate d3/d9/fb 76731 0 2024-04-26T20:18:40.536 INFO:tasks.workunit.client.0.smithi016.stdout:7/239: rename d0/l8 to d0/d1/d34/d25/l44 0 2024-04-26T20:18:40.538 INFO:tasks.workunit.client.0.smithi016.stdout:6/159: rmdir d1/d21/d26/d1c/d2e 39 2024-04-26T20:18:40.540 INFO:tasks.workunit.client.0.smithi016.stdout:9/245: unlink d1/d2e/c3c 0 2024-04-26T20:18:40.540 INFO:tasks.workunit.client.0.smithi016.stdout:9/246: getdents d1/d29/d2a/d33/d44 0 2024-04-26T20:18:40.540 INFO:tasks.workunit.client.0.smithi016.stdout:9/247: fsync f0 0 2024-04-26T20:18:40.541 INFO:tasks.workunit.client.0.smithi016.stdout:0/205: mkdir d2/dc/d45 0 2024-04-26T20:18:40.544 INFO:tasks.workunit.client.0.smithi016.stdout:4/178: creat d0/dd/d19/d1f/f3e x:0 0 0 2024-04-26T20:18:40.549 INFO:tasks.workunit.client.0.smithi016.stdout:8/176: mknod d9/d2f/c39 0 2024-04-26T20:18:40.552 INFO:tasks.workunit.client.0.smithi016.stdout:5/395: sync 2024-04-26T20:18:40.552 INFO:tasks.workunit.client.0.smithi016.stdout:2/204: sync 2024-04-26T20:18:40.556 INFO:tasks.workunit.client.0.smithi016.stdout:7/240: link d0/d24/c33 d0/d1/d34/d25/d3f/c45 0 2024-04-26T20:18:40.556 INFO:tasks.workunit.client.0.smithi016.stdout:7/241: chown d0/d1/d6/l16 1 1 2024-04-26T20:18:40.561 INFO:tasks.workunit.client.0.smithi016.stdout:5/396: unlink d1/l19 0 2024-04-26T20:18:40.561 INFO:tasks.workunit.client.0.smithi016.stdout:5/397: write d1/d9/d1c/d52/f63 [413028,21788] 0 2024-04-26T20:18:40.563 INFO:tasks.workunit.client.0.smithi016.stdout:2/205: symlink d1d/d20/d22/l40 0 2024-04-26T20:18:40.563 INFO:tasks.workunit.client.0.smithi016.stdout:4/179: write d0/dd/d1b/f3a [304199,18219] 0 2024-04-26T20:18:40.563 INFO:tasks.workunit.client.0.smithi016.stdout:4/180: truncate d0/dd/f2c 5102847 0 2024-04-26T20:18:40.564 INFO:tasks.workunit.client.0.smithi016.stdout:7/242: getdents d0/d1/d6 0 2024-04-26T20:18:40.566 INFO:tasks.workunit.client.0.smithi016.stdout:0/206: getdents d2/d20/d41 0 2024-04-26T20:18:40.566 INFO:tasks.workunit.client.0.smithi016.stdout:1/337: sync 2024-04-26T20:18:40.568 INFO:tasks.workunit.client.0.smithi016.stdout:8/177: link l2 d9/l3a 0 2024-04-26T20:18:40.568 INFO:tasks.workunit.client.0.smithi016.stdout:8/178: fdatasync d9/d23/d26/f2b 0 2024-04-26T20:18:40.568 INFO:tasks.workunit.client.0.smithi016.stdout:8/179: write d9/d19/f1e [1620960,121547] 0 2024-04-26T20:18:40.568 INFO:tasks.workunit.client.0.smithi016.stdout:8/180: fdatasync d9/f1f 0 2024-04-26T20:18:40.570 INFO:tasks.workunit.client.0.smithi016.stdout:5/398: creat d1/d9/d11/d4d/d72/f7c x:0 0 0 2024-04-26T20:18:40.571 INFO:tasks.workunit.client.0.smithi016.stdout:2/206: getdents d1d/d2a 0 2024-04-26T20:18:40.572 INFO:tasks.workunit.client.0.smithi016.stdout:0/207: chown d2/dc/d18/f29 8521351 1 2024-04-26T20:18:40.597 INFO:tasks.workunit.client.0.smithi016.stdout:6/160: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:40.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/181: dread d0/f11 [0,4194304] 0 2024-04-26T20:18:40.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/182: read - d0/dd/d19/f24 zero size 2024-04-26T20:18:40.597 INFO:tasks.workunit.client.0.smithi016.stdout:4/183: fsync d0/f11 0 2024-04-26T20:18:40.606 INFO:tasks.workunit.client.0.smithi016.stdout:6/161: write d1/f7 [6078892,62082] 0 2024-04-26T20:18:40.613 INFO:tasks.workunit.client.0.smithi016.stdout:4/184: write d0/fa [2987749,15156] 0 2024-04-26T20:18:40.699 INFO:tasks.workunit.client.0.smithi016.stdout:8/181: symlink d9/d2f/l3b 0 2024-04-26T20:18:40.702 INFO:tasks.workunit.client.0.smithi016.stdout:7/243: rename d0/d24 to d0/d1/d46 0 2024-04-26T20:18:40.702 INFO:tasks.workunit.client.0.smithi016.stdout:7/244: truncate d0/f42 1370183 0 2024-04-26T20:18:40.704 INFO:tasks.workunit.client.0.smithi016.stdout:6/162: mkdir d1/d3a 0 2024-04-26T20:18:40.704 INFO:tasks.workunit.client.0.smithi016.stdout:6/163: fdatasync d1/d21/f39 0 2024-04-26T20:18:40.707 INFO:tasks.workunit.client.0.smithi016.stdout:4/185: mknod d0/dd/d19/d34/c3f 0 2024-04-26T20:18:40.709 INFO:tasks.workunit.client.0.smithi016.stdout:7/245: mknod d0/d1/d34/c47 0 2024-04-26T20:18:40.709 INFO:tasks.workunit.client.0.smithi016.stdout:7/246: write d0/d1/d34/d3b/f3c [297490,30769] 0 2024-04-26T20:18:40.709 INFO:tasks.workunit.client.0.smithi016.stdout:7/247: chown d0/d1/d34/d25/l37 153052 1 2024-04-26T20:18:40.709 INFO:tasks.workunit.client.0.smithi016.stdout:4/186: mknod d0/d1e/d30/c40 0 2024-04-26T20:18:40.711 INFO:tasks.workunit.client.0.smithi016.stdout:7/248: symlink d0/d1/l48 0 2024-04-26T20:18:40.717 INFO:tasks.workunit.client.0.smithi016.stdout:7/249: link d0/l13 d0/d1/d34/d25/l49 0 2024-04-26T20:18:40.717 INFO:tasks.workunit.client.0.smithi016.stdout:7/250: chown d0/fc 44449379 1 2024-04-26T20:18:40.717 INFO:tasks.workunit.client.0.smithi016.stdout:7/251: truncate d0/fc 2454718 0 2024-04-26T20:18:40.717 INFO:tasks.workunit.client.0.smithi016.stdout:7/252: readlink d0/d1/d46/l43 0 2024-04-26T20:18:40.718 INFO:tasks.workunit.client.0.smithi016.stdout:8/182: dread d9/f14 [0,4194304] 0 2024-04-26T20:18:40.723 INFO:tasks.workunit.client.0.smithi016.stdout:7/253: creat d0/d1/d34/d3b/f4a x:0 0 0 2024-04-26T20:18:40.737 INFO:tasks.workunit.client.0.smithi016.stdout:8/183: truncate d9/d19/f1e 1721359 0 2024-04-26T20:18:40.737 INFO:tasks.workunit.client.0.smithi016.stdout:5/399: dread d1/d9/f38 [0,4194304] 0 2024-04-26T20:18:40.738 INFO:tasks.workunit.client.0.smithi016.stdout:8/184: creat d9/d23/f3c x:0 0 0 2024-04-26T20:18:40.738 INFO:tasks.workunit.client.0.smithi016.stdout:8/185: chown d9/c38 14182 1 2024-04-26T20:18:40.738 INFO:tasks.workunit.client.0.smithi016.stdout:8/186: readlink d9/l3a 0 2024-04-26T20:18:40.741 INFO:tasks.workunit.client.0.smithi016.stdout:5/400: truncate d1/d9/d11/f58 79748 0 2024-04-26T20:18:40.741 INFO:tasks.workunit.client.0.smithi016.stdout:5/401: fsync d1/f1f 0 2024-04-26T20:18:40.742 INFO:tasks.workunit.client.0.smithi016.stdout:8/187: link d9/d19/c22 d9/d2f/c3d 0 2024-04-26T20:18:40.742 INFO:tasks.workunit.client.0.smithi016.stdout:8/188: fdatasync d9/f16 0 2024-04-26T20:18:40.744 INFO:tasks.workunit.client.0.smithi016.stdout:3/111: dwrite f2 [0,4194304] 0 2024-04-26T20:18:40.744 INFO:tasks.workunit.client.0.smithi016.stdout:5/402: mkdir d1/d7d 0 2024-04-26T20:18:40.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/403: rename d1/d9/d1c/l3a to d1/d9/d11/d4d/l7e 0 2024-04-26T20:18:40.764 INFO:tasks.workunit.client.0.smithi016.stdout:6/164: dwrite d1/fd [0,4194304] 0 2024-04-26T20:18:40.769 INFO:tasks.workunit.client.0.smithi016.stdout:2/207: dwrite d1d/d27/d2d/f3a [0,4194304] 0 2024-04-26T20:18:40.775 INFO:tasks.workunit.client.0.smithi016.stdout:7/254: dread d0/d1/d34/f2c [0,4194304] 0 2024-04-26T20:18:40.775 INFO:tasks.workunit.client.0.smithi016.stdout:7/255: chown d0/d1/d34 403 1 2024-04-26T20:18:40.775 INFO:tasks.workunit.client.0.smithi016.stdout:7/256: stat d0/d1/l32 0 2024-04-26T20:18:40.787 INFO:tasks.workunit.client.0.smithi016.stdout:3/112: dread d3/f7 [0,4194304] 0 2024-04-26T20:18:40.788 INFO:tasks.workunit.client.0.smithi016.stdout:4/187: dwrite d0/dd/f2c [0,4194304] 0 2024-04-26T20:18:40.789 INFO:tasks.workunit.client.0.smithi016.stdout:8/189: dwrite d9/f20 [0,4194304] 0 2024-04-26T20:18:40.805 INFO:tasks.workunit.client.0.smithi016.stdout:3/113: write f2 [3350916,33] 0 2024-04-26T20:18:40.805 INFO:tasks.workunit.client.0.smithi016.stdout:3/114: chown d3 1439729098 1 2024-04-26T20:18:41.018 INFO:tasks.workunit.client.0.smithi016.stdout:6/165: mkdir d1/d8/d3b 0 2024-04-26T20:18:41.019 INFO:tasks.workunit.client.0.smithi016.stdout:2/208: symlink d1d/d2a/d3d/l41 0 2024-04-26T20:18:41.019 INFO:tasks.workunit.client.0.smithi016.stdout:2/209: fsync d1d/d20/d22/f2e 0 2024-04-26T20:18:41.021 INFO:tasks.workunit.client.0.smithi016.stdout:7/257: mkdir d0/d1/d4b 0 2024-04-26T20:18:41.022 INFO:tasks.workunit.client.0.smithi016.stdout:4/188: rename d0/dd/d19/d34 to d0/d1e/d41 0 2024-04-26T20:18:41.023 INFO:tasks.workunit.client.0.smithi016.stdout:8/190: stat d9/d2f/c3d 0 2024-04-26T20:18:41.024 INFO:tasks.workunit.client.0.smithi016.stdout:3/115: creat d3/df/f1e x:0 0 0 2024-04-26T20:18:41.025 INFO:tasks.workunit.client.0.smithi016.stdout:3/116: stat d3/d9/d18/f1c 0 2024-04-26T20:18:41.025 INFO:tasks.workunit.client.0.smithi016.stdout:3/117: chown d3/d9/ce 1564133 1 2024-04-26T20:18:41.025 INFO:tasks.workunit.client.0.smithi016.stdout:4/189: dread d0/f11 [0,4194304] 0 2024-04-26T20:18:41.028 INFO:tasks.workunit.client.0.smithi016.stdout:7/258: truncate d0/d1/f30 2191980 0 2024-04-26T20:18:41.028 INFO:tasks.workunit.client.0.smithi016.stdout:7/259: chown d0/d1/d34/d25/f36 78249756 1 2024-04-26T20:18:41.029 INFO:tasks.workunit.client.0.smithi016.stdout:8/191: mknod d9/d23/d26/c3e 0 2024-04-26T20:18:41.034 INFO:tasks.workunit.client.0.smithi016.stdout:4/190: rename d0/dd/c1c to d0/d1e/d30/c42 0 2024-04-26T20:18:41.034 INFO:tasks.workunit.client.0.smithi016.stdout:2/210: unlink d1d/d27/d2d/f3a 0 2024-04-26T20:18:41.034 INFO:tasks.workunit.client.0.smithi016.stdout:6/166: dread d1/fa [4194304,4194304] 0 2024-04-26T20:18:41.034 INFO:tasks.workunit.client.0.smithi016.stdout:6/167: chown d1/d21/d26/d25 2458714 1 2024-04-26T20:18:41.034 INFO:tasks.workunit.client.0.smithi016.stdout:8/192: mkdir d9/d23/d27/d3f 0 2024-04-26T20:18:41.035 INFO:tasks.workunit.client.0.smithi016.stdout:4/191: mkdir d0/d1e/d41/d43 0 2024-04-26T20:18:41.035 INFO:tasks.workunit.client.0.smithi016.stdout:4/192: write d0/dd/d19/f24 [430625,99883] 0 2024-04-26T20:18:41.035 INFO:tasks.workunit.client.0.smithi016.stdout:9/248: sync 2024-04-26T20:18:41.036 INFO:tasks.workunit.client.0.smithi016.stdout:2/211: creat d1d/d20/f42 x:0 0 0 2024-04-26T20:18:41.036 INFO:tasks.workunit.client.0.smithi016.stdout:2/212: dread - d1d/d27/f3f zero size 2024-04-26T20:18:41.037 INFO:tasks.workunit.client.0.smithi016.stdout:6/168: creat d1/d21/d26/d1c/f3c x:0 0 0 2024-04-26T20:18:41.037 INFO:tasks.workunit.client.0.smithi016.stdout:6/169: dread - d1/f1f zero size 2024-04-26T20:18:41.038 INFO:tasks.workunit.client.0.smithi016.stdout:6/170: readlink d1/d21/l28 0 2024-04-26T20:18:41.038 INFO:tasks.workunit.client.0.smithi016.stdout:9/249: rename d1/d25 to d1/d2/d4c 0 2024-04-26T20:18:41.041 INFO:tasks.workunit.client.0.smithi016.stdout:2/213: creat d1d/f43 x:0 0 0 2024-04-26T20:18:41.041 INFO:tasks.workunit.client.0.smithi016.stdout:0/208: sync 2024-04-26T20:18:41.041 INFO:tasks.workunit.client.0.smithi016.stdout:5/404: sync 2024-04-26T20:18:41.041 INFO:tasks.workunit.client.0.smithi016.stdout:8/193: dread f5 [0,4194304] 0 2024-04-26T20:18:41.042 INFO:tasks.workunit.client.0.smithi016.stdout:1/338: sync 2024-04-26T20:18:41.043 INFO:tasks.workunit.client.0.smithi016.stdout:2/214: rename f5 to d1d/d27/d2d/f44 0 2024-04-26T20:18:41.043 INFO:tasks.workunit.client.0.smithi016.stdout:2/215: write d1d/d20/f2b [75760,3863] 0 2024-04-26T20:18:41.044 INFO:tasks.workunit.client.0.smithi016.stdout:5/405: mknod d1/d9/d4b/c7f 0 2024-04-26T20:18:41.046 INFO:tasks.workunit.client.0.smithi016.stdout:6/171: mkdir d1/d8/d2c/d3d 0 2024-04-26T20:18:41.047 INFO:tasks.workunit.client.0.smithi016.stdout:5/406: dread d1/f22 [0,4194304] 0 2024-04-26T20:18:41.047 INFO:tasks.workunit.client.0.smithi016.stdout:5/407: fdatasync d1/f1f 0 2024-04-26T20:18:41.047 INFO:tasks.workunit.client.0.smithi016.stdout:8/194: truncate d9/d19/f1e 1382238 0 2024-04-26T20:18:41.049 INFO:tasks.workunit.client.0.smithi016.stdout:1/339: creat d3/d5/d6/d9/d49/f67 x:0 0 0 2024-04-26T20:18:41.050 INFO:tasks.workunit.client.0.smithi016.stdout:0/209: mknod d2/d40/c46 0 2024-04-26T20:18:41.051 INFO:tasks.workunit.client.0.smithi016.stdout:0/210: fsync d2/dc/f1d 0 2024-04-26T20:18:41.052 INFO:tasks.workunit.client.0.smithi016.stdout:2/216: truncate d1d/d20/d22/f2e 1747141 0 2024-04-26T20:18:41.055 INFO:tasks.workunit.client.0.smithi016.stdout:6/172: chown d1/d8/c2d 2453 1 2024-04-26T20:18:41.055 INFO:tasks.workunit.client.0.smithi016.stdout:6/173: readlink d1/d21/d26/l1d 0 2024-04-26T20:18:41.056 INFO:tasks.workunit.client.0.smithi016.stdout:9/250: dread f0 [0,4194304] 0 2024-04-26T20:18:41.056 INFO:tasks.workunit.client.0.smithi016.stdout:6/174: truncate d1/f13 965151 0 2024-04-26T20:18:41.056 INFO:tasks.workunit.client.0.smithi016.stdout:6/175: dread - d1/f1f zero size 2024-04-26T20:18:41.056 INFO:tasks.workunit.client.0.smithi016.stdout:6/176: chown d1/l1a 33 1 2024-04-26T20:18:41.059 INFO:tasks.workunit.client.0.smithi016.stdout:2/217: rename d1d/f24 to d1d/d20/d22/d39/f45 0 2024-04-26T20:18:41.059 INFO:tasks.workunit.client.0.smithi016.stdout:2/218: read f11 [3699865,88884] 0 2024-04-26T20:18:41.060 INFO:tasks.workunit.client.0.smithi016.stdout:6/177: creat d1/d21/f3e x:0 0 0 2024-04-26T20:18:41.066 INFO:tasks.workunit.client.0.smithi016.stdout:2/219: mknod d1d/d20/d22/d39/d3e/c46 0 2024-04-26T20:18:41.066 INFO:tasks.workunit.client.0.smithi016.stdout:2/220: chown c0 38919 1 2024-04-26T20:18:41.066 INFO:tasks.workunit.client.0.smithi016.stdout:2/221: truncate d1d/d20/f2b 1059933 0 2024-04-26T20:18:41.068 INFO:tasks.workunit.client.0.smithi016.stdout:9/251: rename d1/d2/d20/d13/l1e to d1/d29/l4d 0 2024-04-26T20:18:41.068 INFO:tasks.workunit.client.0.smithi016.stdout:9/252: chown d1/d1b/f24 64611 1 2024-04-26T20:18:41.069 INFO:tasks.workunit.client.0.smithi016.stdout:2/222: creat d1d/d20/d22/d39/d3e/f47 x:0 0 0 2024-04-26T20:18:41.069 INFO:tasks.workunit.client.0.smithi016.stdout:2/223: stat f1b 0 2024-04-26T20:18:41.074 INFO:tasks.workunit.client.0.smithi016.stdout:2/224: symlink d1d/l48 0 2024-04-26T20:18:41.075 INFO:tasks.workunit.client.0.smithi016.stdout:2/225: mkdir d1d/d27/d49 0 2024-04-26T20:18:41.077 INFO:tasks.workunit.client.0.smithi016.stdout:4/193: write d0/d1e/f21 [3890164,88105] 0 2024-04-26T20:18:41.079 INFO:tasks.workunit.client.0.smithi016.stdout:4/194: symlink d0/d1e/l44 0 2024-04-26T20:18:41.082 INFO:tasks.workunit.client.0.smithi016.stdout:4/195: creat d0/dd/d19/d1f/f45 x:0 0 0 2024-04-26T20:18:41.082 INFO:tasks.workunit.client.0.smithi016.stdout:4/196: truncate d0/dd/d19/d1f/f3e 991261 0 2024-04-26T20:18:41.082 INFO:tasks.workunit.client.0.smithi016.stdout:0/211: write d2/dc/d18/f29 [2648098,40363] 0 2024-04-26T20:18:41.083 INFO:tasks.workunit.client.0.smithi016.stdout:4/197: creat d0/f46 x:0 0 0 2024-04-26T20:18:41.085 INFO:tasks.workunit.client.0.smithi016.stdout:4/198: symlink d0/dd/d1b/l47 0 2024-04-26T20:18:41.086 INFO:tasks.workunit.client.0.smithi016.stdout:4/199: getdents d0/d1e/d41 0 2024-04-26T20:18:41.087 INFO:tasks.workunit.client.0.smithi016.stdout:4/200: dread - d0/dd/f3b zero size 2024-04-26T20:18:41.088 INFO:tasks.workunit.client.0.smithi016.stdout:4/201: creat d0/dd/d1b/f48 x:0 0 0 2024-04-26T20:18:41.088 INFO:tasks.workunit.client.0.smithi016.stdout:4/202: write d0/dd/d19/d1f/f45 [915368,47531] 0 2024-04-26T20:18:41.089 INFO:tasks.workunit.client.0.smithi016.stdout:4/203: write d0/dd/f3b [298616,29790] 0 2024-04-26T20:18:41.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/204: rmdir d0/dd/d19 39 2024-04-26T20:18:41.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/205: chown d0/dd/l13 329 1 2024-04-26T20:18:41.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/206: chown d0/dd/f2c 47891 1 2024-04-26T20:18:41.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/207: fdatasync d0/d1e/f2f 0 2024-04-26T20:18:41.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/208: chown d0/d1e/d41/d43 16144 1 2024-04-26T20:18:41.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/209: fdatasync d0/dd/f2c 0 2024-04-26T20:18:41.093 INFO:tasks.workunit.client.0.smithi016.stdout:5/408: dwrite d1/d9/d11/f18 [4194304,4194304] 0 2024-04-26T20:18:41.093 INFO:tasks.workunit.client.0.smithi016.stdout:5/409: readlink d1/d9/l2d 0 2024-04-26T20:18:41.101 INFO:tasks.workunit.client.0.smithi016.stdout:9/253: dread d1/d1b/f26 [0,4194304] 0 2024-04-26T20:18:41.103 INFO:tasks.workunit.client.0.smithi016.stdout:9/254: rmdir d1/d2/d43 39 2024-04-26T20:18:41.106 INFO:tasks.workunit.client.0.smithi016.stdout:9/255: symlink d1/d2/l4e 0 2024-04-26T20:18:41.116 INFO:tasks.workunit.client.0.smithi016.stdout:8/195: dread d9/d19/f1e [0,4194304] 0 2024-04-26T20:18:41.116 INFO:tasks.workunit.client.0.smithi016.stdout:9/256: dread d1/d2e/f9 [0,4194304] 0 2024-04-26T20:18:41.116 INFO:tasks.workunit.client.0.smithi016.stdout:6/178: dread d1/fd [0,4194304] 0 2024-04-26T20:18:41.116 INFO:tasks.workunit.client.0.smithi016.stdout:6/179: dread - d1/d21/d26/d1c/f3c zero size 2024-04-26T20:18:41.116 INFO:tasks.workunit.client.0.smithi016.stdout:6/180: rename d1 to d1/d8/d2c/d3f 22 2024-04-26T20:18:41.120 INFO:tasks.workunit.client.0.smithi016.stdout:2/226: dwrite f1c [0,4194304] 0 2024-04-26T20:18:41.123 INFO:tasks.workunit.client.0.smithi016.stdout:8/196: unlink d9/f15 0 2024-04-26T20:18:41.124 INFO:tasks.workunit.client.0.smithi016.stdout:9/257: link d1/d2e/c48 d1/d2/d20/d49/c4f 0 2024-04-26T20:18:41.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/197: unlink d9/d19/f1e 0 2024-04-26T20:18:41.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/198: write f5 [18552,67008] 0 2024-04-26T20:18:41.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/199: truncate d9/f16 2243394 0 2024-04-26T20:18:41.130 INFO:tasks.workunit.client.0.smithi016.stdout:9/258: rename d1/d2/d4c to d1/d29/d50 0 2024-04-26T20:18:41.131 INFO:tasks.workunit.client.0.smithi016.stdout:9/259: readlink d1/d1b/l37 0 2024-04-26T20:18:41.131 INFO:tasks.workunit.client.0.smithi016.stdout:9/260: fsync d1/d2/d20/f1f 0 2024-04-26T20:18:41.131 INFO:tasks.workunit.client.0.smithi016.stdout:9/261: stat d1/d29/d2a/l34 0 2024-04-26T20:18:41.131 INFO:tasks.workunit.client.0.smithi016.stdout:9/262: chown d1/d29/d2a/d33/f4a 712 1 2024-04-26T20:18:41.132 INFO:tasks.workunit.client.0.smithi016.stdout:9/263: symlink d1/d2/d20/d49/l51 0 2024-04-26T20:18:41.132 INFO:tasks.workunit.client.0.smithi016.stdout:9/264: chown d1/d2/d20/f1f 189821 1 2024-04-26T20:18:41.132 INFO:tasks.workunit.client.0.smithi016.stdout:9/265: write d1/d1b/f26 [2075542,76137] 0 2024-04-26T20:18:41.142 INFO:tasks.workunit.client.0.smithi016.stdout:1/340: dwrite d3/d5/f43 [4194304,4194304] 0 2024-04-26T20:18:41.145 INFO:tasks.workunit.client.0.smithi016.stdout:1/341: creat d3/d5/da/d66/f68 x:0 0 0 2024-04-26T20:18:41.148 INFO:tasks.workunit.client.0.smithi016.stdout:9/266: rename d1/d29/d50 to d1/d2/d20/d13/d52 0 2024-04-26T20:18:41.148 INFO:tasks.workunit.client.0.smithi016.stdout:2/227: dread f12 [0,4194304] 0 2024-04-26T20:18:41.149 INFO:tasks.workunit.client.0.smithi016.stdout:1/342: rename d3/d5/d6/d9/d49/f4c to d3/d5/d6/d50/d58/f69 0 2024-04-26T20:18:41.150 INFO:tasks.workunit.client.0.smithi016.stdout:1/343: write d3/d5/f43 [1837219,96572] 0 2024-04-26T20:18:41.150 INFO:tasks.workunit.client.0.smithi016.stdout:1/344: write d3/d5/da/fc [2642816,4048] 0 2024-04-26T20:18:41.150 INFO:tasks.workunit.client.0.smithi016.stdout:1/345: fdatasync d3/d5/d6/d5a/f4a 0 2024-04-26T20:18:41.150 INFO:tasks.workunit.client.0.smithi016.stdout:9/267: truncate d1/d1b/f24 3540975 0 2024-04-26T20:18:41.153 INFO:tasks.workunit.client.0.smithi016.stdout:8/200: write d9/d23/d26/f2e [4159876,66263] 0 2024-04-26T20:18:41.163 INFO:tasks.workunit.client.0.smithi016.stdout:6/181: dwrite d1/fa [0,4194304] 0 2024-04-26T20:18:41.168 INFO:tasks.workunit.client.0.smithi016.stdout:2/228: rename f4 to d1d/d2a/f4a 0 2024-04-26T20:18:41.169 INFO:tasks.workunit.client.0.smithi016.stdout:1/346: dread d3/d57/f1a [0,4194304] 0 2024-04-26T20:18:41.171 INFO:tasks.workunit.client.0.smithi016.stdout:6/182: symlink d1/d8/d3b/l40 0 2024-04-26T20:18:41.171 INFO:tasks.workunit.client.0.smithi016.stdout:6/183: chown d1/d21/d26/l1d 12732579 1 2024-04-26T20:18:41.172 INFO:tasks.workunit.client.0.smithi016.stdout:2/229: mknod d1d/d20/d22/d39/c4b 0 2024-04-26T20:18:41.174 INFO:tasks.workunit.client.0.smithi016.stdout:1/347: creat d3/d5/d6/d9/d49/f6a x:0 0 0 2024-04-26T20:18:41.174 INFO:tasks.workunit.client.0.smithi016.stdout:1/348: write d3/d5/da/f30 [1044399,127570] 0 2024-04-26T20:18:41.175 INFO:tasks.workunit.client.0.smithi016.stdout:2/230: creat d1d/d27/d2d/f4c x:0 0 0 2024-04-26T20:18:41.191 INFO:tasks.workunit.client.0.smithi016.stdout:2/231: write d1d/d27/d2d/f44 [6404,94060] 0 2024-04-26T20:18:41.192 INFO:tasks.workunit.client.0.smithi016.stdout:2/232: write d1d/d20/d22/d29/f32 [518700,85005] 0 2024-04-26T20:18:41.193 INFO:tasks.workunit.client.0.smithi016.stdout:9/268: dwrite d1/d2/f6 [0,4194304] 0 2024-04-26T20:18:41.194 INFO:tasks.workunit.client.0.smithi016.stdout:1/349: creat d3/d5/d6/d9/d49/f6b x:0 0 0 2024-04-26T20:18:41.194 INFO:tasks.workunit.client.0.smithi016.stdout:1/350: stat d3/d5/da/f46 0 2024-04-26T20:18:41.195 INFO:tasks.workunit.client.0.smithi016.stdout:2/233: getdents d1d/d20/d22/d39/d3e 0 2024-04-26T20:18:41.198 INFO:tasks.workunit.client.0.smithi016.stdout:9/269: truncate d1/d2e/f9 495057 0 2024-04-26T20:18:41.198 INFO:tasks.workunit.client.0.smithi016.stdout:1/351: truncate d3/d5/d6/d50/d58/f69 614311 0 2024-04-26T20:18:41.198 INFO:tasks.workunit.client.0.smithi016.stdout:1/352: readlink d3/d5/d6/l3a 0 2024-04-26T20:18:41.198 INFO:tasks.workunit.client.0.smithi016.stdout:1/353: write d3/d5/da/f46 [4592037,66287] 0 2024-04-26T20:18:41.199 INFO:tasks.workunit.client.0.smithi016.stdout:6/184: read d1/f4 [240181,1317] 0 2024-04-26T20:18:41.204 INFO:tasks.workunit.client.0.smithi016.stdout:2/234: creat d1d/d27/d49/f4d x:0 0 0 2024-04-26T20:18:41.204 INFO:tasks.workunit.client.0.smithi016.stdout:2/235: dread - d1d/d27/d49/f4d zero size 2024-04-26T20:18:41.204 INFO:tasks.workunit.client.0.smithi016.stdout:9/270: creat d1/d29/d2a/d33/d44/f53 x:0 0 0 2024-04-26T20:18:41.204 INFO:tasks.workunit.client.0.smithi016.stdout:1/354: symlink d3/d5/d6/d50/d58/l6c 0 2024-04-26T20:18:41.212 INFO:tasks.workunit.client.0.smithi016.stdout:8/201: dwrite d9/fb [0,4194304] 0 2024-04-26T20:18:41.215 INFO:tasks.workunit.client.0.smithi016.stdout:6/185: link d1/d21/d26/d25/f35 d1/d8/d2c/f41 0 2024-04-26T20:18:41.218 INFO:tasks.workunit.client.0.smithi016.stdout:2/236: mknod d1d/d2a/c4e 0 2024-04-26T20:18:41.224 INFO:tasks.workunit.client.0.smithi016.stdout:6/186: link d1/fd d1/d8/d2c/f42 0 2024-04-26T20:18:41.225 INFO:tasks.workunit.client.0.smithi016.stdout:2/237: symlink d1d/d20/l4f 0 2024-04-26T20:18:41.228 INFO:tasks.workunit.client.0.smithi016.stdout:9/271: dread d1/d2e/fb [0,4194304] 0 2024-04-26T20:18:41.228 INFO:tasks.workunit.client.0.smithi016.stdout:6/187: mknod d1/d12/c43 0 2024-04-26T20:18:41.232 INFO:tasks.workunit.client.0.smithi016.stdout:2/238: creat d1d/d27/f50 x:0 0 0 2024-04-26T20:18:41.234 INFO:tasks.workunit.client.0.smithi016.stdout:9/272: creat d1/d29/d2a/d33/d44/f54 x:0 0 0 2024-04-26T20:18:41.234 INFO:tasks.workunit.client.0.smithi016.stdout:9/273: chown d1/d2e/fb 4740599 1 2024-04-26T20:18:41.234 INFO:tasks.workunit.client.0.smithi016.stdout:9/274: fdatasync d1/d2e/fb 0 2024-04-26T20:18:41.238 INFO:tasks.workunit.client.0.smithi016.stdout:1/355: read d3/d5/d6/f3c [5506656,36084] 0 2024-04-26T20:18:41.238 INFO:tasks.workunit.client.0.smithi016.stdout:1/356: fdatasync d3/d5/d6/d5a/f4a 0 2024-04-26T20:18:41.238 INFO:tasks.workunit.client.0.smithi016.stdout:1/357: stat d3/d5/f18 0 2024-04-26T20:18:41.242 INFO:tasks.workunit.client.0.smithi016.stdout:8/202: truncate d9/f16 312524 0 2024-04-26T20:18:41.244 INFO:tasks.workunit.client.0.smithi016.stdout:2/239: creat d1d/d2a/f51 x:0 0 0 2024-04-26T20:18:41.244 INFO:tasks.workunit.client.0.smithi016.stdout:2/240: chown d1d/d27/f3f 6320956 1 2024-04-26T20:18:41.245 INFO:tasks.workunit.client.0.smithi016.stdout:9/275: symlink d1/d2/l55 0 2024-04-26T20:18:41.245 INFO:tasks.workunit.client.0.smithi016.stdout:9/276: readlink d1/d2/d20/d13/l16 0 2024-04-26T20:18:41.245 INFO:tasks.workunit.client.0.smithi016.stdout:9/277: write d1/d1b/f26 [886374,29480] 0 2024-04-26T20:18:41.246 INFO:tasks.workunit.client.0.smithi016.stdout:9/278: write d1/d2e/f9 [540288,126229] 0 2024-04-26T20:18:41.246 INFO:tasks.workunit.client.0.smithi016.stdout:8/203: symlink d9/d23/d27/l40 0 2024-04-26T20:18:41.250 INFO:tasks.workunit.client.0.smithi016.stdout:1/358: dread d3/d5/f18 [0,4194304] 0 2024-04-26T20:18:41.254 INFO:tasks.workunit.client.0.smithi016.stdout:8/204: dread d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:41.259 INFO:tasks.workunit.client.0.smithi016.stdout:9/279: truncate d1/f8 3373306 0 2024-04-26T20:18:41.260 INFO:tasks.workunit.client.0.smithi016.stdout:2/241: write d1d/d2a/f4a [5798402,12840] 0 2024-04-26T20:18:41.271 INFO:tasks.workunit.client.0.smithi016.stdout:2/242: read f18 [249396,127610] 0 2024-04-26T20:18:41.273 INFO:tasks.workunit.client.0.smithi016.stdout:8/205: creat d9/d19/f41 x:0 0 0 2024-04-26T20:18:41.274 INFO:tasks.workunit.client.0.smithi016.stdout:2/243: mkdir d1d/d52 0 2024-04-26T20:18:41.275 INFO:tasks.workunit.client.0.smithi016.stdout:2/244: truncate d1d/d27/d49/f4d 1026289 0 2024-04-26T20:18:41.275 INFO:tasks.workunit.client.0.smithi016.stdout:2/245: readlink d1d/d20/l4f 0 2024-04-26T20:18:41.281 INFO:tasks.workunit.client.0.smithi016.stdout:1/359: dwrite d3/d5/d6/d9/f38 [0,4194304] 0 2024-04-26T20:18:41.288 INFO:tasks.workunit.client.0.smithi016.stdout:1/360: rmdir d3/d5/d6/d50 39 2024-04-26T20:18:41.288 INFO:tasks.workunit.client.0.smithi016.stdout:9/280: dwrite d1/d2/d20/f1f [0,4194304] 0 2024-04-26T20:18:41.290 INFO:tasks.workunit.client.0.smithi016.stdout:8/206: link d9/f11 d9/f42 0 2024-04-26T20:18:41.290 INFO:tasks.workunit.client.0.smithi016.stdout:8/207: chown d9/d23/d26/f2e 220629311 1 2024-04-26T20:18:41.291 INFO:tasks.workunit.client.0.smithi016.stdout:8/208: write d9/d19/f33 [157904,118016] 0 2024-04-26T20:18:41.291 INFO:tasks.workunit.client.0.smithi016.stdout:2/246: dread f7 [0,4194304] 0 2024-04-26T20:18:41.292 INFO:tasks.workunit.client.0.smithi016.stdout:8/209: read d9/f1b [108731,84522] 0 2024-04-26T20:18:41.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/361: creat d3/d57/f6d x:0 0 0 2024-04-26T20:18:41.294 INFO:tasks.workunit.client.0.smithi016.stdout:9/281: mknod d1/d29/d2a/d33/d44/c56 0 2024-04-26T20:18:41.296 INFO:tasks.workunit.client.0.smithi016.stdout:8/210: rename l6 to d9/d23/d27/d3f/l43 0 2024-04-26T20:18:41.297 INFO:tasks.workunit.client.0.smithi016.stdout:9/282: creat d1/d29/d2a/f57 x:0 0 0 2024-04-26T20:18:41.297 INFO:tasks.workunit.client.0.smithi016.stdout:9/283: write d1/d29/d2a/d33/f4a [1401992,102754] 0 2024-04-26T20:18:41.297 INFO:tasks.workunit.client.0.smithi016.stdout:9/284: chown d1/d29/d2a/d33/c36 5164 1 2024-04-26T20:18:41.298 INFO:tasks.workunit.client.0.smithi016.stdout:8/211: mkdir d9/d23/d44 0 2024-04-26T20:18:41.298 INFO:tasks.workunit.client.0.smithi016.stdout:8/212: truncate d9/d19/f34 4446617 0 2024-04-26T20:18:41.300 INFO:tasks.workunit.client.0.smithi016.stdout:9/285: truncate d1/f15 1520174 0 2024-04-26T20:18:41.301 INFO:tasks.workunit.client.0.smithi016.stdout:8/213: unlink d9/d23/d27/c29 0 2024-04-26T20:18:41.303 INFO:tasks.workunit.client.0.smithi016.stdout:2/247: dread fa [0,4194304] 0 2024-04-26T20:18:41.303 INFO:tasks.workunit.client.0.smithi016.stdout:9/286: creat d1/d1b/f58 x:0 0 0 2024-04-26T20:18:41.304 INFO:tasks.workunit.client.0.smithi016.stdout:1/362: dread d3/d5/da/f46 [0,4194304] 0 2024-04-26T20:18:41.306 INFO:tasks.workunit.client.0.smithi016.stdout:2/248: creat d1d/d27/f53 x:0 0 0 2024-04-26T20:18:41.311 INFO:tasks.workunit.client.0.smithi016.stdout:8/214: rename d9/d23/d27 to d9/d19/d45 0 2024-04-26T20:18:41.312 INFO:tasks.workunit.client.0.smithi016.stdout:1/363: creat d3/d57/f6e x:0 0 0 2024-04-26T20:18:41.314 INFO:tasks.workunit.client.0.smithi016.stdout:8/215: creat d9/d23/f46 x:0 0 0 2024-04-26T20:18:41.315 INFO:tasks.workunit.client.0.smithi016.stdout:1/364: mknod d3/d5/d6/d9/d49/c6f 0 2024-04-26T20:18:41.319 INFO:tasks.workunit.client.0.smithi016.stdout:8/216: mknod d9/d23/d26/c47 0 2024-04-26T20:18:41.319 INFO:tasks.workunit.client.0.smithi016.stdout:8/217: chown d9/d2f/c3d 70023 1 2024-04-26T20:18:41.322 INFO:tasks.workunit.client.0.smithi016.stdout:1/365: symlink d3/d5/d6/d9/d2a/d3b/l70 0 2024-04-26T20:18:41.322 INFO:tasks.workunit.client.0.smithi016.stdout:1/366: read - d3/d57/f6d zero size 2024-04-26T20:18:41.322 INFO:tasks.workunit.client.0.smithi016.stdout:1/367: chown d3/d5/d6/d5a/f3f 5878284 1 2024-04-26T20:18:41.328 INFO:tasks.workunit.client.0.smithi016.stdout:1/368: dread d3/d5/da/f30 [0,4194304] 0 2024-04-26T20:18:41.379 INFO:tasks.workunit.client.0.smithi016.stdout:1/369: dread d3/f4 [0,4194304] 0 2024-04-26T20:18:41.379 INFO:tasks.workunit.client.0.smithi016.stdout:2/249: dwrite d1d/d27/d2d/f4c [0,4194304] 0 2024-04-26T20:18:41.386 INFO:tasks.workunit.client.0.smithi016.stdout:1/370: rename d3/d5/d6/f3c to d3/d5/d6/d9/f71 0 2024-04-26T20:18:41.389 INFO:tasks.workunit.client.0.smithi016.stdout:2/250: mknod d1d/d20/d22/d39/c54 0 2024-04-26T20:18:41.393 INFO:tasks.workunit.client.0.smithi016.stdout:1/371: unlink d3/d57/l51 0 2024-04-26T20:18:41.406 INFO:tasks.workunit.client.0.smithi016.stdout:8/218: dwrite d9/f13 [0,4194304] 0 2024-04-26T20:18:41.407 INFO:tasks.workunit.client.0.smithi016.stdout:2/251: symlink d1d/d52/l55 0 2024-04-26T20:18:41.408 INFO:tasks.workunit.client.0.smithi016.stdout:8/219: creat d9/d19/d45/d3f/f48 x:0 0 0 2024-04-26T20:18:41.410 INFO:tasks.workunit.client.0.smithi016.stdout:2/252: unlink d1d/d27/d49/f4d 0 2024-04-26T20:18:41.411 INFO:tasks.workunit.client.0.smithi016.stdout:8/220: stat l2 0 2024-04-26T20:18:41.413 INFO:tasks.workunit.client.0.smithi016.stdout:2/253: link d1d/d2a/f51 d1d/d27/d49/f56 0 2024-04-26T20:18:41.413 INFO:tasks.workunit.client.0.smithi016.stdout:2/254: fdatasync d1d/d20/d22/d29/f32 0 2024-04-26T20:18:41.414 INFO:tasks.workunit.client.0.smithi016.stdout:8/221: mknod d9/d2f/c49 0 2024-04-26T20:18:41.414 INFO:tasks.workunit.client.0.smithi016.stdout:8/222: write d9/d19/f41 [581783,18596] 0 2024-04-26T20:18:41.415 INFO:tasks.workunit.client.0.smithi016.stdout:2/255: mknod d1d/d20/d22/d29/c57 0 2024-04-26T20:18:41.416 INFO:tasks.workunit.client.0.smithi016.stdout:2/256: mknod d1d/d20/d22/d29/c58 0 2024-04-26T20:18:41.418 INFO:tasks.workunit.client.0.smithi016.stdout:8/223: rename d9/c32 to d9/c4a 0 2024-04-26T20:18:41.418 INFO:tasks.workunit.client.0.smithi016.stdout:8/224: write d9/f1b [773072,4864] 0 2024-04-26T20:18:41.418 INFO:tasks.workunit.client.0.smithi016.stdout:8/225: truncate d9/d23/d26/f2a 1108481 0 2024-04-26T20:18:41.420 INFO:tasks.workunit.client.0.smithi016.stdout:2/257: rename d1d/d2a/d3d/l41 to d1d/d52/l59 0 2024-04-26T20:18:41.420 INFO:tasks.workunit.client.0.smithi016.stdout:2/258: write f11 [1348873,89451] 0 2024-04-26T20:18:41.421 INFO:tasks.workunit.client.0.smithi016.stdout:8/226: mknod d9/d23/d44/c4b 0 2024-04-26T20:18:41.462 INFO:tasks.workunit.client.0.smithi016.stdout:8/227: dwrite d9/f13 [0,4194304] 0 2024-04-26T20:18:41.472 INFO:tasks.workunit.client.0.smithi016.stdout:8/228: dread d9/f42 [0,4194304] 0 2024-04-26T20:18:41.473 INFO:tasks.workunit.client.0.smithi016.stdout:8/229: chown d9/l3a 1655 1 2024-04-26T20:18:41.473 INFO:tasks.workunit.client.0.smithi016.stdout:8/230: chown l3 180 1 2024-04-26T20:18:41.474 INFO:tasks.workunit.client.0.smithi016.stdout:2/259: mkdir d1d/d27/d2d/d5a 0 2024-04-26T20:18:41.475 INFO:tasks.workunit.client.0.smithi016.stdout:8/231: symlink d9/d19/d45/l4c 0 2024-04-26T20:18:41.490 INFO:tasks.workunit.client.0.smithi016.stdout:8/232: dread d9/f20 [0,4194304] 0 2024-04-26T20:18:41.490 INFO:tasks.workunit.client.0.smithi016.stdout:2/260: getdents d1d/d20 0 2024-04-26T20:18:41.492 INFO:tasks.workunit.client.0.smithi016.stdout:8/233: mkdir d9/d19/d45/d3f/d4d 0 2024-04-26T20:18:41.492 INFO:tasks.workunit.client.0.smithi016.stdout:2/261: mknod d1d/d27/d2d/d5a/c5b 0 2024-04-26T20:18:41.579 INFO:tasks.workunit.client.0.smithi016.stdout:8/234: symlink d9/d23/d44/l4e 0 2024-04-26T20:18:41.580 INFO:tasks.workunit.client.0.smithi016.stdout:7/260: sync 2024-04-26T20:18:41.586 INFO:tasks.workunit.client.0.smithi016.stdout:3/118: sync 2024-04-26T20:18:41.586 INFO:tasks.workunit.client.0.smithi016.stdout:0/212: sync 2024-04-26T20:18:41.586 INFO:tasks.workunit.client.0.smithi016.stdout:0/213: fsync d2/d20/f27 0 2024-04-26T20:18:41.586 INFO:tasks.workunit.client.0.smithi016.stdout:0/214: fdatasync d2/dc/f44 0 2024-04-26T20:18:41.587 INFO:tasks.workunit.client.0.smithi016.stdout:7/261: creat d0/f4c x:0 0 0 2024-04-26T20:18:41.587 INFO:tasks.workunit.client.0.smithi016.stdout:7/262: readlink d0/d1/d34/d25/l37 0 2024-04-26T20:18:41.588 INFO:tasks.workunit.client.0.smithi016.stdout:3/119: mknod d3/d9/c1f 0 2024-04-26T20:18:41.589 INFO:tasks.workunit.client.0.smithi016.stdout:0/215: symlink d2/dc/l47 0 2024-04-26T20:18:41.589 INFO:tasks.workunit.client.0.smithi016.stdout:7/263: creat d0/d1/d4b/f4d x:0 0 0 2024-04-26T20:18:41.590 INFO:tasks.workunit.client.0.smithi016.stdout:3/120: mkdir d3/df/d20 0 2024-04-26T20:18:41.591 INFO:tasks.workunit.client.0.smithi016.stdout:0/216: getdents d2/d40 0 2024-04-26T20:18:41.591 INFO:tasks.workunit.client.0.smithi016.stdout:7/264: getdents d0/d1/d34 0 2024-04-26T20:18:41.592 INFO:tasks.workunit.client.0.smithi016.stdout:3/121: creat d3/d9/d18/f21 x:0 0 0 2024-04-26T20:18:41.593 INFO:tasks.workunit.client.0.smithi016.stdout:0/217: creat d2/dc/d18/f48 x:0 0 0 2024-04-26T20:18:41.594 INFO:tasks.workunit.client.0.smithi016.stdout:7/265: symlink d0/l4e 0 2024-04-26T20:18:41.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/122: creat d3/d9/f22 x:0 0 0 2024-04-26T20:18:41.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/123: readlink d3/l1d 0 2024-04-26T20:18:41.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/124: readlink d3/l6 0 2024-04-26T20:18:41.708 INFO:tasks.workunit.client.0.smithi016.stdout:3/125: dwrite d3/d9/fb [0,4194304] 0 2024-04-26T20:18:41.709 INFO:tasks.workunit.client.0.smithi016.stdout:0/218: read - d2/d8/f11 zero size 2024-04-26T20:18:41.710 INFO:tasks.workunit.client.0.smithi016.stdout:7/266: symlink d0/d1/d34/l4f 0 2024-04-26T20:18:41.712 INFO:tasks.workunit.client.0.smithi016.stdout:3/126: rename d3/fd to d3/df/f23 0 2024-04-26T20:18:41.712 INFO:tasks.workunit.client.0.smithi016.stdout:3/127: truncate d3/d9/f17 5214693 0 2024-04-26T20:18:41.712 INFO:tasks.workunit.client.0.smithi016.stdout:3/128: dread - d3/f1b zero size 2024-04-26T20:18:41.713 INFO:tasks.workunit.client.0.smithi016.stdout:0/219: creat d2/d20/d41/f49 x:0 0 0 2024-04-26T20:18:41.714 INFO:tasks.workunit.client.0.smithi016.stdout:7/267: mkdir d0/d1/d34/d25/d50 0 2024-04-26T20:18:41.714 INFO:tasks.workunit.client.0.smithi016.stdout:7/268: chown d0/f17 535238840 1 2024-04-26T20:18:41.715 INFO:tasks.workunit.client.0.smithi016.stdout:3/129: mknod d3/df/d20/c24 0 2024-04-26T20:18:41.716 INFO:tasks.workunit.client.0.smithi016.stdout:0/220: link d2/d20/d41/c43 d2/dc/d1e/d35/c4a 0 2024-04-26T20:18:41.716 INFO:tasks.workunit.client.0.smithi016.stdout:0/221: dread - d2/dc/f1d zero size 2024-04-26T20:18:41.731 INFO:tasks.workunit.client.0.smithi016.stdout:0/222: dread d2/d8/f9 [0,4194304] 0 2024-04-26T20:18:41.732 INFO:tasks.workunit.client.0.smithi016.stdout:7/269: rmdir d0/d1/d6 39 2024-04-26T20:18:41.733 INFO:tasks.workunit.client.0.smithi016.stdout:3/130: mkdir d3/df/d25 0 2024-04-26T20:18:41.733 INFO:tasks.workunit.client.0.smithi016.stdout:3/131: chown d3/l6 1 1 2024-04-26T20:18:41.734 INFO:tasks.workunit.client.0.smithi016.stdout:3/132: write d3/f19 [330345,12333] 0 2024-04-26T20:18:41.734 INFO:tasks.workunit.client.0.smithi016.stdout:0/223: fsync d2/fb 0 2024-04-26T20:18:41.734 INFO:tasks.workunit.client.0.smithi016.stdout:0/224: truncate d2/d20/d41/f49 144865 0 2024-04-26T20:18:41.734 INFO:tasks.workunit.client.0.smithi016.stdout:7/270: mkdir d0/d51 0 2024-04-26T20:18:41.774 INFO:tasks.workunit.client.0.smithi016.stdout:0/225: dwrite d2/dc/f17 [0,4194304] 0 2024-04-26T20:18:41.774 INFO:tasks.workunit.client.0.smithi016.stdout:0/226: chown d2/d20/f27 529077527 1 2024-04-26T20:18:41.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/133: creat d3/df/f26 x:0 0 0 2024-04-26T20:18:41.820 INFO:tasks.workunit.client.0.smithi016.stdout:7/271: dwrite d0/f29 [0,4194304] 0 2024-04-26T20:18:41.820 INFO:tasks.workunit.client.0.smithi016.stdout:7/272: fsync d0/f38 0 2024-04-26T20:18:41.820 INFO:tasks.workunit.client.0.smithi016.stdout:0/227: truncate d2/d8/fe 61423 0 2024-04-26T20:18:41.829 INFO:tasks.workunit.client.0.smithi016.stdout:3/134: dwrite d3/df/f1e [0,4194304] 0 2024-04-26T20:18:41.829 INFO:tasks.workunit.client.0.smithi016.stdout:3/135: chown d3/l1d 20120 1 2024-04-26T20:18:41.829 INFO:tasks.workunit.client.0.smithi016.stdout:3/136: fsync d3/df/f13 0 2024-04-26T20:18:41.829 INFO:tasks.workunit.client.0.smithi016.stdout:3/137: getdents d3/df/d25 0 2024-04-26T20:18:41.829 INFO:tasks.workunit.client.0.smithi016.stdout:3/138: fdatasync d3/df/f23 0 2024-04-26T20:18:41.829 INFO:tasks.workunit.client.0.smithi016.stdout:3/139: dread - d3/d9/f22 zero size 2024-04-26T20:18:41.830 INFO:tasks.workunit.client.0.smithi016.stdout:3/140: write d3/d9/d18/f1c [973467,56243] 0 2024-04-26T20:18:41.830 INFO:tasks.workunit.client.0.smithi016.stdout:3/141: fdatasync d3/df/f1e 0 2024-04-26T20:18:41.830 INFO:tasks.workunit.client.0.smithi016.stdout:7/273: symlink d0/d1/d34/d3b/l52 0 2024-04-26T20:18:41.840 INFO:tasks.workunit.client.0.smithi016.stdout:0/228: write d2/dc/f17 [3155455,70456] 0 2024-04-26T20:18:41.840 INFO:tasks.workunit.client.0.smithi016.stdout:3/142: dread f0 [0,4194304] 0 2024-04-26T20:18:41.841 INFO:tasks.workunit.client.0.smithi016.stdout:7/274: creat d0/d1/d40/f53 x:0 0 0 2024-04-26T20:18:41.842 INFO:tasks.workunit.client.0.smithi016.stdout:0/229: mknod d2/dc/d18/c4b 0 2024-04-26T20:18:41.842 INFO:tasks.workunit.client.0.smithi016.stdout:3/143: truncate d3/df/f23 3246974 0 2024-04-26T20:18:41.915 INFO:tasks.workunit.client.0.smithi016.stdout:3/144: write d3/d9/d18/f1c [810799,34661] 0 2024-04-26T20:18:41.915 INFO:tasks.workunit.client.0.smithi016.stdout:7/275: rmdir d0/d1 39 2024-04-26T20:18:41.916 INFO:tasks.workunit.client.0.smithi016.stdout:3/145: creat d3/df/d20/f27 x:0 0 0 2024-04-26T20:18:41.917 INFO:tasks.workunit.client.0.smithi016.stdout:7/276: creat d0/d1/d34/d25/d50/f54 x:0 0 0 2024-04-26T20:18:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:5/410: sync 2024-04-26T20:18:41.922 INFO:tasks.workunit.client.0.smithi016.stdout:4/210: sync 2024-04-26T20:18:41.924 INFO:tasks.workunit.client.0.smithi016.stdout:3/146: creat d3/df/d25/f28 x:0 0 0 2024-04-26T20:18:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/211: unlink d0/dd/d19/l1d 0 2024-04-26T20:18:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/212: readlink d0/d1e/l44 0 2024-04-26T20:18:41.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/213: chown d0/dd/f2c 619012 1 2024-04-26T20:18:41.927 INFO:tasks.workunit.client.0.smithi016.stdout:3/147: link d3/df/d25/f28 d3/f29 0 2024-04-26T20:18:41.934 INFO:tasks.workunit.client.0.smithi016.stdout:0/230: dwrite d2/fb [0,4194304] 0 2024-04-26T20:18:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:5/411: dread d1/d9/d11/f34 [0,4194304] 0 2024-04-26T20:18:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:5/412: readlink d1/d9/d1c/l5b 0 2024-04-26T20:18:41.935 INFO:tasks.workunit.client.0.smithi016.stdout:3/148: mkdir d3/df/d25/d2a 0 2024-04-26T20:18:41.936 INFO:tasks.workunit.client.0.smithi016.stdout:0/231: truncate d2/d8/f36 649134 0 2024-04-26T20:18:41.937 INFO:tasks.workunit.client.0.smithi016.stdout:5/413: creat d1/d78/f80 x:0 0 0 2024-04-26T20:18:41.938 INFO:tasks.workunit.client.0.smithi016.stdout:0/232: mkdir d2/d20/d41/d4c 0 2024-04-26T20:18:41.939 INFO:tasks.workunit.client.0.smithi016.stdout:5/414: symlink d1/d7d/l81 0 2024-04-26T20:18:41.940 INFO:tasks.workunit.client.0.smithi016.stdout:0/233: symlink d2/d8/l4d 0 2024-04-26T20:18:41.943 INFO:tasks.workunit.client.0.smithi016.stdout:5/415: mkdir d1/d9/d1c/d52/d74/d5f/d82 0 2024-04-26T20:18:41.949 INFO:tasks.workunit.client.0.smithi016.stdout:3/149: getdents d3 0 2024-04-26T20:18:41.949 INFO:tasks.workunit.client.0.smithi016.stdout:3/150: fsync d3/f7 0 2024-04-26T20:18:41.950 INFO:tasks.workunit.client.0.smithi016.stdout:0/234: mkdir d2/d20/d41/d4c/d4e 0 2024-04-26T20:18:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:3/151: creat d3/df/f2b x:0 0 0 2024-04-26T20:18:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:4/214: getdents d0/dd/d19 0 2024-04-26T20:18:41.951 INFO:tasks.workunit.client.0.smithi016.stdout:4/215: dread - d0/f46 zero size 2024-04-26T20:18:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:3/152: mknod d3/df/d25/d2a/c2c 0 2024-04-26T20:18:41.955 INFO:tasks.workunit.client.0.smithi016.stdout:4/216: symlink d0/dd/d19/d1f/l49 0 2024-04-26T20:18:41.957 INFO:tasks.workunit.client.0.smithi016.stdout:0/235: creat d2/d20/d41/f4f x:0 0 0 2024-04-26T20:18:41.957 INFO:tasks.workunit.client.0.smithi016.stdout:0/236: stat d2/dc/c12 0 2024-04-26T20:18:41.960 INFO:tasks.workunit.client.0.smithi016.stdout:7/277: dwrite d0/d1/d40/f53 [0,4194304] 0 2024-04-26T20:18:41.961 INFO:tasks.workunit.client.0.smithi016.stdout:3/153: truncate d3/d9/f17 3582010 0 2024-04-26T20:18:41.962 INFO:tasks.workunit.client.0.smithi016.stdout:0/237: creat d2/d20/d41/f50 x:0 0 0 2024-04-26T20:18:41.962 INFO:tasks.workunit.client.0.smithi016.stdout:0/238: truncate d2/d8/d3b/f42 1022727 0 2024-04-26T20:18:41.973 INFO:tasks.workunit.client.0.smithi016.stdout:4/217: dread d0/fa [0,4194304] 0 2024-04-26T20:18:41.975 INFO:tasks.workunit.client.0.smithi016.stdout:7/278: dread d0/f14 [0,4194304] 0 2024-04-26T20:18:41.977 INFO:tasks.workunit.client.0.smithi016.stdout:3/154: unlink d3/df/d20/f27 0 2024-04-26T20:18:41.996 INFO:tasks.workunit.client.0.smithi016.stdout:7/279: dread d0/f17 [0,4194304] 0 2024-04-26T20:18:42.004 INFO:tasks.workunit.client.0.smithi016.stdout:5/416: dwrite d1/d9/d11/f18 [0,4194304] 0 2024-04-26T20:18:42.005 INFO:tasks.workunit.client.0.smithi016.stdout:0/239: mknod d2/d20/c51 0 2024-04-26T20:18:42.005 INFO:tasks.workunit.client.0.smithi016.stdout:0/240: truncate d2/d8/f11 375901 0 2024-04-26T20:18:42.008 INFO:tasks.workunit.client.0.smithi016.stdout:4/218: rename d0/dd/f2c to d0/d1e/d41/d43/f4a 0 2024-04-26T20:18:42.010 INFO:tasks.workunit.client.0.smithi016.stdout:0/241: mknod d2/dc/d18/d24/c52 0 2024-04-26T20:18:42.012 INFO:tasks.workunit.client.0.smithi016.stdout:7/280: rename d0/f38 to d0/d1/d34/d25/d3f/f55 0 2024-04-26T20:18:42.013 INFO:tasks.workunit.client.0.smithi016.stdout:4/219: rmdir d0/dd/d19 39 2024-04-26T20:18:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:0/242: mkdir d2/dc/d18/d24/d53 0 2024-04-26T20:18:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:0/243: dread - d2/dc/d1e/f38 zero size 2024-04-26T20:18:42.015 INFO:tasks.workunit.client.0.smithi016.stdout:7/281: symlink d0/l56 0 2024-04-26T20:18:42.016 INFO:tasks.workunit.client.0.smithi016.stdout:7/282: chown d0/d1/c12 107677 1 2024-04-26T20:18:42.016 INFO:tasks.workunit.client.0.smithi016.stdout:3/155: dwrite d3/d9/d18/f1c [0,4194304] 0 2024-04-26T20:18:42.018 INFO:tasks.workunit.client.0.smithi016.stdout:4/220: getdents d0/d1e 0 2024-04-26T20:18:42.020 INFO:tasks.workunit.client.0.smithi016.stdout:0/244: rename d2/d8/fe to d2/d20/d41/d4c/d4e/f54 0 2024-04-26T20:18:42.022 INFO:tasks.workunit.client.0.smithi016.stdout:4/221: creat d0/dd/d19/f4b x:0 0 0 2024-04-26T20:18:42.024 INFO:tasks.workunit.client.0.smithi016.stdout:0/245: link d2/fb d2/dc/d1e/d25/f55 0 2024-04-26T20:18:42.027 INFO:tasks.workunit.client.0.smithi016.stdout:7/283: dread d0/d1/f30 [0,4194304] 0 2024-04-26T20:18:42.027 INFO:tasks.workunit.client.0.smithi016.stdout:5/417: dread d1/f31 [0,4194304] 0 2024-04-26T20:18:42.028 INFO:tasks.workunit.client.0.smithi016.stdout:4/222: rename d0/d1e/f2f to d0/d1e/f4c 0 2024-04-26T20:18:42.029 INFO:tasks.workunit.client.0.smithi016.stdout:0/246: mknod d2/d8/d37/c56 0 2024-04-26T20:18:42.030 INFO:tasks.workunit.client.0.smithi016.stdout:6/188: sync 2024-04-26T20:18:42.030 INFO:tasks.workunit.client.0.smithi016.stdout:7/284: symlink d0/d1/d34/d3b/l57 0 2024-04-26T20:18:42.032 INFO:tasks.workunit.client.0.smithi016.stdout:4/223: creat d0/dd/d19/f4d x:0 0 0 2024-04-26T20:18:42.033 INFO:tasks.workunit.client.0.smithi016.stdout:0/247: rmdir d2/dc/d1e/d25 39 2024-04-26T20:18:42.034 INFO:tasks.workunit.client.0.smithi016.stdout:4/224: write d0/dd/d19/d1f/f3e [623420,111178] 0 2024-04-26T20:18:42.034 INFO:tasks.workunit.client.0.smithi016.stdout:4/225: write d0/dd/f12 [6076829,61578] 0 2024-04-26T20:18:42.034 INFO:tasks.workunit.client.0.smithi016.stdout:4/226: write d0/fa [4039244,102854] 0 2024-04-26T20:18:42.034 INFO:tasks.workunit.client.0.smithi016.stdout:4/227: fdatasync d0/dd/f25 0 2024-04-26T20:18:42.035 INFO:tasks.workunit.client.0.smithi016.stdout:6/189: mknod d1/d12/c44 0 2024-04-26T20:18:42.035 INFO:tasks.workunit.client.0.smithi016.stdout:6/190: write d1/d21/d26/f24 [871629,57374] 0 2024-04-26T20:18:42.035 INFO:tasks.workunit.client.0.smithi016.stdout:8/235: sync 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:8/236: read f8 [47184,45728] 0 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:8/237: stat d9/d19/f33 0 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:9/287: sync 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:8/238: write d9/d19/d45/d3f/f48 [499961,76953] 0 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:8/239: write f5 [331791,10569] 0 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:8/240: chown d9/d2f/c3d 135902098 1 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:7/285: getdents d0 0 2024-04-26T20:18:42.037 INFO:tasks.workunit.client.0.smithi016.stdout:7/286: chown d0/d1/d34/d3b 1 1 2024-04-26T20:18:42.039 INFO:tasks.workunit.client.0.smithi016.stdout:2/262: sync 2024-04-26T20:18:42.039 INFO:tasks.workunit.client.0.smithi016.stdout:1/372: sync 2024-04-26T20:18:42.039 INFO:tasks.workunit.client.0.smithi016.stdout:2/263: write d1d/d20/d22/d29/f38 [575047,78483] 0 2024-04-26T20:18:42.039 INFO:tasks.workunit.client.0.smithi016.stdout:2/264: fdatasync f12 0 2024-04-26T20:18:42.042 INFO:tasks.workunit.client.0.smithi016.stdout:4/228: rmdir d0/d1e/d41/d43 39 2024-04-26T20:18:42.043 INFO:tasks.workunit.client.0.smithi016.stdout:6/191: mkdir d1/d45 0 2024-04-26T20:18:42.052 INFO:tasks.workunit.client.0.smithi016.stdout:2/265: read d1d/d20/d22/d29/f38 [526523,20267] 0 2024-04-26T20:18:42.052 INFO:tasks.workunit.client.0.smithi016.stdout:2/266: write d1d/d27/f53 [484338,103349] 0 2024-04-26T20:18:42.052 INFO:tasks.workunit.client.0.smithi016.stdout:2/267: chown d1d/d2a/d3d 10770393 1 2024-04-26T20:18:42.053 INFO:tasks.workunit.client.0.smithi016.stdout:9/288: rename d1/d2/d20/d13 to d1/d59 0 2024-04-26T20:18:42.060 INFO:tasks.workunit.client.0.smithi016.stdout:0/248: write d2/dc/d1e/d25/f55 [3534798,33100] 0 2024-04-26T20:18:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:7/287: symlink d0/d1/d4b/l58 0 2024-04-26T20:18:42.064 INFO:tasks.workunit.client.0.smithi016.stdout:1/373: mknod d3/d5/d6/d9/d49/c72 0 2024-04-26T20:18:42.065 INFO:tasks.workunit.client.0.smithi016.stdout:4/229: mkdir d0/d1e/d4e 0 2024-04-26T20:18:42.066 INFO:tasks.workunit.client.0.smithi016.stdout:9/289: creat d1/d2e/d40/f5a x:0 0 0 2024-04-26T20:18:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/156: dwrite d3/f16 [0,4194304] 0 2024-04-26T20:18:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/157: chown d3/la 59 1 2024-04-26T20:18:42.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/158: fdatasync d3/df/f23 0 2024-04-26T20:18:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:0/249: mkdir d2/d20/d57 0 2024-04-26T20:18:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:1/374: truncate d3/d57/f1a 1746430 0 2024-04-26T20:18:42.069 INFO:tasks.workunit.client.0.smithi016.stdout:4/230: symlink d0/dd/d19/l4f 0 2024-04-26T20:18:42.070 INFO:tasks.workunit.client.0.smithi016.stdout:4/231: write d0/dd/f3b [932503,96103] 0 2024-04-26T20:18:42.073 INFO:tasks.workunit.client.0.smithi016.stdout:3/159: mkdir d3/d9/d2d 0 2024-04-26T20:18:42.074 INFO:tasks.workunit.client.0.smithi016.stdout:1/375: rmdir d3 39 2024-04-26T20:18:42.074 INFO:tasks.workunit.client.0.smithi016.stdout:1/376: dread - d3/d5/d6/d9/d49/f67 zero size 2024-04-26T20:18:42.075 INFO:tasks.workunit.client.0.smithi016.stdout:0/250: dread d2/dc/f1c [0,4194304] 0 2024-04-26T20:18:42.077 INFO:tasks.workunit.client.0.smithi016.stdout:4/232: getdents d0 0 2024-04-26T20:18:42.085 INFO:tasks.workunit.client.0.smithi016.stdout:3/160: rmdir d3 39 2024-04-26T20:18:42.088 INFO:tasks.workunit.client.0.smithi016.stdout:0/251: unlink d2/d20/c34 0 2024-04-26T20:18:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:9/290: dread d1/d2e/f17 [0,4194304] 0 2024-04-26T20:18:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:2/268: dwrite d1d/f1f [0,4194304] 0 2024-04-26T20:18:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:2/269: fsync f1c 0 2024-04-26T20:18:42.089 INFO:tasks.workunit.client.0.smithi016.stdout:9/291: write d1/d29/d2a/d33/d44/f53 [131618,89988] 0 2024-04-26T20:18:42.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/233: mknod d0/d1e/c50 0 2024-04-26T20:18:42.091 INFO:tasks.workunit.client.0.smithi016.stdout:5/418: dwrite d1/d9/d1c/d52/d74/f32 [0,4194304] 0 2024-04-26T20:18:42.094 INFO:tasks.workunit.client.0.smithi016.stdout:3/161: rmdir d3/d9/d18 39 2024-04-26T20:18:42.098 INFO:tasks.workunit.client.0.smithi016.stdout:2/270: getdents d1d/d27/d49 0 2024-04-26T20:18:42.100 INFO:tasks.workunit.client.0.smithi016.stdout:9/292: mknod d1/d29/c5b 0 2024-04-26T20:18:42.106 INFO:tasks.workunit.client.0.smithi016.stdout:5/419: rename d1/d9/d4b/c5c to d1/d9/d1c/d52/d74/d5f/d82/c83 0 2024-04-26T20:18:42.107 INFO:tasks.workunit.client.0.smithi016.stdout:3/162: mknod d3/df/d20/c2e 0 2024-04-26T20:18:42.107 INFO:tasks.workunit.client.0.smithi016.stdout:3/163: write d3/f7 [1734346,43013] 0 2024-04-26T20:18:42.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/293: creat d1/d29/d2a/d33/f5c x:0 0 0 2024-04-26T20:18:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:2/271: dread f13 [0,4194304] 0 2024-04-26T20:18:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:5/420: truncate d1/f1b 3441511 0 2024-04-26T20:18:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:2/272: fdatasync fe 0 2024-04-26T20:18:42.110 INFO:tasks.workunit.client.0.smithi016.stdout:5/421: readlink d1/l48 0 2024-04-26T20:18:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:5/422: read d1/d9/d1c/d52/d74/f4f [1785337,126970] 0 2024-04-26T20:18:42.111 INFO:tasks.workunit.client.0.smithi016.stdout:3/164: creat d3/df/f2f x:0 0 0 2024-04-26T20:18:42.112 INFO:tasks.workunit.client.0.smithi016.stdout:3/165: chown d3/df/d25/f28 8489 1 2024-04-26T20:18:42.117 INFO:tasks.workunit.client.0.smithi016.stdout:9/294: creat d1/d29/d2a/f5d x:0 0 0 2024-04-26T20:18:42.117 INFO:tasks.workunit.client.0.smithi016.stdout:2/273: creat d1d/d27/d49/f5c x:0 0 0 2024-04-26T20:18:42.118 INFO:tasks.workunit.client.0.smithi016.stdout:5/423: rmdir d1/d9/d11 39 2024-04-26T20:18:42.121 INFO:tasks.workunit.client.0.smithi016.stdout:3/166: symlink d3/df/d20/l30 0 2024-04-26T20:18:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:2/274: symlink d1d/d27/d49/l5d 0 2024-04-26T20:18:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:2/275: fdatasync d1d/d20/d22/f2e 0 2024-04-26T20:18:42.123 INFO:tasks.workunit.client.0.smithi016.stdout:2/276: write f18 [1683984,59340] 0 2024-04-26T20:18:42.124 INFO:tasks.workunit.client.0.smithi016.stdout:5/424: symlink d1/d9/d11/l84 0 2024-04-26T20:18:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:3/167: unlink d3/d9/f22 0 2024-04-26T20:18:42.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/277: creat d1d/d20/d22/d39/f5e x:0 0 0 2024-04-26T20:18:42.137 INFO:tasks.workunit.client.0.smithi016.stdout:5/425: unlink d1/d9/d25/c46 0 2024-04-26T20:18:42.137 INFO:tasks.workunit.client.0.smithi016.stdout:5/426: chown d1/d9/d11/d4d/f6d 42851985 1 2024-04-26T20:18:42.141 INFO:tasks.workunit.client.0.smithi016.stdout:3/168: truncate d3/f1b 662380 0 2024-04-26T20:18:42.142 INFO:tasks.workunit.client.0.smithi016.stdout:2/278: creat d1d/d52/f5f x:0 0 0 2024-04-26T20:18:42.144 INFO:tasks.workunit.client.0.smithi016.stdout:5/427: creat d1/d9/d4b/f85 x:0 0 0 2024-04-26T20:18:42.160 INFO:tasks.workunit.client.0.smithi016.stdout:2/279: dread f13 [0,4194304] 0 2024-04-26T20:18:42.160 INFO:tasks.workunit.client.0.smithi016.stdout:2/280: fsync d1d/d2a/f4a 0 2024-04-26T20:18:42.161 INFO:tasks.workunit.client.0.smithi016.stdout:3/169: getdents d3/df/d25 0 2024-04-26T20:18:42.162 INFO:tasks.workunit.client.0.smithi016.stdout:9/295: dwrite d1/f15 [0,4194304] 0 2024-04-26T20:18:42.163 INFO:tasks.workunit.client.0.smithi016.stdout:4/234: dwrite d0/d1e/d41/d43/f4a [4194304,4194304] 0 2024-04-26T20:18:42.166 INFO:tasks.workunit.client.0.smithi016.stdout:2/281: mknod d1d/d27/d2d/c60 0 2024-04-26T20:18:42.167 INFO:tasks.workunit.client.0.smithi016.stdout:9/296: mkdir d1/d29/d3e/d5e 0 2024-04-26T20:18:42.167 INFO:tasks.workunit.client.0.smithi016.stdout:9/297: read d1/d1b/f24 [1600026,1940] 0 2024-04-26T20:18:42.167 INFO:tasks.workunit.client.0.smithi016.stdout:9/298: write d1/d2/f6 [4658485,95771] 0 2024-04-26T20:18:42.168 INFO:tasks.workunit.client.0.smithi016.stdout:4/235: symlink d0/d1e/d41/l51 0 2024-04-26T20:18:42.168 INFO:tasks.workunit.client.0.smithi016.stdout:5/428: symlink d1/d9/d1c/l86 0 2024-04-26T20:18:42.173 INFO:tasks.workunit.client.0.smithi016.stdout:2/282: creat d1d/d52/f61 x:0 0 0 2024-04-26T20:18:42.181 INFO:tasks.workunit.client.0.smithi016.stdout:9/299: link d1/d2e/f17 d1/d2/f5f 0 2024-04-26T20:18:42.182 INFO:tasks.workunit.client.0.smithi016.stdout:5/429: truncate d1/d9/d1c/d52/d74/f32 3477033 0 2024-04-26T20:18:42.215 INFO:tasks.workunit.client.0.smithi016.stdout:4/236: dwrite d0/f11 [0,4194304] 0 2024-04-26T20:18:42.219 INFO:tasks.workunit.client.0.smithi016.stdout:9/300: link d1/d59/l18 d1/d2e/l60 0 2024-04-26T20:18:42.225 INFO:tasks.workunit.client.0.smithi016.stdout:5/430: link d1/l40 d1/d9/d25/l87 0 2024-04-26T20:18:42.225 INFO:tasks.workunit.client.0.smithi016.stdout:5/431: write d1/d9/d25/f54 [951834,58857] 0 2024-04-26T20:18:42.233 INFO:tasks.workunit.client.0.smithi016.stdout:4/237: mkdir d0/d1e/d4e/d52 0 2024-04-26T20:18:42.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/238: write d0/d1e/f4c [4383107,67613] 0 2024-04-26T20:18:42.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/239: write d0/f1 [456832,30470] 0 2024-04-26T20:18:42.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/240: write d0/fa [2182884,23850] 0 2024-04-26T20:18:42.235 INFO:tasks.workunit.client.0.smithi016.stdout:9/301: creat d1/d2/f61 x:0 0 0 2024-04-26T20:18:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:5/432: mkdir d1/d88 0 2024-04-26T20:18:42.237 INFO:tasks.workunit.client.0.smithi016.stdout:5/433: chown d1/d9/d25/f54 215277 1 2024-04-26T20:18:42.238 INFO:tasks.workunit.client.0.smithi016.stdout:4/241: symlink d0/dd/l53 0 2024-04-26T20:18:42.239 INFO:tasks.workunit.client.0.smithi016.stdout:9/302: unlink d1/d2e/l11 0 2024-04-26T20:18:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:5/434: creat d1/d7d/f89 x:0 0 0 2024-04-26T20:18:42.240 INFO:tasks.workunit.client.0.smithi016.stdout:5/435: fdatasync d1/d9/d4b/f39 0 2024-04-26T20:18:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:2/283: dwrite d1d/d20/d22/d39/f5e [0,4194304] 0 2024-04-26T20:18:42.250 INFO:tasks.workunit.client.0.smithi016.stdout:2/284: truncate d1d/d20/d22/d29/f38 1147833 0 2024-04-26T20:18:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:4/242: mkdir d0/d1e/d4e/d52/d54 0 2024-04-26T20:18:42.251 INFO:tasks.workunit.client.0.smithi016.stdout:5/436: dread d1/d9/f49 [0,4194304] 0 2024-04-26T20:18:42.252 INFO:tasks.workunit.client.0.smithi016.stdout:9/303: creat d1/d2e/d40/f62 x:0 0 0 2024-04-26T20:18:42.255 INFO:tasks.workunit.client.0.smithi016.stdout:2/285: rename d1d/d20/d22/f33 to d1d/d20/d22/f62 0 2024-04-26T20:18:42.257 INFO:tasks.workunit.client.0.smithi016.stdout:5/437: unlink d1/d9/l53 0 2024-04-26T20:18:42.264 INFO:tasks.workunit.client.0.smithi016.stdout:9/304: fsync d1/d2e/d40/f62 0 2024-04-26T20:18:42.267 INFO:tasks.workunit.client.0.smithi016.stdout:2/286: truncate fa 5678214 0 2024-04-26T20:18:42.274 INFO:tasks.workunit.client.0.smithi016.stdout:5/438: read d1/f31 [1588808,39393] 0 2024-04-26T20:18:42.278 INFO:tasks.workunit.client.0.smithi016.stdout:9/305: rename d1/d2/d20/f1f to d1/d2e/f63 0 2024-04-26T20:18:42.287 INFO:tasks.workunit.client.0.smithi016.stdout:9/306: dread d1/d1b/f26 [0,4194304] 0 2024-04-26T20:18:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:2/287: write f1b [3464000,2898] 0 2024-04-26T20:18:42.293 INFO:tasks.workunit.client.0.smithi016.stdout:2/288: chown c16 969 1 2024-04-26T20:18:42.294 INFO:tasks.workunit.client.0.smithi016.stdout:5/439: getdents d1/d9/d1c/d52/d74/d5f/d82 0 2024-04-26T20:18:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:9/307: creat d1/d59/f64 x:0 0 0 2024-04-26T20:18:42.295 INFO:tasks.workunit.client.0.smithi016.stdout:9/308: fsync d1/d2e/d40/f62 0 2024-04-26T20:18:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:2/289: mknod d1d/d20/d22/d39/c63 0 2024-04-26T20:18:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:2/290: write d1d/d27/d2d/f30 [164484,73657] 0 2024-04-26T20:18:42.297 INFO:tasks.workunit.client.0.smithi016.stdout:5/440: creat d1/f8a x:0 0 0 2024-04-26T20:18:42.298 INFO:tasks.workunit.client.0.smithi016.stdout:5/441: chown d1/d9/d11/c24 729629 1 2024-04-26T20:18:42.302 INFO:tasks.workunit.client.0.smithi016.stdout:4/243: dwrite d0/fa [0,4194304] 0 2024-04-26T20:18:42.381 INFO:tasks.workunit.client.0.smithi016.stdout:8/241: dwrite d9/d19/f34 [0,4194304] 0 2024-04-26T20:18:42.381 INFO:tasks.workunit.client.0.smithi016.stdout:6/192: dwrite d1/d21/d26/d25/f36 [0,4194304] 0 2024-04-26T20:18:42.388 INFO:tasks.workunit.client.0.smithi016.stdout:2/291: creat d1d/d20/d22/f64 x:0 0 0 2024-04-26T20:18:42.390 INFO:tasks.workunit.client.0.smithi016.stdout:8/242: truncate d9/d23/d26/f2a 4470 0 2024-04-26T20:18:42.392 INFO:tasks.workunit.client.0.smithi016.stdout:9/309: rename d1/d59/f64 to d1/d29/d2a/d33/d44/f65 0 2024-04-26T20:18:42.400 INFO:tasks.workunit.client.0.smithi016.stdout:2/292: symlink d1d/d2a/d3b/l65 0 2024-04-26T20:18:42.400 INFO:tasks.workunit.client.0.smithi016.stdout:2/293: chown d1d/d2a/f51 36 1 2024-04-26T20:18:42.400 INFO:tasks.workunit.client.0.smithi016.stdout:5/442: dwrite d1/f1f [0,4194304] 0 2024-04-26T20:18:42.401 INFO:tasks.workunit.client.0.smithi016.stdout:8/243: getdents d9/d23/d26 0 2024-04-26T20:18:42.401 INFO:tasks.workunit.client.0.smithi016.stdout:8/244: write f5 [1571666,64093] 0 2024-04-26T20:18:42.404 INFO:tasks.workunit.client.0.smithi016.stdout:9/310: mkdir d1/d66 0 2024-04-26T20:18:42.404 INFO:tasks.workunit.client.0.smithi016.stdout:9/311: dread - d1/d29/d2a/f57 zero size 2024-04-26T20:18:42.408 INFO:tasks.workunit.client.0.smithi016.stdout:5/443: mknod d1/d78/c8b 0 2024-04-26T20:18:42.409 INFO:tasks.workunit.client.0.smithi016.stdout:5/444: write d1/f1b [1036561,37803] 0 2024-04-26T20:18:42.453 INFO:tasks.workunit.client.0.smithi016.stdout:0/252: read d2/d20/f27 [480368,32098] 0 2024-04-26T20:18:42.453 INFO:tasks.workunit.client.0.smithi016.stdout:2/294: dwrite f7 [4194304,4194304] 0 2024-04-26T20:18:42.457 INFO:tasks.workunit.client.0.smithi016.stdout:5/445: unlink d1/d9/d1c/d52/d74/fd 0 2024-04-26T20:18:42.457 INFO:tasks.workunit.client.0.smithi016.stdout:2/295: symlink d1d/l66 0 2024-04-26T20:18:42.469 INFO:tasks.workunit.client.0.smithi016.stdout:9/312: dwrite d1/d2e/d40/f62 [0,4194304] 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:7/288: dwrite d0/d1/d6/f1c [0,4194304] 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:4/244: dwrite d0/d1e/f4c [0,4194304] 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:6/193: write d1/d21/d26/d25/f36 [1498245,23159] 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:8/245: dwrite d9/d23/f3c [0,4194304] 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:0/253: dread d2/dc/d1e/f1f [0,4194304] 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:0/254: chown d2/d20/l23 3026 1 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:0/255: read d2/dc/d1e/f1f [1190839,124838] 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:0/256: fdatasync d2/fb 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:2/296: rename d1d/d52/l55 to d1d/d20/d22/d39/d3e/l67 0 2024-04-26T20:18:42.474 INFO:tasks.workunit.client.0.smithi016.stdout:2/297: fsync d1d/d20/f42 0 2024-04-26T20:18:42.476 INFO:tasks.workunit.client.0.smithi016.stdout:9/313: mknod d1/d2/c67 0 2024-04-26T20:18:42.476 INFO:tasks.workunit.client.0.smithi016.stdout:7/289: rename d0/f28 to d0/f59 0 2024-04-26T20:18:42.476 INFO:tasks.workunit.client.0.smithi016.stdout:7/290: chown d0/f27 8430002 1 2024-04-26T20:18:42.478 INFO:tasks.workunit.client.0.smithi016.stdout:2/298: dread d1d/d27/f53 [0,4194304] 0 2024-04-26T20:18:42.491 INFO:tasks.workunit.client.0.smithi016.stdout:4/245: write d0/f15 [233435,129302] 0 2024-04-26T20:18:42.491 INFO:tasks.workunit.client.0.smithi016.stdout:8/246: getdents d9/d19 0 2024-04-26T20:18:42.491 INFO:tasks.workunit.client.0.smithi016.stdout:0/257: rmdir d2/d20/d41 39 2024-04-26T20:18:42.491 INFO:tasks.workunit.client.0.smithi016.stdout:0/258: rename d2 to d2/dc/d1e/d58 22 2024-04-26T20:18:42.494 INFO:tasks.workunit.client.0.smithi016.stdout:5/446: dread d1/d9/f10 [0,4194304] 0 2024-04-26T20:18:42.495 INFO:tasks.workunit.client.0.smithi016.stdout:2/299: truncate d1d/d20/d22/d39/f5e 888088 0 2024-04-26T20:18:42.495 INFO:tasks.workunit.client.0.smithi016.stdout:7/291: dread d0/fc [0,4194304] 0 2024-04-26T20:18:42.496 INFO:tasks.workunit.client.0.smithi016.stdout:6/194: mkdir d1/d8/d46 0 2024-04-26T20:18:42.497 INFO:tasks.workunit.client.0.smithi016.stdout:4/246: creat d0/d1e/d4e/d52/d54/f55 x:0 0 0 2024-04-26T20:18:42.502 INFO:tasks.workunit.client.0.smithi016.stdout:2/300: symlink d1d/d27/d2d/l68 0 2024-04-26T20:18:42.502 INFO:tasks.workunit.client.0.smithi016.stdout:7/292: link d0/d1/d34/d25/d3f/f55 d0/d51/f5a 0 2024-04-26T20:18:42.502 INFO:tasks.workunit.client.0.smithi016.stdout:7/293: stat d0/d1/d40 0 2024-04-26T20:18:42.503 INFO:tasks.workunit.client.0.smithi016.stdout:6/195: mkdir d1/d8/d2c/d47 0 2024-04-26T20:18:42.504 INFO:tasks.workunit.client.0.smithi016.stdout:6/196: dread - d1/d21/f3e zero size 2024-04-26T20:18:42.504 INFO:tasks.workunit.client.0.smithi016.stdout:6/197: chown f0 748 1 2024-04-26T20:18:42.509 INFO:tasks.workunit.client.0.smithi016.stdout:4/247: link d0/dd/f12 d0/d1e/d41/d43/f56 0 2024-04-26T20:18:42.510 INFO:tasks.workunit.client.0.smithi016.stdout:2/301: dread d1d/d20/d22/d39/f45 [0,4194304] 0 2024-04-26T20:18:42.511 INFO:tasks.workunit.client.0.smithi016.stdout:0/259: rename d2/c30 to d2/dc/c59 0 2024-04-26T20:18:42.512 INFO:tasks.workunit.client.0.smithi016.stdout:5/447: symlink d1/d9/d1c/d52/d74/d5f/l8c 0 2024-04-26T20:18:42.513 INFO:tasks.workunit.client.0.smithi016.stdout:4/248: mkdir d0/dd/d19/d57 0 2024-04-26T20:18:42.513 INFO:tasks.workunit.client.0.smithi016.stdout:8/247: dread d9/d23/d26/f2b [0,4194304] 0 2024-04-26T20:18:42.513 INFO:tasks.workunit.client.0.smithi016.stdout:8/248: readlink d9/d2f/l3b 0 2024-04-26T20:18:42.514 INFO:tasks.workunit.client.0.smithi016.stdout:2/302: truncate d1d/f1f 1686812 0 2024-04-26T20:18:42.514 INFO:tasks.workunit.client.0.smithi016.stdout:2/303: write f18 [2515339,9233] 0 2024-04-26T20:18:42.514 INFO:tasks.workunit.client.0.smithi016.stdout:2/304: write d1d/d27/f3f [529068,17224] 0 2024-04-26T20:18:42.515 INFO:tasks.workunit.client.0.smithi016.stdout:0/260: mkdir d2/d8/d37/d5a 0 2024-04-26T20:18:42.518 INFO:tasks.workunit.client.0.smithi016.stdout:4/249: unlink d0/dd/d19/f4b 0 2024-04-26T20:18:42.518 INFO:tasks.workunit.client.0.smithi016.stdout:8/249: dread d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:42.518 INFO:tasks.workunit.client.0.smithi016.stdout:8/250: read d9/f25 [71497,33472] 0 2024-04-26T20:18:42.518 INFO:tasks.workunit.client.0.smithi016.stdout:6/198: dread d1/fd [0,4194304] 0 2024-04-26T20:18:42.520 INFO:tasks.workunit.client.0.smithi016.stdout:7/294: dread d0/f59 [0,4194304] 0 2024-04-26T20:18:42.521 INFO:tasks.workunit.client.0.smithi016.stdout:0/261: mkdir d2/dc/d18/d5b 0 2024-04-26T20:18:42.521 INFO:tasks.workunit.client.0.smithi016.stdout:0/262: fsync d2/d8/f36 0 2024-04-26T20:18:42.521 INFO:tasks.workunit.client.0.smithi016.stdout:8/251: symlink d9/d19/l4f 0 2024-04-26T20:18:42.522 INFO:tasks.workunit.client.0.smithi016.stdout:6/199: mkdir d1/d21/d48 0 2024-04-26T20:18:42.522 INFO:tasks.workunit.client.0.smithi016.stdout:6/200: write d1/d21/f39 [66108,27428] 0 2024-04-26T20:18:42.523 INFO:tasks.workunit.client.0.smithi016.stdout:7/295: truncate d0/f31 3875808 0 2024-04-26T20:18:42.523 INFO:tasks.workunit.client.0.smithi016.stdout:7/296: fdatasync d0/f14 0 2024-04-26T20:18:42.523 INFO:tasks.workunit.client.0.smithi016.stdout:7/297: fdatasync d0/d1/d46/f2e 0 2024-04-26T20:18:42.523 INFO:tasks.workunit.client.0.smithi016.stdout:7/298: chown d0/d1/d6/f3d 90 1 2024-04-26T20:18:42.525 INFO:tasks.workunit.client.0.smithi016.stdout:0/263: creat d2/d40/f5c x:0 0 0 2024-04-26T20:18:42.525 INFO:tasks.workunit.client.0.smithi016.stdout:8/252: mkdir d9/d23/d44/d50 0 2024-04-26T20:18:42.525 INFO:tasks.workunit.client.0.smithi016.stdout:8/253: chown d9/d19/l4f 17486802 1 2024-04-26T20:18:42.525 INFO:tasks.workunit.client.0.smithi016.stdout:0/264: write d2/d40/f5c [302959,33967] 0 2024-04-26T20:18:42.526 INFO:tasks.workunit.client.0.smithi016.stdout:7/299: symlink d0/d1/d34/d3b/l5b 0 2024-04-26T20:18:42.527 INFO:tasks.workunit.client.0.smithi016.stdout:8/254: mknod d9/d19/c51 0 2024-04-26T20:18:42.527 INFO:tasks.workunit.client.0.smithi016.stdout:8/255: truncate d9/d19/f33 704542 0 2024-04-26T20:18:42.528 INFO:tasks.workunit.client.0.smithi016.stdout:8/256: chown d9/d23/f46 1 1 2024-04-26T20:18:42.528 INFO:tasks.workunit.client.0.smithi016.stdout:8/257: chown d9/d23/d26/d2c/l37 29653501 1 2024-04-26T20:18:42.528 INFO:tasks.workunit.client.0.smithi016.stdout:8/258: chown d9/d23/f3c 298476 1 2024-04-26T20:18:42.528 INFO:tasks.workunit.client.0.smithi016.stdout:0/265: truncate d2/dc/d1e/d25/f28 2898021 0 2024-04-26T20:18:42.531 INFO:tasks.workunit.client.0.smithi016.stdout:7/300: unlink d0/f17 0 2024-04-26T20:18:42.531 INFO:tasks.workunit.client.0.smithi016.stdout:7/301: write d0/f4c [65103,81871] 0 2024-04-26T20:18:42.533 INFO:tasks.workunit.client.0.smithi016.stdout:8/259: unlink d9/f20 0 2024-04-26T20:18:42.537 INFO:tasks.workunit.client.0.smithi016.stdout:0/266: mkdir d2/d8/d37/d5d 0 2024-04-26T20:18:42.537 INFO:tasks.workunit.client.0.smithi016.stdout:3/170: sync 2024-04-26T20:18:42.538 INFO:tasks.workunit.client.0.smithi016.stdout:1/377: sync 2024-04-26T20:18:42.544 INFO:tasks.workunit.client.0.smithi016.stdout:8/260: mkdir d9/d19/d45/d3f/d4d/d52 0 2024-04-26T20:18:42.544 INFO:tasks.workunit.client.0.smithi016.stdout:3/171: unlink d3/d9/f17 0 2024-04-26T20:18:42.544 INFO:tasks.workunit.client.0.smithi016.stdout:3/172: write d3/df/f13 [364092,20574] 0 2024-04-26T20:18:42.545 INFO:tasks.workunit.client.0.smithi016.stdout:1/378: creat d3/d5/d6/d9/f73 x:0 0 0 2024-04-26T20:18:42.548 INFO:tasks.workunit.client.0.smithi016.stdout:8/261: creat d9/f53 x:0 0 0 2024-04-26T20:18:42.554 INFO:tasks.workunit.client.0.smithi016.stdout:7/302: write d0/d1/d40/f53 [1485037,91105] 0 2024-04-26T20:18:42.555 INFO:tasks.workunit.client.0.smithi016.stdout:3/173: rmdir d3/df/d25 39 2024-04-26T20:18:42.564 INFO:tasks.workunit.client.0.smithi016.stdout:7/303: mknod d0/d1/d34/c5c 0 2024-04-26T20:18:42.564 INFO:tasks.workunit.client.0.smithi016.stdout:7/304: chown d0/d1/d34/d25 792 1 2024-04-26T20:18:42.564 INFO:tasks.workunit.client.0.smithi016.stdout:1/379: dread d3/d5/d6/d5a/f3f [0,4194304] 0 2024-04-26T20:18:42.564 INFO:tasks.workunit.client.0.smithi016.stdout:1/380: chown d3/d5/d6/d50/d58/f69 694 1 2024-04-26T20:18:42.584 INFO:tasks.workunit.client.0.smithi016.stdout:3/174: symlink d3/l31 0 2024-04-26T20:18:42.585 INFO:tasks.workunit.client.0.smithi016.stdout:3/175: read d3/d9/f1a [83136,125861] 0 2024-04-26T20:18:42.586 INFO:tasks.workunit.client.0.smithi016.stdout:0/267: dwrite d2/d8/d3b/f42 [0,4194304] 0 2024-04-26T20:18:42.586 INFO:tasks.workunit.client.0.smithi016.stdout:0/268: chown d2/dc/d1e/f38 21 1 2024-04-26T20:18:42.586 INFO:tasks.workunit.client.0.smithi016.stdout:0/269: chown d2/dc/d18 184 1 2024-04-26T20:18:42.587 INFO:tasks.workunit.client.0.smithi016.stdout:3/176: mkdir d3/df/d25/d32 0 2024-04-26T20:18:42.599 INFO:tasks.workunit.client.0.smithi016.stdout:1/381: write d3/d5/da/f46 [4197971,17716] 0 2024-04-26T20:18:42.602 INFO:tasks.workunit.client.0.smithi016.stdout:0/270: creat d2/dc/d18/d5b/f5e x:0 0 0 2024-04-26T20:18:42.605 INFO:tasks.workunit.client.0.smithi016.stdout:7/305: dwrite d0/f14 [0,4194304] 0 2024-04-26T20:18:42.605 INFO:tasks.workunit.client.0.smithi016.stdout:7/306: readlink d0/d1/l23 0 2024-04-26T20:18:42.605 INFO:tasks.workunit.client.0.smithi016.stdout:7/307: chown d0/d1/c18 569 1 2024-04-26T20:18:42.608 INFO:tasks.workunit.client.0.smithi016.stdout:1/382: unlink d3/d5/d6/d4b/l56 0 2024-04-26T20:18:42.608 INFO:tasks.workunit.client.0.smithi016.stdout:1/383: truncate d3/d5/d6/d5a/f4a 312095 0 2024-04-26T20:18:42.654 INFO:tasks.workunit.client.0.smithi016.stdout:7/308: creat d0/d51/f5d x:0 0 0 2024-04-26T20:18:42.660 INFO:tasks.workunit.client.0.smithi016.stdout:8/262: dwrite d9/f1f [0,4194304] 0 2024-04-26T20:18:42.663 INFO:tasks.workunit.client.0.smithi016.stdout:7/309: creat d0/d1/f5e x:0 0 0 2024-04-26T20:18:42.701 INFO:tasks.workunit.client.0.smithi016.stdout:7/310: unlink d0/d1/d34/d25/f36 0 2024-04-26T20:18:42.701 INFO:tasks.workunit.client.0.smithi016.stdout:7/311: readlink d0/d1/l32 0 2024-04-26T20:18:42.703 INFO:tasks.workunit.client.0.smithi016.stdout:3/177: dwrite d3/d9/f1a [0,4194304] 0 2024-04-26T20:18:42.704 INFO:tasks.workunit.client.0.smithi016.stdout:5/448: dwrite d1/d9/f16 [0,4194304] 0 2024-04-26T20:18:42.706 INFO:tasks.workunit.client.0.smithi016.stdout:7/312: creat d0/d1/d34/d25/d3f/f5f x:0 0 0 2024-04-26T20:18:42.759 INFO:tasks.workunit.client.0.smithi016.stdout:1/384: dwrite d3/d5/d6/d9/f73 [0,4194304] 0 2024-04-26T20:18:42.761 INFO:tasks.workunit.client.0.smithi016.stdout:7/313: creat d0/d1/d34/d3b/f60 x:0 0 0 2024-04-26T20:18:42.761 INFO:tasks.workunit.client.0.smithi016.stdout:7/314: chown d0/d1/d34/d25 7273 1 2024-04-26T20:18:42.770 INFO:tasks.workunit.client.0.smithi016.stdout:5/449: dread d1/d9/d1c/d52/d74/f4f [0,4194304] 0 2024-04-26T20:18:42.772 INFO:tasks.workunit.client.0.smithi016.stdout:1/385: creat d3/d5/da/f74 x:0 0 0 2024-04-26T20:18:42.778 INFO:tasks.workunit.client.0.smithi016.stdout:5/450: read d1/d9/d4b/f6a [97510,43093] 0 2024-04-26T20:18:42.778 INFO:tasks.workunit.client.0.smithi016.stdout:8/263: dwrite d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:42.780 INFO:tasks.workunit.client.0.smithi016.stdout:1/386: rename d3/d5/d6/d9/d2a/f32 to d3/d5/d6/d9/d2a/f75 0 2024-04-26T20:18:42.815 INFO:tasks.workunit.client.0.smithi016.stdout:8/264: dwrite d9/fb [0,4194304] 0 2024-04-26T20:18:42.815 INFO:tasks.workunit.client.0.smithi016.stdout:5/451: fsync d1/d9/fc 0 2024-04-26T20:18:42.838 INFO:tasks.workunit.client.0.smithi016.stdout:3/178: dread d3/df/f23 [0,4194304] 0 2024-04-26T20:18:42.839 INFO:tasks.workunit.client.0.smithi016.stdout:3/179: fdatasync f0 0 2024-04-26T20:18:42.852 INFO:tasks.workunit.client.0.smithi016.stdout:0/271: dread d2/d8/f9 [0,4194304] 0 2024-04-26T20:18:42.852 INFO:tasks.workunit.client.0.smithi016.stdout:7/315: dwrite d0/d51/f5a [0,4194304] 0 2024-04-26T20:18:42.852 INFO:tasks.workunit.client.0.smithi016.stdout:4/250: dwrite d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:18:42.852 INFO:tasks.workunit.client.0.smithi016.stdout:7/316: write d0/d1/d34/d25/d3f/f5f [1026629,17590] 0 2024-04-26T20:18:42.853 INFO:tasks.workunit.client.0.smithi016.stdout:4/251: write d0/d1e/d41/d43/f4a [9114072,12696] 0 2024-04-26T20:18:42.853 INFO:tasks.workunit.client.0.smithi016.stdout:3/180: dread f0 [0,4194304] 0 2024-04-26T20:18:42.853 INFO:tasks.workunit.client.0.smithi016.stdout:7/317: write d0/d51/f5d [1038457,1533] 0 2024-04-26T20:18:42.854 INFO:tasks.workunit.client.0.smithi016.stdout:8/265: write d9/f18 [3470583,85501] 0 2024-04-26T20:18:42.854 INFO:tasks.workunit.client.0.smithi016.stdout:8/266: fdatasync d9/f1b 0 2024-04-26T20:18:42.855 INFO:tasks.workunit.client.0.smithi016.stdout:1/387: dwrite d3/d5/da/f29 [0,4194304] 0 2024-04-26T20:18:42.855 INFO:tasks.workunit.client.0.smithi016.stdout:5/452: rename d1/d9/f29 to d1/f8d 0 2024-04-26T20:18:42.858 INFO:tasks.workunit.client.0.smithi016.stdout:7/318: getdents d0/d1 0 2024-04-26T20:18:42.860 INFO:tasks.workunit.client.0.smithi016.stdout:3/181: symlink d3/df/d20/l33 0 2024-04-26T20:18:42.869 INFO:tasks.workunit.client.0.smithi016.stdout:1/388: dread d3/d5/f43 [4194304,4194304] 0 2024-04-26T20:18:42.889 INFO:tasks.workunit.client.0.smithi016.stdout:7/319: rename d0/l56 to d0/d1/d40/l61 0 2024-04-26T20:18:42.889 INFO:tasks.workunit.client.0.smithi016.stdout:7/320: fdatasync d0/f15 0 2024-04-26T20:18:42.889 INFO:tasks.workunit.client.0.smithi016.stdout:7/321: truncate d0/d51/f5d 1228109 0 2024-04-26T20:18:42.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/267: symlink d9/l54 0 2024-04-26T20:18:42.890 INFO:tasks.workunit.client.0.smithi016.stdout:3/182: creat d3/d9/d18/f34 x:0 0 0 2024-04-26T20:18:42.891 INFO:tasks.workunit.client.0.smithi016.stdout:1/389: rmdir d3/d5/d6/d9/d2a 39 2024-04-26T20:18:42.911 INFO:tasks.workunit.client.0.smithi016.stdout:3/183: write d3/f16 [2714593,101126] 0 2024-04-26T20:18:42.912 INFO:tasks.workunit.client.0.smithi016.stdout:7/322: truncate d0/f42 1055118 0 2024-04-26T20:18:42.920 INFO:tasks.workunit.client.0.smithi016.stdout:5/453: dwrite d1/d9/d1c/d52/d74/d5f/f6f [0,4194304] 0 2024-04-26T20:18:42.922 INFO:tasks.workunit.client.0.smithi016.stdout:3/184: mknod d3/df/d25/d2a/c35 0 2024-04-26T20:18:42.930 INFO:tasks.workunit.client.0.smithi016.stdout:3/185: mknod d3/df/d20/c36 0 2024-04-26T20:18:42.934 INFO:tasks.workunit.client.0.smithi016.stdout:7/323: read d0/f31 [2643443,70105] 0 2024-04-26T20:18:42.936 INFO:tasks.workunit.client.0.smithi016.stdout:7/324: unlink d0/f4c 0 2024-04-26T20:18:42.936 INFO:tasks.workunit.client.0.smithi016.stdout:7/325: dread - d0/d1/d34/d3b/f60 zero size 2024-04-26T20:18:42.947 INFO:tasks.workunit.client.0.smithi016.stdout:3/186: dread d3/d9/fb [0,4194304] 0 2024-04-26T20:18:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:3/187: symlink d3/d9/d18/l37 0 2024-04-26T20:18:42.950 INFO:tasks.workunit.client.0.smithi016.stdout:3/188: fsync d3/df/f2f 0 2024-04-26T20:18:42.955 INFO:tasks.workunit.client.0.smithi016.stdout:1/390: dwrite d3/d5/d6/d50/d58/f69 [0,4194304] 0 2024-04-26T20:18:42.956 INFO:tasks.workunit.client.0.smithi016.stdout:0/272: dwrite d2/d40/f5c [0,4194304] 0 2024-04-26T20:18:42.959 INFO:tasks.workunit.client.0.smithi016.stdout:1/391: rename d3/d5/d6/d9/d2a/d3d/f47 to d3/d5/d6/d9/d2a/f76 0 2024-04-26T20:18:42.959 INFO:tasks.workunit.client.0.smithi016.stdout:1/392: chown d3/d5/d6/c5f 38406 1 2024-04-26T20:18:42.961 INFO:tasks.workunit.client.0.smithi016.stdout:0/273: mknod d2/dc/d1e/d25/c5f 0 2024-04-26T20:18:42.963 INFO:tasks.workunit.client.0.smithi016.stdout:1/393: getdents d3/d5/d6/d50/d58 0 2024-04-26T20:18:42.963 INFO:tasks.workunit.client.0.smithi016.stdout:1/394: write d3/d5/da/d66/f68 [225956,45766] 0 2024-04-26T20:18:42.963 INFO:tasks.workunit.client.0.smithi016.stdout:0/274: truncate d2/fb 2388203 0 2024-04-26T20:18:42.972 INFO:tasks.workunit.client.0.smithi016.stdout:5/454: dwrite d1/d9/fc [8388608,4194304] 0 2024-04-26T20:18:42.976 INFO:tasks.workunit.client.0.smithi016.stdout:1/395: truncate d3/d5/da/f46 536936 0 2024-04-26T20:18:42.976 INFO:tasks.workunit.client.0.smithi016.stdout:1/396: stat d3/d5/d6/d9/d2a/d3b/c55 0 2024-04-26T20:18:42.976 INFO:tasks.workunit.client.0.smithi016.stdout:0/275: mkdir d2/d8/d37/d5d/d60 0 2024-04-26T20:18:42.976 INFO:tasks.workunit.client.0.smithi016.stdout:0/276: chown d2/dc/d18/c4b 9535 1 2024-04-26T20:18:42.978 INFO:tasks.workunit.client.0.smithi016.stdout:5/455: chown d1/d9/d11/d4d/f6d 8323 1 2024-04-26T20:18:42.979 INFO:tasks.workunit.client.0.smithi016.stdout:1/397: rmdir d3/d5/d6 39 2024-04-26T20:18:42.988 INFO:tasks.workunit.client.0.smithi016.stdout:4/252: dwrite d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:18:42.988 INFO:tasks.workunit.client.0.smithi016.stdout:1/398: link d3/d5/d6/d9/f38 d3/f77 0 2024-04-26T20:18:42.989 INFO:tasks.workunit.client.0.smithi016.stdout:5/456: symlink d1/d9/d11/l8e 0 2024-04-26T20:18:42.992 INFO:tasks.workunit.client.0.smithi016.stdout:1/399: rename d3/d5/d6/d4b to d3/d5/d6/d5a/d78 0 2024-04-26T20:18:42.994 INFO:tasks.workunit.client.0.smithi016.stdout:5/457: mkdir d1/d9/d4b/d8f 0 2024-04-26T20:18:42.996 INFO:tasks.workunit.client.0.smithi016.stdout:1/400: mkdir d3/d5/d6/d50/d79 0 2024-04-26T20:18:42.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/458: read d1/d9/f73 [2232653,29061] 0 2024-04-26T20:18:42.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/459: chown d1/d9/d11/d4d/d72 191 1 2024-04-26T20:18:43.001 INFO:tasks.workunit.client.0.smithi016.stdout:6/201: sync 2024-04-26T20:18:43.001 INFO:tasks.workunit.client.0.smithi016.stdout:9/314: sync 2024-04-26T20:18:43.001 INFO:tasks.workunit.client.0.smithi016.stdout:2/305: sync 2024-04-26T20:18:43.001 INFO:tasks.workunit.client.0.smithi016.stdout:2/306: write d1d/d27/f53 [1270648,22186] 0 2024-04-26T20:18:43.005 INFO:tasks.workunit.client.0.smithi016.stdout:1/401: unlink d3/d5/d6/f14 0 2024-04-26T20:18:43.011 INFO:tasks.workunit.client.0.smithi016.stdout:1/402: symlink d3/d5/da/l7a 0 2024-04-26T20:18:43.011 INFO:tasks.workunit.client.0.smithi016.stdout:1/403: dread - d3/d57/f6e zero size 2024-04-26T20:18:43.011 INFO:tasks.workunit.client.0.smithi016.stdout:1/404: chown d3/d5/da/f26 969184813 1 2024-04-26T20:18:43.013 INFO:tasks.workunit.client.0.smithi016.stdout:9/315: unlink d1/d29/d2a/f57 0 2024-04-26T20:18:43.013 INFO:tasks.workunit.client.0.smithi016.stdout:9/316: readlink d1/d59/l1d 0 2024-04-26T20:18:43.015 INFO:tasks.workunit.client.0.smithi016.stdout:5/460: mknod d1/d9/d25/c90 0 2024-04-26T20:18:43.020 INFO:tasks.workunit.client.0.smithi016.stdout:3/189: dwrite d3/f16 [0,4194304] 0 2024-04-26T20:18:43.020 INFO:tasks.workunit.client.0.smithi016.stdout:3/190: chown d3/d9/fb 119 1 2024-04-26T20:18:43.029 INFO:tasks.workunit.client.0.smithi016.stdout:6/202: rename d1/d8/c10 to d1/d45/c49 0 2024-04-26T20:18:43.029 INFO:tasks.workunit.client.0.smithi016.stdout:3/191: truncate d3/f7 1225770 0 2024-04-26T20:18:43.029 INFO:tasks.workunit.client.0.smithi016.stdout:3/192: write d3/f19 [820144,124636] 0 2024-04-26T20:18:43.033 INFO:tasks.workunit.client.0.smithi016.stdout:3/193: dread d3/df/f13 [0,4194304] 0 2024-04-26T20:18:43.033 INFO:tasks.workunit.client.0.smithi016.stdout:3/194: dread - d3/df/f26 zero size 2024-04-26T20:18:43.033 INFO:tasks.workunit.client.0.smithi016.stdout:3/195: fsync d3/df/f1e 0 2024-04-26T20:18:43.033 INFO:tasks.workunit.client.0.smithi016.stdout:0/277: write d2/d8/f9 [3852984,14193] 0 2024-04-26T20:18:43.033 INFO:tasks.workunit.client.0.smithi016.stdout:0/278: chown d2/d8/d3b 11 1 2024-04-26T20:18:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/279: chown d2/dc/l2a 3683 1 2024-04-26T20:18:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/280: chown d2/dc/f1c 1940 1 2024-04-26T20:18:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/281: chown d2/d20/d41/c43 28 1 2024-04-26T20:18:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/282: chown d2/d40 317 1 2024-04-26T20:18:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:3/196: write d3/df/f2b [161849,125325] 0 2024-04-26T20:18:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/283: write d2/dc/f1d [693497,58447] 0 2024-04-26T20:18:43.034 INFO:tasks.workunit.client.0.smithi016.stdout:3/197: write f2 [1418850,81495] 0 2024-04-26T20:18:43.035 INFO:tasks.workunit.client.0.smithi016.stdout:5/461: dread d1/d9/d1c/d52/d74/d5f/f6f [0,4194304] 0 2024-04-26T20:18:43.035 INFO:tasks.workunit.client.0.smithi016.stdout:5/462: write d1/f8a [824720,58427] 0 2024-04-26T20:18:43.044 INFO:tasks.workunit.client.0.smithi016.stdout:3/198: dread d3/d9/fb [0,4194304] 0 2024-04-26T20:18:43.045 INFO:tasks.workunit.client.0.smithi016.stdout:7/326: dread d0/d1/d34/d25/d3f/f55 [0,4194304] 0 2024-04-26T20:18:43.045 INFO:tasks.workunit.client.0.smithi016.stdout:8/268: dwrite d9/d23/f3c [0,4194304] 0 2024-04-26T20:18:43.045 INFO:tasks.workunit.client.0.smithi016.stdout:8/269: stat d9/d19/d45/l4c 0 2024-04-26T20:18:43.048 INFO:tasks.workunit.client.0.smithi016.stdout:1/405: read d3/d5/f33 [222733,38956] 0 2024-04-26T20:18:43.049 INFO:tasks.workunit.client.0.smithi016.stdout:8/270: dread d9/d19/f41 [0,4194304] 0 2024-04-26T20:18:43.058 INFO:tasks.workunit.client.0.smithi016.stdout:9/317: dread d1/d29/d2a/d33/f4a [0,4194304] 0 2024-04-26T20:18:43.058 INFO:tasks.workunit.client.0.smithi016.stdout:9/318: fsync d1/d1b/f24 0 2024-04-26T20:18:43.067 INFO:tasks.workunit.client.0.smithi016.stdout:0/284: dread d2/d20/f27 [0,4194304] 0 2024-04-26T20:18:43.072 INFO:tasks.workunit.client.0.smithi016.stdout:2/307: dwrite d1d/d20/d22/d39/f45 [0,4194304] 0 2024-04-26T20:18:43.075 INFO:tasks.workunit.client.0.smithi016.stdout:6/203: write f0 [4190042,106148] 0 2024-04-26T20:18:43.075 INFO:tasks.workunit.client.0.smithi016.stdout:6/204: write d1/d21/d26/d1c/f20 [730816,66050] 0 2024-04-26T20:18:43.153 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b34200640 1 Processor -- start 2024-04-26T20:18:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b34200640 1 -- start start 2024-04-26T20:18:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b34200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b34200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b2c0c9b30 0x7f7b2c070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b34200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0ce4d0 con 0x7f7b2c155ee0 2024-04-26T20:18:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b34200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c0730a0 con 0x7f7b2c0c9b30 2024-04-26T20:18:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b34200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c1562c0 con 0x7f7b2c073c40 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b30e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b32200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b2c0c9b30 0x7f7b2c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b30e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c06fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:33282/0 (socket says 172.21.15.16:33282) 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b30e00640 1 -- 172.21.15.16:0/1437912397 learned_addr learned my addr 172.21.15.16:0/1437912397 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.291+0000 7f7b32200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b2c0c9b30 0x7f7b2c070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:41676/0 (socket says 172.21.15.16:41676) 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.295+0000 7f7b30e00640 1 -- 172.21.15.16:0/1437912397 >> v2:172.21.15.192:3300/0 conn(0x7f7b2c0c9b30 msgr2=0x7f7b2c070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.295+0000 7f7b30e00640 1 --2- 172.21.15.16:0/1437912397 >> v2:172.21.15.192:3300/0 conn(0x7f7b2c0c9b30 0x7f7b2c070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.295+0000 7f7b30e00640 1 -- 172.21.15.16:0/1437912397 >> v1:172.21.15.192:6789/0 conn(0x7f7b2c155ee0 legacy=0x7f7b2c073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.295+0000 7f7b30e00640 1 -- 172.21.15.16:0/1437912397 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c15c740 con 0x7f7b2c073c40 2024-04-26T20:18:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.295+0000 7f7b32200640 1 --2- 172.21.15.16:0/1437912397 >> v2:172.21.15.192:3300/0 conn(0x7f7b2c0c9b30 0x7f7b2c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:18:43.298 INFO:tasks.workunit.client.0.smithi016.stdout:5/463: mknod d1/d9/d11/c91 0 2024-04-26T20:18:43.298 INFO:tasks.workunit.client.0.smithi016.stdout:3/199: getdents d3/df/d25/d2a 0 2024-04-26T20:18:43.298 INFO:tasks.workunit.client.0.smithi016.stdout:7/327: getdents d0/d1/d34/d3b 0 2024-04-26T20:18:43.299 INFO:tasks.workunit.client.0.smithi016.stdout:1/406: truncate d3/d5/d6/d9/f38 2569881 0 2024-04-26T20:18:43.299 INFO:tasks.workunit.client.0.smithi016.stdout:1/407: fsync d3/d5/da/f74 0 2024-04-26T20:18:43.299 INFO:tasks.workunit.client.0.smithi016.stdout:8/271: mknod d9/d19/c55 0 2024-04-26T20:18:43.299 INFO:tasks.workunit.client.0.smithi016.stdout:8/272: truncate d9/f53 366820 0 2024-04-26T20:18:43.300 INFO:tasks.workunit.client.0.smithi016.stdout:9/319: symlink d1/d66/l68 0 2024-04-26T20:18:43.301 INFO:tasks.workunit.client.0.smithi016.stdout:0/285: rename d2/d8/d37/d5a to d2/d40/d61 0 2024-04-26T20:18:43.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b30e00640 1 --2- 172.21.15.16:0/1437912397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c06fd40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009870 tx=0x7f7b1801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58123b34c9c97e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b2be00640 1 -- 172.21.15.16:0/1437912397 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b180a9620 con 0x7f7b2c073c40 2024-04-26T20:18:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b2be00640 1 -- 172.21.15.16:0/1437912397 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b180a97c0 con 0x7f7b2c073c40 2024-04-26T20:18:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b2be00640 1 -- 172.21.15.16:0/1437912397 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b180a9b90 con 0x7f7b2c073c40 2024-04-26T20:18:43.303 INFO:tasks.workunit.client.0.smithi016.stdout:2/308: creat d1d/d27/d49/f69 x:0 0 0 2024-04-26T20:18:43.304 INFO:tasks.workunit.client.0.smithi016.stdout:2/309: chown d1d/d2a/d3b/l65 257667749 1 2024-04-26T20:18:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b34200640 1 -- 172.21.15.16:0/1437912397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 msgr2=0x7f7b2c06fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b34200640 1 --2- 172.21.15.16:0/1437912397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c06fd40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009870 tx=0x7f7b1801c560 comp rx=0 tx=0).stop 2024-04-26T20:18:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b34200640 1 -- 172.21.15.16:0/1437912397 shutdown_connections 2024-04-26T20:18:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b34200640 1 --2- 172.21.15.16:0/1437912397 >> v2:172.21.15.192:3300/0 conn(0x7f7b2c0c9b30 0x7f7b2c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b34200640 1 --2- 172.21.15.16:0/1437912397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c06fd40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.299+0000 7f7b34200640 1 -- 172.21.15.16:0/1437912397 >> 172.21.15.16:0/1437912397 conn(0x7f7b2c0cd5e0 msgr2=0x7f7b2c0cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:43.305 INFO:tasks.workunit.client.0.smithi016.stdout:6/205: mknod d1/d21/d26/d1c/c4a 0 2024-04-26T20:18:43.305 INFO:tasks.workunit.client.0.smithi016.stdout:6/206: write d1/fa [5280406,62694] 0 2024-04-26T20:18:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.303+0000 7f7b34200640 1 -- 172.21.15.16:0/1437912397 shutdown_connections 2024-04-26T20:18:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.303+0000 7f7b34200640 1 -- 172.21.15.16:0/1437912397 wait complete. 2024-04-26T20:18:43.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.303+0000 7f7b34200640 1 Processor -- start 2024-04-26T20:18:43.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.303+0000 7f7b34200640 1 -- start start 2024-04-26T20:18:43.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b2c0c9b30 0x7f7b2c1f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c155ee0 0x7f7b2c06fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c168e50 con 0x7f7b2c155ee0 2024-04-26T20:18:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c168cd0 con 0x7f7b2c0c9b30 2024-04-26T20:18:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c168fd0 con 0x7f7b2c073c40 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c155ee0 0x7f7b2c06fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b31800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c155ee0 0x7f7b2c06fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39556/0 (socket says 172.21.15.16:39556) 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 -- 172.21.15.16:0/955507859 learned_addr learned my addr 172.21.15.16:0/955507859 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b30e00640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b2c0c9b30 0x7f7b2c1f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 -- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 msgr2=0x7f7b2c14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 -- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b2c0c9b30 msgr2=0x7f7b2c1f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b2c0c9b30 0x7f7b2c1f8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 -- 172.21.15.16:0/955507859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0c9600 con 0x7f7b2c155ee0 2024-04-26T20:18:43.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b32200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c155ee0 0x7f7b2c06fd90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400efc0 tx=0x7f7b2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:43.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b29600640 1 -- 172.21.15.16:0/955507859 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24018030 con 0x7f7b2c155ee0 2024-04-26T20:18:43.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b29600640 1 -- 172.21.15.16:0/955507859 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2400cdf0 con 0x7f7b2c155ee0 2024-04-26T20:18:43.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b29600640 1 -- 172.21.15.16:0/955507859 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24003bc0 con 0x7f7b2c155ee0 2024-04-26T20:18:43.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c151b00 con 0x7f7b2c155ee0 2024-04-26T20:18:43.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.307+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c1520c0 con 0x7f7b2c155ee0 2024-04-26T20:18:43.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.311+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c077c20 con 0x7f7b2c155ee0 2024-04-26T20:18:43.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.311+0000 7f7b29600640 1 -- 172.21.15.16:0/955507859 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b2401b070 con 0x7f7b2c155ee0 2024-04-26T20:18:43.318 INFO:tasks.workunit.client.0.smithi016.stdout:1/408: rmdir d3/d5/d6/d9/d2a/d3d 39 2024-04-26T20:18:43.319 INFO:tasks.workunit.client.0.smithi016.stdout:8/273: creat d9/d19/d45/f56 x:0 0 0 2024-04-26T20:18:43.319 INFO:tasks.workunit.client.0.smithi016.stdout:3/200: creat d3/df/d25/d32/f38 x:0 0 0 2024-04-26T20:18:43.319 INFO:tasks.workunit.client.0.smithi016.stdout:3/201: fsync d3/d9/f1a 0 2024-04-26T20:18:43.319 INFO:tasks.workunit.client.0.smithi016.stdout:3/202: chown d3/df/d25/d2a 663066 1 2024-04-26T20:18:43.319 INFO:tasks.workunit.client.0.smithi016.stdout:9/320: symlink d1/d2e/d40/l69 0 2024-04-26T20:18:43.319 INFO:tasks.workunit.client.0.smithi016.stdout:5/464: dread d1/d9/d11/f18 [0,4194304] 0 2024-04-26T20:18:43.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.315+0000 7f7b29600640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7b0c0683d0 0x7f7b0c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.315+0000 7f7b29600640 1 -- 172.21.15.16:0/955507859 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f7b24087620 con 0x7f7b2c155ee0 2024-04-26T20:18:43.321 INFO:tasks.workunit.client.0.smithi016.stdout:7/328: rename d0/d1/d34/d25/l37 to d0/d1/l62 0 2024-04-26T20:18:43.327 INFO:tasks.workunit.client.0.smithi016.stdout:6/207: symlink d1/d21/l4b 0 2024-04-26T20:18:43.327 INFO:tasks.workunit.client.0.smithi016.stdout:1/409: unlink d3/d5/d6/d9/d2a/d3b/d52/l65 0 2024-04-26T20:18:43.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.323+0000 7f7b31800640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7b0c0683d0 0x7f7b0c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.323+0000 7f7b29600640 1 -- 172.21.15.16:0/955507859 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7b24022070 con 0x7f7b2c155ee0 2024-04-26T20:18:43.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.323+0000 7f7b31800640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7b0c0683d0 0x7f7b0c06a890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7b20001810 tx=0x7f7b20009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:43.337 INFO:tasks.workunit.client.0.smithi016.stdout:8/274: creat d9/d19/d45/d3f/d4d/d52/f57 x:0 0 0 2024-04-26T20:18:43.338 INFO:tasks.workunit.client.0.smithi016.stdout:3/203: mknod d3/c39 0 2024-04-26T20:18:43.338 INFO:tasks.workunit.client.0.smithi016.stdout:3/204: chown d3/df/d25/d32 1 1 2024-04-26T20:18:43.338 INFO:tasks.workunit.client.0.smithi016.stdout:3/205: write d3/f29 [292184,19106] 0 2024-04-26T20:18:43.338 INFO:tasks.workunit.client.0.smithi016.stdout:9/321: link d1/d2/l4e d1/d2/d43/l6a 0 2024-04-26T20:18:43.339 INFO:tasks.workunit.client.0.smithi016.stdout:7/329: rename d0/d1/d34/c1f to d0/d1/d34/d25/c63 0 2024-04-26T20:18:43.347 INFO:tasks.workunit.client.0.smithi016.stdout:3/206: symlink d3/df/d25/d2a/l3a 0 2024-04-26T20:18:43.348 INFO:tasks.workunit.client.0.smithi016.stdout:4/253: sync 2024-04-26T20:18:43.351 INFO:tasks.workunit.client.0.smithi016.stdout:9/322: rename d1/f14 to d1/d2e/d40/f6b 0 2024-04-26T20:18:43.354 INFO:tasks.workunit.client.0.smithi016.stdout:3/207: rmdir d3/df 39 2024-04-26T20:18:43.364 INFO:tasks.workunit.client.0.smithi016.stdout:0/286: dwrite d2/dc/d1e/d25/f28 [0,4194304] 0 2024-04-26T20:18:43.367 INFO:tasks.workunit.client.0.smithi016.stdout:8/275: write d9/f11 [1912146,93146] 0 2024-04-26T20:18:43.367 INFO:tasks.workunit.client.0.smithi016.stdout:8/276: fdatasync d9/d23/d26/f2b 0 2024-04-26T20:18:43.371 INFO:tasks.workunit.client.0.smithi016.stdout:9/323: symlink d1/d2e/l6c 0 2024-04-26T20:18:43.375 INFO:tasks.workunit.client.0.smithi016.stdout:2/310: dwrite f7 [4194304,4194304] 0 2024-04-26T20:18:43.375 INFO:tasks.workunit.client.0.smithi016.stdout:9/324: write d1/fa [1833020,95622] 0 2024-04-26T20:18:43.380 INFO:tasks.workunit.client.0.smithi016.stdout:0/287: link d2/d20/f2f d2/d20/d41/f62 0 2024-04-26T20:18:43.380 INFO:tasks.workunit.client.0.smithi016.stdout:5/465: dwrite d1/d9/d1c/d52/d74/f32 [0,4194304] 0 2024-04-26T20:18:43.384 INFO:tasks.workunit.client.0.smithi016.stdout:4/254: dread d0/dd/d1b/f3a [0,4194304] 0 2024-04-26T20:18:43.387 INFO:tasks.workunit.client.0.smithi016.stdout:9/325: unlink d1/d2/f5f 0 2024-04-26T20:18:43.387 INFO:tasks.workunit.client.0.smithi016.stdout:0/288: creat d2/dc/d1e/d35/f63 x:0 0 0 2024-04-26T20:18:43.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/466: mknod d1/d9/d11/d4d/d72/c92 0 2024-04-26T20:18:43.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/467: fsync d1/f8d 0 2024-04-26T20:18:43.390 INFO:tasks.workunit.client.0.smithi016.stdout:4/255: rename d0/dd/d1b/f3a to d0/dd/d19/d1f/f58 0 2024-04-26T20:18:43.392 INFO:tasks.workunit.client.0.smithi016.stdout:5/468: symlink d1/d9/d25/l93 0 2024-04-26T20:18:43.395 INFO:tasks.workunit.client.0.smithi016.stdout:0/289: rename d2/dc/f17 to d2/d8/d37/d5d/f64 0 2024-04-26T20:18:43.395 INFO:tasks.workunit.client.0.smithi016.stdout:0/290: fsync d2/d8/d3b/f42 0 2024-04-26T20:18:43.395 INFO:tasks.workunit.client.0.smithi016.stdout:0/291: chown d2/fb 3 1 2024-04-26T20:18:43.395 INFO:tasks.workunit.client.0.smithi016.stdout:9/326: symlink d1/d29/l6d 0 2024-04-26T20:18:43.396 INFO:tasks.workunit.client.0.smithi016.stdout:0/292: readlink d2/l4 0 2024-04-26T20:18:43.396 INFO:tasks.workunit.client.0.smithi016.stdout:0/293: read - d2/d20/d41/f4f zero size 2024-04-26T20:18:43.402 INFO:tasks.workunit.client.0.smithi016.stdout:3/208: dread d3/f29 [0,4194304] 0 2024-04-26T20:18:43.404 INFO:tasks.workunit.client.0.smithi016.stdout:3/209: creat d3/df/d25/d32/f3b x:0 0 0 2024-04-26T20:18:43.404 INFO:tasks.workunit.client.0.smithi016.stdout:3/210: fsync d3/df/f26 0 2024-04-26T20:18:43.405 INFO:tasks.workunit.client.0.smithi016.stdout:8/277: write d9/fb [1114133,8758] 0 2024-04-26T20:18:43.407 INFO:tasks.workunit.client.0.smithi016.stdout:1/410: dwrite d3/d5/da/f30 [0,4194304] 0 2024-04-26T20:18:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:2/311: write d1d/d27/f53 [125835,85960] 0 2024-04-26T20:18:43.409 INFO:tasks.workunit.client.0.smithi016.stdout:1/411: dread d3/d5/d6/d5a/f4a [0,4194304] 0 2024-04-26T20:18:43.421 INFO:tasks.workunit.client.0.smithi016.stdout:2/312: creat d1d/d2a/f6a x:0 0 0 2024-04-26T20:18:43.421 INFO:tasks.workunit.client.0.smithi016.stdout:2/313: fsync d1d/f1f 0 2024-04-26T20:18:43.423 INFO:tasks.workunit.client.0.smithi016.stdout:1/412: getdents d3/d5/d6/d9/d2a 0 2024-04-26T20:18:43.425 INFO:tasks.workunit.client.0.smithi016.stdout:2/314: mkdir d1d/d27/d2d/d6b 0 2024-04-26T20:18:43.425 INFO:tasks.workunit.client.0.smithi016.stdout:2/315: fdatasync d1d/d52/f61 0 2024-04-26T20:18:43.425 INFO:tasks.workunit.client.0.smithi016.stdout:2/316: write d1d/d2a/f31 [471744,90997] 0 2024-04-26T20:18:43.426 INFO:tasks.workunit.client.0.smithi016.stdout:2/317: fsync d1d/d20/d22/f62 0 2024-04-26T20:18:43.427 INFO:tasks.workunit.client.0.smithi016.stdout:2/318: symlink d1d/d20/d22/d39/d3e/l6c 0 2024-04-26T20:18:43.431 INFO:tasks.workunit.client.0.smithi016.stdout:2/319: rename d1d/d2a/f6a to d1d/d27/d49/f6d 0 2024-04-26T20:18:43.431 INFO:tasks.workunit.client.0.smithi016.stdout:2/320: write f13 [1056964,27820] 0 2024-04-26T20:18:43.433 INFO:tasks.workunit.client.0.smithi016.stdout:2/321: link c16 d1d/d27/d2d/d5a/c6e 0 2024-04-26T20:18:43.444 INFO:tasks.workunit.client.0.smithi016.stdout:2/322: symlink d1d/l6f 0 2024-04-26T20:18:43.444 INFO:tasks.workunit.client.0.smithi016.stdout:5/469: dwrite d1/d9/d1c/d52/f63 [0,4194304] 0 2024-04-26T20:18:43.451 INFO:tasks.workunit.client.0.smithi016.stdout:3/211: dwrite d3/f29 [0,4194304] 0 2024-04-26T20:18:43.454 INFO:tasks.workunit.client.0.smithi016.stdout:8/278: dread d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:43.455 INFO:tasks.workunit.client.0.smithi016.stdout:5/470: creat d1/d9/d1c/d52/d74/f94 x:0 0 0 2024-04-26T20:18:43.456 INFO:tasks.workunit.client.0.smithi016.stdout:3/212: mknod d3/d9/c3c 0 2024-04-26T20:18:43.463 INFO:tasks.workunit.client.0.smithi016.stdout:8/279: link d9/f18 d9/d23/d44/d50/f58 0 2024-04-26T20:18:43.463 INFO:tasks.workunit.client.0.smithi016.stdout:3/213: link d3/d9/f1a d3/d9/f3d 0 2024-04-26T20:18:43.464 INFO:tasks.workunit.client.0.smithi016.stdout:5/471: creat d1/d9/f95 x:0 0 0 2024-04-26T20:18:43.467 INFO:tasks.workunit.client.0.smithi016.stdout:3/214: creat d3/df/f3e x:0 0 0 2024-04-26T20:18:43.475 INFO:tasks.workunit.client.0.smithi016.stdout:0/294: write d2/dc/d18/f1a [3412494,69255] 0 2024-04-26T20:18:43.476 INFO:tasks.workunit.client.0.smithi016.stdout:5/472: mknod d1/d9/d1c/d52/d74/d5f/d82/c96 0 2024-04-26T20:18:43.477 INFO:tasks.workunit.client.0.smithi016.stdout:0/295: creat d2/d20/d41/f65 x:0 0 0 2024-04-26T20:18:43.477 INFO:tasks.workunit.client.0.smithi016.stdout:0/296: fdatasync d2/d20/d41/f62 0 2024-04-26T20:18:43.477 INFO:tasks.workunit.client.0.smithi016.stdout:9/327: dwrite d1/f8 [0,4194304] 0 2024-04-26T20:18:43.477 INFO:tasks.workunit.client.0.smithi016.stdout:1/413: dread d3/d57/f35 [0,4194304] 0 2024-04-26T20:18:43.480 INFO:tasks.workunit.client.0.smithi016.stdout:5/473: rename d1/d9/d1c/l86 to d1/l97 0 2024-04-26T20:18:43.484 INFO:tasks.workunit.client.0.smithi016.stdout:9/328: rename d1/d1b/l1c to d1/d29/d2a/d33/d44/l6e 0 2024-04-26T20:18:43.484 INFO:tasks.workunit.client.0.smithi016.stdout:9/329: read d1/d2e/f35 [2962582,42118] 0 2024-04-26T20:18:43.488 INFO:tasks.workunit.client.0.smithi016.stdout:2/323: dwrite d1d/d2a/f4a [4194304,4194304] 0 2024-04-26T20:18:43.500 INFO:tasks.workunit.client.0.smithi016.stdout:5/474: unlink d1/d9/l36 0 2024-04-26T20:18:43.500 INFO:tasks.workunit.client.0.smithi016.stdout:5/475: fsync d1/d9/d1c/d52/d74/f94 0 2024-04-26T20:18:43.516 INFO:tasks.workunit.client.0.smithi016.stdout:8/280: dwrite d9/d19/d45/d3f/f48 [0,4194304] 0 2024-04-26T20:18:43.517 INFO:tasks.workunit.client.0.smithi016.stdout:3/215: write f0 [1959297,95848] 0 2024-04-26T20:18:43.517 INFO:tasks.workunit.client.0.smithi016.stdout:3/216: stat f2 0 2024-04-26T20:18:43.518 INFO:tasks.workunit.client.0.smithi016.stdout:2/324: rmdir d1d/d20 39 2024-04-26T20:18:43.518 INFO:tasks.workunit.client.0.smithi016.stdout:2/325: write d1d/d52/f61 [433439,29143] 0 2024-04-26T20:18:43.522 INFO:tasks.workunit.client.0.smithi016.stdout:8/281: mknod d9/d19/d45/d3f/d4d/d52/c59 0 2024-04-26T20:18:43.529 INFO:tasks.workunit.client.0.smithi016.stdout:2/326: rename d1d/d27/d49/f69 to d1d/d27/d2d/f70 0 2024-04-26T20:18:43.531 INFO:tasks.workunit.client.0.smithi016.stdout:8/282: truncate d9/d23/f3c 4106966 0 2024-04-26T20:18:43.544 INFO:tasks.workunit.client.0.smithi016.stdout:1/414: write d3/d5/da/f30 [576420,130388] 0 2024-04-26T20:18:43.559 INFO:tasks.workunit.client.0.smithi016.stdout:5/476: write d1/d9/fc [5808875,16922] 0 2024-04-26T20:18:43.559 INFO:tasks.workunit.client.0.smithi016.stdout:9/330: dwrite d1/d29/d2a/f5d [0,4194304] 0 2024-04-26T20:18:43.559 INFO:tasks.workunit.client.0.smithi016.stdout:2/327: creat d1d/d27/d2d/d6b/f71 x:0 0 0 2024-04-26T20:18:43.562 INFO:tasks.workunit.client.0.smithi016.stdout:3/217: dread d3/df/f1e [0,4194304] 0 2024-04-26T20:18:43.562 INFO:tasks.workunit.client.0.smithi016.stdout:3/218: fsync d3/df/f3e 0 2024-04-26T20:18:43.578 INFO:tasks.workunit.client.0.smithi016.stdout:8/283: dread d9/f16 [0,4194304] 0 2024-04-26T20:18:43.583 INFO:tasks.workunit.client.0.smithi016.stdout:2/328: symlink d1d/d27/d2d/d6b/l72 0 2024-04-26T20:18:43.589 INFO:tasks.workunit.client.0.smithi016.stdout:9/331: creat d1/d29/d2a/d33/f6f x:0 0 0 2024-04-26T20:18:43.589 INFO:tasks.workunit.client.0.smithi016.stdout:9/332: stat d1/d2e/f63 0 2024-04-26T20:18:43.589 INFO:tasks.workunit.client.0.smithi016.stdout:9/333: write d1/d2e/f35 [4729573,82191] 0 2024-04-26T20:18:43.590 INFO:tasks.workunit.client.0.smithi016.stdout:3/219: mkdir d3/df/d25/d32/d3f 0 2024-04-26T20:18:43.590 INFO:tasks.workunit.client.0.smithi016.stdout:9/334: stat d1/d2e/f35 0 2024-04-26T20:18:43.593 INFO:tasks.workunit.client.0.smithi016.stdout:8/284: creat d9/d19/d45/d3f/d4d/d52/f5a x:0 0 0 2024-04-26T20:18:43.593 INFO:tasks.workunit.client.0.smithi016.stdout:8/285: write d9/d23/d26/f2d [4296266,99418] 0 2024-04-26T20:18:43.595 INFO:tasks.workunit.client.0.smithi016.stdout:2/329: link d1d/d20/d22/l40 d1d/d27/d2d/l73 0 2024-04-26T20:18:43.595 INFO:tasks.workunit.client.0.smithi016.stdout:9/335: getdents d1/d29 0 2024-04-26T20:18:43.597 INFO:tasks.workunit.client.0.smithi016.stdout:8/286: rename d9/d23/f46 to d9/d23/d44/f5b 0 2024-04-26T20:18:43.597 INFO:tasks.workunit.client.0.smithi016.stdout:8/287: dread - d9/d19/d45/d3f/d4d/d52/f5a zero size 2024-04-26T20:18:43.598 INFO:tasks.workunit.client.0.smithi016.stdout:2/330: creat d1d/d20/d22/d39/d3e/f74 x:0 0 0 2024-04-26T20:18:43.599 INFO:tasks.workunit.client.0.smithi016.stdout:9/336: creat d1/d66/f70 x:0 0 0 2024-04-26T20:18:43.601 INFO:tasks.workunit.client.0.smithi016.stdout:2/331: mknod d1d/d27/c75 0 2024-04-26T20:18:43.603 INFO:tasks.workunit.client.0.smithi016.stdout:8/288: dread d9/d19/f41 [0,4194304] 0 2024-04-26T20:18:43.603 INFO:tasks.workunit.client.0.smithi016.stdout:8/289: write d9/d19/f34 [871894,39787] 0 2024-04-26T20:18:43.603 INFO:tasks.workunit.client.0.smithi016.stdout:8/290: chown d9/d19/d45/d3f/d4d/d52/f5a 176183336 1 2024-04-26T20:18:43.606 INFO:tasks.workunit.client.0.smithi016.stdout:8/291: rename d9/d2f/c49 to d9/d19/d45/d3f/d4d/c5c 0 2024-04-26T20:18:43.606 INFO:tasks.workunit.client.0.smithi016.stdout:8/292: truncate d9/d19/f33 1663496 0 2024-04-26T20:18:43.608 INFO:tasks.workunit.client.0.smithi016.stdout:8/293: creat d9/d2f/f5d x:0 0 0 2024-04-26T20:18:43.610 INFO:tasks.workunit.client.0.smithi016.stdout:8/294: creat d9/d2f/f5e x:0 0 0 2024-04-26T20:18:43.610 INFO:tasks.workunit.client.0.smithi016.stdout:8/295: truncate d9/d23/d26/f2b 4779404 0 2024-04-26T20:18:43.611 INFO:tasks.workunit.client.0.smithi016.stdout:8/296: symlink d9/d23/d26/l5f 0 2024-04-26T20:18:43.614 INFO:tasks.workunit.client.0.smithi016.stdout:8/297: unlink d9/f25 0 2024-04-26T20:18:43.614 INFO:tasks.workunit.client.0.smithi016.stdout:8/298: chown d9/d23/l28 69782 1 2024-04-26T20:18:43.616 INFO:tasks.workunit.client.0.smithi016.stdout:8/299: mknod d9/d19/c60 0 2024-04-26T20:18:43.617 INFO:tasks.workunit.client.0.smithi016.stdout:8/300: getdents d9/d19/d45/d3f 0 2024-04-26T20:18:43.618 INFO:tasks.workunit.client.0.smithi016.stdout:8/301: mknod d9/d23/d44/c61 0 2024-04-26T20:18:43.619 INFO:tasks.workunit.client.0.smithi016.stdout:8/302: rename d9/d23/d26/f2b to d9/d19/d45/d3f/d4d/d52/f62 0 2024-04-26T20:18:43.640 INFO:tasks.workunit.client.0.smithi016.stdout:8/303: link d9/d19/d45/d3f/d4d/d52/f62 d9/d19/d45/d3f/f63 0 2024-04-26T20:18:43.641 INFO:tasks.workunit.client.0.smithi016.stdout:9/337: dread d1/d1b/f32 [0,4194304] 0 2024-04-26T20:18:43.641 INFO:tasks.workunit.client.0.smithi016.stdout:5/477: dwrite d1/d78/f80 [0,4194304] 0 2024-04-26T20:18:43.643 INFO:tasks.workunit.client.0.smithi016.stdout:9/338: getdents d1/d66 0 2024-04-26T20:18:43.643 INFO:tasks.workunit.client.0.smithi016.stdout:9/339: dread - d1/d29/d2a/d33/d44/f54 zero size 2024-04-26T20:18:43.654 INFO:tasks.workunit.client.0.smithi016.stdout:8/304: rename d9/d19/d45/d3f/d4d/d52 to d9/d19/d45/d3f/d64 0 2024-04-26T20:18:43.660 INFO:tasks.workunit.client.0.smithi016.stdout:9/340: truncate d1/f8 3147770 0 2024-04-26T20:18:43.660 INFO:tasks.workunit.client.0.smithi016.stdout:8/305: creat d9/d19/d45/d3f/d64/f65 x:0 0 0 2024-04-26T20:18:43.660 INFO:tasks.workunit.client.0.smithi016.stdout:8/306: truncate d9/f53 712559 0 2024-04-26T20:18:43.661 INFO:tasks.workunit.client.0.smithi016.stdout:8/307: mkdir d9/d66 0 2024-04-26T20:18:43.667 INFO:tasks.workunit.client.0.smithi016.stdout:2/332: dwrite fe [0,4194304] 0 2024-04-26T20:18:43.672 INFO:tasks.workunit.client.0.smithi016.stdout:6/208: dwrite d1/d8/f2f [8388608,4194304] 0 2024-04-26T20:18:43.673 INFO:tasks.workunit.client.0.smithi016.stdout:6/209: symlink d1/d12/l4c 0 2024-04-26T20:18:43.675 INFO:tasks.workunit.client.0.smithi016.stdout:6/210: creat d1/d21/d26/d1c/f4d x:0 0 0 2024-04-26T20:18:43.675 INFO:tasks.workunit.client.0.smithi016.stdout:6/211: mkdir d1/d21/d26/d1c/d4e 0 2024-04-26T20:18:43.727 INFO:tasks.workunit.client.0.smithi016.stdout:5/478: dwrite d1/d9/d4b/f44 [4194304,4194304] 0 2024-04-26T20:18:43.728 INFO:tasks.workunit.client.0.smithi016.stdout:5/479: getdents d1/d9/d4b/d8f 0 2024-04-26T20:18:43.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/212: dwrite d1/d8/d2c/f42 [0,4194304] 0 2024-04-26T20:18:43.744 INFO:tasks.workunit.client.0.smithi016.stdout:7/330: dwrite d0/d1/d34/d25/d3f/f55 [0,4194304] 0 2024-04-26T20:18:43.766 INFO:tasks.workunit.client.0.smithi016.stdout:8/308: dread d9/d23/f3c [0,4194304] 0 2024-04-26T20:18:43.766 INFO:tasks.workunit.client.0.smithi016.stdout:8/309: chown d9/d23/d26 1665504 1 2024-04-26T20:18:43.768 INFO:tasks.workunit.client.0.smithi016.stdout:4/256: dwrite d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:18:43.768 INFO:tasks.workunit.client.0.smithi016.stdout:9/341: dread d1/d29/d2a/d33/f4a [0,4194304] 0 2024-04-26T20:18:43.774 INFO:tasks.workunit.client.0.smithi016.stdout:5/480: dread d1/d9/d11/f34 [0,4194304] 0 2024-04-26T20:18:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.791+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b2c14f840 con 0x7f7b2c155ee0 2024-04-26T20:18:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b29600640 1 -- 172.21.15.16:0/955507859 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7f7b24010040 con 0x7f7b2c155ee0 2024-04-26T20:18:43.796 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7b0c0683d0 msgr2=0x7f7b0c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7b0c0683d0 0x7f7b0c06a890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7b20001810 tx=0x7f7b20009040 comp rx=0 tx=0).stop 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c155ee0 msgr2=0x7f7b2c06fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c155ee0 0x7f7b2c06fd90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400efc0 tx=0x7f7b2400c490 comp rx=0 tx=0).stop 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 shutdown_connections 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7b0c0683d0 0x7f7b0c06a890 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c155ee0 0x7f7b2c06fd90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b2c0c9b30 0x7f7b2c1f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 --2- 172.21.15.16:0/955507859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b2c073c40 0x7f7b2c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 >> 172.21.15.16:0/955507859 conn(0x7f7b2c0cd5e0 msgr2=0x7f7b2c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 shutdown_connections 2024-04-26T20:18:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.795+0000 7f7b34200640 1 -- 172.21.15.16:0/955507859 wait complete. 2024-04-26T20:18:43.818 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=2) 2024-04-26T20:18:43.818 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T20:18:43.819 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:18:43.838 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T20:18:43.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:43.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.983+0000 7ff49c800640 1 Processor -- start 2024-04-26T20:18:43.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.983+0000 7ff49c800640 1 -- start start 2024-04-26T20:18:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.983+0000 7ff49c800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff494153fc0 0x7ff4940c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff49c800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4940cb080 con 0x7ff494159ec0 2024-04-26T20:18:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff49c800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4940cb360 con 0x7ff4940cec90 2024-04-26T20:18:43.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff49c800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7ff4941543a0 con 0x7ff494153fc0 2024-04-26T20:18:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff49a800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff494159ec0 0x7ff49415a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57818/0 (socket says 172.21.15.16:57818) 2024-04-26T20:18:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff49a800640 1 -- 172.21.15.16:0/1423220135 learned_addr learned my addr 172.21.15.16:0/1423220135 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:18:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193960449 0 0) 0x7ff4940cb080 con 0x7ff494159ec0 2024-04-26T20:18:43.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff47c003530 con 0x7ff494159ec0 2024-04-26T20:18:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499e00640 1 --2- 172.21.15.16:0/1423220135 >> v2:172.21.15.192:3300/0 conn(0x7ff494153fc0 0x7ff4940c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 179683201 0 0) 0x7ff47c003530 con 0x7ff494159ec0 2024-04-26T20:18:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 >> v2:172.21.15.192:3300/0 conn(0x7ff494153fc0 msgr2=0x7ff4940c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 --2- 172.21.15.16:0/1423220135 >> v2:172.21.15.192:3300/0 conn(0x7ff494153fc0 0x7ff4940c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 >> v1:172.21.15.192:6789/0 conn(0x7ff4940cec90 legacy=0x7ff4940c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4940cb640 con 0x7ff494159ec0 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7ff490001a00 con 0x7ff494159ec0 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 >> v1:172.21.15.16:6789/0 conn(0x7ff494159ec0 legacy=0x7ff49415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c003a10 0x7ff47c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff47c004810 0x7ff47c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff47c005220 0x7ff47c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4941543a0 con 0x7ff47c004810 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c00c170 con 0x7ff47c005220 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff47c00c370 con 0x7ff47c003a10 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499400640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff47c004810 0x7ff47c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff49a800640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff47c005220 0x7ff47c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499e00640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c003a10 0x7ff47c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:43.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499400640 1 -- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c003a10 msgr2=0x7ff47c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499400640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c003a10 0x7ff47c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499400640 1 -- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff47c005220 msgr2=0x7ff47c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499400640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff47c005220 0x7ff47c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff499400640 1 -- 172.21.15.16:0/1423220135 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c003530 con 0x7ff47c004810 2024-04-26T20:18:43.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.987+0000 7ff49a800640 1 -- 172.21.15.16:0/1423220135 reap_dead start 2024-04-26T20:18:43.994 INFO:tasks.workunit.client.0.smithi016.stdout:6/213: creat d1/d21/d48/f4f x:0 0 0 2024-04-26T20:18:43.994 INFO:tasks.workunit.client.0.smithi016.stdout:6/214: fsync d1/d21/f39 0 2024-04-26T20:18:43.994 INFO:tasks.workunit.client.0.smithi016.stdout:7/331: mknod d0/d1/d34/d25/d3f/c64 0 2024-04-26T20:18:43.994 INFO:tasks.workunit.client.0.smithi016.stdout:7/332: write d0/d1/d40/f53 [5115690,33802] 0 2024-04-26T20:18:43.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.991+0000 7ff499400640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff47c004810 0x7ff47c004c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff484001780 tx=0x7ff48401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9ace60485e280f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840013a0 con 0x7ff47c004810 2024-04-26T20:18:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840052f0 con 0x7ff47c004810 2024-04-26T20:18:43.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff498a00640 1 -- 172.21.15.16:0/1423220135 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484003840 con 0x7ff47c004810 2024-04-26T20:18:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff49c800640 1 -- 172.21.15.16:0/1423220135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff47c004810 msgr2=0x7ff47c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff49c800640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff47c004810 0x7ff47c004c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff484001780 tx=0x7ff48401c3e0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff49c800640 1 -- 172.21.15.16:0/1423220135 shutdown_connections 2024-04-26T20:18:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff49c800640 1 --2- 172.21.15.16:0/1423220135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff47c004810 0x7ff47c004c90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.995+0000 7ff49c800640 1 -- 172.21.15.16:0/1423220135 >> 172.21.15.16:0/1423220135 conn(0x7ff494073240 msgr2=0x7ff494073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.999+0000 7ff49c800640 1 -- 172.21.15.16:0/1423220135 shutdown_connections 2024-04-26T20:18:44.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.999+0000 7ff49c800640 1 -- 172.21.15.16:0/1423220135 wait complete. 2024-04-26T20:18:44.001 INFO:tasks.workunit.client.0.smithi016.stdout:4/257: symlink d0/d1e/d4e/d52/d54/l59 0 2024-04-26T20:18:44.002 INFO:tasks.workunit.client.0.smithi016.stdout:4/258: dread - d0/f46 zero size 2024-04-26T20:18:44.002 INFO:tasks.workunit.client.0.smithi016.stdout:9/342: link d1/d2/d20/l3d d1/d29/l71 0 2024-04-26T20:18:44.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.999+0000 7ff49c800640 1 Processor -- start 2024-04-26T20:18:44.003 INFO:tasks.workunit.client.0.smithi016.stdout:9/343: dread - d1/d2e/d40/f5a zero size 2024-04-26T20:18:44.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:43.999+0000 7ff49c800640 1 -- start start 2024-04-26T20:18:44.007 INFO:tasks.workunit.client.0.smithi016.stdout:5/481: mkdir d1/d9/d1c/d52/d74/d98 0 2024-04-26T20:18:44.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c004810 0x7ff4941f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff494148ad0 0x7ff494148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff494146ab0 0x7ff494146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940cbc90 con 0x7ff494146ab0 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940cae30 con 0x7ff494148ad0 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff494070650 con 0x7ff47c004810 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff494146ab0 0x7ff494146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff494146ab0 0x7ff494146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39568/0 (socket says 172.21.15.16:39568) 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 -- 172.21.15.16:0/750492166 learned_addr learned my addr 172.21.15.16:0/750492166 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 -- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c004810 msgr2=0x7ff4941f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c004810 0x7ff4941f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 -- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff494148ad0 msgr2=0x7ff494148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff494148ad0 0x7ff494148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 -- 172.21.15.16:0/750492166 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49414b930 con 0x7ff494146ab0 2024-04-26T20:18:44.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49a800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff494146ab0 0x7ff494146f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff4940cf290 tx=0x7ff490011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:44.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff48e000640 1 -- 172.21.15.16:0/750492166 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490010040 con 0x7ff494146ab0 2024-04-26T20:18:44.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff48e000640 1 -- 172.21.15.16:0/750492166 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49001a070 con 0x7ff494146ab0 2024-04-26T20:18:44.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff48e000640 1 -- 172.21.15.16:0/750492166 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49000fb00 con 0x7ff494146ab0 2024-04-26T20:18:44.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff494149d80 con 0x7ff494146ab0 2024-04-26T20:18:44.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.003+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49414b670 con 0x7ff494146ab0 2024-04-26T20:18:44.009 INFO:tasks.workunit.client.0.smithi016.stdout:7/333: rename d0/d1/d34/d3b/f4a to d0/d1/d34/d25/d3f/f65 0 2024-04-26T20:18:44.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.007+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4700052a0 con 0x7ff494146ab0 2024-04-26T20:18:44.011 INFO:tasks.workunit.client.0.smithi016.stdout:4/259: mkdir d0/d1e/d41/d43/d5a 0 2024-04-26T20:18:44.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.011+0000 7ff48e000640 1 -- 172.21.15.16:0/750492166 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff49000fca0 con 0x7ff494146ab0 2024-04-26T20:18:44.015 INFO:tasks.workunit.client.0.smithi016.stdout:7/334: rename d0/d1/l1d to d0/d1/d4b/l66 0 2024-04-26T20:18:44.015 INFO:tasks.workunit.client.0.smithi016.stdout:7/335: write d0/d1/d34/d25/d3f/f65 [908766,91642] 0 2024-04-26T20:18:44.015 INFO:tasks.workunit.client.0.smithi016.stdout:4/260: symlink d0/dd/d19/d1f/l5b 0 2024-04-26T20:18:44.015 INFO:tasks.workunit.client.0.smithi016.stdout:4/261: fdatasync d0/f10 0 2024-04-26T20:18:44.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.011+0000 7ff48e000640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff4780683d0 0x7ff47806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:44.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.015+0000 7ff499e00640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff4780683d0 0x7ff47806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:44.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.015+0000 7ff48e000640 1 -- 172.21.15.16:0/750492166 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7ff490058420 con 0x7ff494146ab0 2024-04-26T20:18:44.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.015+0000 7ff499e00640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff4780683d0 0x7ff47806a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff488006aa0 tx=0x7ff488006a30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:44.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.015+0000 7ff48e000640 1 -- 172.21.15.16:0/750492166 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff49005aa80 con 0x7ff494146ab0 2024-04-26T20:18:44.030 INFO:tasks.workunit.client.0.smithi016.stdout:7/336: mkdir d0/d67 0 2024-04-26T20:18:44.030 INFO:tasks.workunit.client.0.smithi016.stdout:4/262: creat d0/f5c x:0 0 0 2024-04-26T20:18:44.030 INFO:tasks.workunit.client.0.smithi016.stdout:4/263: chown d0/dd/d19/d1f/l5b 47207 1 2024-04-26T20:18:44.030 INFO:tasks.workunit.client.0.smithi016.stdout:4/264: dread - d0/f46 zero size 2024-04-26T20:18:44.031 INFO:tasks.workunit.client.0.smithi016.stdout:8/310: dread d9/f11 [0,4194304] 0 2024-04-26T20:18:44.044 INFO:tasks.workunit.client.0.smithi016.stdout:4/265: rename d0/d1e/d41/l51 to d0/d1e/d41/d43/l5d 0 2024-04-26T20:18:44.044 INFO:tasks.workunit.client.0.smithi016.stdout:4/266: chown d0/d1e/d41/d43 26291689 1 2024-04-26T20:18:44.044 INFO:tasks.workunit.client.0.smithi016.stdout:6/215: write d1/fd [2387933,78407] 0 2024-04-26T20:18:44.057 INFO:tasks.workunit.client.0.smithi016.stdout:0/297: sync 2024-04-26T20:18:44.057 INFO:tasks.workunit.client.0.smithi016.stdout:3/220: sync 2024-04-26T20:18:44.057 INFO:tasks.workunit.client.0.smithi016.stdout:1/415: sync 2024-04-26T20:18:44.057 INFO:tasks.workunit.client.0.smithi016.stdout:2/333: sync 2024-04-26T20:18:44.062 INFO:tasks.workunit.client.0.smithi016.stdout:7/337: write d0/f29 [858078,54318] 0 2024-04-26T20:18:44.062 INFO:tasks.workunit.client.0.smithi016.stdout:5/482: dread d1/d9/d1c/d52/d74/d5f/f6f [0,4194304] 0 2024-04-26T20:18:44.063 INFO:tasks.workunit.client.0.smithi016.stdout:3/221: creat d3/df/f40 x:0 0 0 2024-04-26T20:18:44.063 INFO:tasks.workunit.client.0.smithi016.stdout:3/222: truncate d3/f7 1379744 0 2024-04-26T20:18:44.063 INFO:tasks.workunit.client.0.smithi016.stdout:3/223: write d3/d9/d18/f34 [188829,58457] 0 2024-04-26T20:18:44.063 INFO:tasks.workunit.client.0.smithi016.stdout:7/338: mknod d0/c68 0 2024-04-26T20:18:44.063 INFO:tasks.workunit.client.0.smithi016.stdout:1/416: rmdir d3/d5/d6/d9/d2a/d3d 39 2024-04-26T20:18:44.064 INFO:tasks.workunit.client.0.smithi016.stdout:1/417: chown d3/d5/d6/d9/d2a/d3b/l70 66 1 2024-04-26T20:18:44.064 INFO:tasks.workunit.client.0.smithi016.stdout:0/298: symlink d2/d20/d57/l66 0 2024-04-26T20:18:44.064 INFO:tasks.workunit.client.0.smithi016.stdout:5/483: mkdir d1/d78/d99 0 2024-04-26T20:18:44.080 INFO:tasks.workunit.client.0.smithi016.stdout:1/418: creat d3/d5/da/f7b x:0 0 0 2024-04-26T20:18:44.080 INFO:tasks.workunit.client.0.smithi016.stdout:7/339: link d0/d1/d34/d25/l2a d0/d67/l69 0 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:7/340: dread - d0/d1/d4b/f4d zero size 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:5/484: rename d1/d9/d1c/c2f to d1/d9/d25/c9a 0 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:0/299: creat d2/d20/f67 x:0 0 0 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:5/485: truncate d1/d7d/f89 712995 0 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:6/216: write d1/fa [4052260,1481] 0 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:6/217: write d1/d8/d2c/f41 [607391,4037] 0 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:3/224: mkdir d3/df/d20/d41 0 2024-04-26T20:18:44.081 INFO:tasks.workunit.client.0.smithi016.stdout:3/225: readlink d3/df/d20/l30 0 2024-04-26T20:18:44.089 INFO:tasks.workunit.client.0.smithi016.stdout:9/344: dwrite d1/d2/f6 [0,4194304] 0 2024-04-26T20:18:44.096 INFO:tasks.workunit.client.0.smithi016.stdout:8/311: dwrite d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:44.099 INFO:tasks.workunit.client.0.smithi016.stdout:8/312: chown d9/lf 16412424 1 2024-04-26T20:18:44.099 INFO:tasks.workunit.client.0.smithi016.stdout:8/313: chown d9/d23/l28 1149139 1 2024-04-26T20:18:44.099 INFO:tasks.workunit.client.0.smithi016.stdout:5/486: dread d1/d9/d4b/f44 [4194304,4194304] 0 2024-04-26T20:18:44.100 INFO:tasks.workunit.client.0.smithi016.stdout:9/345: mknod d1/d2/d43/c72 0 2024-04-26T20:18:44.106 INFO:tasks.workunit.client.0.smithi016.stdout:5/487: unlink d1/d9/d1c/d52/c65 0 2024-04-26T20:18:44.107 INFO:tasks.workunit.client.0.smithi016.stdout:5/488: chown d1/d9/d11 14 1 2024-04-26T20:18:44.107 INFO:tasks.workunit.client.0.smithi016.stdout:5/489: readlink d1/d9/d11/l30 0 2024-04-26T20:18:44.107 INFO:tasks.workunit.client.0.smithi016.stdout:5/490: chown d1/d9/d25/f2a 2811 1 2024-04-26T20:18:44.107 INFO:tasks.workunit.client.0.smithi016.stdout:5/491: truncate d1/d9/d4b/f85 871347 0 2024-04-26T20:18:44.107 INFO:tasks.workunit.client.0.smithi016.stdout:5/492: chown d1/d9/d11/d4d/l7e 5959178 1 2024-04-26T20:18:44.109 INFO:tasks.workunit.client.0.smithi016.stdout:9/346: rmdir d1/d2/d43 39 2024-04-26T20:18:44.112 INFO:tasks.workunit.client.0.smithi016.stdout:5/493: rename d1/d9/d1c/d52/d74/d5f/f6f to d1/d9/d11/d4d/f9b 0 2024-04-26T20:18:44.112 INFO:tasks.workunit.client.0.smithi016.stdout:5/494: dread - d1/d9/d11/d4d/f6d zero size 2024-04-26T20:18:44.119 INFO:tasks.workunit.client.0.smithi016.stdout:2/334: write f1c [2201418,106054] 0 2024-04-26T20:18:44.119 INFO:tasks.workunit.client.0.smithi016.stdout:3/226: dread d3/f1b [0,4194304] 0 2024-04-26T20:18:44.120 INFO:tasks.workunit.client.0.smithi016.stdout:3/227: read - d3/df/d25/d32/f38 zero size 2024-04-26T20:18:44.120 INFO:tasks.workunit.client.0.smithi016.stdout:3/228: fdatasync d3/d9/fb 0 2024-04-26T20:18:44.120 INFO:tasks.workunit.client.0.smithi016.stdout:3/229: fsync d3/df/f2f 0 2024-04-26T20:18:44.125 INFO:tasks.workunit.client.0.smithi016.stdout:2/335: unlink d1d/l66 0 2024-04-26T20:18:44.128 INFO:tasks.workunit.client.0.smithi016.stdout:3/230: creat d3/df/d25/d2a/f42 x:0 0 0 2024-04-26T20:18:44.128 INFO:tasks.workunit.client.0.smithi016.stdout:3/231: fsync d3/f29 0 2024-04-26T20:18:44.129 INFO:tasks.workunit.client.0.smithi016.stdout:3/232: dread - d3/df/d25/d2a/f42 zero size 2024-04-26T20:18:44.132 INFO:tasks.workunit.client.0.smithi016.stdout:2/336: dread d1d/d27/d2d/f30 [0,4194304] 0 2024-04-26T20:18:44.133 INFO:tasks.workunit.client.0.smithi016.stdout:3/233: symlink d3/d9/l43 0 2024-04-26T20:18:44.135 INFO:tasks.workunit.client.0.smithi016.stdout:2/337: truncate f11 1028503 0 2024-04-26T20:18:44.135 INFO:tasks.workunit.client.0.smithi016.stdout:3/234: mkdir d3/df/d44 0 2024-04-26T20:18:44.135 INFO:tasks.workunit.client.0.smithi016.stdout:3/235: stat d3/df/d25/d32 0 2024-04-26T20:18:44.135 INFO:tasks.workunit.client.0.smithi016.stdout:3/236: stat d3/df/d20/l30 0 2024-04-26T20:18:44.139 INFO:tasks.workunit.client.0.smithi016.stdout:1/419: dwrite d3/d5/da/f7b [0,4194304] 0 2024-04-26T20:18:44.145 INFO:tasks.workunit.client.0.smithi016.stdout:2/338: creat d1d/d20/f76 x:0 0 0 2024-04-26T20:18:44.153 INFO:tasks.workunit.client.0.smithi016.stdout:7/341: dwrite d0/f59 [0,4194304] 0 2024-04-26T20:18:44.156 INFO:tasks.workunit.client.0.smithi016.stdout:1/420: symlink d3/d5/da/d66/l7c 0 2024-04-26T20:18:44.168 INFO:tasks.workunit.client.0.smithi016.stdout:8/314: dwrite d9/d19/d45/f56 [0,4194304] 0 2024-04-26T20:18:44.168 INFO:tasks.workunit.client.0.smithi016.stdout:8/315: write d9/d19/d45/d3f/d64/f57 [153375,91601] 0 2024-04-26T20:18:44.172 INFO:tasks.workunit.client.0.smithi016.stdout:8/316: rmdir d9/d23/d44/d50 39 2024-04-26T20:18:44.174 INFO:tasks.workunit.client.0.smithi016.stdout:8/317: creat d9/d19/d45/f67 x:0 0 0 2024-04-26T20:18:44.176 INFO:tasks.workunit.client.0.smithi016.stdout:1/421: dread d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:44.176 INFO:tasks.workunit.client.0.smithi016.stdout:1/422: fdatasync d3/d5/d6/d9/f4e 0 2024-04-26T20:18:44.178 INFO:tasks.workunit.client.0.smithi016.stdout:1/423: symlink d3/l7d 0 2024-04-26T20:18:44.178 INFO:tasks.workunit.client.0.smithi016.stdout:1/424: stat d3/f4 0 2024-04-26T20:18:44.179 INFO:tasks.workunit.client.0.smithi016.stdout:4/267: dwrite d0/d1e/d41/d43/f56 [4194304,4194304] 0 2024-04-26T20:18:44.179 INFO:tasks.workunit.client.0.smithi016.stdout:4/268: fsync d0/d1e/f21 0 2024-04-26T20:18:44.179 INFO:tasks.workunit.client.0.smithi016.stdout:4/269: chown d0/fa 388662 1 2024-04-26T20:18:44.179 INFO:tasks.workunit.client.0.smithi016.stdout:4/270: readlink d0/d1e/l44 0 2024-04-26T20:18:44.179 INFO:tasks.workunit.client.0.smithi016.stdout:4/271: truncate d0/d1e/d4e/d52/d54/f55 4689028 0 2024-04-26T20:18:44.180 INFO:tasks.workunit.client.0.smithi016.stdout:7/342: dread d0/d1/d34/d25/f26 [0,4194304] 0 2024-04-26T20:18:44.182 INFO:tasks.workunit.client.0.smithi016.stdout:7/343: read d0/d1/f20 [1422304,96267] 0 2024-04-26T20:18:44.182 INFO:tasks.workunit.client.0.smithi016.stdout:4/272: creat d0/dd/d19/d57/f5e x:0 0 0 2024-04-26T20:18:44.182 INFO:tasks.workunit.client.0.smithi016.stdout:4/273: truncate d0/dd/d19/d57/f5e 233859 0 2024-04-26T20:18:44.185 INFO:tasks.workunit.client.0.smithi016.stdout:4/274: creat d0/d1e/d41/f5f x:0 0 0 2024-04-26T20:18:44.191 INFO:tasks.workunit.client.0.smithi016.stdout:8/318: truncate d9/f16 3708442 0 2024-04-26T20:18:44.193 INFO:tasks.workunit.client.0.smithi016.stdout:8/319: creat d9/d23/d44/f68 x:0 0 0 2024-04-26T20:18:44.199 INFO:tasks.workunit.client.0.smithi016.stdout:2/339: dwrite d1d/d20/d22/d39/f5e [0,4194304] 0 2024-04-26T20:18:44.200 INFO:tasks.workunit.client.0.smithi016.stdout:0/300: dwrite d2/dc/d1e/f1f [4194304,4194304] 0 2024-04-26T20:18:44.201 INFO:tasks.workunit.client.0.smithi016.stdout:2/340: rename f1c to d1d/d20/d22/d39/d3e/f77 0 2024-04-26T20:18:44.204 INFO:tasks.workunit.client.0.smithi016.stdout:2/341: rename d1d/d20/d22/l28 to d1d/d2a/l78 0 2024-04-26T20:18:44.205 INFO:tasks.workunit.client.0.smithi016.stdout:2/342: getdents d1d/d2a/d3d 0 2024-04-26T20:18:44.205 INFO:tasks.workunit.client.0.smithi016.stdout:2/343: write d1d/d52/f5f [945031,86054] 0 2024-04-26T20:18:44.210 INFO:tasks.workunit.client.0.smithi016.stdout:2/344: mknod d1d/d20/d22/d29/c79 0 2024-04-26T20:18:44.210 INFO:tasks.workunit.client.0.smithi016.stdout:2/345: truncate d1d/d2a/f31 1277932 0 2024-04-26T20:18:44.211 INFO:tasks.workunit.client.0.smithi016.stdout:4/275: write d0/d1e/d41/d43/f4a [4708716,109405] 0 2024-04-26T20:18:44.212 INFO:tasks.workunit.client.0.smithi016.stdout:4/276: write d0/dd/d19/d1f/f58 [3225934,19513] 0 2024-04-26T20:18:44.216 INFO:tasks.workunit.client.0.smithi016.stdout:8/320: dread d9/f1f [0,4194304] 0 2024-04-26T20:18:44.216 INFO:tasks.workunit.client.0.smithi016.stdout:2/346: link d1d/d20/d22/f62 d1d/d27/d2d/d5a/f7a 0 2024-04-26T20:18:44.216 INFO:tasks.workunit.client.0.smithi016.stdout:2/347: write d1d/d52/f5f [1509899,6959] 0 2024-04-26T20:18:44.222 INFO:tasks.workunit.client.0.smithi016.stdout:3/237: dwrite d3/df/d25/f28 [0,4194304] 0 2024-04-26T20:18:44.223 INFO:tasks.workunit.client.0.smithi016.stdout:4/277: dread d0/dd/d19/d1f/f45 [0,4194304] 0 2024-04-26T20:18:44.223 INFO:tasks.workunit.client.0.smithi016.stdout:0/301: dread d2/d8/d37/d5d/f64 [0,4194304] 0 2024-04-26T20:18:44.224 INFO:tasks.workunit.client.0.smithi016.stdout:0/302: chown d2/d20/d41/c43 0 1 2024-04-26T20:18:44.225 INFO:tasks.workunit.client.0.smithi016.stdout:3/238: truncate f2 1881205 0 2024-04-26T20:18:44.225 INFO:tasks.workunit.client.0.smithi016.stdout:3/239: chown d3/df 31648 1 2024-04-26T20:18:44.225 INFO:tasks.workunit.client.0.smithi016.stdout:3/240: getdents d3/d9/d2d 0 2024-04-26T20:18:44.226 INFO:tasks.workunit.client.0.smithi016.stdout:4/278: creat d0/dd/d19/d57/f60 x:0 0 0 2024-04-26T20:18:44.226 INFO:tasks.workunit.client.0.smithi016.stdout:0/303: fdatasync d2/f14 0 2024-04-26T20:18:44.227 INFO:tasks.workunit.client.0.smithi016.stdout:4/279: mknod d0/d1e/d41/d43/d5a/c61 0 2024-04-26T20:18:44.228 INFO:tasks.workunit.client.0.smithi016.stdout:0/304: truncate d2/d40/f5c 276160 0 2024-04-26T20:18:44.228 INFO:tasks.workunit.client.0.smithi016.stdout:4/280: mknod d0/d1e/d4e/c62 0 2024-04-26T20:18:44.229 INFO:tasks.workunit.client.0.smithi016.stdout:0/305: write d2/d8/d37/d5d/f64 [5141248,5722] 0 2024-04-26T20:18:44.233 INFO:tasks.workunit.client.0.smithi016.stdout:8/321: dread d9/d23/d26/f2d [0,4194304] 0 2024-04-26T20:18:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:0/306: symlink d2/dc/d1e/l68 0 2024-04-26T20:18:44.240 INFO:tasks.workunit.client.0.smithi016.stdout:0/307: stat d2/d8/d37/d5d 0 2024-04-26T20:18:44.241 INFO:tasks.workunit.client.0.smithi016.stdout:2/348: write d1d/d27/d2d/d5a/f7a [3279497,89874] 0 2024-04-26T20:18:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:8/322: mknod d9/d23/d44/c69 0 2024-04-26T20:18:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:8/323: chown d9/d23/d44/f5b 52881249 1 2024-04-26T20:18:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:8/324: chown d9/d19/c55 108 1 2024-04-26T20:18:44.243 INFO:tasks.workunit.client.0.smithi016.stdout:0/308: creat d2/d20/d41/f69 x:0 0 0 2024-04-26T20:18:44.244 INFO:tasks.workunit.client.0.smithi016.stdout:3/241: write d3/d9/d18/f1c [325315,16813] 0 2024-04-26T20:18:44.244 INFO:tasks.workunit.client.0.smithi016.stdout:3/242: stat d3/df/f1e 0 2024-04-26T20:18:44.244 INFO:tasks.workunit.client.0.smithi016.stdout:8/325: symlink d9/d19/l6a 0 2024-04-26T20:18:44.248 INFO:tasks.workunit.client.0.smithi016.stdout:0/309: mknod d2/d40/c6a 0 2024-04-26T20:18:44.257 INFO:tasks.workunit.client.0.smithi016.stdout:8/326: unlink d9/d19/d45/f56 0 2024-04-26T20:18:44.257 INFO:tasks.workunit.client.0.smithi016.stdout:8/327: chown d9/l3a 22775003 1 2024-04-26T20:18:44.276 INFO:tasks.workunit.client.0.smithi016.stdout:4/281: dread d0/dd/d19/d57/f5e [0,4194304] 0 2024-04-26T20:18:44.276 INFO:tasks.workunit.client.0.smithi016.stdout:7/344: dwrite d0/d1/d34/d25/d3f/f5f [0,4194304] 0 2024-04-26T20:18:44.287 INFO:tasks.workunit.client.0.smithi016.stdout:7/345: creat d0/d67/f6a x:0 0 0 2024-04-26T20:18:44.288 INFO:tasks.workunit.client.0.smithi016.stdout:7/346: write d0/d1/d6/f3d [973192,95662] 0 2024-04-26T20:18:44.293 INFO:tasks.workunit.client.0.smithi016.stdout:3/243: dwrite d3/d9/fb [0,4194304] 0 2024-04-26T20:18:44.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/310: dwrite d2/f14 [8388608,4194304] 0 2024-04-26T20:18:44.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/311: dread - d2/d20/d41/f62 zero size 2024-04-26T20:18:44.340 INFO:tasks.workunit.client.0.smithi016.stdout:2/349: dwrite d1d/d27/d2d/f70 [0,4194304] 0 2024-04-26T20:18:44.354 INFO:tasks.workunit.client.0.smithi016.stdout:2/350: dread d1d/d20/d22/d39/d3e/f77 [0,4194304] 0 2024-04-26T20:18:44.354 INFO:tasks.workunit.client.0.smithi016.stdout:0/312: dwrite d2/d8/f11 [0,4194304] 0 2024-04-26T20:18:44.386 INFO:tasks.workunit.client.0.smithi016.stdout:6/218: dwrite d1/f1f [0,4194304] 0 2024-04-26T20:18:44.412 INFO:tasks.workunit.client.0.smithi016.stdout:5/495: dwrite d1/d9/d25/f67 [0,4194304] 0 2024-04-26T20:18:44.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.415+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff470005590 con 0x7ff494146ab0 2024-04-26T20:18:44.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.415+0000 7ff48e000640 1 -- 172.21.15.16:0/750492166 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7ff49005a380 con 0x7ff494146ab0 2024-04-26T20:18:44.420 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:44.420 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:44.420 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff4780683d0 msgr2=0x7ff47806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff4780683d0 0x7ff47806a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff488006aa0 tx=0x7ff488006a30 comp rx=0 tx=0).stop 2024-04-26T20:18:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff494146ab0 msgr2=0x7ff494146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff494146ab0 0x7ff494146f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff4940cf290 tx=0x7ff490011b70 comp rx=0 tx=0).stop 2024-04-26T20:18:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 shutdown_connections 2024-04-26T20:18:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff4780683d0 0x7ff47806a890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff494146ab0 0x7ff494146f30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff494148ad0 0x7ff494148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 --2- 172.21.15.16:0/750492166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff47c004810 0x7ff4941f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:44.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 >> 172.21.15.16:0/750492166 conn(0x7ff494073240 msgr2=0x7ff494071260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:44.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 shutdown_connections 2024-04-26T20:18:44.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:44.419+0000 7ff49c800640 1 -- 172.21.15.16:0/750492166 wait complete. 2024-04-26T20:18:44.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/425: dwrite d3/f4 [0,4194304] 0 2024-04-26T20:18:44.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/426: chown d3/d5/d6/d9/d49/c5c 8202362 1 2024-04-26T20:18:44.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/427: write d3/d5/d6/d5a/f5d [1024891,79469] 0 2024-04-26T20:18:44.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/428: readlink d3/d5/d6/l3a 0 2024-04-26T20:18:44.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/429: readlink d3/d5/d6/d9/d2a/d3b/l62 0 2024-04-26T20:18:44.444 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-26T20:18:44.550 INFO:tasks.workunit.client.0.smithi016.stdout:4/282: creat d0/dd/d19/d57/f63 x:0 0 0 2024-04-26T20:18:44.550 INFO:tasks.workunit.client.0.smithi016.stdout:7/347: unlink d0/d1/d6/f1c 0 2024-04-26T20:18:44.550 INFO:tasks.workunit.client.0.smithi016.stdout:3/244: unlink d3/df/d20/c2e 0 2024-04-26T20:18:44.552 INFO:tasks.workunit.client.0.smithi016.stdout:2/351: rename d1d/d2a/d3b/f3c to d1d/d2a/d3d/f7b 0 2024-04-26T20:18:44.552 INFO:tasks.workunit.client.0.smithi016.stdout:2/352: chown d1d/d20/d22/f62 0 1 2024-04-26T20:18:44.552 INFO:tasks.workunit.client.0.smithi016.stdout:2/353: write d1d/d20/d22/d39/d3e/f47 [701732,13741] 0 2024-04-26T20:18:44.563 INFO:tasks.workunit.client.0.smithi016.stdout:1/430: mknod d3/d5/d6/d50/d79/c7e 0 2024-04-26T20:18:44.563 INFO:tasks.workunit.client.0.smithi016.stdout:1/431: readlink d3/d5/d6/l15 0 2024-04-26T20:18:44.563 INFO:tasks.workunit.client.0.smithi016.stdout:1/432: write d3/d5/f33 [274308,70377] 0 2024-04-26T20:18:44.564 INFO:tasks.workunit.client.0.smithi016.stdout:7/348: truncate d0/d1/d34/f2c 1292526 0 2024-04-26T20:18:44.565 INFO:tasks.workunit.client.0.smithi016.stdout:3/245: mknod d3/df/d25/d32/d3f/c45 0 2024-04-26T20:18:44.568 INFO:tasks.workunit.client.0.smithi016.stdout:0/313: rename d2/d8/d37/c56 to d2/dc/d1e/d35/c6b 0 2024-04-26T20:18:44.570 INFO:tasks.workunit.client.0.smithi016.stdout:7/349: dread d0/d1/f20 [0,4194304] 0 2024-04-26T20:18:44.570 INFO:tasks.workunit.client.0.smithi016.stdout:7/350: fdatasync d0/f27 0 2024-04-26T20:18:44.570 INFO:tasks.workunit.client.0.smithi016.stdout:3/246: creat d3/df/d25/f46 x:0 0 0 2024-04-26T20:18:44.573 INFO:tasks.workunit.client.0.smithi016.stdout:0/314: mknod d2/d40/c6c 0 2024-04-26T20:18:44.573 INFO:tasks.workunit.client.0.smithi016.stdout:0/315: truncate d2/dc/d1e/f3a 483691 0 2024-04-26T20:18:44.573 INFO:tasks.workunit.client.0.smithi016.stdout:0/316: chown d2/d8/d3b 1 1 2024-04-26T20:18:44.575 INFO:tasks.workunit.client.0.smithi016.stdout:1/433: link d3/d5/d6/d9/d49/f6b d3/d5/d6/f7f 0 2024-04-26T20:18:44.577 INFO:tasks.workunit.client.0.smithi016.stdout:7/351: mknod d0/d67/c6b 0 2024-04-26T20:18:44.579 INFO:tasks.workunit.client.0.smithi016.stdout:3/247: link d3/f19 d3/d9/d2d/f47 0 2024-04-26T20:18:44.581 INFO:tasks.workunit.client.0.smithi016.stdout:0/317: truncate d2/dc/d18/f29 4975834 0 2024-04-26T20:18:44.582 INFO:tasks.workunit.client.0.smithi016.stdout:1/434: symlink d3/d5/da/d66/l80 0 2024-04-26T20:18:44.585 INFO:tasks.workunit.client.0.smithi016.stdout:0/318: creat d2/d20/d41/d4c/d4e/f6d x:0 0 0 2024-04-26T20:18:44.588 INFO:tasks.workunit.client.0.smithi016.stdout:6/219: rename d1/d8/c2d to d1/d21/d26/d1c/d2e/c50 0 2024-04-26T20:18:44.588 INFO:tasks.workunit.client.0.smithi016.stdout:6/220: chown d1/d21/d26/d1c/f4d 194 1 2024-04-26T20:18:44.588 INFO:tasks.workunit.client.0.smithi016.stdout:6/221: chown d1/d21/d26/l1d 832716521 1 2024-04-26T20:18:44.592 INFO:tasks.workunit.client.0.smithi016.stdout:6/222: mkdir d1/d21/d48/d51 0 2024-04-26T20:18:44.592 INFO:tasks.workunit.client.0.smithi016.stdout:1/435: symlink d3/d5/d6/l81 0 2024-04-26T20:18:44.595 INFO:tasks.workunit.client.0.smithi016.stdout:1/436: link d3/d5/d6/l81 d3/d5/d6/d9/d2a/d3b/l82 0 2024-04-26T20:18:44.596 INFO:tasks.workunit.client.0.smithi016.stdout:4/283: write d0/dd/f25 [204047,7886] 0 2024-04-26T20:18:44.598 INFO:tasks.workunit.client.0.smithi016.stdout:1/437: creat d3/d5/d6/d9/d49/f83 x:0 0 0 2024-04-26T20:18:44.600 INFO:tasks.workunit.client.0.smithi016.stdout:4/284: mkdir d0/d1e/d64 0 2024-04-26T20:18:44.602 INFO:tasks.workunit.client.0.smithi016.stdout:4/285: mknod d0/dd/d1b/c65 0 2024-04-26T20:18:44.602 INFO:tasks.workunit.client.0.smithi016.stdout:4/286: write d0/d1e/d41/d43/f4a [5396115,102785] 0 2024-04-26T20:18:44.604 INFO:tasks.workunit.client.0.smithi016.stdout:2/354: dwrite d1d/f43 [0,4194304] 0 2024-04-26T20:18:44.612 INFO:tasks.workunit.client.0.smithi016.stdout:0/319: dread d2/d8/f9 [0,4194304] 0 2024-04-26T20:18:44.620 INFO:tasks.workunit.client.0.smithi016.stdout:0/320: mknod d2/d8/d37/d5d/d60/c6e 0 2024-04-26T20:18:44.636 INFO:tasks.workunit.client.0.smithi016.stdout:9/347: sync 2024-04-26T20:18:44.636 INFO:tasks.workunit.client.0.smithi016.stdout:9/348: read d1/d2/fd [2275459,52040] 0 2024-04-26T20:18:44.638 INFO:tasks.workunit.client.0.smithi016.stdout:9/349: mknod d1/d29/d2a/d33/c73 0 2024-04-26T20:18:44.642 INFO:tasks.workunit.client.0.smithi016.stdout:9/350: creat d1/d59/d52/f74 x:0 0 0 2024-04-26T20:18:44.642 INFO:tasks.workunit.client.0.smithi016.stdout:9/351: fsync d1/d29/d2a/d33/d44/f65 0 2024-04-26T20:18:44.644 INFO:tasks.workunit.client.0.smithi016.stdout:4/287: mkdir d0/dd/d66 0 2024-04-26T20:18:44.644 INFO:tasks.workunit.client.0.smithi016.stdout:4/288: chown d0/dd/d19/d57/f60 2373 1 2024-04-26T20:18:44.645 INFO:tasks.workunit.client.0.smithi016.stdout:4/289: stat d0/c2b 0 2024-04-26T20:18:44.645 INFO:tasks.workunit.client.0.smithi016.stdout:4/290: chown d0/dd/d19/f24 3 1 2024-04-26T20:18:44.651 INFO:tasks.workunit.client.0.smithi016.stdout:4/291: truncate d0/d1e/f21 1874226 0 2024-04-26T20:18:44.651 INFO:tasks.workunit.client.0.smithi016.stdout:4/292: write d0/dd/d19/d57/f60 [393443,6509] 0 2024-04-26T20:18:44.651 INFO:tasks.workunit.client.0.smithi016.stdout:4/293: stat d0/f46 0 2024-04-26T20:18:44.653 INFO:tasks.workunit.client.0.smithi016.stdout:4/294: link d0/d1e/d41/c3f d0/dd/c67 0 2024-04-26T20:18:44.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/438: dwrite d3/d5/d6/d50/f60 [0,4194304] 0 2024-04-26T20:18:44.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/439: readlink d3/d5/da/d66/l7c 0 2024-04-26T20:18:44.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/440: chown d3/d5/d6/d9/d49/f6a 23820 1 2024-04-26T20:18:44.675 INFO:tasks.workunit.client.0.smithi016.stdout:5/496: rename d1/d9/d1c/d52/f75 to d1/d9/d11/d4d/f9c 0 2024-04-26T20:18:44.684 INFO:tasks.workunit.client.0.smithi016.stdout:6/223: rename d1/d21/d26/l1d to d1/d21/d26/d25/l52 0 2024-04-26T20:18:44.684 INFO:tasks.workunit.client.0.smithi016.stdout:4/295: dread d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:18:44.684 INFO:tasks.workunit.client.0.smithi016.stdout:1/441: read d3/d5/f18 [4257801,65893] 0 2024-04-26T20:18:44.684 INFO:tasks.workunit.client.0.smithi016.stdout:2/355: dwrite d1d/d52/f5f [0,4194304] 0 2024-04-26T20:18:44.684 INFO:tasks.workunit.client.0.smithi016.stdout:2/356: write d1d/d27/f3f [1571732,100919] 0 2024-04-26T20:18:44.684 INFO:tasks.workunit.client.0.smithi016.stdout:3/248: dwrite d3/df/f40 [0,4194304] 0 2024-04-26T20:18:44.687 INFO:tasks.workunit.client.0.smithi016.stdout:9/352: dwrite d1/d2e/f35 [0,4194304] 0 2024-04-26T20:18:44.690 INFO:tasks.workunit.client.0.smithi016.stdout:7/352: write d0/d1/d46/f2e [2752167,6487] 0 2024-04-26T20:18:44.690 INFO:tasks.workunit.client.0.smithi016.stdout:7/353: write d0/f29 [1624566,10809] 0 2024-04-26T20:18:44.690 INFO:tasks.workunit.client.0.smithi016.stdout:7/354: write d0/d1/d40/f53 [6111187,116858] 0 2024-04-26T20:18:44.693 INFO:tasks.workunit.client.0.smithi016.stdout:5/497: fsync d1/d9/f14 0 2024-04-26T20:18:44.693 INFO:tasks.workunit.client.0.smithi016.stdout:1/442: mkdir d3/d5/d6/d9/d49/d84 0 2024-04-26T20:18:44.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/357: mkdir d1d/d20/d7c 0 2024-04-26T20:18:44.699 INFO:tasks.workunit.client.0.smithi016.stdout:8/328: sync 2024-04-26T20:18:44.700 INFO:tasks.workunit.client.0.smithi016.stdout:1/443: dread d3/d5/da/f21 [0,4194304] 0 2024-04-26T20:18:44.701 INFO:tasks.workunit.client.0.smithi016.stdout:7/355: rename d0/d1/d40 to d0/d1/d34/d3b/d6c 0 2024-04-26T20:18:44.703 INFO:tasks.workunit.client.0.smithi016.stdout:5/498: link d1/d9/d11/l84 d1/d9/d1c/d52/d74/d98/l9d 0 2024-04-26T20:18:44.705 INFO:tasks.workunit.client.0.smithi016.stdout:8/329: creat d9/d23/d26/d2c/f6b x:0 0 0 2024-04-26T20:18:44.709 INFO:tasks.workunit.client.0.smithi016.stdout:9/353: truncate d1/d2e/f17 381556 0 2024-04-26T20:18:44.712 INFO:tasks.workunit.client.0.smithi016.stdout:1/444: creat d3/d5/d6/d50/d79/f85 x:0 0 0 2024-04-26T20:18:44.712 INFO:tasks.workunit.client.0.smithi016.stdout:1/445: chown d3/d5/d6/le 3 1 2024-04-26T20:18:44.713 INFO:tasks.workunit.client.0.smithi016.stdout:7/356: mkdir d0/d1/d34/d25/d3f/d6d 0 2024-04-26T20:18:44.718 INFO:tasks.workunit.client.0.smithi016.stdout:5/499: getdents d1/d9/d11/d4d 0 2024-04-26T20:18:44.718 INFO:tasks.workunit.client.0.smithi016.stdout:5/500: dread - d1/d9/d1c/d52/d74/f94 zero size 2024-04-26T20:18:44.718 INFO:tasks.workunit.client.0.smithi016.stdout:5/501: fsync d1/d9/d1c/d52/f63 0 2024-04-26T20:18:44.720 INFO:tasks.workunit.client.0.smithi016.stdout:8/330: truncate d9/d23/d26/f2a 3252688 0 2024-04-26T20:18:44.720 INFO:tasks.workunit.client.0.smithi016.stdout:8/331: readlink d9/d23/d44/l4e 0 2024-04-26T20:18:44.722 INFO:tasks.workunit.client.0.smithi016.stdout:2/358: write d1d/d52/f5f [1949810,82001] 0 2024-04-26T20:18:44.724 INFO:tasks.workunit.client.0.smithi016.stdout:7/357: mkdir d0/d1/d6/d6e 0 2024-04-26T20:18:44.725 INFO:tasks.workunit.client.0.smithi016.stdout:7/358: chown d0/d1/d34/d25/d50 0 1 2024-04-26T20:18:44.725 INFO:tasks.workunit.client.0.smithi016.stdout:7/359: write d0/d1/d34/f2c [1582193,37692] 0 2024-04-26T20:18:44.728 INFO:tasks.workunit.client.0.smithi016.stdout:0/321: dwrite d2/dc/d1e/d25/f28 [0,4194304] 0 2024-04-26T20:18:44.732 INFO:tasks.workunit.client.0.smithi016.stdout:2/359: dread d1d/d20/d22/d29/f38 [0,4194304] 0 2024-04-26T20:18:44.732 INFO:tasks.workunit.client.0.smithi016.stdout:0/322: creat d2/d20/d41/f6f x:0 0 0 2024-04-26T20:18:44.732 INFO:tasks.workunit.client.0.smithi016.stdout:1/446: mkdir d3/d5/d6/d9/d49/d84/d86 0 2024-04-26T20:18:44.733 INFO:tasks.workunit.client.0.smithi016.stdout:0/323: mkdir d2/d8/d37/d70 0 2024-04-26T20:18:44.733 INFO:tasks.workunit.client.0.smithi016.stdout:0/324: write d2/d20/d41/f62 [517292,42705] 0 2024-04-26T20:18:44.735 INFO:tasks.workunit.client.0.smithi016.stdout:0/325: link d2/dc/d18/d5b/f5e d2/dc/f71 0 2024-04-26T20:18:44.735 INFO:tasks.workunit.client.0.smithi016.stdout:0/326: write d2/d20/f27 [416911,88650] 0 2024-04-26T20:18:44.736 INFO:tasks.workunit.client.0.smithi016.stdout:0/327: chown d2/dc/d1e 1749 1 2024-04-26T20:18:44.736 INFO:tasks.workunit.client.0.smithi016.stdout:6/224: dwrite d1/f7 [8388608,4194304] 0 2024-04-26T20:18:44.736 INFO:tasks.workunit.client.0.smithi016.stdout:6/225: dread - d1/d21/d26/d1c/f4d zero size 2024-04-26T20:18:44.736 INFO:tasks.workunit.client.0.smithi016.stdout:6/226: chown d1/d3a 0 1 2024-04-26T20:18:44.736 INFO:tasks.workunit.client.0.smithi016.stdout:6/227: truncate f0 4531676 0 2024-04-26T20:18:44.736 INFO:tasks.workunit.client.0.smithi016.stdout:6/228: write d1/d21/d26/d25/f36 [1885848,39111] 0 2024-04-26T20:18:44.737 INFO:tasks.workunit.client.0.smithi016.stdout:0/328: mkdir d2/d20/d41/d72 0 2024-04-26T20:18:44.738 INFO:tasks.workunit.client.0.smithi016.stdout:6/229: mkdir d1/d21/d26/d1c/d2e/d53 0 2024-04-26T20:18:44.742 INFO:tasks.workunit.client.0.smithi016.stdout:0/329: dread d2/dc/d1e/f3a [0,4194304] 0 2024-04-26T20:18:44.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/230: creat d1/d21/d26/f54 x:0 0 0 2024-04-26T20:18:44.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/231: read - d1/d21/d26/f54 zero size 2024-04-26T20:18:44.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/232: dread - d1/d21/d26/d1c/f4d zero size 2024-04-26T20:18:44.744 INFO:tasks.workunit.client.0.smithi016.stdout:0/330: rename d2/d8/lf to d2/d8/d37/d5d/d60/l73 0 2024-04-26T20:18:44.775 INFO:tasks.workunit.client.0.smithi016.stdout:4/296: dread d0/f11 [0,4194304] 0 2024-04-26T20:18:44.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/249: dwrite d3/df/d25/d32/f38 [0,4194304] 0 2024-04-26T20:18:44.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/250: chown d3/d9/d2d 57857170 1 2024-04-26T20:18:44.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/251: readlink d3/l15 0 2024-04-26T20:18:44.776 INFO:tasks.workunit.client.0.smithi016.stdout:4/297: symlink d0/d1e/d41/l68 0 2024-04-26T20:18:44.778 INFO:tasks.workunit.client.0.smithi016.stdout:1/447: dread d3/d5/f43 [0,4194304] 0 2024-04-26T20:18:44.778 INFO:tasks.workunit.client.0.smithi016.stdout:1/448: readlink d3/d5/d6/l81 0 2024-04-26T20:18:44.799 INFO:tasks.workunit.client.0.smithi016.stdout:8/332: write d9/d23/f3c [3885173,94023] 0 2024-04-26T20:18:44.799 INFO:tasks.workunit.client.0.smithi016.stdout:8/333: readlink d9/d23/l28 0 2024-04-26T20:18:44.804 INFO:tasks.workunit.client.0.smithi016.stdout:5/502: write d1/d9/fc [2620294,16813] 0 2024-04-26T20:18:44.804 INFO:tasks.workunit.client.0.smithi016.stdout:7/360: dwrite d0/d1/d34/d25/d50/f54 [0,4194304] 0 2024-04-26T20:18:44.826 INFO:tasks.workunit.client.0.smithi016.stdout:6/233: dwrite d1/fd [0,4194304] 0 2024-04-26T20:18:44.826 INFO:tasks.workunit.client.0.smithi016.stdout:6/234: fsync d1/fd 0 2024-04-26T20:18:44.826 INFO:tasks.workunit.client.0.smithi016.stdout:6/235: dread - d1/f27 zero size 2024-04-26T20:18:44.849 INFO:tasks.workunit.client.0.smithi016.stdout:5/503: dwrite d1/f8a [0,4194304] 0 2024-04-26T20:18:45.030 INFO:tasks.workunit.client.0.smithi016.stdout:4/298: symlink d0/d1e/d4e/d52/d54/l69 0 2024-04-26T20:18:45.030 INFO:tasks.workunit.client.0.smithi016.stdout:4/299: chown d0/d1e/d41/d43 447550470 1 2024-04-26T20:18:45.030 INFO:tasks.workunit.client.0.smithi016.stdout:3/252: link d3/df/f13 d3/d9/d2d/f48 0 2024-04-26T20:18:45.030 INFO:tasks.workunit.client.0.smithi016.stdout:1/449: creat d3/d5/d6/d50/f87 x:0 0 0 2024-04-26T20:18:45.032 INFO:tasks.workunit.client.0.smithi016.stdout:8/334: rename d9/d23/d44/c61 to d9/d23/d44/d50/c6c 0 2024-04-26T20:18:45.035 INFO:tasks.workunit.client.0.smithi016.stdout:7/361: rmdir d0/d1/d34/d3b 39 2024-04-26T20:18:45.038 INFO:tasks.workunit.client.0.smithi016.stdout:6/236: creat d1/d3a/f55 x:0 0 0 2024-04-26T20:18:45.038 INFO:tasks.workunit.client.0.smithi016.stdout:6/237: readlink d1/d21/l28 0 2024-04-26T20:18:45.049 INFO:tasks.workunit.client.0.smithi016.stdout:4/300: symlink d0/dd/d19/l6a 0 2024-04-26T20:18:45.049 INFO:tasks.workunit.client.0.smithi016.stdout:4/301: chown d0/dd/d19/l3c 7 1 2024-04-26T20:18:45.050 INFO:tasks.workunit.client.0.smithi016.stdout:6/238: rename d1/d8/ff to d1/d8/d2c/d3d/f56 0 2024-04-26T20:18:45.053 INFO:tasks.workunit.client.0.smithi016.stdout:4/302: link d0/dd/c67 d0/d1e/d41/c6b 0 2024-04-26T20:18:45.053 INFO:tasks.workunit.client.0.smithi016.stdout:4/303: fdatasync d0/d1e/d41/d43/f56 0 2024-04-26T20:18:45.060 INFO:tasks.workunit.client.0.smithi016.stdout:6/239: dread d1/d8/d2c/f41 [0,4194304] 0 2024-04-26T20:18:45.062 INFO:tasks.workunit.client.0.smithi016.stdout:6/240: mknod d1/d8/d46/c57 0 2024-04-26T20:18:45.062 INFO:tasks.workunit.client.0.smithi016.stdout:6/241: truncate d1/f4 5077618 0 2024-04-26T20:18:45.063 INFO:tasks.workunit.client.0.smithi016.stdout:6/242: creat d1/d8/d2c/d3d/f58 x:0 0 0 2024-04-26T20:18:45.065 INFO:tasks.workunit.client.0.smithi016.stdout:6/243: truncate d1/d8/d2c/f41 96362 0 2024-04-26T20:18:45.066 INFO:tasks.workunit.client.0.smithi016.stdout:3/253: read d3/df/d25/f28 [4019309,33569] 0 2024-04-26T20:18:45.067 INFO:tasks.workunit.client.0.smithi016.stdout:6/244: creat d1/d21/d26/d1c/d2e/d53/f59 x:0 0 0 2024-04-26T20:18:45.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/254: rename l1 to d3/l49 0 2024-04-26T20:18:45.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/255: dread - d3/df/f2f zero size 2024-04-26T20:18:45.089 INFO:tasks.workunit.client.0.smithi016.stdout:1/450: dwrite d3/d5/f4f [0,4194304] 0 2024-04-26T20:18:45.100 INFO:tasks.workunit.client.0.smithi016.stdout:4/304: dread d0/d1e/f4c [0,4194304] 0 2024-04-26T20:18:45.107 INFO:tasks.workunit.client.0.smithi016.stdout:8/335: dwrite d9/d23/d44/d50/f58 [0,4194304] 0 2024-04-26T20:18:45.109 INFO:tasks.workunit.client.0.smithi016.stdout:8/336: dread f8 [0,4194304] 0 2024-04-26T20:18:45.109 INFO:tasks.workunit.client.0.smithi016.stdout:8/337: chown d9/d23/d26/c47 35258 1 2024-04-26T20:18:45.126 INFO:tasks.workunit.client.0.smithi016.stdout:8/338: write d9/d23/d44/d50/f58 [1962331,86290] 0 2024-04-26T20:18:45.129 INFO:tasks.workunit.client.0.smithi016.stdout:8/339: read d9/f1b [684870,106675] 0 2024-04-26T20:18:45.129 INFO:tasks.workunit.client.0.smithi016.stdout:8/340: write d9/d19/d45/f67 [471939,30398] 0 2024-04-26T20:18:45.161 INFO:tasks.workunit.client.0.smithi016.stdout:8/341: dwrite d9/d23/d26/d2c/f6b [0,4194304] 0 2024-04-26T20:18:45.322 INFO:tasks.workunit.client.0.smithi016.stdout:6/245: rename d1/d21/d26/f24 to d1/d8/d2c/d47/f5a 0 2024-04-26T20:18:45.322 INFO:tasks.workunit.client.0.smithi016.stdout:6/246: readlink d1/l1a 0 2024-04-26T20:18:45.322 INFO:tasks.workunit.client.0.smithi016.stdout:3/256: mkdir d3/df/d25/d2a/d4a 0 2024-04-26T20:18:45.323 INFO:tasks.workunit.client.0.smithi016.stdout:1/451: mknod d3/d5/d6/d9/d49/d84/c88 0 2024-04-26T20:18:45.324 INFO:tasks.workunit.client.0.smithi016.stdout:4/305: symlink d0/dd/d1b/l6c 0 2024-04-26T20:18:45.324 INFO:tasks.workunit.client.0.smithi016.stdout:4/306: dread - d0/dd/d19/f38 zero size 2024-04-26T20:18:45.326 INFO:tasks.workunit.client.0.smithi016.stdout:8/342: mknod d9/d23/c6d 0 2024-04-26T20:18:45.327 INFO:tasks.workunit.client.0.smithi016.stdout:4/307: creat d0/dd/f6d x:0 0 0 2024-04-26T20:18:45.328 INFO:tasks.workunit.client.0.smithi016.stdout:8/343: link d9/d19/d45/l4c d9/d23/d26/d2c/l6e 0 2024-04-26T20:18:45.329 INFO:tasks.workunit.client.0.smithi016.stdout:6/247: symlink d1/d8/l5b 0 2024-04-26T20:18:45.330 INFO:tasks.workunit.client.0.smithi016.stdout:1/452: rename d3/d5/da/f74 to d3/d5/d6/f89 0 2024-04-26T20:18:45.331 INFO:tasks.workunit.client.0.smithi016.stdout:8/344: creat d9/d23/d44/f6f x:0 0 0 2024-04-26T20:18:45.333 INFO:tasks.workunit.client.0.smithi016.stdout:6/248: creat d1/d8/f5c x:0 0 0 2024-04-26T20:18:45.333 INFO:tasks.workunit.client.0.smithi016.stdout:6/249: chown d1/d21/d26/d1c/d2e/d53/f59 106239514 1 2024-04-26T20:18:45.333 INFO:tasks.workunit.client.0.smithi016.stdout:6/250: fdatasync d1/d8/d2c/d47/f5a 0 2024-04-26T20:18:45.333 INFO:tasks.workunit.client.0.smithi016.stdout:6/251: write d1/d21/f3e [115994,36935] 0 2024-04-26T20:18:45.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/354: sync 2024-04-26T20:18:45.342 INFO:tasks.workunit.client.0.smithi016.stdout:2/360: sync 2024-04-26T20:18:45.342 INFO:tasks.workunit.client.0.smithi016.stdout:5/504: sync 2024-04-26T20:18:45.342 INFO:tasks.workunit.client.0.smithi016.stdout:0/331: sync 2024-04-26T20:18:45.343 INFO:tasks.workunit.client.0.smithi016.stdout:9/355: fdatasync f0 0 2024-04-26T20:18:45.343 INFO:tasks.workunit.client.0.smithi016.stdout:0/332: truncate d2/d8/f36 944664 0 2024-04-26T20:18:45.343 INFO:tasks.workunit.client.0.smithi016.stdout:7/362: sync 2024-04-26T20:18:45.343 INFO:tasks.workunit.client.0.smithi016.stdout:7/363: stat d0/f27 0 2024-04-26T20:18:45.343 INFO:tasks.workunit.client.0.smithi016.stdout:7/364: write d0/d1/f41 [196597,70510] 0 2024-04-26T20:18:45.343 INFO:tasks.workunit.client.0.smithi016.stdout:3/257: dread d3/df/f40 [0,4194304] 0 2024-04-26T20:18:45.344 INFO:tasks.workunit.client.0.smithi016.stdout:5/505: rmdir d1/d9/d1c/d52 39 2024-04-26T20:18:45.345 INFO:tasks.workunit.client.0.smithi016.stdout:2/361: link d1d/d20/f76 d1d/d20/d22/d39/f7d 0 2024-04-26T20:18:45.346 INFO:tasks.workunit.client.0.smithi016.stdout:0/333: getdents d2/dc/d18/d24 0 2024-04-26T20:18:45.347 INFO:tasks.workunit.client.0.smithi016.stdout:3/258: creat d3/df/d20/f4b x:0 0 0 2024-04-26T20:18:45.347 INFO:tasks.workunit.client.0.smithi016.stdout:0/334: dread d2/dc/f1c [0,4194304] 0 2024-04-26T20:18:45.347 INFO:tasks.workunit.client.0.smithi016.stdout:5/506: stat d1/d9/d25/c9a 0 2024-04-26T20:18:45.347 INFO:tasks.workunit.client.0.smithi016.stdout:5/507: fsync d1/f8d 0 2024-04-26T20:18:45.347 INFO:tasks.workunit.client.0.smithi016.stdout:7/365: mknod d0/d1/c6f 0 2024-04-26T20:18:45.349 INFO:tasks.workunit.client.0.smithi016.stdout:2/362: mkdir d1d/d27/d2d/d6b/d7e 0 2024-04-26T20:18:45.352 INFO:tasks.workunit.client.0.smithi016.stdout:3/259: rmdir d3/df/d44 0 2024-04-26T20:18:45.352 INFO:tasks.workunit.client.0.smithi016.stdout:0/335: symlink d2/d20/d57/l74 0 2024-04-26T20:18:45.352 INFO:tasks.workunit.client.0.smithi016.stdout:3/260: read d3/d9/d18/f1c [659348,18638] 0 2024-04-26T20:18:45.355 INFO:tasks.workunit.client.0.smithi016.stdout:5/508: creat d1/d9/d1c/d52/d74/d98/f9e x:0 0 0 2024-04-26T20:18:45.357 INFO:tasks.workunit.client.0.smithi016.stdout:3/261: rename d3/df/d20/c36 to d3/df/d25/d32/c4c 0 2024-04-26T20:18:45.373 INFO:tasks.workunit.client.0.smithi016.stdout:9/356: dread d1/d2e/d40/f62 [0,4194304] 0 2024-04-26T20:18:45.373 INFO:tasks.workunit.client.0.smithi016.stdout:9/357: write d1/d2/fd [3302314,110473] 0 2024-04-26T20:18:45.377 INFO:tasks.workunit.client.0.smithi016.stdout:5/509: mkdir d1/d9f 0 2024-04-26T20:18:45.377 INFO:tasks.workunit.client.0.smithi016.stdout:5/510: chown d1/d9/d1c/d52/d74/d5f/l62 45926 1 2024-04-26T20:18:45.379 INFO:tasks.workunit.client.0.smithi016.stdout:9/358: mkdir d1/d29/d2a/d75 0 2024-04-26T20:18:45.379 INFO:tasks.workunit.client.0.smithi016.stdout:9/359: chown d1/d2/f61 6436399 1 2024-04-26T20:18:45.379 INFO:tasks.workunit.client.0.smithi016.stdout:9/360: write d1/d2/f5 [852944,105802] 0 2024-04-26T20:18:45.381 INFO:tasks.workunit.client.0.smithi016.stdout:5/511: creat d1/fa0 x:0 0 0 2024-04-26T20:18:45.383 INFO:tasks.workunit.client.0.smithi016.stdout:9/361: link d1/d29/d2a/l3b d1/d29/l76 0 2024-04-26T20:18:45.404 INFO:tasks.workunit.client.0.smithi016.stdout:1/453: dwrite d3/d5/d6/d5a/f5d [0,4194304] 0 2024-04-26T20:18:45.406 INFO:tasks.workunit.client.0.smithi016.stdout:5/512: mknod d1/d88/ca1 0 2024-04-26T20:18:45.406 INFO:tasks.workunit.client.0.smithi016.stdout:5/513: readlink d1/d9/d11/d4d/l68 0 2024-04-26T20:18:45.410 INFO:tasks.workunit.client.0.smithi016.stdout:2/363: dwrite d1d/d2a/d3d/f7b [0,4194304] 0 2024-04-26T20:18:45.410 INFO:tasks.workunit.client.0.smithi016.stdout:2/364: fsync d1d/d20/d22/d39/d3e/f77 0 2024-04-26T20:18:45.412 INFO:tasks.workunit.client.0.smithi016.stdout:1/454: truncate d3/d5/da/f30 1175119 0 2024-04-26T20:18:45.416 INFO:tasks.workunit.client.0.smithi016.stdout:5/514: dread d1/d9/d25/f47 [0,4194304] 0 2024-04-26T20:18:45.416 INFO:tasks.workunit.client.0.smithi016.stdout:9/362: write d1/d29/d2a/f5d [4165798,65190] 0 2024-04-26T20:18:45.416 INFO:tasks.workunit.client.0.smithi016.stdout:7/366: dwrite d0/d1/d6/f3d [0,4194304] 0 2024-04-26T20:18:45.421 INFO:tasks.workunit.client.0.smithi016.stdout:2/365: rename l17 to d1d/d27/d49/l7f 0 2024-04-26T20:18:45.463 INFO:tasks.workunit.client.0.smithi016.stdout:7/367: dread d0/d1/f20 [0,4194304] 0 2024-04-26T20:18:45.463 INFO:tasks.workunit.client.0.smithi016.stdout:7/368: stat d0/d1/d34/c5c 0 2024-04-26T20:18:45.471 INFO:tasks.workunit.client.0.smithi016.stdout:2/366: getdents d1d/d52 0 2024-04-26T20:18:45.475 INFO:tasks.workunit.client.0.smithi016.stdout:5/515: dwrite d1/d9/d4b/f6a [0,4194304] 0 2024-04-26T20:18:45.483 INFO:tasks.workunit.client.0.smithi016.stdout:7/369: dread d0/d1/d6/f3d [0,4194304] 0 2024-04-26T20:18:45.493 INFO:tasks.workunit.client.0.smithi016.stdout:9/363: dwrite d1/d2e/f35 [0,4194304] 0 2024-04-26T20:18:45.493 INFO:tasks.workunit.client.0.smithi016.stdout:9/364: write d1/d1b/f32 [422729,36507] 0 2024-04-26T20:18:45.495 INFO:tasks.workunit.client.0.smithi016.stdout:7/370: rename d0/l4e to d0/d1/d34/d25/d3f/l70 0 2024-04-26T20:18:45.495 INFO:tasks.workunit.client.0.smithi016.stdout:9/365: rmdir d1/d2e 39 2024-04-26T20:18:45.496 INFO:tasks.workunit.client.0.smithi016.stdout:7/371: link d0/fc d0/d1/d34/d3b/d6c/f71 0 2024-04-26T20:18:45.497 INFO:tasks.workunit.client.0.smithi016.stdout:9/366: truncate d1/d2/f3 2621001 0 2024-04-26T20:18:45.497 INFO:tasks.workunit.client.0.smithi016.stdout:9/367: dread - d1/d2/f61 zero size 2024-04-26T20:18:45.529 INFO:tasks.workunit.client.0.smithi016.stdout:9/368: dwrite d1/d2e/f35 [0,4194304] 0 2024-04-26T20:18:45.574 INFO:tasks.workunit.client.0.smithi016.stdout:9/369: dwrite d1/d2e/f35 [0,4194304] 0 2024-04-26T20:18:45.575 INFO:tasks.workunit.client.0.smithi016.stdout:9/370: truncate d1/d66/f70 308198 0 2024-04-26T20:18:45.598 INFO:tasks.workunit.client.0.smithi016.stdout:4/308: dwrite d0/dd/f6d [0,4194304] 0 2024-04-26T20:18:45.599 INFO:tasks.workunit.client.0.smithi016.stdout:7/372: rename d0/d1/f41 to d0/d1/d4b/f72 0 2024-04-26T20:18:45.599 INFO:tasks.workunit.client.0.smithi016.stdout:7/373: stat d0/d1/d34/d3b/l5b 0 2024-04-26T20:18:45.599 INFO:tasks.workunit.client.0.smithi016.stdout:7/374: chown d0/d1/d34/d25/d3f/c45 15 1 2024-04-26T20:18:45.601 INFO:tasks.workunit.client.0.smithi016.stdout:4/309: symlink d0/dd/d19/d1f/l6e 0 2024-04-26T20:18:45.603 INFO:tasks.workunit.client.0.smithi016.stdout:9/371: rename d1/d29 to d1/d2/d20/d49/d77 0 2024-04-26T20:18:45.605 INFO:tasks.workunit.client.0.smithi016.stdout:4/310: mkdir d0/dd/d66/d6f 0 2024-04-26T20:18:45.605 INFO:tasks.workunit.client.0.smithi016.stdout:4/311: write d0/dd/d19/f38 [11451,67043] 0 2024-04-26T20:18:45.606 INFO:tasks.workunit.client.0.smithi016.stdout:9/372: rmdir d1/d2/d20/d49/d77/d3e 39 2024-04-26T20:18:45.607 INFO:tasks.workunit.client.0.smithi016.stdout:4/312: symlink d0/d1e/d41/l70 0 2024-04-26T20:18:45.623 INFO:tasks.workunit.client.0.smithi016.stdout:4/313: dread d0/d1e/d41/d43/f4a [4194304,4194304] 0 2024-04-26T20:18:45.623 INFO:tasks.workunit.client.0.smithi016.stdout:4/314: getdents d0/d1e/d64 0 2024-04-26T20:18:45.624 INFO:tasks.workunit.client.0.smithi016.stdout:9/373: rmdir d1/d2 39 2024-04-26T20:18:45.625 INFO:tasks.workunit.client.0.smithi016.stdout:8/345: dread f5 [0,4194304] 0 2024-04-26T20:18:45.629 INFO:tasks.workunit.client.0.smithi016.stdout:0/336: dread d2/d20/d41/d4c/d4e/f54 [0,4194304] 0 2024-04-26T20:18:45.629 INFO:tasks.workunit.client.0.smithi016.stdout:0/337: getdents d2/dc/d18/d24/d53 0 2024-04-26T20:18:45.631 INFO:tasks.workunit.client.0.smithi016.stdout:4/315: symlink d0/dd/d1b/l71 0 2024-04-26T20:18:45.631 INFO:tasks.workunit.client.0.smithi016.stdout:4/316: chown d0/d1e/d41/l70 4812490 1 2024-04-26T20:18:45.631 INFO:tasks.workunit.client.0.smithi016.stdout:4/317: write d0/dd/d1b/f48 [805231,27106] 0 2024-04-26T20:18:45.632 INFO:tasks.workunit.client.0.smithi016.stdout:0/338: creat d2/d8/d37/d70/f75 x:0 0 0 2024-04-26T20:18:45.634 INFO:tasks.workunit.client.0.smithi016.stdout:4/318: link d0/dd/l13 d0/dd/d1b/l72 0 2024-04-26T20:18:45.644 INFO:tasks.workunit.client.0.smithi016.stdout:6/252: dwrite d1/f4 [0,4194304] 0 2024-04-26T20:18:45.653 INFO:tasks.workunit.client.0.smithi016.stdout:7/375: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:45.656 INFO:tasks.workunit.client.0.smithi016.stdout:0/339: mknod d2/dc/d45/c76 0 2024-04-26T20:18:45.656 INFO:tasks.workunit.client.0.smithi016.stdout:0/340: write d2/d40/f5c [1128997,24581] 0 2024-04-26T20:18:45.656 INFO:tasks.workunit.client.0.smithi016.stdout:0/341: write d2/d8/f9 [4525147,91830] 0 2024-04-26T20:18:45.656 INFO:tasks.workunit.client.0.smithi016.stdout:0/342: fsync d2/d20/d41/f50 0 2024-04-26T20:18:45.665 INFO:tasks.workunit.client.0.smithi016.stdout:8/346: dwrite d9/d23/d44/f5b [0,4194304] 0 2024-04-26T20:18:45.665 INFO:tasks.workunit.client.0.smithi016.stdout:7/376: write d0/d1/d6/fa [1956130,26407] 0 2024-04-26T20:18:45.670 INFO:tasks.workunit.client.0.smithi016.stdout:7/377: mkdir d0/d1/d6/d73 0 2024-04-26T20:18:45.670 INFO:tasks.workunit.client.0.smithi016.stdout:7/378: chown d0/d1/d6/l35 4 1 2024-04-26T20:18:45.670 INFO:tasks.workunit.client.0.smithi016.stdout:7/379: chown d0/d1/d6/d73 122436837 1 2024-04-26T20:18:45.670 INFO:tasks.workunit.client.0.smithi016.stdout:7/380: truncate d0/d1/d34/f2c 2439223 0 2024-04-26T20:18:45.670 INFO:tasks.workunit.client.0.smithi016.stdout:7/381: chown d0/d1/d34/c47 126643 1 2024-04-26T20:18:45.688 INFO:tasks.workunit.client.0.smithi016.stdout:7/382: dread d0/f27 [0,4194304] 0 2024-04-26T20:18:45.688 INFO:tasks.workunit.client.0.smithi016.stdout:7/383: write d0/d1/d46/f2e [2425218,40371] 0 2024-04-26T20:18:45.689 INFO:tasks.workunit.client.0.smithi016.stdout:7/384: stat d0/d1/d34/d25 0 2024-04-26T20:18:45.692 INFO:tasks.workunit.client.0.smithi016.stdout:4/319: write d0/f10 [1606953,77260] 0 2024-04-26T20:18:45.693 INFO:tasks.workunit.client.0.smithi016.stdout:7/385: mkdir d0/d1/d34/d25/d3f/d6d/d74 0 2024-04-26T20:18:45.696 INFO:tasks.workunit.client.0.smithi016.stdout:4/320: link d0/d1e/f21 d0/d1e/f73 0 2024-04-26T20:18:45.696 INFO:tasks.workunit.client.0.smithi016.stdout:4/321: readlink d0/dd/l13 0 2024-04-26T20:18:45.701 INFO:tasks.workunit.client.0.smithi016.stdout:5/516: read d1/d9/d4b/f44 [2982346,119959] 0 2024-04-26T20:18:45.701 INFO:tasks.workunit.client.0.smithi016.stdout:5/517: truncate d1/d9/d11/d4d/f6d 790225 0 2024-04-26T20:18:45.701 INFO:tasks.workunit.client.0.smithi016.stdout:3/262: dwrite f2 [0,4194304] 0 2024-04-26T20:18:45.705 INFO:tasks.workunit.client.0.smithi016.stdout:7/386: rename d0/d1/d34/c2f to d0/d1/d34/d3b/c75 0 2024-04-26T20:18:45.707 INFO:tasks.workunit.client.0.smithi016.stdout:9/374: dread d1/d2e/fb [0,4194304] 0 2024-04-26T20:18:45.707 INFO:tasks.workunit.client.0.smithi016.stdout:9/375: chown d1/d2/d20/d49/d77/l71 18 1 2024-04-26T20:18:45.708 INFO:tasks.workunit.client.0.smithi016.stdout:7/387: creat d0/d1/d34/d25/d3f/d6d/f76 x:0 0 0 2024-04-26T20:18:45.708 INFO:tasks.workunit.client.0.smithi016.stdout:7/388: chown d0/d1/d34/d25/d3f/f65 1262474 1 2024-04-26T20:18:45.710 INFO:tasks.workunit.client.0.smithi016.stdout:9/376: mknod d1/d2/c78 0 2024-04-26T20:18:45.711 INFO:tasks.workunit.client.0.smithi016.stdout:7/389: creat d0/d1/d34/d25/d3f/d6d/f77 x:0 0 0 2024-04-26T20:18:45.711 INFO:tasks.workunit.client.0.smithi016.stdout:7/390: truncate d0/d1/d34/d3b/f3c 1185766 0 2024-04-26T20:18:45.717 INFO:tasks.workunit.client.0.smithi016.stdout:9/377: write d1/d2/f10 [972790,1074] 0 2024-04-26T20:18:45.717 INFO:tasks.workunit.client.0.smithi016.stdout:3/263: dread d3/d9/fb [0,4194304] 0 2024-04-26T20:18:45.718 INFO:tasks.workunit.client.0.smithi016.stdout:7/391: truncate d0/fc 2414105 0 2024-04-26T20:18:45.719 INFO:tasks.workunit.client.0.smithi016.stdout:9/378: unlink d1/d2e/d40/l4b 0 2024-04-26T20:18:45.720 INFO:tasks.workunit.client.0.smithi016.stdout:3/264: dread d3/d9/d2d/f48 [0,4194304] 0 2024-04-26T20:18:45.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/392: mknod d0/d1/d34/d3b/d6c/c78 0 2024-04-26T20:18:45.731 INFO:tasks.workunit.client.0.smithi016.stdout:3/265: creat d3/d9/f4d x:0 0 0 2024-04-26T20:18:45.749 INFO:tasks.workunit.client.0.smithi016.stdout:8/347: dwrite d9/d23/d44/d50/f58 [4194304,4194304] 0 2024-04-26T20:18:45.751 INFO:tasks.workunit.client.0.smithi016.stdout:3/266: rmdir d3/df/d25/d2a 39 2024-04-26T20:18:45.752 INFO:tasks.workunit.client.0.smithi016.stdout:8/348: mkdir d9/d23/d44/d70 0 2024-04-26T20:18:45.763 INFO:tasks.workunit.client.0.smithi016.stdout:8/349: write d9/d23/d26/f2a [2906152,2870] 0 2024-04-26T20:18:45.764 INFO:tasks.workunit.client.0.smithi016.stdout:3/267: rename d3/df/f3e to d3/df/d20/d41/f4e 0 2024-04-26T20:18:45.765 INFO:tasks.workunit.client.0.smithi016.stdout:3/268: readlink d3/l6 0 2024-04-26T20:18:45.765 INFO:tasks.workunit.client.0.smithi016.stdout:8/350: creat d9/d19/d45/f71 x:0 0 0 2024-04-26T20:18:45.765 INFO:tasks.workunit.client.0.smithi016.stdout:8/351: write d9/d2f/f5e [566715,66679] 0 2024-04-26T20:18:45.766 INFO:tasks.workunit.client.0.smithi016.stdout:8/352: truncate d9/d19/d45/f67 1365478 0 2024-04-26T20:18:45.766 INFO:tasks.workunit.client.0.smithi016.stdout:8/353: write d9/d23/d26/d2c/f6b [4318412,47569] 0 2024-04-26T20:18:45.766 INFO:tasks.workunit.client.0.smithi016.stdout:8/354: write d9/d19/d45/d3f/d64/f65 [533771,121642] 0 2024-04-26T20:18:45.774 INFO:tasks.workunit.client.0.smithi016.stdout:5/518: dwrite d1/d9/d1c/d52/d74/d98/f9e [0,4194304] 0 2024-04-26T20:18:45.786 INFO:tasks.workunit.client.0.smithi016.stdout:3/269: write d3/f16 [3950814,74820] 0 2024-04-26T20:18:45.790 INFO:tasks.workunit.client.0.smithi016.stdout:9/379: write d1/d2e/fb [3084767,23230] 0 2024-04-26T20:18:45.793 INFO:tasks.workunit.client.0.smithi016.stdout:3/270: mkdir d3/d9/d2d/d4f 0 2024-04-26T20:18:45.820 INFO:tasks.workunit.client.0.smithi016.stdout:8/355: dwrite d9/f13 [0,4194304] 0 2024-04-26T20:18:45.835 INFO:tasks.workunit.client.0.smithi016.stdout:3/271: dwrite f0 [0,4194304] 0 2024-04-26T20:18:45.835 INFO:tasks.workunit.client.0.smithi016.stdout:3/272: read d3/f1b [563408,96104] 0 2024-04-26T20:18:45.837 INFO:tasks.workunit.client.0.smithi016.stdout:9/380: mkdir d1/d2/d79 0 2024-04-26T20:18:45.837 INFO:tasks.workunit.client.0.smithi016.stdout:9/381: write d1/d2/d20/d49/d77/d2a/d33/d44/f54 [646074,129299] 0 2024-04-26T20:18:45.842 INFO:tasks.workunit.client.0.smithi016.stdout:9/382: dread d1/d2e/d40/f6b [0,4194304] 0 2024-04-26T20:18:45.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/383: dread d1/d2/f10 [0,4194304] 0 2024-04-26T20:18:45.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/384: truncate f0 3435171 0 2024-04-26T20:18:45.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/385: dread - d1/d1b/f58 zero size 2024-04-26T20:18:45.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/386: write d1/d2/f61 [293647,119472] 0 2024-04-26T20:18:45.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/387: write d1/f41 [656083,46999] 0 2024-04-26T20:18:45.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/388: write d1/d2/d20/d49/d77/d2a/f5d [4108166,3317] 0 2024-04-26T20:18:45.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/389: chown d1/d66/l68 2915492 1 2024-04-26T20:18:45.869 INFO:tasks.workunit.client.0.smithi016.stdout:3/273: rename d3/df/f23 to d3/d9/d2d/d4f/f50 0 2024-04-26T20:18:45.890 INFO:tasks.workunit.client.0.smithi016.stdout:7/393: dwrite d0/f31 [4194304,4194304] 0 2024-04-26T20:18:45.890 INFO:tasks.workunit.client.0.smithi016.stdout:7/394: chown d0/d1/d34/d3b/f3c 0 1 2024-04-26T20:18:45.896 INFO:tasks.workunit.client.0.smithi016.stdout:7/395: getdents d0/d1 0 2024-04-26T20:18:45.901 INFO:tasks.workunit.client.0.smithi016.stdout:9/390: dwrite d1/d2/f6 [4194304,4194304] 0 2024-04-26T20:18:45.907 INFO:tasks.workunit.client.0.smithi016.stdout:7/396: mkdir d0/d1/d34/d25/d3f/d6d/d79 0 2024-04-26T20:18:45.919 INFO:tasks.workunit.client.0.smithi016.stdout:8/356: dread d9/d19/d45/f67 [0,4194304] 0 2024-04-26T20:18:45.920 INFO:tasks.workunit.client.0.smithi016.stdout:9/391: creat d1/d2e/f7a x:0 0 0 2024-04-26T20:18:45.922 INFO:tasks.workunit.client.0.smithi016.stdout:3/274: dwrite d3/df/d20/d41/f4e [0,4194304] 0 2024-04-26T20:18:45.922 INFO:tasks.workunit.client.0.smithi016.stdout:3/275: dread - d3/df/d20/f4b zero size 2024-04-26T20:18:45.922 INFO:tasks.workunit.client.0.smithi016.stdout:5/519: dwrite d1/d9/d11/f58 [0,4194304] 0 2024-04-26T20:18:45.922 INFO:tasks.workunit.client.0.smithi016.stdout:9/392: rename d1/d1b/f26 to d1/d2/d20/d49/f7b 0 2024-04-26T20:18:45.923 INFO:tasks.workunit.client.0.smithi016.stdout:8/357: mkdir d9/d72 0 2024-04-26T20:18:45.924 INFO:tasks.workunit.client.0.smithi016.stdout:3/276: symlink d3/df/l51 0 2024-04-26T20:18:45.924 INFO:tasks.workunit.client.0.smithi016.stdout:9/393: read d1/fa [1474929,85089] 0 2024-04-26T20:18:45.928 INFO:tasks.workunit.client.0.smithi016.stdout:8/358: mkdir d9/d66/d73 0 2024-04-26T20:18:45.928 INFO:tasks.workunit.client.0.smithi016.stdout:8/359: readlink d9/l3a 0 2024-04-26T20:18:45.928 INFO:tasks.workunit.client.0.smithi016.stdout:3/277: mknod d3/d9/d2d/d4f/c52 0 2024-04-26T20:18:45.928 INFO:tasks.workunit.client.0.smithi016.stdout:3/278: dread - d3/df/f26 zero size 2024-04-26T20:18:45.929 INFO:tasks.workunit.client.0.smithi016.stdout:9/394: creat d1/d59/d52/f7c x:0 0 0 2024-04-26T20:18:45.930 INFO:tasks.workunit.client.0.smithi016.stdout:8/360: mkdir d9/d72/d74 0 2024-04-26T20:18:45.931 INFO:tasks.workunit.client.0.smithi016.stdout:3/279: unlink d3/d9/fb 0 2024-04-26T20:18:45.932 INFO:tasks.workunit.client.0.smithi016.stdout:9/395: creat d1/d1b/f7d x:0 0 0 2024-04-26T20:18:45.932 INFO:tasks.workunit.client.0.smithi016.stdout:9/396: write d1/f15 [4920438,41128] 0 2024-04-26T20:18:45.934 INFO:tasks.workunit.client.0.smithi016.stdout:8/361: rename d9/d19/d45/l40 to d9/d23/d44/l75 0 2024-04-26T20:18:45.934 INFO:tasks.workunit.client.0.smithi016.stdout:8/362: readlink d9/lf 0 2024-04-26T20:18:45.934 INFO:tasks.workunit.client.0.smithi016.stdout:8/363: truncate d9/f16 3845433 0 2024-04-26T20:18:45.935 INFO:tasks.workunit.client.0.smithi016.stdout:3/280: creat d3/df/d25/f53 x:0 0 0 2024-04-26T20:18:45.937 INFO:tasks.workunit.client.0.smithi016.stdout:8/364: creat d9/d23/d26/f76 x:0 0 0 2024-04-26T20:18:45.939 INFO:tasks.workunit.client.0.smithi016.stdout:3/281: mknod d3/df/c54 0 2024-04-26T20:18:45.939 INFO:tasks.workunit.client.0.smithi016.stdout:7/397: read d0/f15 [6487689,10677] 0 2024-04-26T20:18:45.953 INFO:tasks.workunit.client.0.smithi016.stdout:5/520: dread d1/d9/f38 [0,4194304] 0 2024-04-26T20:18:45.955 INFO:tasks.workunit.client.0.smithi016.stdout:8/365: creat d9/d23/d26/d2c/f77 x:0 0 0 2024-04-26T20:18:45.956 INFO:tasks.workunit.client.0.smithi016.stdout:5/521: symlink d1/d9/d1c/la2 0 2024-04-26T20:18:45.957 INFO:tasks.workunit.client.0.smithi016.stdout:3/282: dread d3/d9/d2d/d4f/f50 [0,4194304] 0 2024-04-26T20:18:45.957 INFO:tasks.workunit.client.0.smithi016.stdout:3/283: fsync d3/df/d25/f28 0 2024-04-26T20:18:45.957 INFO:tasks.workunit.client.0.smithi016.stdout:3/284: dread - d3/df/f26 zero size 2024-04-26T20:18:45.959 INFO:tasks.workunit.client.0.smithi016.stdout:3/285: symlink d3/df/d20/d41/l55 0 2024-04-26T20:18:45.973 INFO:tasks.workunit.client.0.smithi016.stdout:8/366: truncate d9/d23/d26/f2a 2848484 0 2024-04-26T20:18:45.974 INFO:tasks.workunit.client.0.smithi016.stdout:3/286: rename d3/df/d20/l30 to d3/df/d25/d2a/d4a/l56 0 2024-04-26T20:18:45.975 INFO:tasks.workunit.client.0.smithi016.stdout:8/367: creat d9/d66/f78 x:0 0 0 2024-04-26T20:18:45.977 INFO:tasks.workunit.client.0.smithi016.stdout:5/522: write d1/d9/d25/f67 [1609049,1240] 0 2024-04-26T20:18:45.977 INFO:tasks.workunit.client.0.smithi016.stdout:5/523: fdatasync d1/d9/d11/f58 0 2024-04-26T20:18:45.977 INFO:tasks.workunit.client.0.smithi016.stdout:5/524: readlink d1/d9/d25/l87 0 2024-04-26T20:18:45.977 INFO:tasks.workunit.client.0.smithi016.stdout:8/368: mkdir d9/d19/d45/d3f/d79 0 2024-04-26T20:18:45.977 INFO:tasks.workunit.client.0.smithi016.stdout:8/369: write d9/d23/d44/f5b [5241240,11599] 0 2024-04-26T20:18:45.979 INFO:tasks.workunit.client.0.smithi016.stdout:5/525: rename d1/d9/d11/f58 to d1/d9/d11/d4d/fa3 0 2024-04-26T20:18:45.979 INFO:tasks.workunit.client.0.smithi016.stdout:5/526: chown d1/d9/d11/c2e 4470 1 2024-04-26T20:18:45.979 INFO:tasks.workunit.client.0.smithi016.stdout:8/370: mknod d9/d23/d26/c7a 0 2024-04-26T20:18:45.980 INFO:tasks.workunit.client.0.smithi016.stdout:5/527: symlink d1/d9/d1c/d52/d74/la4 0 2024-04-26T20:18:45.981 INFO:tasks.workunit.client.0.smithi016.stdout:5/528: write d1/d9/d25/f2a [4466440,99327] 0 2024-04-26T20:18:45.997 INFO:tasks.workunit.client.0.smithi016.stdout:3/287: dread d3/df/d20/d41/f4e [0,4194304] 0 2024-04-26T20:18:45.997 INFO:tasks.workunit.client.0.smithi016.stdout:3/288: stat d3/d9/d2d/d4f/c52 0 2024-04-26T20:18:45.998 INFO:tasks.workunit.client.0.smithi016.stdout:8/371: rmdir d9/d23 39 2024-04-26T20:18:45.999 INFO:tasks.workunit.client.0.smithi016.stdout:9/397: dwrite d1/d2/f61 [0,4194304] 0 2024-04-26T20:18:46.000 INFO:tasks.workunit.client.0.smithi016.stdout:9/398: write d1/d2e/d40/f5a [509618,48099] 0 2024-04-26T20:18:46.005 INFO:tasks.workunit.client.0.smithi016.stdout:3/289: symlink d3/df/d20/d41/l57 0 2024-04-26T20:18:46.035 INFO:tasks.workunit.client.0.smithi016.stdout:8/372: dwrite d9/d23/d44/d50/f58 [4194304,4194304] 0 2024-04-26T20:18:46.044 INFO:tasks.workunit.client.0.smithi016.stdout:9/399: link d1/d2e/f7a d1/d2/d20/d49/d77/f7e 0 2024-04-26T20:18:46.044 INFO:tasks.workunit.client.0.smithi016.stdout:9/400: chown d1/d2/d20/d49/d77/f7e 42275 1 2024-04-26T20:18:46.044 INFO:tasks.workunit.client.0.smithi016.stdout:9/401: truncate d1/d2e/d40/f5a 769272 0 2024-04-26T20:18:46.044 INFO:tasks.workunit.client.0.smithi016.stdout:9/402: fsync d1/d2e/d40/f62 0 2024-04-26T20:18:46.044 INFO:tasks.workunit.client.0.smithi016.stdout:9/403: readlink d1/d66/l68 0 2024-04-26T20:18:46.045 INFO:tasks.workunit.client.0.smithi016.stdout:3/290: rename d3/d9/d18/f21 to d3/df/f58 0 2024-04-26T20:18:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:9/404: symlink d1/d59/d52/l7f 0 2024-04-26T20:18:46.046 INFO:tasks.workunit.client.0.smithi016.stdout:9/405: chown d1/d2/d20/l3d 248077 1 2024-04-26T20:18:46.105 INFO:tasks.workunit.client.0.smithi016.stdout:0/343: sync 2024-04-26T20:18:46.105 INFO:tasks.workunit.client.0.smithi016.stdout:6/253: sync 2024-04-26T20:18:46.105 INFO:tasks.workunit.client.0.smithi016.stdout:2/367: sync 2024-04-26T20:18:46.108 INFO:tasks.workunit.client.0.smithi016.stdout:1/455: sync 2024-04-26T20:18:46.108 INFO:tasks.workunit.client.0.smithi016.stdout:6/254: write d1/d3a/f55 [960050,107662] 0 2024-04-26T20:18:46.108 INFO:tasks.workunit.client.0.smithi016.stdout:3/291: mkdir d3/d9/d18/d59 0 2024-04-26T20:18:46.111 INFO:tasks.workunit.client.0.smithi016.stdout:9/406: unlink d1/d2/d20/d49/d77/d2a/l3b 0 2024-04-26T20:18:46.111 INFO:tasks.workunit.client.0.smithi016.stdout:0/344: dread d2/d20/d41/f62 [0,4194304] 0 2024-04-26T20:18:46.111 INFO:tasks.workunit.client.0.smithi016.stdout:0/345: chown d2/d20/d41/d4c 12462410 1 2024-04-26T20:18:46.113 INFO:tasks.workunit.client.0.smithi016.stdout:5/529: dwrite d1/d78/f80 [0,4194304] 0 2024-04-26T20:18:46.115 INFO:tasks.workunit.client.0.smithi016.stdout:2/368: link d1d/l48 d1d/d27/d2d/d5a/l80 0 2024-04-26T20:18:46.115 INFO:tasks.workunit.client.0.smithi016.stdout:6/255: mkdir d1/d21/d26/d1c/d5d 0 2024-04-26T20:18:46.115 INFO:tasks.workunit.client.0.smithi016.stdout:6/256: fsync d1/d21/d48/f4f 0 2024-04-26T20:18:46.116 INFO:tasks.workunit.client.0.smithi016.stdout:3/292: mkdir d3/d9/d18/d5a 0 2024-04-26T20:18:46.116 INFO:tasks.workunit.client.0.smithi016.stdout:9/407: link d1/d2/d20/d49/f7b d1/d1b/f80 0 2024-04-26T20:18:46.116 INFO:tasks.workunit.client.0.smithi016.stdout:9/408: write d1/f41 [812224,112644] 0 2024-04-26T20:18:46.116 INFO:tasks.workunit.client.0.smithi016.stdout:9/409: chown d1/d1b 209016 1 2024-04-26T20:18:46.117 INFO:tasks.workunit.client.0.smithi016.stdout:0/346: symlink d2/dc/d1e/l77 0 2024-04-26T20:18:46.118 INFO:tasks.workunit.client.0.smithi016.stdout:5/530: symlink d1/la5 0 2024-04-26T20:18:46.118 INFO:tasks.workunit.client.0.smithi016.stdout:5/531: chown d1/d9/d25/c90 255000 1 2024-04-26T20:18:46.118 INFO:tasks.workunit.client.0.smithi016.stdout:5/532: chown d1/d9/d1c/d52/d74/la4 5 1 2024-04-26T20:18:46.120 INFO:tasks.workunit.client.0.smithi016.stdout:2/369: creat d1d/d20/f81 x:0 0 0 2024-04-26T20:18:46.121 INFO:tasks.workunit.client.0.smithi016.stdout:6/257: mknod d1/d8/d2c/d47/c5e 0 2024-04-26T20:18:46.121 INFO:tasks.workunit.client.0.smithi016.stdout:6/258: truncate d1/d8/d2c/d3d/f58 566017 0 2024-04-26T20:18:46.122 INFO:tasks.workunit.client.0.smithi016.stdout:3/293: mkdir d3/df/d20/d5b 0 2024-04-26T20:18:46.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/410: mknod d1/d2/d20/d49/c81 0 2024-04-26T20:18:46.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/411: fsync d1/d2/d20/d49/d77/d2a/f5d 0 2024-04-26T20:18:46.129 INFO:tasks.workunit.client.0.smithi016.stdout:0/347: unlink d2/dc/c12 0 2024-04-26T20:18:46.129 INFO:tasks.workunit.client.0.smithi016.stdout:0/348: fsync d2/dc/d1e/d25/f55 0 2024-04-26T20:18:46.129 INFO:tasks.workunit.client.0.smithi016.stdout:0/349: chown d2/d8 5652405 1 2024-04-26T20:18:46.129 INFO:tasks.workunit.client.0.smithi016.stdout:0/350: write d2/dc/d18/f1a [1719832,97864] 0 2024-04-26T20:18:46.129 INFO:tasks.workunit.client.0.smithi016.stdout:5/533: creat d1/d78/fa6 x:0 0 0 2024-04-26T20:18:46.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/370: creat d1d/d2a/f82 x:0 0 0 2024-04-26T20:18:46.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/371: dread - d1d/d20/d22/f64 zero size 2024-04-26T20:18:46.130 INFO:tasks.workunit.client.0.smithi016.stdout:6/259: creat d1/d21/d26/d1c/d2e/d53/f5f x:0 0 0 2024-04-26T20:18:46.130 INFO:tasks.workunit.client.0.smithi016.stdout:6/260: stat d1/d21/c22 0 2024-04-26T20:18:46.133 INFO:tasks.workunit.client.0.smithi016.stdout:0/351: creat d2/dc/d45/f78 x:0 0 0 2024-04-26T20:18:46.133 INFO:tasks.workunit.client.0.smithi016.stdout:0/352: readlink d2/d20/d57/l66 0 2024-04-26T20:18:46.134 INFO:tasks.workunit.client.0.smithi016.stdout:3/294: unlink d3/la 0 2024-04-26T20:18:46.134 INFO:tasks.workunit.client.0.smithi016.stdout:3/295: fdatasync d3/f1b 0 2024-04-26T20:18:46.135 INFO:tasks.workunit.client.0.smithi016.stdout:5/534: symlink d1/d9/d25/la7 0 2024-04-26T20:18:46.135 INFO:tasks.workunit.client.0.smithi016.stdout:6/261: mknod d1/d8/d2c/d47/c60 0 2024-04-26T20:18:46.135 INFO:tasks.workunit.client.0.smithi016.stdout:6/262: write d1/d21/d26/f54 [347213,91749] 0 2024-04-26T20:18:46.136 INFO:tasks.workunit.client.0.smithi016.stdout:0/353: creat d2/dc/f79 x:0 0 0 2024-04-26T20:18:46.137 INFO:tasks.workunit.client.0.smithi016.stdout:3/296: creat d3/df/d25/f5c x:0 0 0 2024-04-26T20:18:46.137 INFO:tasks.workunit.client.0.smithi016.stdout:3/297: write d3/d9/d18/f34 [852078,102950] 0 2024-04-26T20:18:46.137 INFO:tasks.workunit.client.0.smithi016.stdout:3/298: write d3/df/f2b [701458,94376] 0 2024-04-26T20:18:46.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/299: readlink d3/l6 0 2024-04-26T20:18:46.138 INFO:tasks.workunit.client.0.smithi016.stdout:5/535: link d1/d9/d25/l57 d1/d9/d4b/la8 0 2024-04-26T20:18:46.139 INFO:tasks.workunit.client.0.smithi016.stdout:9/412: write d1/f8 [1032684,129863] 0 2024-04-26T20:18:46.139 INFO:tasks.workunit.client.0.smithi016.stdout:9/413: fsync d1/d2/f6 0 2024-04-26T20:18:46.139 INFO:tasks.workunit.client.0.smithi016.stdout:9/414: chown d1/d2/d20/d49/d77 36 1 2024-04-26T20:18:46.139 INFO:tasks.workunit.client.0.smithi016.stdout:9/415: dread - d1/d59/d52/f74 zero size 2024-04-26T20:18:46.139 INFO:tasks.workunit.client.0.smithi016.stdout:6/263: symlink d1/d3a/l61 0 2024-04-26T20:18:46.140 INFO:tasks.workunit.client.0.smithi016.stdout:1/456: dwrite d3/d5/d6/d9/f38 [0,4194304] 0 2024-04-26T20:18:46.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/354: creat d2/dc/d1e/d35/f7a x:0 0 0 2024-04-26T20:18:46.149 INFO:tasks.workunit.client.0.smithi016.stdout:2/372: dread f12 [0,4194304] 0 2024-04-26T20:18:46.160 INFO:tasks.workunit.client.0.smithi016.stdout:3/300: getdents d3/d9/d18 0 2024-04-26T20:18:46.164 INFO:tasks.workunit.client.0.smithi016.stdout:4/322: sync 2024-04-26T20:18:46.170 INFO:tasks.workunit.client.0.smithi016.stdout:9/416: rename d1/d1b/f32 to d1/d1b/f82 0 2024-04-26T20:18:46.170 INFO:tasks.workunit.client.0.smithi016.stdout:1/457: dread d3/f4 [0,4194304] 0 2024-04-26T20:18:46.173 INFO:tasks.workunit.client.0.smithi016.stdout:6/264: mknod d1/d21/d26/d25/c62 0 2024-04-26T20:18:46.206 INFO:tasks.workunit.client.0.smithi016.stdout:3/301: link d3/d9/d2d/d4f/c52 d3/d9/d18/d59/c5d 0 2024-04-26T20:18:46.207 INFO:tasks.workunit.client.0.smithi016.stdout:4/323: creat d0/dd/d19/f74 x:0 0 0 2024-04-26T20:18:46.208 INFO:tasks.workunit.client.0.smithi016.stdout:1/458: creat d3/d57/f8a x:0 0 0 2024-04-26T20:18:46.208 INFO:tasks.workunit.client.0.smithi016.stdout:1/459: write d3/d5/da/f46 [895416,80427] 0 2024-04-26T20:18:46.208 INFO:tasks.workunit.client.0.smithi016.stdout:1/460: chown d3/d5/d6/l1f 3223 1 2024-04-26T20:18:46.216 INFO:tasks.workunit.client.0.smithi016.stdout:0/355: dwrite d2/d20/d41/f6f [0,4194304] 0 2024-04-26T20:18:46.217 INFO:tasks.workunit.client.0.smithi016.stdout:1/461: mknod d3/d5/d6/d9/d2a/d3b/c8b 0 2024-04-26T20:18:46.225 INFO:tasks.workunit.client.0.smithi016.stdout:6/265: dwrite d1/f7 [4194304,4194304] 0 2024-04-26T20:18:46.225 INFO:tasks.workunit.client.0.smithi016.stdout:6/266: truncate d1/d21/d26/d1c/f3c 932730 0 2024-04-26T20:18:46.226 INFO:tasks.workunit.client.0.smithi016.stdout:6/267: chown d1 91167 1 2024-04-26T20:18:46.239 INFO:tasks.workunit.client.0.smithi016.stdout:2/373: write d1d/d27/f3f [123769,130375] 0 2024-04-26T20:18:46.242 INFO:tasks.workunit.client.0.smithi016.stdout:0/356: symlink d2/dc/d45/l7b 0 2024-04-26T20:18:46.242 INFO:tasks.workunit.client.0.smithi016.stdout:0/357: chown d2/dc/d1e 63 1 2024-04-26T20:18:46.242 INFO:tasks.workunit.client.0.smithi016.stdout:0/358: fdatasync d2/d8/f9 0 2024-04-26T20:18:46.243 INFO:tasks.workunit.client.0.smithi016.stdout:6/268: getdents d1 0 2024-04-26T20:18:46.243 INFO:tasks.workunit.client.0.smithi016.stdout:9/417: dwrite d1/d2e/f35 [4194304,4194304] 0 2024-04-26T20:18:46.244 INFO:tasks.workunit.client.0.smithi016.stdout:2/374: mknod d1d/d20/d22/c83 0 2024-04-26T20:18:46.245 INFO:tasks.workunit.client.0.smithi016.stdout:2/375: dread - d1d/d20/f81 zero size 2024-04-26T20:18:46.257 INFO:tasks.workunit.client.0.smithi016.stdout:6/269: symlink d1/d21/d26/d25/l63 0 2024-04-26T20:18:46.257 INFO:tasks.workunit.client.0.smithi016.stdout:6/270: chown d1/d21/f3e 11215003 1 2024-04-26T20:18:46.257 INFO:tasks.workunit.client.0.smithi016.stdout:5/536: dwrite d1/d9/f16 [0,4194304] 0 2024-04-26T20:18:46.258 INFO:tasks.workunit.client.0.smithi016.stdout:2/376: mknod d1d/d20/c84 0 2024-04-26T20:18:46.259 INFO:tasks.workunit.client.0.smithi016.stdout:0/359: dread d2/d8/f36 [0,4194304] 0 2024-04-26T20:18:46.259 INFO:tasks.workunit.client.0.smithi016.stdout:0/360: write d2/dc/f79 [221698,50473] 0 2024-04-26T20:18:46.259 INFO:tasks.workunit.client.0.smithi016.stdout:6/271: creat d1/d21/d26/d1c/d2e/f64 x:0 0 0 2024-04-26T20:18:46.260 INFO:tasks.workunit.client.0.smithi016.stdout:5/537: creat d1/d9/d11/fa9 x:0 0 0 2024-04-26T20:18:46.261 INFO:tasks.workunit.client.0.smithi016.stdout:9/418: creat d1/d2/d20/d49/d77/d2a/d75/f83 x:0 0 0 2024-04-26T20:18:46.261 INFO:tasks.workunit.client.0.smithi016.stdout:9/419: fdatasync d1/d2/f5 0 2024-04-26T20:18:46.261 INFO:tasks.workunit.client.0.smithi016.stdout:9/420: chown d1/d2/d20/d49/d77/d2a/d33/d44 466 1 2024-04-26T20:18:46.265 INFO:tasks.workunit.client.0.smithi016.stdout:1/462: dwrite d3/d5/da/fc [0,4194304] 0 2024-04-26T20:18:46.266 INFO:tasks.workunit.client.0.smithi016.stdout:2/377: creat d1d/d2a/d3d/f85 x:0 0 0 2024-04-26T20:18:46.270 INFO:tasks.workunit.client.0.smithi016.stdout:0/361: fsync d2/f15 0 2024-04-26T20:18:46.270 INFO:tasks.workunit.client.0.smithi016.stdout:3/302: dwrite d3/df/f1e [0,4194304] 0 2024-04-26T20:18:46.270 INFO:tasks.workunit.client.0.smithi016.stdout:0/362: getdents d2/dc/d18/d24/d53 0 2024-04-26T20:18:46.270 INFO:tasks.workunit.client.0.smithi016.stdout:3/303: readlink d3/df/d20/l33 0 2024-04-26T20:18:46.270 INFO:tasks.workunit.client.0.smithi016.stdout:0/363: fdatasync d2/d20/d41/d4c/d4e/f54 0 2024-04-26T20:18:46.272 INFO:tasks.workunit.client.0.smithi016.stdout:5/538: unlink d1/d9/d1c/l55 0 2024-04-26T20:18:46.275 INFO:tasks.workunit.client.0.smithi016.stdout:1/463: rename d3/d5/d6/d9/d49 to d3/d5/da/d66/d8c 0 2024-04-26T20:18:46.275 INFO:tasks.workunit.client.0.smithi016.stdout:1/464: chown c0 15621 1 2024-04-26T20:18:46.277 INFO:tasks.workunit.client.0.smithi016.stdout:2/378: creat d1d/d20/d22/d39/d3e/f86 x:0 0 0 2024-04-26T20:18:46.278 INFO:tasks.workunit.client.0.smithi016.stdout:2/379: fdatasync d1d/f1f 0 2024-04-26T20:18:46.278 INFO:tasks.workunit.client.0.smithi016.stdout:2/380: fsync d1d/d27/d2d/f4c 0 2024-04-26T20:18:46.278 INFO:tasks.workunit.client.0.smithi016.stdout:2/381: write f1b [4377594,93840] 0 2024-04-26T20:18:46.278 INFO:tasks.workunit.client.0.smithi016.stdout:2/382: write d1d/d20/d22/d29/f32 [1378622,78140] 0 2024-04-26T20:18:46.278 INFO:tasks.workunit.client.0.smithi016.stdout:2/383: truncate d1d/d20/d22/d39/d3e/f47 1145670 0 2024-04-26T20:18:46.283 INFO:tasks.workunit.client.0.smithi016.stdout:9/421: creat d1/d2/d20/d49/d77/d3e/f84 x:0 0 0 2024-04-26T20:18:46.287 INFO:tasks.workunit.client.0.smithi016.stdout:1/465: rmdir d3/d5/da/d66 39 2024-04-26T20:18:46.288 INFO:tasks.workunit.client.0.smithi016.stdout:6/272: write d1/f6 [436698,117744] 0 2024-04-26T20:18:46.299 INFO:tasks.workunit.client.0.smithi016.stdout:4/324: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:18:46.299 INFO:tasks.workunit.client.0.smithi016.stdout:4/325: write d0/d1e/f21 [2775063,86797] 0 2024-04-26T20:18:46.299 INFO:tasks.workunit.client.0.smithi016.stdout:4/326: read d0/dd/d19/d1f/f45 [917436,40726] 0 2024-04-26T20:18:46.299 INFO:tasks.workunit.client.0.smithi016.stdout:9/422: mkdir d1/d2/d20/d49/d77/d2a/d75/d85 0 2024-04-26T20:18:46.299 INFO:tasks.workunit.client.0.smithi016.stdout:9/423: chown d1/d1b/l38 747 1 2024-04-26T20:18:46.299 INFO:tasks.workunit.client.0.smithi016.stdout:1/466: mkdir d3/d5/d8d 0 2024-04-26T20:18:46.307 INFO:tasks.workunit.client.0.smithi016.stdout:3/304: dwrite d3/d9/f4d [0,4194304] 0 2024-04-26T20:18:46.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/305: fsync d3/d9/d18/f34 0 2024-04-26T20:18:46.309 INFO:tasks.workunit.client.0.smithi016.stdout:9/424: mknod d1/d2e/d40/c86 0 2024-04-26T20:18:46.309 INFO:tasks.workunit.client.0.smithi016.stdout:1/467: symlink d3/d5/d6/d9/d2a/d3d/l8e 0 2024-04-26T20:18:46.311 INFO:tasks.workunit.client.0.smithi016.stdout:4/327: dread d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:18:46.311 INFO:tasks.workunit.client.0.smithi016.stdout:3/306: mknod d3/df/d25/c5e 0 2024-04-26T20:18:46.313 INFO:tasks.workunit.client.0.smithi016.stdout:9/425: symlink d1/d2/d20/d49/d77/d3e/l87 0 2024-04-26T20:18:46.313 INFO:tasks.workunit.client.0.smithi016.stdout:9/426: write d1/f8 [420262,105847] 0 2024-04-26T20:18:46.313 INFO:tasks.workunit.client.0.smithi016.stdout:9/427: dread - d1/d1b/f58 zero size 2024-04-26T20:18:46.315 INFO:tasks.workunit.client.0.smithi016.stdout:1/468: rename d3/d5/d6/d9/d2a/f75 to d3/d5/f8f 0 2024-04-26T20:18:46.316 INFO:tasks.workunit.client.0.smithi016.stdout:3/307: unlink d3/d9/c1f 0 2024-04-26T20:18:46.319 INFO:tasks.workunit.client.0.smithi016.stdout:9/428: dread d1/d2/d20/d49/d77/d2a/d33/f4a [0,4194304] 0 2024-04-26T20:18:46.319 INFO:tasks.workunit.client.0.smithi016.stdout:1/469: rmdir d3/d5/d6/d5a 39 2024-04-26T20:18:46.321 INFO:tasks.workunit.client.0.smithi016.stdout:3/308: creat d3/d9/d2d/f5f x:0 0 0 2024-04-26T20:18:46.363 INFO:tasks.workunit.client.0.smithi016.stdout:2/384: write f7 [64129,28529] 0 2024-04-26T20:18:46.399 INFO:tasks.workunit.client.0.smithi016.stdout:4/328: dread d0/dd/f3b [0,4194304] 0 2024-04-26T20:18:46.399 INFO:tasks.workunit.client.0.smithi016.stdout:6/273: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:46.399 INFO:tasks.workunit.client.0.smithi016.stdout:6/274: stat d1/d8/d3b/l40 0 2024-04-26T20:18:46.399 INFO:tasks.workunit.client.0.smithi016.stdout:6/275: readlink d1/d3a/l61 0 2024-04-26T20:18:46.400 INFO:tasks.workunit.client.0.smithi016.stdout:4/329: truncate d0/d1e/d41/f5f 998042 0 2024-04-26T20:18:46.400 INFO:tasks.workunit.client.0.smithi016.stdout:6/276: fdatasync d1/d21/d26/d1c/d2e/d53/f59 0 2024-04-26T20:18:46.401 INFO:tasks.workunit.client.0.smithi016.stdout:9/429: creat d1/d2/d43/f88 x:0 0 0 2024-04-26T20:18:46.401 INFO:tasks.workunit.client.0.smithi016.stdout:9/430: truncate d1/d59/d52/f74 472155 0 2024-04-26T20:18:46.401 INFO:tasks.workunit.client.0.smithi016.stdout:9/431: read d1/f8 [37825,60719] 0 2024-04-26T20:18:46.402 INFO:tasks.workunit.client.0.smithi016.stdout:1/470: creat d3/d5/d6/d5a/f90 x:0 0 0 2024-04-26T20:18:46.402 INFO:tasks.workunit.client.0.smithi016.stdout:1/471: write d3/d5/d6/d5a/f3f [461535,82823] 0 2024-04-26T20:18:46.403 INFO:tasks.workunit.client.0.smithi016.stdout:1/472: truncate d3/d57/f44 259715 0 2024-04-26T20:18:46.403 INFO:tasks.workunit.client.0.smithi016.stdout:1/473: dread - d3/d5/d6/d50/d79/f85 zero size 2024-04-26T20:18:46.422 INFO:tasks.workunit.client.0.smithi016.stdout:3/309: dwrite f2 [4194304,4194304] 0 2024-04-26T20:18:46.426 INFO:tasks.workunit.client.0.smithi016.stdout:4/330: rename d0/dd/d19/f74 to d0/d1e/f75 0 2024-04-26T20:18:46.426 INFO:tasks.workunit.client.0.smithi016.stdout:6/277: symlink d1/d21/d26/d1c/d2e/l65 0 2024-04-26T20:18:46.429 INFO:tasks.workunit.client.0.smithi016.stdout:3/310: rename d3/df/d25/f46 to d3/f60 0 2024-04-26T20:18:46.429 INFO:tasks.workunit.client.0.smithi016.stdout:3/311: truncate d3/d9/f4d 4727579 0 2024-04-26T20:18:46.430 INFO:tasks.workunit.client.0.smithi016.stdout:6/278: fdatasync d1/d8/fc 0 2024-04-26T20:18:46.445 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:46.449 INFO:tasks.workunit.client.0.smithi016.stdout:2/385: dwrite d1d/d20/d22/f62 [0,4194304] 0 2024-04-26T20:18:46.449 INFO:tasks.workunit.client.0.smithi016.stdout:2/386: write d1d/d20/d22/d39/d3e/f47 [1422101,122499] 0 2024-04-26T20:18:46.450 INFO:tasks.workunit.client.0.smithi016.stdout:2/387: chown d1d/d27/d2d/f4c 47803980 1 2024-04-26T20:18:46.450 INFO:tasks.workunit.client.0.smithi016.stdout:6/279: mknod d1/d21/d26/d1c/c66 0 2024-04-26T20:18:46.450 INFO:tasks.workunit.client.0.smithi016.stdout:6/280: truncate d1/d21/d26/d1c/d2e/f64 878363 0 2024-04-26T20:18:46.450 INFO:tasks.workunit.client.0.smithi016.stdout:6/281: chown d1/fa 60 1 2024-04-26T20:18:46.455 INFO:tasks.workunit.client.0.smithi016.stdout:3/312: read d3/d9/f4d [4006527,44614] 0 2024-04-26T20:18:46.516 INFO:tasks.workunit.client.0.smithi016.stdout:3/313: dwrite d3/d9/f3d [0,4194304] 0 2024-04-26T20:18:46.530 INFO:tasks.workunit.client.0.smithi016.stdout:6/282: dwrite f0 [0,4194304] 0 2024-04-26T20:18:46.533 INFO:tasks.workunit.client.0.smithi016.stdout:6/283: dread d1/d8/d2c/f41 [0,4194304] 0 2024-04-26T20:18:46.535 INFO:tasks.workunit.client.0.smithi016.stdout:9/432: dread d1/d2/d20/d49/f7b [0,4194304] 0 2024-04-26T20:18:46.536 INFO:tasks.workunit.client.0.smithi016.stdout:5/539: dwrite d1/d9/f3d [0,4194304] 0 2024-04-26T20:18:46.536 INFO:tasks.workunit.client.0.smithi016.stdout:4/331: truncate d0/d1e/f73 255496 0 2024-04-26T20:18:46.537 INFO:tasks.workunit.client.0.smithi016.stdout:4/332: write d0/dd/d19/d57/f60 [578958,28072] 0 2024-04-26T20:18:46.537 INFO:tasks.workunit.client.0.smithi016.stdout:4/333: readlink d0/d1e/d41/l68 0 2024-04-26T20:18:46.537 INFO:tasks.workunit.client.0.smithi016.stdout:4/334: write d0/dd/d19/d57/f63 [293207,58604] 0 2024-04-26T20:18:46.539 INFO:tasks.workunit.client.0.smithi016.stdout:2/388: unlink d1d/d2a/f82 0 2024-04-26T20:18:46.542 INFO:tasks.workunit.client.0.smithi016.stdout:6/284: rmdir d1/d8/d2c/d3d 39 2024-04-26T20:18:46.542 INFO:tasks.workunit.client.0.smithi016.stdout:9/433: symlink d1/d2/d20/d49/d77/d3e/l89 0 2024-04-26T20:18:46.543 INFO:tasks.workunit.client.0.smithi016.stdout:2/389: read d1d/d2a/f31 [1034296,41498] 0 2024-04-26T20:18:46.553 INFO:tasks.workunit.client.0.smithi016.stdout:6/285: getdents d1/d8/d2c/d47 0 2024-04-26T20:18:46.569 INFO:tasks.workunit.client.0.smithi016.stdout:5/540: read d1/d9/d25/f47 [1229703,98923] 0 2024-04-26T20:18:46.569 INFO:tasks.workunit.client.0.smithi016.stdout:5/541: readlink d1/d9/d25/l6e 0 2024-04-26T20:18:46.570 INFO:tasks.workunit.client.0.smithi016.stdout:9/434: symlink d1/d2e/d40/l8a 0 2024-04-26T20:18:46.570 INFO:tasks.workunit.client.0.smithi016.stdout:6/286: dread d1/d8/d2c/d47/f5a [0,4194304] 0 2024-04-26T20:18:46.571 INFO:tasks.workunit.client.0.smithi016.stdout:3/314: dwrite d3/f16 [0,4194304] 0 2024-04-26T20:18:46.571 INFO:tasks.workunit.client.0.smithi016.stdout:3/315: write d3/df/f26 [915080,18853] 0 2024-04-26T20:18:46.571 INFO:tasks.workunit.client.0.smithi016.stdout:2/390: mknod d1d/d27/d2d/d6b/c87 0 2024-04-26T20:18:46.571 INFO:tasks.workunit.client.0.smithi016.stdout:5/542: mkdir d1/d9/d11/daa 0 2024-04-26T20:18:46.573 INFO:tasks.workunit.client.0.smithi016.stdout:6/287: mkdir d1/d8/d2c/d47/d67 0 2024-04-26T20:18:46.573 INFO:tasks.workunit.client.0.smithi016.stdout:3/316: mkdir d3/df/d20/d61 0 2024-04-26T20:18:46.574 INFO:tasks.workunit.client.0.smithi016.stdout:2/391: mkdir d1d/d20/d22/d88 0 2024-04-26T20:18:46.574 INFO:tasks.workunit.client.0.smithi016.stdout:2/392: fsync d1d/d27/d2d/f44 0 2024-04-26T20:18:46.575 INFO:tasks.workunit.client.0.smithi016.stdout:5/543: mknod d1/d78/d99/cab 0 2024-04-26T20:18:46.576 INFO:tasks.workunit.client.0.smithi016.stdout:9/435: rename d1/d66/l68 to d1/d2/d20/d49/d77/l8b 0 2024-04-26T20:18:46.576 INFO:tasks.workunit.client.0.smithi016.stdout:9/436: chown d1/fa 30568624 1 2024-04-26T20:18:46.576 INFO:tasks.workunit.client.0.smithi016.stdout:6/288: symlink d1/d21/d26/d1c/d5d/l68 0 2024-04-26T20:18:46.577 INFO:tasks.workunit.client.0.smithi016.stdout:3/317: mkdir d3/d9/d2d/d62 0 2024-04-26T20:18:46.579 INFO:tasks.workunit.client.0.smithi016.stdout:8/373: sync 2024-04-26T20:18:46.580 INFO:tasks.workunit.client.0.smithi016.stdout:7/398: sync 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:5/544: getdents d1 0 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:5/545: chown d1/f22 1 1 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:5/546: dread - d1/d9/d11/fa9 zero size 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:5/547: dread - d1/d78/fa6 zero size 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:9/437: mkdir d1/d59/d52/d8c 0 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:3/318: write d3/f19 [431691,44637] 0 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:9/438: truncate d1/d2/d20/d49/d77/d2a/d75/f83 728214 0 2024-04-26T20:18:46.582 INFO:tasks.workunit.client.0.smithi016.stdout:9/439: readlink d1/d59/l18 0 2024-04-26T20:18:46.583 INFO:tasks.workunit.client.0.smithi016.stdout:8/374: mknod d9/d23/d26/d2c/c7b 0 2024-04-26T20:18:46.583 INFO:tasks.workunit.client.0.smithi016.stdout:7/399: getdents d0/d51 0 2024-04-26T20:18:46.583 INFO:tasks.workunit.client.0.smithi016.stdout:7/400: write d0/d1/f30 [831551,81761] 0 2024-04-26T20:18:46.584 INFO:tasks.workunit.client.0.smithi016.stdout:5/548: truncate d1/d9/d25/f47 2650453 0 2024-04-26T20:18:46.584 INFO:tasks.workunit.client.0.smithi016.stdout:5/549: write d1/d9/d1c/d52/d74/f4f [1080658,72629] 0 2024-04-26T20:18:46.586 INFO:tasks.workunit.client.0.smithi016.stdout:3/319: link d3/df/c54 d3/df/d20/d41/c63 0 2024-04-26T20:18:46.586 INFO:tasks.workunit.client.0.smithi016.stdout:8/375: creat d9/d19/d45/f7c x:0 0 0 2024-04-26T20:18:46.589 INFO:tasks.workunit.client.0.smithi016.stdout:7/401: creat d0/d1/d34/d25/d3f/f7a x:0 0 0 2024-04-26T20:18:46.592 INFO:tasks.workunit.client.0.smithi016.stdout:5/550: mkdir d1/d9/d11/d4d/d72/dac 0 2024-04-26T20:18:46.592 INFO:tasks.workunit.client.0.smithi016.stdout:5/551: chown d1/d9 139336 1 2024-04-26T20:18:46.593 INFO:tasks.workunit.client.0.smithi016.stdout:8/376: symlink d9/d19/d45/d3f/d79/l7d 0 2024-04-26T20:18:46.595 INFO:tasks.workunit.client.0.smithi016.stdout:7/402: symlink d0/d1/d46/l7b 0 2024-04-26T20:18:46.595 INFO:tasks.workunit.client.0.smithi016.stdout:2/393: dread d1d/d20/d22/d39/f45 [0,4194304] 0 2024-04-26T20:18:46.595 INFO:tasks.workunit.client.0.smithi016.stdout:7/403: chown d0/d1 2 1 2024-04-26T20:18:46.596 INFO:tasks.workunit.client.0.smithi016.stdout:5/552: symlink d1/d9/d1c/d52/d74/lad 0 2024-04-26T20:18:46.597 INFO:tasks.workunit.client.0.smithi016.stdout:8/377: mknod d9/d19/d45/c7e 0 2024-04-26T20:18:46.597 INFO:tasks.workunit.client.0.smithi016.stdout:8/378: truncate d9/d23/d44/f68 1011547 0 2024-04-26T20:18:46.597 INFO:tasks.workunit.client.0.smithi016.stdout:2/394: mkdir d1d/d20/d22/d89 0 2024-04-26T20:18:46.599 INFO:tasks.workunit.client.0.smithi016.stdout:7/404: creat d0/d1/d34/d3b/d6c/f7c x:0 0 0 2024-04-26T20:18:46.600 INFO:tasks.workunit.client.0.smithi016.stdout:8/379: creat d9/d19/d45/d3f/f7f x:0 0 0 2024-04-26T20:18:46.603 INFO:tasks.workunit.client.0.smithi016.stdout:7/405: symlink d0/d1/d34/d25/d3f/l7d 0 2024-04-26T20:18:46.603 INFO:tasks.workunit.client.0.smithi016.stdout:2/395: creat d1d/d27/d2d/d6b/d7e/f8a x:0 0 0 2024-04-26T20:18:46.603 INFO:tasks.workunit.client.0.smithi016.stdout:2/396: fdatasync d1d/d27/d2d/f70 0 2024-04-26T20:18:46.603 INFO:tasks.workunit.client.0.smithi016.stdout:6/289: dread d1/f7 [4194304,4194304] 0 2024-04-26T20:18:46.604 INFO:tasks.workunit.client.0.smithi016.stdout:6/290: dread - d1/d21/d26/d1c/f4d zero size 2024-04-26T20:18:46.604 INFO:tasks.workunit.client.0.smithi016.stdout:5/553: link d1/d9/d25/l93 d1/d9/lae 0 2024-04-26T20:18:46.605 INFO:tasks.workunit.client.0.smithi016.stdout:5/554: write d1/d9/f14 [3816641,11020] 0 2024-04-26T20:18:46.607 INFO:tasks.workunit.client.0.smithi016.stdout:8/380: getdents d9/d19 0 2024-04-26T20:18:46.607 INFO:tasks.workunit.client.0.smithi016.stdout:8/381: chown d9/d23/d26/f2d 46215 1 2024-04-26T20:18:46.616 INFO:tasks.workunit.client.0.smithi016.stdout:6/291: link d1/fd d1/d21/d26/d1c/d2e/d53/f69 0 2024-04-26T20:18:46.619 INFO:tasks.workunit.client.0.smithi016.stdout:2/397: write d1d/d27/f3f [1268211,26852] 0 2024-04-26T20:18:46.626 INFO:tasks.workunit.client.0.smithi016.stdout:5/555: rename d1/d9/d1c/c2c to d1/caf 0 2024-04-26T20:18:46.628 INFO:tasks.workunit.client.0.smithi016.stdout:8/382: creat d9/d23/d26/d2c/f80 x:0 0 0 2024-04-26T20:18:46.638 INFO:tasks.workunit.client.0.smithi016.stdout:3/320: dwrite d3/df/f2b [0,4194304] 0 2024-04-26T20:18:46.638 INFO:tasks.workunit.client.0.smithi016.stdout:9/440: write d1/d2e/d40/f62 [2185730,129143] 0 2024-04-26T20:18:46.639 INFO:tasks.workunit.client.0.smithi016.stdout:9/441: readlink d1/d1b/l37 0 2024-04-26T20:18:46.642 INFO:tasks.workunit.client.0.smithi016.stdout:5/556: mknod d1/d9/d4b/cb0 0 2024-04-26T20:18:46.662 INFO:tasks.workunit.client.0.smithi016.stdout:2/398: write d1d/d2a/d3d/f7b [3857286,23632] 0 2024-04-26T20:18:46.662 INFO:tasks.workunit.client.0.smithi016.stdout:2/399: chown d1d/d20/d22/d39/d3e/c46 150174336 1 2024-04-26T20:18:46.662 INFO:tasks.workunit.client.0.smithi016.stdout:2/400: stat d1d/d27/c75 0 2024-04-26T20:18:46.668 INFO:tasks.workunit.client.0.smithi016.stdout:5/557: symlink d1/d9/d11/daa/lb1 0 2024-04-26T20:18:46.670 INFO:tasks.workunit.client.0.smithi016.stdout:7/406: dwrite d0/f15 [8388608,4194304] 0 2024-04-26T20:18:46.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:18:46.676 INFO:tasks.workunit.client.0.smithi016.stdout:7/407: write d0/d1/f20 [1198193,79802] 0 2024-04-26T20:18:46.679 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:18:46.681 INFO:tasks.workunit.client.0.smithi016.stdout:2/401: link d1d/d27/d2d/c60 d1d/d27/d2d/c8b 0 2024-04-26T20:18:46.686 INFO:tasks.workunit.client.0.smithi016.stdout:9/442: symlink d1/d2/d20/d49/d77/l8d 0 2024-04-26T20:18:46.688 INFO:tasks.workunit.client.0.smithi016.stdout:2/402: unlink d1d/d20/d22/l25 0 2024-04-26T20:18:46.689 INFO:tasks.workunit.client.0.smithi016.stdout:9/443: mknod d1/d2/d20/c8e 0 2024-04-26T20:18:46.690 INFO:tasks.workunit.client.0.smithi016.stdout:2/403: truncate d1d/d20/f2b 1043757 0 2024-04-26T20:18:46.697 INFO:tasks.workunit.client.0.smithi016.stdout:3/321: dwrite d3/d9/f1a [0,4194304] 0 2024-04-26T20:18:46.697 INFO:tasks.workunit.client.0.smithi016.stdout:2/404: symlink d1d/d20/d22/d39/l8c 0 2024-04-26T20:18:46.697 INFO:tasks.workunit.client.0.smithi016.stdout:2/405: write d1d/d20/f81 [298123,82451] 0 2024-04-26T20:18:46.697 INFO:tasks.workunit.client.0.smithi016.stdout:5/558: dread d1/d9/d25/f64 [0,4194304] 0 2024-04-26T20:18:46.697 INFO:tasks.workunit.client.0.smithi016.stdout:5/559: write d1/d9/d11/f61 [1818102,90152] 0 2024-04-26T20:18:46.697 INFO:tasks.workunit.client.0.smithi016.stdout:5/560: chown d1/d9/d1c/d52/d74/f94 300 1 2024-04-26T20:18:46.699 INFO:tasks.workunit.client.0.smithi016.stdout:9/444: rename d1/d2/d20/d49/d77/l6d to d1/d66/l8f 0 2024-04-26T20:18:46.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49c4e00640 1 Processor -- start 2024-04-26T20:18:46.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49c4e00640 1 -- start start 2024-04-26T20:18:46.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49c4e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49c00cec90 0x7f49c00c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:46.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49c4e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f49c00c7ff0 0x7f49c0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:46.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49c4e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c00cb080 con 0x7f49c0153fc0 2024-04-26T20:18:46.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49c4e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f49c01543a0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49c4e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f49c00cae30 con 0x7f49c00cec90 2024-04-26T20:18:46.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49bd400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49c00cec90 0x7f49c00c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:46.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49be800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f49c00c7ff0 0x7f49c0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:46.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49bd400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49c00cec90 0x7f49c00c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:55736/0 (socket says 172.21.15.16:55736) 2024-04-26T20:18:46.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49be800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f49c00c7ff0 0x7f49c0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36882/0 (socket says 172.21.15.16:36882) 2024-04-26T20:18:46.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49bd400640 1 -- 172.21.15.16:0/471847217 learned_addr learned my addr 172.21.15.16:0/471847217 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:46.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49bde00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f49c0153fc0 0x7f49c00c8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:54690/0 (socket says 172.21.15.16:54690) 2024-04-26T20:18:46.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49be800640 1 -- 172.21.15.16:0/471847217 >> v2:172.21.15.192:3300/0 conn(0x7f49c00cec90 msgr2=0x7f49c00c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:46.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49be800640 1 --2- 172.21.15.16:0/471847217 >> v2:172.21.15.192:3300/0 conn(0x7f49c00cec90 0x7f49c00c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49be800640 1 -- 172.21.15.16:0/471847217 >> v1:172.21.15.192:6789/0 conn(0x7f49c0153fc0 legacy=0x7f49c00c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:46.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.711+0000 7f49be800640 1 -- 172.21.15.16:0/471847217 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c00cb360 con 0x7f49c00c7ff0 2024-04-26T20:18:46.721 INFO:tasks.workunit.client.0.smithi016.stdout:8/383: dwrite d9/d19/d45/d3f/d64/f62 [0,4194304] 0 2024-04-26T20:18:46.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49be800640 1 --2- 172.21.15.16:0/471847217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c0159ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f49c00708e0 tx=0x7f49b801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783d7616b533ab3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:46.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49bca00640 1 -- 172.21.15.16:0/471847217 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80b2070 con 0x7f49c00c7ff0 2024-04-26T20:18:46.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49bca00640 1 -- 172.21.15.16:0/471847217 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b80a57f0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49bca00640 1 -- 172.21.15.16:0/471847217 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80a5bc0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.723 INFO:tasks.workunit.client.0.smithi016.stdout:8/384: write d9/f53 [97761,49133] 0 2024-04-26T20:18:46.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49c4e00640 1 -- 172.21.15.16:0/471847217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 msgr2=0x7f49c0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49c4e00640 1 --2- 172.21.15.16:0/471847217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c0159ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f49c00708e0 tx=0x7f49b801c930 comp rx=0 tx=0).stop 2024-04-26T20:18:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49c4e00640 1 -- 172.21.15.16:0/471847217 shutdown_connections 2024-04-26T20:18:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49c4e00640 1 --2- 172.21.15.16:0/471847217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c0159ec0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49c4e00640 1 --2- 172.21.15.16:0/471847217 >> v2:172.21.15.192:3300/0 conn(0x7f49c00cec90 0x7f49c00c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.719+0000 7f49c4e00640 1 -- 172.21.15.16:0/471847217 >> 172.21.15.16:0/471847217 conn(0x7f49c0073240 msgr2=0x7f49c0073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.723+0000 7f49c4e00640 1 -- 172.21.15.16:0/471847217 shutdown_connections 2024-04-26T20:18:46.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.723+0000 7f49c4e00640 1 -- 172.21.15.16:0/471847217 wait complete. 2024-04-26T20:18:46.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.723+0000 7f49c4e00640 1 Processor -- start 2024-04-26T20:18:46.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.723+0000 7f49c4e00640 1 -- start start 2024-04-26T20:18:46.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49c4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:46.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49c4e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c00cec90 0x7f49c0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:46.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49c4e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c0153fc0 0x7f49c0155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:46.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49c4e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00c78b0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49c4e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00cbc90 con 0x7f49c0153fc0 2024-04-26T20:18:46.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49c4e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f49c0070650 con 0x7f49c00cec90 2024-04-26T20:18:46.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c014b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36886/0 (socket says 172.21.15.16:36886) 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 -- 172.21.15.16:0/1969036602 learned_addr learned my addr 172.21.15.16:0/1969036602 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49be800640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c0153fc0 0x7f49c0155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bd400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c00cec90 0x7f49c0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 -- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c00cec90 msgr2=0x7f49c0154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c00cec90 0x7f49c0154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 -- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c0153fc0 msgr2=0x7f49c0155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c0153fc0 0x7f49c0155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 -- 172.21.15.16:0/1969036602 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c01545f0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49bde00640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c014b060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00c460 tx=0x7f49ac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:46.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49b6000640 1 -- 172.21.15.16:0/1969036602 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac018070 con 0x7f49c00c7ff0 2024-04-26T20:18:46.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49b6000640 1 -- 172.21.15.16:0/1969036602 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac007480 con 0x7f49c00c7ff0 2024-04-26T20:18:46.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49b6000640 1 -- 172.21.15.16:0/1969036602 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0047f0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.727+0000 7f49c4e00640 1 -- 172.21.15.16:0/1969036602 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c014c680 con 0x7f49c00c7ff0 2024-04-26T20:18:46.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.731+0000 7f49c4e00640 1 -- 172.21.15.16:0/1969036602 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c014cc40 con 0x7f49c00c7ff0 2024-04-26T20:18:46.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.731+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49940052a0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.735 INFO:tasks.workunit.client.0.smithi016.stdout:7/408: dwrite d0/d51/f5d [0,4194304] 0 2024-04-26T20:18:46.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.731+0000 7f49b6000640 1 -- 172.21.15.16:0/1969036602 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49ac0049b0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.731+0000 7f49b6000640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f49a00683b0 0x7f49a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:46.737 INFO:tasks.workunit.client.0.smithi016.stdout:5/561: truncate d1/d9/d4b/f6a 1643311 0 2024-04-26T20:18:46.737 INFO:tasks.workunit.client.0.smithi016.stdout:5/562: write d1/d9/d25/f79 [622888,122433] 0 2024-04-26T20:18:46.739 INFO:tasks.workunit.client.0.smithi016.stdout:7/409: symlink d0/d1/d6/d73/l7e 0 2024-04-26T20:18:46.739 INFO:tasks.workunit.client.0.smithi016.stdout:7/410: dread - d0/d67/f6a zero size 2024-04-26T20:18:46.740 INFO:tasks.workunit.client.0.smithi016.stdout:3/322: dwrite d3/df/d20/d41/f4e [0,4194304] 0 2024-04-26T20:18:46.740 INFO:tasks.workunit.client.0.smithi016.stdout:3/323: stat d3/df/f58 0 2024-04-26T20:18:46.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.739+0000 7f49bd400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f49a00683b0 0x7f49a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:46.742 INFO:tasks.workunit.client.0.smithi016.stdout:5/563: link d1/d9/d11/l3f d1/d9/d11/daa/lb2 0 2024-04-26T20:18:46.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.739+0000 7f49bd400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f49a00683b0 0x7f49a006a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f49c014bac0 tx=0x7f49b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.739+0000 7f49b6000640 1 -- 172.21.15.16:0/1969036602 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f49ac053a60 con 0x7f49c00c7ff0 2024-04-26T20:18:46.743 INFO:tasks.workunit.client.0.smithi016.stdout:6/292: dwrite d1/d8/d2c/f42 [0,4194304] 0 2024-04-26T20:18:46.743 INFO:tasks.workunit.client.0.smithi016.stdout:7/411: truncate d0/d1/d34/d25/d3f/f55 313878 0 2024-04-26T20:18:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.739+0000 7f49b6000640 1 -- 172.21.15.16:0/1969036602 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49ac0559c0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.765 INFO:tasks.workunit.client.0.smithi016.stdout:2/406: dread d1d/d2a/f4a [4194304,4194304] 0 2024-04-26T20:18:46.768 INFO:tasks.workunit.client.0.smithi016.stdout:9/445: write d1/d2/f6 [6093515,47488] 0 2024-04-26T20:18:46.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/446: dread d1/d2e/d40/f5a [0,4194304] 0 2024-04-26T20:18:46.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/447: chown d1/d2/f3 31438 1 2024-04-26T20:18:46.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/448: dread - d1/d2/d20/d49/d77/d3e/f84 zero size 2024-04-26T20:18:46.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/449: chown d1/d2/d20/d49/d77/l8b 412 1 2024-04-26T20:18:46.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/450: fsync d1/d2/fd 0 2024-04-26T20:18:46.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/451: truncate d1/d2/d20/d49/d77/d3e/f84 985300 0 2024-04-26T20:18:46.791 INFO:tasks.workunit.client.0.smithi016.stdout:8/385: dwrite d9/d23/d26/f76 [0,4194304] 0 2024-04-26T20:18:46.791 INFO:tasks.workunit.client.0.smithi016.stdout:8/386: chown d9/d23/l28 558 1 2024-04-26T20:18:46.791 INFO:tasks.workunit.client.0.smithi016.stdout:8/387: dread - d9/d19/d45/d3f/f7f zero size 2024-04-26T20:18:46.807 INFO:tasks.workunit.client.0.smithi016.stdout:3/324: dwrite d3/f60 [0,4194304] 0 2024-04-26T20:18:46.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4994005590 con 0x7f49c00c7ff0 2024-04-26T20:18:46.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49b6000640 1 -- 172.21.15.16:0/1969036602 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7f49ac059cc0 con 0x7f49c00c7ff0 2024-04-26T20:18:46.970 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:46.970 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:46.971 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:46.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f49a00683b0 msgr2=0x7f49a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:46.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f49a00683b0 0x7f49a006a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f49c014bac0 tx=0x7f49b0008040 comp rx=0 tx=0).stop 2024-04-26T20:18:46.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 msgr2=0x7f49c014b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:46.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c014b060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00c460 tx=0x7f49ac00c920 comp rx=0 tx=0).stop 2024-04-26T20:18:46.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 shutdown_connections 2024-04-26T20:18:46.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f49a00683b0 0x7f49a006a870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c0153fc0 0x7f49c0155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c00cec90 0x7f49c0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 --2- 172.21.15.16:0/1969036602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49c00c7ff0 0x7f49c014b060 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 >> 172.21.15.16:0/1969036602 conn(0x7f49c0073240 msgr2=0x7f49c0150110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 shutdown_connections 2024-04-26T20:18:46.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:46.967+0000 7f49ab400640 1 -- 172.21.15.16:0/1969036602 wait complete. 2024-04-26T20:18:46.991 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-26T20:18:46.994 INFO:tasks.workunit.client.0.smithi016.stdout:6/293: mknod d1/d3a/c6a 0 2024-04-26T20:18:46.994 INFO:tasks.workunit.client.0.smithi016.stdout:7/412: rename d0/l13 to d0/d1/l7f 0 2024-04-26T20:18:46.995 INFO:tasks.workunit.client.0.smithi016.stdout:7/413: truncate d0/d1/d34/d3b/d6c/f53 6475259 0 2024-04-26T20:18:46.995 INFO:tasks.workunit.client.0.smithi016.stdout:2/407: rmdir d1d/d27/d2d/d6b 39 2024-04-26T20:18:46.995 INFO:tasks.workunit.client.0.smithi016.stdout:2/408: truncate d1d/d20/f42 786702 0 2024-04-26T20:18:46.996 INFO:tasks.workunit.client.0.smithi016.stdout:9/452: symlink d1/d2/d20/d49/d77/d3e/l90 0 2024-04-26T20:18:46.998 INFO:tasks.workunit.client.0.smithi016.stdout:8/388: truncate f5 25969 0 2024-04-26T20:18:47.002 INFO:tasks.workunit.client.0.smithi016.stdout:5/564: symlink d1/d9/lb3 0 2024-04-26T20:18:47.002 INFO:tasks.workunit.client.0.smithi016.stdout:5/565: fdatasync d1/fa0 0 2024-04-26T20:18:47.003 INFO:tasks.workunit.client.0.smithi016.stdout:6/294: mknod d1/d8/d2c/c6b 0 2024-04-26T20:18:47.004 INFO:tasks.workunit.client.0.smithi016.stdout:3/325: rename d3/d9/d2d/f48 to d3/df/f64 0 2024-04-26T20:18:47.008 INFO:tasks.workunit.client.0.smithi016.stdout:7/414: link d0/d1/d34/d25/d3f/c45 d0/d1/d34/d25/d3f/d6d/d79/c80 0 2024-04-26T20:18:47.008 INFO:tasks.workunit.client.0.smithi016.stdout:7/415: chown d0/d1/c18 299 1 2024-04-26T20:18:47.008 INFO:tasks.workunit.client.0.smithi016.stdout:7/416: fdatasync d0/d1/d34/f2c 0 2024-04-26T20:18:47.009 INFO:tasks.workunit.client.0.smithi016.stdout:9/453: symlink d1/d1b/l91 0 2024-04-26T20:18:47.010 INFO:tasks.workunit.client.0.smithi016.stdout:8/389: mknod d9/d23/d44/d50/c81 0 2024-04-26T20:18:47.011 INFO:tasks.workunit.client.0.smithi016.stdout:2/409: rename d1d/d20/d22/d39/d3e/l67 to d1d/d27/d2d/d6b/l8d 0 2024-04-26T20:18:47.013 INFO:tasks.workunit.client.0.smithi016.stdout:3/326: write d3/df/f26 [326275,16834] 0 2024-04-26T20:18:47.013 INFO:tasks.workunit.client.0.smithi016.stdout:3/327: dread - d3/d9/d2d/f5f zero size 2024-04-26T20:18:47.013 INFO:tasks.workunit.client.0.smithi016.stdout:3/328: chown d3/f60 1 1 2024-04-26T20:18:47.013 INFO:tasks.workunit.client.0.smithi016.stdout:3/329: read - d3/df/d25/f5c zero size 2024-04-26T20:18:47.013 INFO:tasks.workunit.client.0.smithi016.stdout:3/330: fdatasync d3/df/f2f 0 2024-04-26T20:18:47.013 INFO:tasks.workunit.client.0.smithi016.stdout:7/417: symlink d0/d1/d34/d25/d3f/d6d/d79/l81 0 2024-04-26T20:18:47.013 INFO:tasks.workunit.client.0.smithi016.stdout:7/418: chown d0/d1/l23 642 1 2024-04-26T20:18:47.014 INFO:tasks.workunit.client.0.smithi016.stdout:9/454: creat d1/d1b/f92 x:0 0 0 2024-04-26T20:18:47.014 INFO:tasks.workunit.client.0.smithi016.stdout:9/455: write d1/d2/d20/d49/d77/d2a/d33/d44/f53 [922579,57393] 0 2024-04-26T20:18:47.015 INFO:tasks.workunit.client.0.smithi016.stdout:8/390: symlink d9/d19/d45/d3f/l82 0 2024-04-26T20:18:47.015 INFO:tasks.workunit.client.0.smithi016.stdout:8/391: write d9/f53 [309357,129709] 0 2024-04-26T20:18:47.016 INFO:tasks.workunit.client.0.smithi016.stdout:2/410: creat d1d/d27/d2d/d6b/d7e/f8e x:0 0 0 2024-04-26T20:18:47.018 INFO:tasks.workunit.client.0.smithi016.stdout:3/331: link d3/f19 d3/d9/f65 0 2024-04-26T20:18:47.018 INFO:tasks.workunit.client.0.smithi016.stdout:3/332: chown d3/df/d20/d41/l55 400551794 1 2024-04-26T20:18:47.018 INFO:tasks.workunit.client.0.smithi016.stdout:3/333: write d3/f1b [1597142,99974] 0 2024-04-26T20:18:47.021 INFO:tasks.workunit.client.0.smithi016.stdout:7/419: symlink d0/d1/d34/d25/d50/l82 0 2024-04-26T20:18:47.021 INFO:tasks.workunit.client.0.smithi016.stdout:7/420: chown d0/d1/d6/d6e 476 1 2024-04-26T20:18:47.021 INFO:tasks.workunit.client.0.smithi016.stdout:9/456: dread d1/d2/d20/d49/d77/d2a/d33/d44/f54 [0,4194304] 0 2024-04-26T20:18:47.021 INFO:tasks.workunit.client.0.smithi016.stdout:9/457: chown d1/d2e/f17 0 1 2024-04-26T20:18:47.027 INFO:tasks.workunit.client.0.smithi016.stdout:8/392: symlink d9/d19/d45/d3f/d64/l83 0 2024-04-26T20:18:47.027 INFO:tasks.workunit.client.0.smithi016.stdout:3/334: rename d3/df/d25/c5e to d3/d9/d2d/d62/c66 0 2024-04-26T20:18:47.027 INFO:tasks.workunit.client.0.smithi016.stdout:9/458: mkdir d1/d2/d20/d49/d77/d3e/d5e/d93 0 2024-04-26T20:18:47.027 INFO:tasks.workunit.client.0.smithi016.stdout:3/335: mknod d3/df/d25/d2a/d4a/c67 0 2024-04-26T20:18:47.027 INFO:tasks.workunit.client.0.smithi016.stdout:3/336: symlink d3/df/l68 0 2024-04-26T20:18:47.027 INFO:tasks.workunit.client.0.smithi016.stdout:3/337: chown d3/l15 824869552 1 2024-04-26T20:18:47.045 INFO:tasks.workunit.client.0.smithi016.stdout:3/338: dread d3/df/d25/d32/f38 [0,4194304] 0 2024-04-26T20:18:47.045 INFO:tasks.workunit.client.0.smithi016.stdout:3/339: stat d3/df/f1e 0 2024-04-26T20:18:47.046 INFO:tasks.workunit.client.0.smithi016.stdout:2/411: dread d1d/d52/f5f [0,4194304] 0 2024-04-26T20:18:47.047 INFO:tasks.workunit.client.0.smithi016.stdout:2/412: write d1d/d2a/d3d/f7b [4943081,113456] 0 2024-04-26T20:18:47.049 INFO:tasks.workunit.client.0.smithi016.stdout:3/340: rmdir d3/df/d25/d32 39 2024-04-26T20:18:47.052 INFO:tasks.workunit.client.0.smithi016.stdout:2/413: creat d1d/d20/d22/f8f x:0 0 0 2024-04-26T20:18:47.053 INFO:tasks.workunit.client.0.smithi016.stdout:2/414: mknod d1d/d27/d49/c90 0 2024-04-26T20:18:47.053 INFO:tasks.workunit.client.0.smithi016.stdout:2/415: stat d1d/d27/d2d/d6b/d7e/f8a 0 2024-04-26T20:18:47.053 INFO:tasks.workunit.client.0.smithi016.stdout:2/416: write d1d/d20/d22/d29/f37 [431920,100254] 0 2024-04-26T20:18:47.055 INFO:tasks.workunit.client.0.smithi016.stdout:2/417: unlink d1d/d20/d22/f64 0 2024-04-26T20:18:47.062 INFO:tasks.workunit.client.0.smithi016.stdout:5/566: dwrite d1/d9/d4b/f85 [0,4194304] 0 2024-04-26T20:18:47.065 INFO:tasks.workunit.client.0.smithi016.stdout:5/567: mkdir d1/d9/d4b/db4 0 2024-04-26T20:18:47.066 INFO:tasks.workunit.client.0.smithi016.stdout:5/568: stat d1/l48 0 2024-04-26T20:18:47.072 INFO:tasks.workunit.client.0.smithi016.stdout:8/393: write d9/d23/d44/d50/f58 [5559182,17031] 0 2024-04-26T20:18:47.076 INFO:tasks.workunit.client.0.smithi016.stdout:6/295: dwrite d1/fd [0,4194304] 0 2024-04-26T20:18:47.076 INFO:tasks.workunit.client.0.smithi016.stdout:6/296: chown d1/d21/d48 37 1 2024-04-26T20:18:47.083 INFO:tasks.workunit.client.0.smithi016.stdout:8/394: unlink d9/d23/d44/d50/c6c 0 2024-04-26T20:18:47.083 INFO:tasks.workunit.client.0.smithi016.stdout:8/395: chown d9/d23/d26/d2c/f6b 925 1 2024-04-26T20:18:47.085 INFO:tasks.workunit.client.0.smithi016.stdout:4/335: sync 2024-04-26T20:18:47.086 INFO:tasks.workunit.client.0.smithi016.stdout:0/364: sync 2024-04-26T20:18:47.086 INFO:tasks.workunit.client.0.smithi016.stdout:8/396: rename d9/d19/l1d to d9/d66/d73/l84 0 2024-04-26T20:18:47.091 INFO:tasks.workunit.client.0.smithi016.stdout:1/474: sync 2024-04-26T20:18:47.096 INFO:tasks.workunit.client.0.smithi016.stdout:0/365: creat d2/dc/d1e/f7c x:0 0 0 2024-04-26T20:18:47.096 INFO:tasks.workunit.client.0.smithi016.stdout:0/366: dread - d2/dc/f44 zero size 2024-04-26T20:18:47.108 INFO:tasks.workunit.client.0.smithi016.stdout:1/475: rename d3/d57/f1a to d3/d5/d8d/f91 0 2024-04-26T20:18:47.119 INFO:tasks.workunit.client.0.smithi016.stdout:1/476: link d3/d5/da/d66/d8c/d84/c88 d3/d5/d6/d9/d2a/d3d/c92 0 2024-04-26T20:18:47.122 INFO:tasks.workunit.client.0.smithi016.stdout:1/477: rename d3/f4 to d3/d5/da/d66/d8c/f93 0 2024-04-26T20:18:47.123 INFO:tasks.workunit.client.0.smithi016.stdout:1/478: symlink d3/d5/da/d66/d8c/d84/d86/l94 0 2024-04-26T20:18:47.125 INFO:tasks.workunit.client.0.smithi016.stdout:1/479: mknod d3/d5/d6/d9/c95 0 2024-04-26T20:18:47.131 INFO:tasks.workunit.client.0.smithi016.stdout:4/336: dread d0/dd/f3b [0,4194304] 0 2024-04-26T20:18:47.137 INFO:tasks.workunit.client.0.smithi016.stdout:9/459: dread d1/d2/f3 [0,4194304] 0 2024-04-26T20:18:47.137 INFO:tasks.workunit.client.0.smithi016.stdout:2/418: dwrite d1d/d2a/f51 [0,4194304] 0 2024-04-26T20:18:47.138 INFO:tasks.workunit.client.0.smithi016.stdout:7/421: dwrite d0/d1/d34/d25/d3f/f5f [0,4194304] 0 2024-04-26T20:18:47.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/341: dwrite d3/df/f1e [0,4194304] 0 2024-04-26T20:18:47.138 INFO:tasks.workunit.client.0.smithi016.stdout:7/422: stat d0/d1/d34/d3b/l57 0 2024-04-26T20:18:47.138 INFO:tasks.workunit.client.0.smithi016.stdout:4/337: link d0/d1e/d30/c40 d0/dd/d1b/c76 0 2024-04-26T20:18:47.139 INFO:tasks.workunit.client.0.smithi016.stdout:9/460: symlink d1/d2/d20/d49/d77/d2a/d33/l94 0 2024-04-26T20:18:47.141 INFO:tasks.workunit.client.0.smithi016.stdout:3/342: unlink d3/d9/d18/l37 0 2024-04-26T20:18:47.141 INFO:tasks.workunit.client.0.smithi016.stdout:8/397: dread d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:47.141 INFO:tasks.workunit.client.0.smithi016.stdout:7/423: getdents d0/d1/d46 0 2024-04-26T20:18:47.143 INFO:tasks.workunit.client.0.smithi016.stdout:4/338: truncate d0/d1e/d41/f5f 460801 0 2024-04-26T20:18:47.143 INFO:tasks.workunit.client.0.smithi016.stdout:4/339: write d0/dd/d19/d1f/f3e [3281,125262] 0 2024-04-26T20:18:47.145 INFO:tasks.workunit.client.0.smithi016.stdout:9/461: mknod d1/d1b/c95 0 2024-04-26T20:18:47.145 INFO:tasks.workunit.client.0.smithi016.stdout:9/462: chown d1/d1b/f58 110499 1 2024-04-26T20:18:47.145 INFO:tasks.workunit.client.0.smithi016.stdout:9/463: dread - d1/d2/d20/d49/d77/d2a/d33/d44/f65 zero size 2024-04-26T20:18:47.145 INFO:tasks.workunit.client.0.smithi016.stdout:9/464: stat d1/d2/d20/d49/d77/d2a/d33/c36 0 2024-04-26T20:18:47.146 INFO:tasks.workunit.client.0.smithi016.stdout:8/398: unlink d9/f13 0 2024-04-26T20:18:47.146 INFO:tasks.workunit.client.0.smithi016.stdout:2/419: write d1d/d52/f61 [346863,76925] 0 2024-04-26T20:18:47.152 INFO:tasks.workunit.client.0.smithi016.stdout:8/399: getdents d9/d19/d45/d3f/d4d 0 2024-04-26T20:18:47.152 INFO:tasks.workunit.client.0.smithi016.stdout:9/465: rename d1/d2e/d40/l69 to d1/d2e/d40/l96 0 2024-04-26T20:18:47.160 INFO:tasks.workunit.client.0.smithi016.stdout:9/466: creat d1/f97 x:0 0 0 2024-04-26T20:18:47.164 INFO:tasks.workunit.client.0.smithi016.stdout:9/467: creat d1/d59/d52/f98 x:0 0 0 2024-04-26T20:18:47.171 INFO:tasks.workunit.client.0.smithi016.stdout:9/468: link d1/d1b/f82 d1/d2/d20/d49/d77/d3e/f99 0 2024-04-26T20:18:47.178 INFO:tasks.workunit.client.0.smithi016.stdout:3/343: read d3/d9/d18/f1c [1392829,124713] 0 2024-04-26T20:18:47.179 INFO:tasks.workunit.client.0.smithi016.stdout:1/480: getdents d3/d5/da/d66/d8c 0 2024-04-26T20:18:47.181 INFO:tasks.workunit.client.0.smithi016.stdout:0/367: dwrite d2/dc/d18/d5b/f5e [0,4194304] 0 2024-04-26T20:18:47.183 INFO:tasks.workunit.client.0.smithi016.stdout:7/424: dwrite d0/d1/d34/d25/d50/f54 [4194304,4194304] 0 2024-04-26T20:18:47.183 INFO:tasks.workunit.client.0.smithi016.stdout:7/425: write d0/d1/d34/d25/d3f/d6d/f76 [521469,70689] 0 2024-04-26T20:18:47.199 INFO:tasks.workunit.client.0.smithi016.stdout:9/469: dread d1/d1b/f80 [0,4194304] 0 2024-04-26T20:18:47.206 INFO:tasks.workunit.client.0.smithi016.stdout:3/344: dread d3/d9/f65 [0,4194304] 0 2024-04-26T20:18:47.208 INFO:tasks.workunit.client.0.smithi016.stdout:5/569: dwrite d1/d9/d4b/f85 [0,4194304] 0 2024-04-26T20:18:47.223 INFO:tasks.workunit.client.0.smithi016.stdout:4/340: dwrite d0/dd/f6d [0,4194304] 0 2024-04-26T20:18:47.224 INFO:tasks.workunit.client.0.smithi016.stdout:6/297: dwrite d1/d21/d26/f54 [0,4194304] 0 2024-04-26T20:18:47.253 INFO:tasks.workunit.client.0.smithi016.stdout:7/426: dwrite d0/d1/d34/d25/d50/f54 [0,4194304] 0 2024-04-26T20:18:47.253 INFO:tasks.workunit.client.0.smithi016.stdout:7/427: fdatasync d0/d51/f5d 0 2024-04-26T20:18:47.253 INFO:tasks.workunit.client.0.smithi016.stdout:7/428: chown d0/d1/d6/d73 6246 1 2024-04-26T20:18:47.253 INFO:tasks.workunit.client.0.smithi016.stdout:7/429: fsync d0/d1/d4b/f4d 0 2024-04-26T20:18:47.268 INFO:tasks.workunit.client.0.smithi016.stdout:4/341: dwrite d0/dd/d19/f24 [0,4194304] 0 2024-04-26T20:18:47.290 INFO:tasks.workunit.client.0.smithi016.stdout:4/342: dwrite d0/f5c [0,4194304] 0 2024-04-26T20:18:47.290 INFO:tasks.workunit.client.0.smithi016.stdout:4/343: chown d0/d1e/c50 210937343 1 2024-04-26T20:18:47.290 INFO:tasks.workunit.client.0.smithi016.stdout:4/344: chown d0/f11 39033 1 2024-04-26T20:18:47.430 INFO:tasks.workunit.client.0.smithi016.stdout:1/481: mkdir d3/d5/da/d66/d8c/d84/d96 0 2024-04-26T20:18:47.430 INFO:tasks.workunit.client.0.smithi016.stdout:1/482: truncate d3/d5/d6/f7f 159156 0 2024-04-26T20:18:47.432 INFO:tasks.workunit.client.0.smithi016.stdout:0/368: rename d2/dc/d1e/d35/l3c to d2/dc/d1e/d25/l7d 0 2024-04-26T20:18:47.432 INFO:tasks.workunit.client.0.smithi016.stdout:0/369: stat d2/d20/d41/f65 0 2024-04-26T20:18:47.433 INFO:tasks.workunit.client.0.smithi016.stdout:0/370: truncate d2/dc/f1d 1775470 0 2024-04-26T20:18:47.433 INFO:tasks.workunit.client.0.smithi016.stdout:3/345: truncate d3/d9/d2d/d4f/f50 2158674 0 2024-04-26T20:18:47.433 INFO:tasks.workunit.client.0.smithi016.stdout:5/570: creat d1/d9/d1c/d52/d74/d5f/fb5 x:0 0 0 2024-04-26T20:18:47.435 INFO:tasks.workunit.client.0.smithi016.stdout:6/298: creat d1/d8/d46/f6c x:0 0 0 2024-04-26T20:18:47.439 INFO:tasks.workunit.client.0.smithi016.stdout:4/345: getdents d0/dd/d66 0 2024-04-26T20:18:47.440 INFO:tasks.workunit.client.0.smithi016.stdout:1/483: creat d3/d5/d6/d5a/f97 x:0 0 0 2024-04-26T20:18:47.440 INFO:tasks.workunit.client.0.smithi016.stdout:1/484: getdents d3/d5/d6/d50/d58 0 2024-04-26T20:18:47.442 INFO:tasks.workunit.client.0.smithi016.stdout:9/470: rename d1/d59/l16 to d1/d2/d20/d49/d77/d2a/d75/d85/l9a 0 2024-04-26T20:18:47.442 INFO:tasks.workunit.client.0.smithi016.stdout:9/471: fdatasync d1/d2/f61 0 2024-04-26T20:18:47.442 INFO:tasks.workunit.client.0.smithi016.stdout:9/472: dread - d1/d59/d52/f98 zero size 2024-04-26T20:18:47.443 INFO:tasks.workunit.client.0.smithi016.stdout:9/473: truncate d1/d2e/d40/f5a 1212594 0 2024-04-26T20:18:47.444 INFO:tasks.workunit.client.0.smithi016.stdout:0/371: symlink d2/d8/l7e 0 2024-04-26T20:18:47.445 INFO:tasks.workunit.client.0.smithi016.stdout:4/346: link d0/fa d0/dd/d66/f77 0 2024-04-26T20:18:47.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/485: getdents d3/d5/d6/d9/d2a/d3d 0 2024-04-26T20:18:47.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/486: chown d3/d5/d6/d9/d2a/d3b/l62 224 1 2024-04-26T20:18:47.446 INFO:tasks.workunit.client.0.smithi016.stdout:1/487: truncate d3/d5/d6/d9/f4e 4737448 0 2024-04-26T20:18:47.447 INFO:tasks.workunit.client.0.smithi016.stdout:0/372: creat d2/d20/d57/f7f x:0 0 0 2024-04-26T20:18:47.448 INFO:tasks.workunit.client.0.smithi016.stdout:0/373: fsync d2/d20/d41/f4f 0 2024-04-26T20:18:47.450 INFO:tasks.workunit.client.0.smithi016.stdout:7/430: rename d0/d1/d34/d3b to d0/d83 0 2024-04-26T20:18:47.454 INFO:tasks.workunit.client.0.smithi016.stdout:1/488: creat d3/d5/d6/d9/d2a/d3b/f98 x:0 0 0 2024-04-26T20:18:47.456 INFO:tasks.workunit.client.0.smithi016.stdout:9/474: unlink d1/d2/d20/d49/d77/l2d 0 2024-04-26T20:18:47.459 INFO:tasks.workunit.client.0.smithi016.stdout:0/374: creat d2/d8/f80 x:0 0 0 2024-04-26T20:18:47.460 INFO:tasks.workunit.client.0.smithi016.stdout:0/375: dread - d2/dc/d1e/d35/f7a zero size 2024-04-26T20:18:47.463 INFO:tasks.workunit.client.0.smithi016.stdout:7/431: rename d0/d1/d34/d25/d3f/f55 to d0/d1/d46/f84 0 2024-04-26T20:18:47.465 INFO:tasks.workunit.client.0.smithi016.stdout:1/489: rmdir d3/d5/d6/d9/d2a 39 2024-04-26T20:18:47.467 INFO:tasks.workunit.client.0.smithi016.stdout:9/475: mkdir d1/d2/d20/d49/d77/d2a/d75/d85/d9b 0 2024-04-26T20:18:47.467 INFO:tasks.workunit.client.0.smithi016.stdout:9/476: write d1/d2e/fb [955748,120314] 0 2024-04-26T20:18:47.470 INFO:tasks.workunit.client.0.smithi016.stdout:2/420: dwrite d1d/d20/d22/f2e [0,4194304] 0 2024-04-26T20:18:47.470 INFO:tasks.workunit.client.0.smithi016.stdout:2/421: write d1d/d20/d22/d39/f7d [175646,55699] 0 2024-04-26T20:18:47.475 INFO:tasks.workunit.client.0.smithi016.stdout:8/400: truncate d9/d19/f34 1680681 0 2024-04-26T20:18:47.475 INFO:tasks.workunit.client.0.smithi016.stdout:8/401: readlink d9/d66/d73/l84 0 2024-04-26T20:18:47.476 INFO:tasks.workunit.client.0.smithi016.stdout:7/432: truncate d0/d1/d34/d25/d3f/f5f 2273000 0 2024-04-26T20:18:47.478 INFO:tasks.workunit.client.0.smithi016.stdout:6/299: write d1/d8/fc [3941528,26649] 0 2024-04-26T20:18:47.485 INFO:tasks.workunit.client.0.smithi016.stdout:8/402: creat d9/d23/d26/d2c/f85 x:0 0 0 2024-04-26T20:18:47.486 INFO:tasks.workunit.client.0.smithi016.stdout:7/433: getdents d0/d1/d34/d25/d3f/d6d/d79 0 2024-04-26T20:18:47.490 INFO:tasks.workunit.client.0.smithi016.stdout:0/376: dread d2/dc/d1e/d25/f28 [0,4194304] 0 2024-04-26T20:18:47.490 INFO:tasks.workunit.client.0.smithi016.stdout:0/377: chown d2/d20/d41/f49 13499822 1 2024-04-26T20:18:47.491 INFO:tasks.workunit.client.0.smithi016.stdout:0/378: readlink d2/d20/l2d 0 2024-04-26T20:18:47.491 INFO:tasks.workunit.client.0.smithi016.stdout:0/379: dread - d2/d20/d41/f50 zero size 2024-04-26T20:18:47.491 INFO:tasks.workunit.client.0.smithi016.stdout:2/422: dread d1d/d20/d22/d29/f37 [0,4194304] 0 2024-04-26T20:18:47.491 INFO:tasks.workunit.client.0.smithi016.stdout:9/477: link d1/d2/d20/d49/d77/d2a/d33/l3a d1/d2/d20/d49/d77/l9c 0 2024-04-26T20:18:47.491 INFO:tasks.workunit.client.0.smithi016.stdout:8/403: creat d9/d2f/f86 x:0 0 0 2024-04-26T20:18:47.493 INFO:tasks.workunit.client.0.smithi016.stdout:7/434: rename d0/d1/f20 to d0/d83/f85 0 2024-04-26T20:18:47.495 INFO:tasks.workunit.client.0.smithi016.stdout:1/490: rmdir d3/d5/d6/d5a/d78 0 2024-04-26T20:18:47.497 INFO:tasks.workunit.client.0.smithi016.stdout:0/380: creat d2/d40/d61/f81 x:0 0 0 2024-04-26T20:18:47.499 INFO:tasks.workunit.client.0.smithi016.stdout:8/404: symlink d9/d2f/l87 0 2024-04-26T20:18:47.499 INFO:tasks.workunit.client.0.smithi016.stdout:8/405: fdatasync d9/f11 0 2024-04-26T20:18:47.499 INFO:tasks.workunit.client.0.smithi016.stdout:8/406: fdatasync d9/d19/f33 0 2024-04-26T20:18:47.499 INFO:tasks.workunit.client.0.smithi016.stdout:8/407: truncate d9/d23/d44/f6f 407410 0 2024-04-26T20:18:47.500 INFO:tasks.workunit.client.0.smithi016.stdout:9/478: rename d1/d2/f3 to d1/d2/d43/f9d 0 2024-04-26T20:18:47.502 INFO:tasks.workunit.client.0.smithi016.stdout:7/435: creat d0/d1/d6/d6e/f86 x:0 0 0 2024-04-26T20:18:47.502 INFO:tasks.workunit.client.0.smithi016.stdout:7/436: write d0/f59 [4636272,92753] 0 2024-04-26T20:18:47.502 INFO:tasks.workunit.client.0.smithi016.stdout:7/437: readlink d0/d1/d34/d25/l2a 0 2024-04-26T20:18:47.503 INFO:tasks.workunit.client.0.smithi016.stdout:7/438: write d0/d1/d46/f2e [3415520,60114] 0 2024-04-26T20:18:47.503 INFO:tasks.workunit.client.0.smithi016.stdout:7/439: write d0/d83/f60 [640102,6065] 0 2024-04-26T20:18:47.505 INFO:tasks.workunit.client.0.smithi016.stdout:0/381: getdents d2/d40 0 2024-04-26T20:18:47.507 INFO:tasks.workunit.client.0.smithi016.stdout:9/479: rename d1/d1b/f58 to d1/d2/d20/d49/d77/d2a/d75/d85/f9e 0 2024-04-26T20:18:47.509 INFO:tasks.workunit.client.0.smithi016.stdout:1/491: rename d3/d5/d6/d5a/f97 to d3/d5/d6/d5a/f99 0 2024-04-26T20:18:47.510 INFO:tasks.workunit.client.0.smithi016.stdout:0/382: mkdir d2/d40/d82 0 2024-04-26T20:18:47.511 INFO:tasks.workunit.client.0.smithi016.stdout:9/480: creat d1/d2/d20/d49/f9f x:0 0 0 2024-04-26T20:18:47.511 INFO:tasks.workunit.client.0.smithi016.stdout:9/481: truncate d1/d2e/f17 662745 0 2024-04-26T20:18:47.511 INFO:tasks.workunit.client.0.smithi016.stdout:1/492: truncate d3/d5/da/f29 3190302 0 2024-04-26T20:18:47.513 INFO:tasks.workunit.client.0.smithi016.stdout:0/383: unlink d2/d20/d41/f4f 0 2024-04-26T20:18:47.514 INFO:tasks.workunit.client.0.smithi016.stdout:9/482: unlink d1/d1b/f92 0 2024-04-26T20:18:47.514 INFO:tasks.workunit.client.0.smithi016.stdout:9/483: readlink d1/l21 0 2024-04-26T20:18:47.517 INFO:tasks.workunit.client.0.smithi016.stdout:1/493: unlink d3/d5/da/f46 0 2024-04-26T20:18:47.517 INFO:tasks.workunit.client.0.smithi016.stdout:0/384: getdents d2/d8/d3b 0 2024-04-26T20:18:47.518 INFO:tasks.workunit.client.0.smithi016.stdout:9/484: symlink d1/d59/d52/d8c/la0 0 2024-04-26T20:18:47.519 INFO:tasks.workunit.client.0.smithi016.stdout:9/485: rename d1/d2 to d1/d2/d20/d49/d77/d2a/d75/da1 22 2024-04-26T20:18:47.524 INFO:tasks.workunit.client.0.smithi016.stdout:7/440: dread d0/f15 [4194304,4194304] 0 2024-04-26T20:18:47.524 INFO:tasks.workunit.client.0.smithi016.stdout:7/441: chown d0/d83/d6c/l61 118992882 1 2024-04-26T20:18:47.530 INFO:tasks.workunit.client.0.smithi016.stdout:8/408: dread d9/d19/d45/d3f/d64/f62 [0,4194304] 0 2024-04-26T20:18:47.530 INFO:tasks.workunit.client.0.smithi016.stdout:1/494: mknod d3/d5/da/d66/d8c/d84/c9a 0 2024-04-26T20:18:47.532 INFO:tasks.workunit.client.0.smithi016.stdout:1/495: dread d3/d5/d6/d5a/f4a [0,4194304] 0 2024-04-26T20:18:47.533 INFO:tasks.workunit.client.0.smithi016.stdout:0/385: creat d2/d8/d37/f83 x:0 0 0 2024-04-26T20:18:47.534 INFO:tasks.workunit.client.0.smithi016.stdout:0/386: chown d2/d40/c46 15267560 1 2024-04-26T20:18:47.534 INFO:tasks.workunit.client.0.smithi016.stdout:0/387: chown d2/dc/d1e 97 1 2024-04-26T20:18:47.534 INFO:tasks.workunit.client.0.smithi016.stdout:9/486: write d1/d59/d52/f30 [229006,53429] 0 2024-04-26T20:18:47.534 INFO:tasks.workunit.client.0.smithi016.stdout:7/442: dread d0/d83/d6c/f71 [0,4194304] 0 2024-04-26T20:18:47.535 INFO:tasks.workunit.client.0.smithi016.stdout:8/409: truncate d9/f42 2421289 0 2024-04-26T20:18:47.535 INFO:tasks.workunit.client.0.smithi016.stdout:1/496: truncate d3/d5/f4f 3582639 0 2024-04-26T20:18:47.536 INFO:tasks.workunit.client.0.smithi016.stdout:0/388: stat d2/dc/d1e/d35/c6b 0 2024-04-26T20:18:47.537 INFO:tasks.workunit.client.0.smithi016.stdout:9/487: creat d1/d59/d52/d8c/fa2 x:0 0 0 2024-04-26T20:18:47.538 INFO:tasks.workunit.client.0.smithi016.stdout:7/443: write d0/fc [1759643,48649] 0 2024-04-26T20:18:47.539 INFO:tasks.workunit.client.0.smithi016.stdout:8/410: rmdir d9 39 2024-04-26T20:18:47.575 INFO:tasks.workunit.client.0.smithi016.stdout:1/497: dwrite d3/d57/f6e [0,4194304] 0 2024-04-26T20:18:47.575 INFO:tasks.workunit.client.0.smithi016.stdout:1/498: chown d3/d5/d6/d9/d2a/d3b/d52 1 1 2024-04-26T20:18:47.576 INFO:tasks.workunit.client.0.smithi016.stdout:0/389: creat d2/dc/d45/f84 x:0 0 0 2024-04-26T20:18:47.577 INFO:tasks.workunit.client.0.smithi016.stdout:7/444: rename d0/d83/d6c to d0/d1/d34/d25/d3f/d6d/d87 0 2024-04-26T20:18:47.577 INFO:tasks.workunit.client.0.smithi016.stdout:7/445: chown d0/d1/c1a 24931 1 2024-04-26T20:18:47.579 INFO:tasks.workunit.client.0.smithi016.stdout:1/499: mknod d3/d5/d6/d50/c9b 0 2024-04-26T20:18:47.579 INFO:tasks.workunit.client.0.smithi016.stdout:1/500: readlink d3/d5/d6/d9/d2a/d3d/l8e 0 2024-04-26T20:18:47.581 INFO:tasks.workunit.client.0.smithi016.stdout:0/390: rename d2/d8/d37/f83 to d2/d40/d61/f85 0 2024-04-26T20:18:47.581 INFO:tasks.workunit.client.0.smithi016.stdout:0/391: chown d2/d8 28151 1 2024-04-26T20:18:47.581 INFO:tasks.workunit.client.0.smithi016.stdout:0/392: fsync d2/d20/d41/d4c/d4e/f6d 0 2024-04-26T20:18:47.582 INFO:tasks.workunit.client.0.smithi016.stdout:7/446: mkdir d0/d1/d88 0 2024-04-26T20:18:47.583 INFO:tasks.workunit.client.0.smithi016.stdout:1/501: symlink d3/d5/da/l9c 0 2024-04-26T20:18:47.628 INFO:tasks.workunit.client.0.smithi016.stdout:1/502: dwrite d3/d5/da/d66/d8c/f93 [0,4194304] 0 2024-04-26T20:18:47.629 INFO:tasks.workunit.client.0.smithi016.stdout:0/393: creat d2/d20/d41/d4c/d4e/f86 x:0 0 0 2024-04-26T20:18:47.677 INFO:tasks.workunit.client.0.smithi016.stdout:2/423: dread d1d/d27/d49/f56 [0,4194304] 0 2024-04-26T20:18:47.681 INFO:tasks.workunit.client.0.smithi016.stdout:7/447: mkdir d0/d89 0 2024-04-26T20:18:47.687 INFO:tasks.workunit.client.0.smithi016.stdout:0/394: dwrite d2/d20/d41/f62 [0,4194304] 0 2024-04-26T20:18:47.688 INFO:tasks.workunit.client.0.smithi016.stdout:1/503: getdents d3/d57 0 2024-04-26T20:18:47.688 INFO:tasks.workunit.client.0.smithi016.stdout:1/504: chown d3/d5/da/d66/d8c/d84/c88 28413067 1 2024-04-26T20:18:47.689 INFO:tasks.workunit.client.0.smithi016.stdout:2/424: rename d1d/d20/d22/d29/f38 to d1d/d20/d7c/f91 0 2024-04-26T20:18:47.691 INFO:tasks.workunit.client.0.smithi016.stdout:0/395: unlink d2/dc/d1e/f7c 0 2024-04-26T20:18:47.700 INFO:tasks.workunit.client.0.smithi016.stdout:8/411: dwrite d9/d19/f41 [0,4194304] 0 2024-04-26T20:18:47.700 INFO:tasks.workunit.client.0.smithi016.stdout:8/412: chown d9/f53 109833061 1 2024-04-26T20:18:47.700 INFO:tasks.workunit.client.0.smithi016.stdout:1/505: getdents d3/d5/d6/d50 0 2024-04-26T20:18:47.703 INFO:tasks.workunit.client.0.smithi016.stdout:2/425: creat d1d/d27/d49/f92 x:0 0 0 2024-04-26T20:18:47.705 INFO:tasks.workunit.client.0.smithi016.stdout:0/396: rename d2/d40/d82 to d2/d20/d41/d87 0 2024-04-26T20:18:47.708 INFO:tasks.workunit.client.0.smithi016.stdout:8/413: unlink d9/d23/c35 0 2024-04-26T20:18:47.710 INFO:tasks.workunit.client.0.smithi016.stdout:1/506: symlink d3/d5/d8d/l9d 0 2024-04-26T20:18:47.710 INFO:tasks.workunit.client.0.smithi016.stdout:1/507: write d3/d5/d6/d5a/f3f [840490,114258] 0 2024-04-26T20:18:47.710 INFO:tasks.workunit.client.0.smithi016.stdout:1/508: stat d3/d5/d6/d9/d2a/d3b/d52 0 2024-04-26T20:18:47.713 INFO:tasks.workunit.client.0.smithi016.stdout:2/426: rename d1d/l6f to d1d/d27/d2d/d6b/l93 0 2024-04-26T20:18:47.714 INFO:tasks.workunit.client.0.smithi016.stdout:8/414: link d9/d19/c51 d9/d66/c88 0 2024-04-26T20:18:47.715 INFO:tasks.workunit.client.0.smithi016.stdout:1/509: mkdir d3/d5/d6/d9/d9e 0 2024-04-26T20:18:47.729 INFO:tasks.workunit.client.0.smithi016.stdout:1/510: dread d3/d5/f43 [0,4194304] 0 2024-04-26T20:18:47.743 INFO:tasks.workunit.client.0.smithi016.stdout:9/488: dwrite d1/d1b/f24 [0,4194304] 0 2024-04-26T20:18:47.745 INFO:tasks.workunit.client.0.smithi016.stdout:0/397: rename d2/d20/d41/f6f to d2/d20/d41/d4c/d4e/f88 0 2024-04-26T20:18:47.747 INFO:tasks.workunit.client.0.smithi016.stdout:8/415: mknod d9/d66/c89 0 2024-04-26T20:18:47.747 INFO:tasks.workunit.client.0.smithi016.stdout:8/416: readlink d9/l36 0 2024-04-26T20:18:47.747 INFO:tasks.workunit.client.0.smithi016.stdout:8/417: chown d9/d19/d45/d3f/d64/f57 34515 1 2024-04-26T20:18:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/427: rename f11 to d1d/d27/d2d/f94 0 2024-04-26T20:18:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/428: chown d1d/d2a/d3b 118619101 1 2024-04-26T20:18:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/429: stat d1d/d20/f76 0 2024-04-26T20:18:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/430: write d1d/d27/d2d/f94 [2028927,118636] 0 2024-04-26T20:18:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/431: chown d1d/d27 3547 1 2024-04-26T20:18:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/432: fsync d1d/d20/d22/d29/f32 0 2024-04-26T20:18:47.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/433: chown d1d/d20/d22/d88 0 1 2024-04-26T20:18:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:0/398: link d2/dc/f44 d2/dc/d45/f89 0 2024-04-26T20:18:47.752 INFO:tasks.workunit.client.0.smithi016.stdout:0/399: dread - d2/dc/d45/f78 zero size 2024-04-26T20:18:47.754 INFO:tasks.workunit.client.0.smithi016.stdout:8/418: unlink d9/d23/l28 0 2024-04-26T20:18:47.757 INFO:tasks.workunit.client.0.smithi016.stdout:7/448: dread d0/d1/d34/d25/d50/f54 [4194304,4194304] 0 2024-04-26T20:18:47.759 INFO:tasks.workunit.client.0.smithi016.stdout:2/434: rename d1d/d20/d22/d29/f32 to d1d/d20/d22/d88/f95 0 2024-04-26T20:18:47.760 INFO:tasks.workunit.client.0.smithi016.stdout:0/400: creat d2/d40/d61/f8a x:0 0 0 2024-04-26T20:18:47.760 INFO:tasks.workunit.client.0.smithi016.stdout:0/401: chown d2/l4 963 1 2024-04-26T20:18:47.761 INFO:tasks.workunit.client.0.smithi016.stdout:7/449: mknod d0/d1/d88/c8a 0 2024-04-26T20:18:47.768 INFO:tasks.workunit.client.0.smithi016.stdout:8/419: rename d9/d23/d44/d70 to d9/d72/d74/d8a 0 2024-04-26T20:18:47.769 INFO:tasks.workunit.client.0.smithi016.stdout:8/420: chown l2 28785858 1 2024-04-26T20:18:47.769 INFO:tasks.workunit.client.0.smithi016.stdout:7/450: symlink d0/d1/d34/l8b 0 2024-04-26T20:18:47.771 INFO:tasks.workunit.client.0.smithi016.stdout:0/402: rename d2/d40/d61/f85 to d2/d20/d41/d87/f8b 0 2024-04-26T20:18:47.833 INFO:tasks.workunit.client.0.smithi016.stdout:1/511: dwrite d3/d5/f4f [0,4194304] 0 2024-04-26T20:18:47.833 INFO:tasks.workunit.client.0.smithi016.stdout:1/512: fsync d3/d57/f6e 0 2024-04-26T20:18:47.833 INFO:tasks.workunit.client.0.smithi016.stdout:1/513: chown d3/d5/d6/d9/f73 61 1 2024-04-26T20:18:47.833 INFO:tasks.workunit.client.0.smithi016.stdout:8/421: symlink d9/d23/d26/d2c/l8b 0 2024-04-26T20:18:47.833 INFO:tasks.workunit.client.0.smithi016.stdout:7/451: rmdir d0/d1/d6/d73 39 2024-04-26T20:18:47.846 INFO:tasks.workunit.client.0.smithi016.stdout:2/435: dwrite d1d/d20/f42 [0,4194304] 0 2024-04-26T20:18:47.847 INFO:tasks.workunit.client.0.smithi016.stdout:2/436: write d1d/d20/d22/f8f [202288,115813] 0 2024-04-26T20:18:47.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/489: dread d1/d59/d52/f74 [0,4194304] 0 2024-04-26T20:18:47.849 INFO:tasks.workunit.client.0.smithi016.stdout:8/422: link d9/d23/d44/f5b d9/d23/d44/f8c 0 2024-04-26T20:18:47.849 INFO:tasks.workunit.client.0.smithi016.stdout:9/490: write d1/d66/f70 [1319508,107828] 0 2024-04-26T20:18:47.906 INFO:tasks.workunit.client.0.smithi016.stdout:8/423: mknod d9/d23/d44/c8d 0 2024-04-26T20:18:47.906 INFO:tasks.workunit.client.0.smithi016.stdout:8/424: fsync d9/d19/d45/d3f/f48 0 2024-04-26T20:18:47.906 INFO:tasks.workunit.client.0.smithi016.stdout:8/425: chown d9/d19/d45/d3f/d64/f5a 89012054 1 2024-04-26T20:18:47.906 INFO:tasks.workunit.client.0.smithi016.stdout:9/491: symlink d1/d66/la3 0 2024-04-26T20:18:47.910 INFO:tasks.workunit.client.0.smithi016.stdout:9/492: dread d1/d2/d20/d49/d77/d3e/f99 [0,4194304] 0 2024-04-26T20:18:47.943 INFO:tasks.workunit.client.0.smithi016.stdout:9/493: dread d1/d2/d20/d49/d77/d3e/f84 [0,4194304] 0 2024-04-26T20:18:47.945 INFO:tasks.workunit.client.0.smithi016.stdout:7/452: truncate d0/d1/d34/d25/d3f/d6d/d87/f53 2957667 0 2024-04-26T20:18:47.964 INFO:tasks.workunit.client.0.smithi016.stdout:7/453: dread d0/f29 [0,4194304] 0 2024-04-26T20:18:47.964 INFO:tasks.workunit.client.0.smithi016.stdout:8/426: creat d9/d23/d44/f8e x:0 0 0 2024-04-26T20:18:47.965 INFO:tasks.workunit.client.0.smithi016.stdout:9/494: mknod d1/d59/d52/d8c/ca4 0 2024-04-26T20:18:47.967 INFO:tasks.workunit.client.0.smithi016.stdout:1/514: dwrite d3/d5/d6/d50/d58/f69 [0,4194304] 0 2024-04-26T20:18:47.968 INFO:tasks.workunit.client.0.smithi016.stdout:7/454: creat d0/f8c x:0 0 0 2024-04-26T20:18:47.969 INFO:tasks.workunit.client.0.smithi016.stdout:8/427: creat d9/d19/f8f x:0 0 0 2024-04-26T20:18:47.969 INFO:tasks.workunit.client.0.smithi016.stdout:1/515: creat d3/d5/d6/d50/d79/f9f x:0 0 0 2024-04-26T20:18:47.970 INFO:tasks.workunit.client.0.smithi016.stdout:7/455: mknod d0/d1/d88/c8d 0 2024-04-26T20:18:47.971 INFO:tasks.workunit.client.0.smithi016.stdout:8/428: getdents d9/d72 0 2024-04-26T20:18:47.971 INFO:tasks.workunit.client.0.smithi016.stdout:8/429: dread - d9/d19/d45/d3f/d64/f5a zero size 2024-04-26T20:18:47.972 INFO:tasks.workunit.client.0.smithi016.stdout:1/516: creat d3/d5/da/d66/d8c/fa0 x:0 0 0 2024-04-26T20:18:47.972 INFO:tasks.workunit.client.0.smithi016.stdout:1/517: dread - d3/d5/d6/d50/f87 zero size 2024-04-26T20:18:47.972 INFO:tasks.workunit.client.0.smithi016.stdout:1/518: getdents d3/d5/d6/d9/d2a/d3d 0 2024-04-26T20:18:47.973 INFO:tasks.workunit.client.0.smithi016.stdout:9/495: dread d1/d2/f5 [0,4194304] 0 2024-04-26T20:18:47.973 INFO:tasks.workunit.client.0.smithi016.stdout:9/496: chown d1/d2/d20/d49/d77/l9c 25624601 1 2024-04-26T20:18:47.982 INFO:tasks.workunit.client.0.smithi016.stdout:7/456: creat d0/d1/d4b/f8e x:0 0 0 2024-04-26T20:18:47.983 INFO:tasks.workunit.client.0.smithi016.stdout:7/457: truncate d0/d1/d34/d25/d3f/f7a 30655 0 2024-04-26T20:18:47.984 INFO:tasks.workunit.client.0.smithi016.stdout:7/458: rename d0/d1/c12 to d0/d1/d34/d25/d3f/d6d/d74/c8f 0 2024-04-26T20:18:47.986 INFO:tasks.workunit.client.0.smithi016.stdout:8/430: rename d9/fb to d9/f90 0 2024-04-26T20:18:47.988 INFO:tasks.workunit.client.0.smithi016.stdout:7/459: link d0/d1/f5e d0/d67/f90 0 2024-04-26T20:18:47.989 INFO:tasks.workunit.client.0.smithi016.stdout:8/431: creat d9/d19/f91 x:0 0 0 2024-04-26T20:18:47.994 INFO:tasks.workunit.client.0.smithi016.stdout:9/497: write d1/d2/f61 [2630207,111391] 0 2024-04-26T20:18:47.995 INFO:tasks.workunit.client.0.smithi016.stdout:8/432: getdents d9/d66/d73 0 2024-04-26T20:18:47.995 INFO:tasks.workunit.client.0.smithi016.stdout:8/433: truncate d9/d19/d45/f7c 516472 0 2024-04-26T20:18:47.996 INFO:tasks.workunit.client.0.smithi016.stdout:1/519: write d3/d5/da/d66/d8c/f93 [3201140,90156] 0 2024-04-26T20:18:47.996 INFO:tasks.workunit.client.0.smithi016.stdout:1/520: chown d3/d5/da/d66/l7c 401564 1 2024-04-26T20:18:47.997 INFO:tasks.workunit.client.0.smithi016.stdout:9/498: mkdir d1/d59/da5 0 2024-04-26T20:18:47.997 INFO:tasks.workunit.client.0.smithi016.stdout:9/499: readlink d1/d66/l8f 0 2024-04-26T20:18:47.998 INFO:tasks.workunit.client.0.smithi016.stdout:8/434: rmdir d9/d72/d74/d8a 0 2024-04-26T20:18:47.999 INFO:tasks.workunit.client.0.smithi016.stdout:1/521: stat d3/d5/d6/d9/d2a/d3d/l3e 0 2024-04-26T20:18:48.000 INFO:tasks.workunit.client.0.smithi016.stdout:1/522: mknod d3/d5/d6/d50/ca1 0 2024-04-26T20:18:48.073 INFO:tasks.workunit.client.0.smithi016.stdout:7/460: dwrite d0/d1/f30 [0,4194304] 0 2024-04-26T20:18:48.075 INFO:tasks.workunit.client.0.smithi016.stdout:7/461: rename d0/d83/l57 to d0/d1/d34/d25/l91 0 2024-04-26T20:18:48.075 INFO:tasks.workunit.client.0.smithi016.stdout:7/462: fsync d0/d1/d6/d6e/f86 0 2024-04-26T20:18:48.089 INFO:tasks.workunit.client.0.smithi016.stdout:1/523: dread d3/d5/da/f29 [0,4194304] 0 2024-04-26T20:18:48.089 INFO:tasks.workunit.client.0.smithi016.stdout:1/524: truncate d3/d5/d6/d50/d79/f85 574237 0 2024-04-26T20:18:48.090 INFO:tasks.workunit.client.0.smithi016.stdout:1/525: mkdir d3/d5/da/d66/da2 0 2024-04-26T20:18:48.092 INFO:tasks.workunit.client.0.smithi016.stdout:1/526: unlink d3/d5/da/d66/f68 0 2024-04-26T20:18:48.093 INFO:tasks.workunit.client.0.smithi016.stdout:1/527: truncate d3/d5/d6/d5a/f4a 1091640 0 2024-04-26T20:18:48.094 INFO:tasks.workunit.client.0.smithi016.stdout:9/500: dwrite d1/d2e/fb [0,4194304] 0 2024-04-26T20:18:48.095 INFO:tasks.workunit.client.0.smithi016.stdout:1/528: unlink d3/d5/da/d66/d8c/f67 0 2024-04-26T20:18:48.096 INFO:tasks.workunit.client.0.smithi016.stdout:1/529: getdents d3 0 2024-04-26T20:18:48.105 INFO:tasks.workunit.client.0.smithi016.stdout:9/501: dread d1/d2/f61 [0,4194304] 0 2024-04-26T20:18:48.106 INFO:tasks.workunit.client.0.smithi016.stdout:9/502: mknod d1/d2/d43/ca6 0 2024-04-26T20:18:48.107 INFO:tasks.workunit.client.0.smithi016.stdout:9/503: creat d1/fa7 x:0 0 0 2024-04-26T20:18:48.107 INFO:tasks.workunit.client.0.smithi016.stdout:9/504: chown d1/d2e/l2f 1 1 2024-04-26T20:18:48.107 INFO:tasks.workunit.client.0.smithi016.stdout:8/435: dread d9/f14 [0,4194304] 0 2024-04-26T20:18:48.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/505: rename d1/d59/d52/l7f to d1/d2/d79/la8 0 2024-04-26T20:18:48.109 INFO:tasks.workunit.client.0.smithi016.stdout:9/506: getdents d1/d2/d20/d49/d77 0 2024-04-26T20:18:48.109 INFO:tasks.workunit.client.0.smithi016.stdout:9/507: write d1/f97 [671883,102170] 0 2024-04-26T20:18:48.130 INFO:tasks.workunit.client.0.smithi016.stdout:8/436: dread d9/d23/d26/d2c/f6b [0,4194304] 0 2024-04-26T20:18:48.132 INFO:tasks.workunit.client.0.smithi016.stdout:8/437: mknod d9/d19/d45/d3f/d79/c92 0 2024-04-26T20:18:48.140 INFO:tasks.workunit.client.0.smithi016.stdout:1/530: write d3/d5/d6/d50/f60 [1819170,59714] 0 2024-04-26T20:18:48.142 INFO:tasks.workunit.client.0.smithi016.stdout:1/531: creat d3/d5/da/d66/d8c/d84/d86/fa3 x:0 0 0 2024-04-26T20:18:48.142 INFO:tasks.workunit.client.0.smithi016.stdout:1/532: read d3/d5/d6/d50/f60 [1101522,62061] 0 2024-04-26T20:18:48.142 INFO:tasks.workunit.client.0.smithi016.stdout:1/533: truncate d3/d5/da/d66/d8c/f6a 318467 0 2024-04-26T20:18:48.143 INFO:tasks.workunit.client.0.smithi016.stdout:1/534: mkdir d3/d57/da4 0 2024-04-26T20:18:48.145 INFO:tasks.workunit.client.0.smithi016.stdout:1/535: creat d3/d5/d6/d50/d79/fa5 x:0 0 0 2024-04-26T20:18:48.145 INFO:tasks.workunit.client.0.smithi016.stdout:1/536: dread - d3/d5/da/d66/d8c/f83 zero size 2024-04-26T20:18:48.146 INFO:tasks.workunit.client.0.smithi016.stdout:8/438: dread d9/d19/f34 [0,4194304] 0 2024-04-26T20:18:48.146 INFO:tasks.workunit.client.0.smithi016.stdout:1/537: creat d3/d57/da4/fa6 x:0 0 0 2024-04-26T20:18:48.147 INFO:tasks.workunit.client.0.smithi016.stdout:1/538: mkdir d3/d5/d6/d50/d79/da7 0 2024-04-26T20:18:48.147 INFO:tasks.workunit.client.0.smithi016.stdout:1/539: chown d3/d5/da/d66/d8c/d84/c9a 6699 1 2024-04-26T20:18:48.153 INFO:tasks.workunit.client.0.smithi016.stdout:8/439: write d9/d19/d45/f67 [409289,114153] 0 2024-04-26T20:18:48.153 INFO:tasks.workunit.client.0.smithi016.stdout:8/440: chown d9/d2f/f5e 101477963 1 2024-04-26T20:18:48.153 INFO:tasks.workunit.client.0.smithi016.stdout:8/441: write d9/f14 [3304935,114313] 0 2024-04-26T20:18:48.155 INFO:tasks.workunit.client.0.smithi016.stdout:8/442: creat d9/d19/d45/d3f/d4d/f93 x:0 0 0 2024-04-26T20:18:48.157 INFO:tasks.workunit.client.0.smithi016.stdout:8/443: rename d9/d66/c88 to d9/d23/c94 0 2024-04-26T20:18:48.157 INFO:tasks.workunit.client.0.smithi016.stdout:9/508: dwrite d1/d2/fd [8388608,4194304] 0 2024-04-26T20:18:48.161 INFO:tasks.workunit.client.0.smithi016.stdout:8/444: unlink d9/d19/c51 0 2024-04-26T20:18:48.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/445: rename d9/f1f to d9/d72/d74/f95 0 2024-04-26T20:18:48.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/446: dread - d9/d19/d45/d3f/d4d/f93 zero size 2024-04-26T20:18:48.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/447: fdatasync d9/f1b 0 2024-04-26T20:18:48.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/448: truncate d9/d19/d45/f67 2065156 0 2024-04-26T20:18:48.166 INFO:tasks.workunit.client.0.smithi016.stdout:8/449: rename d9/d23/d26/d2c/f80 to d9/d2f/f96 0 2024-04-26T20:18:48.166 INFO:tasks.workunit.client.0.smithi016.stdout:8/450: chown d9/d19/d45 4455716 1 2024-04-26T20:18:48.166 INFO:tasks.workunit.client.0.smithi016.stdout:8/451: write d9/d19/f33 [1990951,116889] 0 2024-04-26T20:18:48.167 INFO:tasks.workunit.client.0.smithi016.stdout:8/452: creat d9/d23/d44/d50/f97 x:0 0 0 2024-04-26T20:18:48.191 INFO:tasks.workunit.client.0.smithi016.stdout:1/540: dwrite d3/d5/d6/d50/f87 [0,4194304] 0 2024-04-26T20:18:48.191 INFO:tasks.workunit.client.0.smithi016.stdout:1/541: fdatasync d3/d5/d6/d9/f73 0 2024-04-26T20:18:48.195 INFO:tasks.workunit.client.0.smithi016.stdout:1/542: symlink d3/d5/d6/d9/d2a/d3b/d52/la8 0 2024-04-26T20:18:48.195 INFO:tasks.workunit.client.0.smithi016.stdout:1/543: truncate d3/d5/d6/d50/d79/f9f 455770 0 2024-04-26T20:18:48.198 INFO:tasks.workunit.client.0.smithi016.stdout:8/453: getdents d9/d2f 0 2024-04-26T20:18:48.198 INFO:tasks.workunit.client.0.smithi016.stdout:8/454: readlink d9/d2f/l3b 0 2024-04-26T20:18:48.198 INFO:tasks.workunit.client.0.smithi016.stdout:8/455: fsync d9/d2f/f86 0 2024-04-26T20:18:48.199 INFO:tasks.workunit.client.0.smithi016.stdout:1/544: creat d3/d5/d6/d9/d2a/d3d/fa9 x:0 0 0 2024-04-26T20:18:48.200 INFO:tasks.workunit.client.0.smithi016.stdout:8/456: creat d9/d72/f98 x:0 0 0 2024-04-26T20:18:48.200 INFO:tasks.workunit.client.0.smithi016.stdout:8/457: write d9/f90 [545949,72404] 0 2024-04-26T20:18:48.201 INFO:tasks.workunit.client.0.smithi016.stdout:1/545: truncate d3/d5/d6/d9/d2a/f76 618365 0 2024-04-26T20:18:48.202 INFO:tasks.workunit.client.0.smithi016.stdout:8/458: mknod d9/d23/d44/d50/c99 0 2024-04-26T20:18:48.202 INFO:tasks.workunit.client.0.smithi016.stdout:1/546: creat d3/d5/d6/d9/d2a/d3b/faa x:0 0 0 2024-04-26T20:18:48.205 INFO:tasks.workunit.client.0.smithi016.stdout:9/509: dwrite d1/fa7 [0,4194304] 0 2024-04-26T20:18:48.213 INFO:tasks.workunit.client.0.smithi016.stdout:9/510: creat d1/d2/d20/d49/d77/d2a/fa9 x:0 0 0 2024-04-26T20:18:48.218 INFO:tasks.workunit.client.0.smithi016.stdout:9/511: rename d1/fa to d1/d2/d20/d49/faa 0 2024-04-26T20:18:48.218 INFO:tasks.workunit.client.0.smithi016.stdout:9/512: getdents d1/d2/d20/d49/d77/d2a/d75/d85/d9b 0 2024-04-26T20:18:48.219 INFO:tasks.workunit.client.0.smithi016.stdout:9/513: write d1/d2/d20/d49/d77/d3e/f99 [597806,39818] 0 2024-04-26T20:18:48.224 INFO:tasks.workunit.client.0.smithi016.stdout:9/514: dread d1/f15 [4194304,4194304] 0 2024-04-26T20:18:48.224 INFO:tasks.workunit.client.0.smithi016.stdout:9/515: chown d1/d2e/f7a 48 1 2024-04-26T20:18:48.245 INFO:tasks.workunit.client.0.smithi016.stdout:8/459: dwrite d9/d23/d44/f6f [0,4194304] 0 2024-04-26T20:18:48.247 INFO:tasks.workunit.client.0.smithi016.stdout:8/460: symlink d9/d66/l9a 0 2024-04-26T20:18:48.247 INFO:tasks.workunit.client.0.smithi016.stdout:8/461: fdatasync d9/d72/d74/f95 0 2024-04-26T20:18:48.247 INFO:tasks.workunit.client.0.smithi016.stdout:8/462: readlink d9/lf 0 2024-04-26T20:18:48.247 INFO:tasks.workunit.client.0.smithi016.stdout:8/463: truncate d9/d19/d45/d3f/d4d/f93 944787 0 2024-04-26T20:18:48.249 INFO:tasks.workunit.client.0.smithi016.stdout:8/464: symlink d9/d23/d26/d2c/l9b 0 2024-04-26T20:18:48.258 INFO:tasks.workunit.client.0.smithi016.stdout:1/547: dwrite d3/d57/f6e [0,4194304] 0 2024-04-26T20:18:48.260 INFO:tasks.workunit.client.0.smithi016.stdout:1/548: dread d3/d5/d6/f7f [0,4194304] 0 2024-04-26T20:18:48.262 INFO:tasks.workunit.client.0.smithi016.stdout:1/549: rename d3/d5/d6/d9/d2a/d3b/d52 to d3/d5/d8d/dab 0 2024-04-26T20:18:48.262 INFO:tasks.workunit.client.0.smithi016.stdout:1/550: write d3/d5/da/f29 [3821920,48749] 0 2024-04-26T20:18:48.263 INFO:tasks.workunit.client.0.smithi016.stdout:1/551: symlink d3/d5/da/d66/lac 0 2024-04-26T20:18:48.263 INFO:tasks.workunit.client.0.smithi016.stdout:8/465: dread d9/d23/d26/f2e [0,4194304] 0 2024-04-26T20:18:48.265 INFO:tasks.workunit.client.0.smithi016.stdout:1/552: creat d3/d5/da/d66/da2/fad x:0 0 0 2024-04-26T20:18:48.265 INFO:tasks.workunit.client.0.smithi016.stdout:1/553: truncate d3/d5/d6/d9/d2a/d3b/f98 869332 0 2024-04-26T20:18:48.265 INFO:tasks.workunit.client.0.smithi016.stdout:1/554: write d3/d5/d6/d5a/f90 [271417,23366] 0 2024-04-26T20:18:48.265 INFO:tasks.workunit.client.0.smithi016.stdout:1/555: chown d3/d5/d6/d9/d2a/f76 6690728 1 2024-04-26T20:18:48.275 INFO:tasks.workunit.client.0.smithi016.stdout:9/516: dwrite d1/d59/d52/f7c [0,4194304] 0 2024-04-26T20:18:48.278 INFO:tasks.workunit.client.0.smithi016.stdout:9/517: symlink d1/d2e/d40/lab 0 2024-04-26T20:18:48.279 INFO:tasks.workunit.client.0.smithi016.stdout:9/518: chown d1/d2/l4e 12 1 2024-04-26T20:18:48.279 INFO:tasks.workunit.client.0.smithi016.stdout:9/519: truncate d1/d2/d20/d49/d77/d2a/d75/d85/f9e 482817 0 2024-04-26T20:18:48.280 INFO:tasks.workunit.client.0.smithi016.stdout:9/520: rename d1/d1b/f82 to d1/d1b/fac 0 2024-04-26T20:18:48.282 INFO:tasks.workunit.client.0.smithi016.stdout:9/521: creat d1/d2e/fad x:0 0 0 2024-04-26T20:18:48.283 INFO:tasks.workunit.client.0.smithi016.stdout:9/522: mknod d1/d2e/cae 0 2024-04-26T20:18:48.286 INFO:tasks.workunit.client.0.smithi016.stdout:9/523: symlink d1/d66/laf 0 2024-04-26T20:18:48.292 INFO:tasks.workunit.client.0.smithi016.stdout:9/524: unlink d1/d2/d20/d49/d77/d2a/d33/c73 0 2024-04-26T20:18:48.300 INFO:tasks.workunit.client.0.smithi016.stdout:9/525: rename d1/d2/d20/d49/d77/d2a/d33/l3a to d1/d2/d20/d49/d77/d3e/d5e/lb0 0 2024-04-26T20:18:48.300 INFO:tasks.workunit.client.0.smithi016.stdout:9/526: stat d1/d2e/f17 0 2024-04-26T20:18:48.301 INFO:tasks.workunit.client.0.smithi016.stdout:9/527: chown d1/d2/d20/d49/d77/d2a/d33/l94 18248820 1 2024-04-26T20:18:48.302 INFO:tasks.workunit.client.0.smithi016.stdout:9/528: mkdir d1/d66/db1 0 2024-04-26T20:18:48.303 INFO:tasks.workunit.client.0.smithi016.stdout:9/529: mknod d1/d2/d43/cb2 0 2024-04-26T20:18:48.303 INFO:tasks.workunit.client.0.smithi016.stdout:9/530: chown d1/d2/d20/d49 21883 1 2024-04-26T20:18:48.303 INFO:tasks.workunit.client.0.smithi016.stdout:9/531: mknod d1/d59/d52/d8c/cb3 0 2024-04-26T20:18:48.305 INFO:tasks.workunit.client.0.smithi016.stdout:9/532: creat d1/d2/d20/d49/d77/d2a/d75/d85/fb4 x:0 0 0 2024-04-26T20:18:48.306 INFO:tasks.workunit.client.0.smithi016.stdout:9/533: mknod d1/d2/d20/d49/cb5 0 2024-04-26T20:18:48.306 INFO:tasks.workunit.client.0.smithi016.stdout:9/534: write d1/d2/d20/d49/d77/d2a/d75/f83 [1148601,6167] 0 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:6/300: sync 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:3/346: sync 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:5/571: sync 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:5/572: chown d1/la5 23 1 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:3/347: fdatasync d3/df/f26 0 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:4/347: sync 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:4/348: dread - d0/dd/d19/f4d zero size 2024-04-26T20:18:48.307 INFO:tasks.workunit.client.0.smithi016.stdout:9/535: rmdir d1/d59/d52/d8c 39 2024-04-26T20:18:48.308 INFO:tasks.workunit.client.0.smithi016.stdout:9/536: write d1/d2/d20/d49/d77/d2a/d33/f5c [355533,32150] 0 2024-04-26T20:18:48.312 INFO:tasks.workunit.client.0.smithi016.stdout:6/301: link d1/d21/d26/d25/l52 d1/d21/d26/l6d 0 2024-04-26T20:18:48.312 INFO:tasks.workunit.client.0.smithi016.stdout:8/466: dwrite d9/d23/d26/d2c/f77 [0,4194304] 0 2024-04-26T20:18:48.312 INFO:tasks.workunit.client.0.smithi016.stdout:8/467: fdatasync d9/d72/d74/f95 0 2024-04-26T20:18:48.313 INFO:tasks.workunit.client.0.smithi016.stdout:5/573: rename d1/d88 to d1/d9/d4b/d8f/db6 0 2024-04-26T20:18:48.313 INFO:tasks.workunit.client.0.smithi016.stdout:9/537: symlink d1/d2/d20/d49/d77/d2a/d33/lb6 0 2024-04-26T20:18:48.315 INFO:tasks.workunit.client.0.smithi016.stdout:8/468: creat d9/d19/d45/d3f/d79/f9c x:0 0 0 2024-04-26T20:18:48.321 INFO:tasks.workunit.client.0.smithi016.stdout:9/538: rename d1/d2/d43/f9d to d1/d2/d43/fb7 0 2024-04-26T20:18:48.328 INFO:tasks.workunit.client.0.smithi016.stdout:8/469: link d9/d19/d45/d3f/d64/f57 d9/d23/d26/d2c/f9d 0 2024-04-26T20:18:48.340 INFO:tasks.workunit.client.0.smithi016.stdout:8/470: dread d9/d2f/f5e [0,4194304] 0 2024-04-26T20:18:48.348 INFO:tasks.workunit.client.0.smithi016.stdout:8/471: rename d9/d23/d44 to d9/d19/d45/d9e 0 2024-04-26T20:18:48.364 INFO:tasks.workunit.client.0.smithi016.stdout:5/574: dwrite d1/d7d/f89 [0,4194304] 0 2024-04-26T20:18:48.365 INFO:tasks.workunit.client.0.smithi016.stdout:5/575: dread - d1/d9/d11/d4d/d72/f7c zero size 2024-04-26T20:18:48.365 INFO:tasks.workunit.client.0.smithi016.stdout:5/576: chown d1/d7d 119 1 2024-04-26T20:18:48.365 INFO:tasks.workunit.client.0.smithi016.stdout:5/577: chown d1/d9/d11/daa/lb1 4 1 2024-04-26T20:18:48.366 INFO:tasks.workunit.client.0.smithi016.stdout:5/578: creat d1/d9f/fb7 x:0 0 0 2024-04-26T20:18:48.366 INFO:tasks.workunit.client.0.smithi016.stdout:5/579: mkdir d1/db8 0 2024-04-26T20:18:48.372 INFO:tasks.workunit.client.0.smithi016.stdout:5/580: link d1/l97 d1/d9/d11/d4d/lb9 0 2024-04-26T20:18:48.373 INFO:tasks.workunit.client.0.smithi016.stdout:5/581: chown d1/l21 6603356 1 2024-04-26T20:18:48.373 INFO:tasks.workunit.client.0.smithi016.stdout:5/582: write d1/d78/fa6 [372547,126044] 0 2024-04-26T20:18:48.373 INFO:tasks.workunit.client.0.smithi016.stdout:5/583: fdatasync d1/d9/f14 0 2024-04-26T20:18:48.374 INFO:tasks.workunit.client.0.smithi016.stdout:5/584: creat d1/d7d/fba x:0 0 0 2024-04-26T20:18:48.390 INFO:tasks.workunit.client.0.smithi016.stdout:8/472: dwrite d9/d19/d45/d3f/d4d/f93 [0,4194304] 0 2024-04-26T20:18:48.390 INFO:tasks.workunit.client.0.smithi016.stdout:5/585: dread d1/d9/d11/d4d/f9b [0,4194304] 0 2024-04-26T20:18:48.395 INFO:tasks.workunit.client.0.smithi016.stdout:1/556: dwrite d3/d5/da/d66/d8c/fa0 [0,4194304] 0 2024-04-26T20:18:48.424 INFO:tasks.workunit.client.0.smithi016.stdout:5/586: write f0 [4618741,104795] 0 2024-04-26T20:18:48.426 INFO:tasks.workunit.client.0.smithi016.stdout:8/473: dwrite d9/d19/d45/d3f/f7f [0,4194304] 0 2024-04-26T20:18:48.431 INFO:tasks.workunit.client.0.smithi016.stdout:8/474: rename d9/d19/d45/d3f/d79 to d9/d72/d74/d9f 0 2024-04-26T20:18:48.432 INFO:tasks.workunit.client.0.smithi016.stdout:8/475: link d9/d2f/f96 d9/d23/d26/d2c/fa0 0 2024-04-26T20:18:48.434 INFO:tasks.workunit.client.0.smithi016.stdout:8/476: mknod d9/ca1 0 2024-04-26T20:18:48.436 INFO:tasks.workunit.client.0.smithi016.stdout:8/477: creat d9/fa2 x:0 0 0 2024-04-26T20:18:48.437 INFO:tasks.workunit.client.0.smithi016.stdout:8/478: mkdir d9/d72/da3 0 2024-04-26T20:18:48.438 INFO:tasks.workunit.client.0.smithi016.stdout:3/348: dwrite d3/df/d25/f5c [0,4194304] 0 2024-04-26T20:18:48.439 INFO:tasks.workunit.client.0.smithi016.stdout:5/587: read d1/d78/f80 [3562926,85598] 0 2024-04-26T20:18:48.439 INFO:tasks.workunit.client.0.smithi016.stdout:8/479: unlink d9/d2f/f5d 0 2024-04-26T20:18:48.452 INFO:tasks.workunit.client.0.smithi016.stdout:3/349: stat d3/df/d25/d2a/d4a/l56 0 2024-04-26T20:18:48.453 INFO:tasks.workunit.client.0.smithi016.stdout:3/350: chown d3/d9 4 1 2024-04-26T20:18:48.453 INFO:tasks.workunit.client.0.smithi016.stdout:5/588: dread d1/d9/fc [4194304,4194304] 0 2024-04-26T20:18:48.453 INFO:tasks.workunit.client.0.smithi016.stdout:5/589: stat d1/d9/d1c/d52/l5e 0 2024-04-26T20:18:48.454 INFO:tasks.workunit.client.0.smithi016.stdout:8/480: rmdir d9/d19/d45/d9e/d50 39 2024-04-26T20:18:48.455 INFO:tasks.workunit.client.0.smithi016.stdout:3/351: mkdir d3/df/d25/d2a/d69 0 2024-04-26T20:18:48.457 INFO:tasks.workunit.client.0.smithi016.stdout:3/352: symlink d3/df/d25/d2a/d69/l6a 0 2024-04-26T20:18:48.458 INFO:tasks.workunit.client.0.smithi016.stdout:3/353: chown d3 220 1 2024-04-26T20:18:48.458 INFO:tasks.workunit.client.0.smithi016.stdout:3/354: readlink d3/d9/lc 0 2024-04-26T20:18:48.468 INFO:tasks.workunit.client.0.smithi016.stdout:3/355: dread d3/f7 [0,4194304] 0 2024-04-26T20:18:48.468 INFO:tasks.workunit.client.0.smithi016.stdout:3/356: dread - d3/df/d20/f4b zero size 2024-04-26T20:18:48.468 INFO:tasks.workunit.client.0.smithi016.stdout:3/357: stat d3/f16 0 2024-04-26T20:18:48.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/302: dwrite d1/fa [4194304,4194304] 0 2024-04-26T20:18:48.482 INFO:tasks.workunit.client.0.smithi016.stdout:3/358: write d3/df/d25/d32/f38 [2302106,57535] 0 2024-04-26T20:18:48.482 INFO:tasks.workunit.client.0.smithi016.stdout:6/303: rmdir d1/d21/d26 39 2024-04-26T20:18:48.484 INFO:tasks.workunit.client.0.smithi016.stdout:3/359: creat d3/d9/d2d/d62/f6b x:0 0 0 2024-04-26T20:18:48.484 INFO:tasks.workunit.client.0.smithi016.stdout:3/360: fsync d3/d9/f1a 0 2024-04-26T20:18:48.485 INFO:tasks.workunit.client.0.smithi016.stdout:3/361: creat d3/d9/d2d/d62/f6c x:0 0 0 2024-04-26T20:18:48.485 INFO:tasks.workunit.client.0.smithi016.stdout:3/362: dread - d3/df/f2f zero size 2024-04-26T20:18:48.486 INFO:tasks.workunit.client.0.smithi016.stdout:5/590: write d1/d9/f10 [1463898,66294] 0 2024-04-26T20:18:48.486 INFO:tasks.workunit.client.0.smithi016.stdout:3/363: creat d3/df/d20/d5b/f6d x:0 0 0 2024-04-26T20:18:48.491 INFO:tasks.workunit.client.0.smithi016.stdout:5/591: link d1/d9/d11/l84 d1/d9/d11/d4d/d72/lbb 0 2024-04-26T20:18:48.491 INFO:tasks.workunit.client.0.smithi016.stdout:5/592: fdatasync d1/d9/d25/f79 0 2024-04-26T20:18:48.491 INFO:tasks.workunit.client.0.smithi016.stdout:4/349: write d0/dd/f12 [5341644,125616] 0 2024-04-26T20:18:48.493 INFO:tasks.workunit.client.0.smithi016.stdout:5/593: mknod d1/d9/d1c/d52/cbc 0 2024-04-26T20:18:48.493 INFO:tasks.workunit.client.0.smithi016.stdout:5/594: chown d1/d9/d1c/d52/d74/la4 17388 1 2024-04-26T20:18:48.496 INFO:tasks.workunit.client.0.smithi016.stdout:5/595: mknod d1/d9/d11/daa/cbd 0 2024-04-26T20:18:48.496 INFO:tasks.workunit.client.0.smithi016.stdout:5/596: readlink d1/d9/d25/l6e 0 2024-04-26T20:18:48.496 INFO:tasks.workunit.client.0.smithi016.stdout:5/597: read d1/d9/f14 [66060,23704] 0 2024-04-26T20:18:48.496 INFO:tasks.workunit.client.0.smithi016.stdout:5/598: truncate d1/d9/d1c/d52/d74/d5f/fb5 465884 0 2024-04-26T20:18:48.496 INFO:tasks.workunit.client.0.smithi016.stdout:5/599: mknod d1/d78/d99/cbe 0 2024-04-26T20:18:48.497 INFO:tasks.workunit.client.0.smithi016.stdout:5/600: mknod d1/d9/d4b/cbf 0 2024-04-26T20:18:48.498 INFO:tasks.workunit.client.0.smithi016.stdout:5/601: rmdir d1/d78 39 2024-04-26T20:18:48.503 INFO:tasks.workunit.client.0.smithi016.stdout:6/304: dread d1/d8/d2c/f42 [0,4194304] 0 2024-04-26T20:18:48.503 INFO:tasks.workunit.client.0.smithi016.stdout:6/305: chown d1/fd 1133783 1 2024-04-26T20:18:48.504 INFO:tasks.workunit.client.0.smithi016.stdout:3/364: write d3/d9/d2d/d4f/f50 [1048,21410] 0 2024-04-26T20:18:48.504 INFO:tasks.workunit.client.0.smithi016.stdout:3/365: write d3/d9/f65 [1377067,123278] 0 2024-04-26T20:18:48.506 INFO:tasks.workunit.client.0.smithi016.stdout:6/306: rmdir d1/d21/d48 39 2024-04-26T20:18:48.508 INFO:tasks.workunit.client.0.smithi016.stdout:4/350: dread d0/f15 [0,4194304] 0 2024-04-26T20:18:48.509 INFO:tasks.workunit.client.0.smithi016.stdout:4/351: stat d0/d1e/d30/c42 0 2024-04-26T20:18:48.509 INFO:tasks.workunit.client.0.smithi016.stdout:5/602: dread d1/d9/d25/f79 [0,4194304] 0 2024-04-26T20:18:48.510 INFO:tasks.workunit.client.0.smithi016.stdout:5/603: mkdir d1/d9/d25/dc0 0 2024-04-26T20:18:48.510 INFO:tasks.workunit.client.0.smithi016.stdout:5/604: stat d1/d9/d1c/d52/d74/c13 0 2024-04-26T20:18:48.511 INFO:tasks.workunit.client.0.smithi016.stdout:5/605: read d1/d9/d4b/f39 [33324,113151] 0 2024-04-26T20:18:48.511 INFO:tasks.workunit.client.0.smithi016.stdout:4/352: creat d0/d1e/f78 x:0 0 0 2024-04-26T20:18:48.511 INFO:tasks.workunit.client.0.smithi016.stdout:6/307: dread d1/d21/f39 [0,4194304] 0 2024-04-26T20:18:48.511 INFO:tasks.workunit.client.0.smithi016.stdout:4/353: chown d0/dd/d19/f4d 42764208 1 2024-04-26T20:18:48.511 INFO:tasks.workunit.client.0.smithi016.stdout:6/308: rename d1/d21/d48 to d1/d21/d48/d6e 22 2024-04-26T20:18:48.511 INFO:tasks.workunit.client.0.smithi016.stdout:4/354: write d0/dd/d19/d1f/f58 [1616817,89866] 0 2024-04-26T20:18:48.511 INFO:tasks.workunit.client.0.smithi016.stdout:6/309: mkdir d1/d21/d26/d25/d6f 0 2024-04-26T20:18:48.513 INFO:tasks.workunit.client.0.smithi016.stdout:4/355: mknod d0/dd/d66/d6f/c79 0 2024-04-26T20:18:48.513 INFO:tasks.workunit.client.0.smithi016.stdout:4/356: stat d0/f1 0 2024-04-26T20:18:48.513 INFO:tasks.workunit.client.0.smithi016.stdout:3/366: truncate d3/d9/d2d/d4f/f50 2028566 0 2024-04-26T20:18:48.514 INFO:tasks.workunit.client.0.smithi016.stdout:4/357: symlink d0/dd/d1b/l7a 0 2024-04-26T20:18:48.514 INFO:tasks.workunit.client.0.smithi016.stdout:4/358: read d0/d1e/f21 [142412,65582] 0 2024-04-26T20:18:48.515 INFO:tasks.workunit.client.0.smithi016.stdout:6/310: write d1/d8/d2c/d47/f5a [553826,96205] 0 2024-04-26T20:18:48.515 INFO:tasks.workunit.client.0.smithi016.stdout:6/311: readlink d1/d3a/l61 0 2024-04-26T20:18:48.516 INFO:tasks.workunit.client.0.smithi016.stdout:4/359: mkdir d0/dd/d19/d1f/d7b 0 2024-04-26T20:18:48.517 INFO:tasks.workunit.client.0.smithi016.stdout:4/360: write d0/dd/d19/d1f/f45 [1120621,44046] 0 2024-04-26T20:18:48.522 INFO:tasks.workunit.client.0.smithi016.stdout:4/361: dread d0/dd/f3b [0,4194304] 0 2024-04-26T20:18:48.526 INFO:tasks.workunit.client.0.smithi016.stdout:5/606: write d1/d9/d25/f2a [889409,64207] 0 2024-04-26T20:18:48.527 INFO:tasks.workunit.client.0.smithi016.stdout:5/607: mkdir d1/d9/d11/d4d/dc1 0 2024-04-26T20:18:48.529 INFO:tasks.workunit.client.0.smithi016.stdout:5/608: stat d1/d9/c41 0 2024-04-26T20:18:48.531 INFO:tasks.workunit.client.0.smithi016.stdout:5/609: rename d1/d9/f14 to d1/d9/d25/fc2 0 2024-04-26T20:18:48.531 INFO:tasks.workunit.client.0.smithi016.stdout:5/610: chown d1/d9/d1c/d52/d74/f94 268 1 2024-04-26T20:18:48.536 INFO:tasks.workunit.client.0.smithi016.stdout:3/367: write d3/df/d25/f5c [3188911,73478] 0 2024-04-26T20:18:48.538 INFO:tasks.workunit.client.0.smithi016.stdout:3/368: creat d3/df/d20/d5b/f6e x:0 0 0 2024-04-26T20:18:48.538 INFO:tasks.workunit.client.0.smithi016.stdout:3/369: write d3/d9/d18/f1c [556877,17235] 0 2024-04-26T20:18:48.539 INFO:tasks.workunit.client.0.smithi016.stdout:3/370: creat d3/d9/d18/d5a/f6f x:0 0 0 2024-04-26T20:18:48.544 INFO:tasks.workunit.client.0.smithi016.stdout:6/312: read d1/f1f [1193847,55533] 0 2024-04-26T20:18:48.545 INFO:tasks.workunit.client.0.smithi016.stdout:6/313: creat d1/d12/f70 x:0 0 0 2024-04-26T20:18:48.554 INFO:tasks.workunit.client.0.smithi016.stdout:5/611: write d1/d7d/f89 [821275,16574] 0 2024-04-26T20:18:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:4/362: dwrite d0/dd/d66/f77 [0,4194304] 0 2024-04-26T20:18:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:4/363: stat d0/d1e/d30 0 2024-04-26T20:18:48.570 INFO:tasks.workunit.client.0.smithi016.stdout:4/364: fsync d0/dd/d66/f77 0 2024-04-26T20:18:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:4/365: truncate d0/dd/f12 3296561 0 2024-04-26T20:18:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:4/366: truncate d0/d1e/f75 356157 0 2024-04-26T20:18:48.573 INFO:tasks.workunit.client.0.smithi016.stdout:4/367: chown d0/d1e/d41/d43/f56 218065368 1 2024-04-26T20:18:48.575 INFO:tasks.workunit.client.0.smithi016.stdout:4/368: unlink d0/d1e/c50 0 2024-04-26T20:18:48.576 INFO:tasks.workunit.client.0.smithi016.stdout:4/369: write d0/d1e/f73 [362060,67089] 0 2024-04-26T20:18:48.576 INFO:tasks.workunit.client.0.smithi016.stdout:4/370: fsync d0/dd/d19/d57/f60 0 2024-04-26T20:18:48.586 INFO:tasks.workunit.client.0.smithi016.stdout:3/371: dwrite d3/d9/d18/f1c [0,4194304] 0 2024-04-26T20:18:48.601 INFO:tasks.workunit.client.0.smithi016.stdout:3/372: dread d3/d9/f1a [0,4194304] 0 2024-04-26T20:18:48.604 INFO:tasks.workunit.client.0.smithi016.stdout:5/612: dread d1/d9/d25/fc2 [0,4194304] 0 2024-04-26T20:18:48.604 INFO:tasks.workunit.client.0.smithi016.stdout:6/314: dwrite d1/f1f [0,4194304] 0 2024-04-26T20:18:48.604 INFO:tasks.workunit.client.0.smithi016.stdout:6/315: write d1/f27 [837953,100112] 0 2024-04-26T20:18:48.607 INFO:tasks.workunit.client.0.smithi016.stdout:6/316: rename d1/d21/d26/d1c/d2e/d53/f59 to d1/d8/d46/f71 0 2024-04-26T20:18:48.607 INFO:tasks.workunit.client.0.smithi016.stdout:6/317: stat d1/d21/d26/l34 0 2024-04-26T20:18:48.610 INFO:tasks.workunit.client.0.smithi016.stdout:6/318: unlink d1/d21/d26/d25/f36 0 2024-04-26T20:18:48.611 INFO:tasks.workunit.client.0.smithi016.stdout:6/319: mknod d1/d21/d26/d1c/d2e/d53/c72 0 2024-04-26T20:18:48.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/371: dwrite d0/dd/d19/f4d [0,4194304] 0 2024-04-26T20:18:48.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/372: chown d0/d1e/d41/c3d 8494 1 2024-04-26T20:18:48.622 INFO:tasks.workunit.client.0.smithi016.stdout:4/373: fsync d0/d1e/f21 0 2024-04-26T20:18:48.622 INFO:tasks.workunit.client.0.smithi016.stdout:4/374: write d0/dd/d19/d1f/f58 [4260677,130961] 0 2024-04-26T20:18:48.629 INFO:tasks.workunit.client.0.smithi016.stdout:5/613: write d1/d9/d1c/d52/d74/d98/f9e [3370101,24774] 0 2024-04-26T20:18:48.629 INFO:tasks.workunit.client.0.smithi016.stdout:5/614: chown d1/d9/d4b/la8 365331266 1 2024-04-26T20:18:48.637 INFO:tasks.workunit.client.0.smithi016.stdout:3/373: dwrite d3/df/f58 [0,4194304] 0 2024-04-26T20:18:48.639 INFO:tasks.workunit.client.0.smithi016.stdout:0/403: sync 2024-04-26T20:18:48.863 INFO:tasks.workunit.client.0.smithi016.stdout:6/320: getdents d1/d8/d2c/d47 0 2024-04-26T20:18:48.864 INFO:tasks.workunit.client.0.smithi016.stdout:4/375: mknod d0/d1e/c7c 0 2024-04-26T20:18:48.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/615: getdents d1 0 2024-04-26T20:18:48.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/616: fdatasync d1/d9/f73 0 2024-04-26T20:18:48.868 INFO:tasks.workunit.client.0.smithi016.stdout:3/374: mkdir d3/d70 0 2024-04-26T20:18:48.870 INFO:tasks.workunit.client.0.smithi016.stdout:0/404: symlink d2/dc/d45/l8c 0 2024-04-26T20:18:48.878 INFO:tasks.workunit.client.0.smithi016.stdout:4/376: mknod d0/dd/d1b/c7d 0 2024-04-26T20:18:48.879 INFO:tasks.workunit.client.0.smithi016.stdout:5/617: mkdir d1/d9/d11/daa/dc3 0 2024-04-26T20:18:48.880 INFO:tasks.workunit.client.0.smithi016.stdout:3/375: symlink d3/df/d25/d2a/l71 0 2024-04-26T20:18:48.882 INFO:tasks.workunit.client.0.smithi016.stdout:0/405: creat d2/d20/d41/d72/f8d x:0 0 0 2024-04-26T20:18:48.882 INFO:tasks.workunit.client.0.smithi016.stdout:0/406: truncate d2/dc/f1c 961098 0 2024-04-26T20:18:48.884 INFO:tasks.workunit.client.0.smithi016.stdout:0/407: fdatasync d2/dc/d1e/f3a 0 2024-04-26T20:18:48.884 INFO:tasks.workunit.client.0.smithi016.stdout:0/408: dread - d2/d20/d57/f7f zero size 2024-04-26T20:18:48.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/377: getdents d0/dd/d66 0 2024-04-26T20:18:48.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/378: fsync d0/f11 0 2024-04-26T20:18:48.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/379: readlink d0/d1e/d30/l32 0 2024-04-26T20:18:48.885 INFO:tasks.workunit.client.0.smithi016.stdout:3/376: symlink d3/df/d20/l72 0 2024-04-26T20:18:48.886 INFO:tasks.workunit.client.0.smithi016.stdout:0/409: rename d2/dc/d45/l8c to d2/d20/d41/d72/l8e 0 2024-04-26T20:18:48.887 INFO:tasks.workunit.client.0.smithi016.stdout:3/377: creat d3/df/d25/d2a/f73 x:0 0 0 2024-04-26T20:18:48.889 INFO:tasks.workunit.client.0.smithi016.stdout:0/410: creat d2/d20/d41/d4c/f8f x:0 0 0 2024-04-26T20:18:48.889 INFO:tasks.workunit.client.0.smithi016.stdout:3/378: mkdir d3/df/d20/d61/d74 0 2024-04-26T20:18:48.896 INFO:tasks.workunit.client.0.smithi016.stdout:0/411: creat d2/d40/f90 x:0 0 0 2024-04-26T20:18:48.896 INFO:tasks.workunit.client.0.smithi016.stdout:0/412: fdatasync d2/dc/f71 0 2024-04-26T20:18:48.898 INFO:tasks.workunit.client.0.smithi016.stdout:3/379: mknod d3/d9/d18/c75 0 2024-04-26T20:18:48.901 INFO:tasks.workunit.client.0.smithi016.stdout:0/413: getdents d2/dc/d18 0 2024-04-26T20:18:48.901 INFO:tasks.workunit.client.0.smithi016.stdout:0/414: write d2/dc/d1e/d25/f28 [4830490,109594] 0 2024-04-26T20:18:48.902 INFO:tasks.workunit.client.0.smithi016.stdout:3/380: mkdir d3/df/d20/d61/d76 0 2024-04-26T20:18:48.907 INFO:tasks.workunit.client.0.smithi016.stdout:0/415: dread d2/d8/f36 [0,4194304] 0 2024-04-26T20:18:48.912 INFO:tasks.workunit.client.0.smithi016.stdout:0/416: getdents d2/d20 0 2024-04-26T20:18:48.912 INFO:tasks.workunit.client.0.smithi016.stdout:6/321: dwrite d1/d8/d2c/d3d/f58 [0,4194304] 0 2024-04-26T20:18:48.912 INFO:tasks.workunit.client.0.smithi016.stdout:6/322: link d1/d8/d2c/d47/c60 d1/d21/d26/d1c/d2e/c73 0 2024-04-26T20:18:48.912 INFO:tasks.workunit.client.0.smithi016.stdout:6/323: readlink d1/d21/d26/d1c/d2e/l65 0 2024-04-26T20:18:48.913 INFO:tasks.workunit.client.0.smithi016.stdout:6/324: mknod d1/d21/d26/c74 0 2024-04-26T20:18:48.914 INFO:tasks.workunit.client.0.smithi016.stdout:6/325: creat d1/d21/d26/f75 x:0 0 0 2024-04-26T20:18:48.915 INFO:tasks.workunit.client.0.smithi016.stdout:2/437: sync 2024-04-26T20:18:48.915 INFO:tasks.workunit.client.0.smithi016.stdout:7/463: sync 2024-04-26T20:18:48.919 INFO:tasks.workunit.client.0.smithi016.stdout:2/438: getdents d1d/d27/d2d/d6b 0 2024-04-26T20:18:48.921 INFO:tasks.workunit.client.0.smithi016.stdout:7/464: truncate d0/f14 2268636 0 2024-04-26T20:18:48.922 INFO:tasks.workunit.client.0.smithi016.stdout:6/326: mkdir d1/d8/d76 0 2024-04-26T20:18:48.923 INFO:tasks.workunit.client.0.smithi016.stdout:6/327: creat d1/d8/d76/f77 x:0 0 0 2024-04-26T20:18:48.924 INFO:tasks.workunit.client.0.smithi016.stdout:6/328: chown d1/fa 495798 1 2024-04-26T20:18:48.924 INFO:tasks.workunit.client.0.smithi016.stdout:6/329: dread - d1/d8/d76/f77 zero size 2024-04-26T20:18:48.924 INFO:tasks.workunit.client.0.smithi016.stdout:6/330: chown d1/d21/d26/d1c/d2e/c50 1176549750 1 2024-04-26T20:18:48.924 INFO:tasks.workunit.client.0.smithi016.stdout:7/465: truncate d0/d1/d6/fa 2394515 0 2024-04-26T20:18:48.925 INFO:tasks.workunit.client.0.smithi016.stdout:6/331: truncate d1/d3a/f55 1060327 0 2024-04-26T20:18:48.925 INFO:tasks.workunit.client.0.smithi016.stdout:7/466: truncate d0/d1/d34/d25/d3f/f5f 16962 0 2024-04-26T20:18:48.929 INFO:tasks.workunit.client.0.smithi016.stdout:4/380: dwrite d0/f46 [0,4194304] 0 2024-04-26T20:18:48.929 INFO:tasks.workunit.client.0.smithi016.stdout:4/381: write d0/dd/f25 [1291803,37112] 0 2024-04-26T20:18:48.930 INFO:tasks.workunit.client.0.smithi016.stdout:6/332: mkdir d1/d21/d78 0 2024-04-26T20:18:48.930 INFO:tasks.workunit.client.0.smithi016.stdout:4/382: creat d0/dd/d19/d1f/d7b/f7e x:0 0 0 2024-04-26T20:18:48.933 INFO:tasks.workunit.client.0.smithi016.stdout:6/333: mknod d1/d8/d46/c79 0 2024-04-26T20:18:48.938 INFO:tasks.workunit.client.0.smithi016.stdout:6/334: getdents d1/d21/d26/d1c 0 2024-04-26T20:18:48.941 INFO:tasks.workunit.client.0.smithi016.stdout:6/335: mknod d1/c7a 0 2024-04-26T20:18:48.974 INFO:tasks.workunit.client.0.smithi016.stdout:7/467: dwrite d0/d1/d34/d25/d3f/f65 [0,4194304] 0 2024-04-26T20:18:48.975 INFO:tasks.workunit.client.0.smithi016.stdout:5/618: dread d1/d9/d25/f64 [0,4194304] 0 2024-04-26T20:18:48.975 INFO:tasks.workunit.client.0.smithi016.stdout:5/619: dread - d1/d9/d1c/d52/d74/f94 zero size 2024-04-26T20:18:48.975 INFO:tasks.workunit.client.0.smithi016.stdout:5/620: chown d1/d9/d4b/d8f/db6/ca1 167401605 1 2024-04-26T20:18:48.975 INFO:tasks.workunit.client.0.smithi016.stdout:5/621: chown d1/d9/d1c/d52/d74/d5f/l8c 881220 1 2024-04-26T20:18:48.978 INFO:tasks.workunit.client.0.smithi016.stdout:7/468: mknod d0/d1/d6/d73/c92 0 2024-04-26T20:18:48.978 INFO:tasks.workunit.client.0.smithi016.stdout:5/622: mkdir d1/d9/d1c/d52/dc4 0 2024-04-26T20:18:48.980 INFO:tasks.workunit.client.0.smithi016.stdout:5/623: symlink d1/d9/d1c/d52/d74/d5f/lc5 0 2024-04-26T20:18:48.980 INFO:tasks.workunit.client.0.smithi016.stdout:5/624: fdatasync d1/d9/d4b/f44 0 2024-04-26T20:18:48.983 INFO:tasks.workunit.client.0.smithi016.stdout:5/625: rename d1/d9/d1c/d52/d74/d98/f9e to d1/d78/d99/fc6 0 2024-04-26T20:18:48.986 INFO:tasks.workunit.client.0.smithi016.stdout:5/626: creat d1/d9/d1c/d52/d74/fc7 x:0 0 0 2024-04-26T20:18:48.989 INFO:tasks.workunit.client.0.smithi016.stdout:5/627: creat d1/d9/d4b/d8f/db6/fc8 x:0 0 0 2024-04-26T20:18:48.991 INFO:tasks.workunit.client.0.smithi016.stdout:5/628: unlink d1/d9/f3d 0 2024-04-26T20:18:48.991 INFO:tasks.workunit.client.0.smithi016.stdout:5/629: dread - d1/d9/d11/d4d/d72/f7c zero size 2024-04-26T20:18:48.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:48.997 INFO:tasks.workunit.client.0.smithi016.stdout:2/439: dread d1d/d52/f5f [0,4194304] 0 2024-04-26T20:18:48.997 INFO:tasks.workunit.client.0.smithi016.stdout:2/440: write d1d/d20/d22/d39/d3e/f74 [1031676,81165] 0 2024-04-26T20:18:49.010 INFO:tasks.workunit.client.0.smithi016.stdout:0/417: dwrite d2/d20/d41/d4c/d4e/f54 [0,4194304] 0 2024-04-26T20:18:49.010 INFO:tasks.workunit.client.0.smithi016.stdout:0/418: fdatasync d2/dc/d1e/f1f 0 2024-04-26T20:18:49.015 INFO:tasks.workunit.client.0.smithi016.stdout:5/630: getdents d1/d9/d4b/d8f/db6 0 2024-04-26T20:18:49.018 INFO:tasks.workunit.client.0.smithi016.stdout:5/631: mknod d1/d9/d1c/d52/d74/d98/cc9 0 2024-04-26T20:18:49.019 INFO:tasks.workunit.client.0.smithi016.stdout:5/632: mknod d1/cca 0 2024-04-26T20:18:49.022 INFO:tasks.workunit.client.0.smithi016.stdout:5/633: mkdir d1/d9/d1c/d52/d74/d98/dcb 0 2024-04-26T20:18:49.044 INFO:tasks.workunit.client.0.smithi016.stdout:6/336: dwrite d1/d21/d26/d1c/f20 [0,4194304] 0 2024-04-26T20:18:49.044 INFO:tasks.workunit.client.0.smithi016.stdout:6/337: mkdir d1/d21/d26/d1c/d7b 0 2024-04-26T20:18:49.048 INFO:tasks.workunit.client.0.smithi016.stdout:7/469: dwrite d0/f14 [0,4194304] 0 2024-04-26T20:18:49.048 INFO:tasks.workunit.client.0.smithi016.stdout:2/441: write d1d/d20/d22/f2e [991156,77041] 0 2024-04-26T20:18:49.050 INFO:tasks.workunit.client.0.smithi016.stdout:3/381: dwrite d3/df/f2f [0,4194304] 0 2024-04-26T20:18:49.051 INFO:tasks.workunit.client.0.smithi016.stdout:5/634: dread d1/d9/d25/f42 [0,4194304] 0 2024-04-26T20:18:49.052 INFO:tasks.workunit.client.0.smithi016.stdout:5/635: chown d1/d9/d11/l30 5942621 1 2024-04-26T20:18:49.053 INFO:tasks.workunit.client.0.smithi016.stdout:6/338: read - d1/d21/d48/f4f zero size 2024-04-26T20:18:49.053 INFO:tasks.workunit.client.0.smithi016.stdout:3/382: creat d3/df/d25/d2a/d4a/f77 x:0 0 0 2024-04-26T20:18:49.060 INFO:tasks.workunit.client.0.smithi016.stdout:5/636: getdents d1/d9/d4b 0 2024-04-26T20:18:49.062 INFO:tasks.workunit.client.0.smithi016.stdout:2/442: dread d1d/d27/f53 [0,4194304] 0 2024-04-26T20:18:49.062 INFO:tasks.workunit.client.0.smithi016.stdout:2/443: chown d1d/d27/d2d/d6b/d7e/f8a 1550 1 2024-04-26T20:18:49.070 INFO:tasks.workunit.client.0.smithi016.stdout:7/470: read d0/f15 [2118440,17607] 0 2024-04-26T20:18:49.070 INFO:tasks.workunit.client.0.smithi016.stdout:7/471: fdatasync d0/d1/d34/d25/d3f/d6d/d87/f7c 0 2024-04-26T20:18:49.076 INFO:tasks.workunit.client.0.smithi016.stdout:6/339: creat d1/d21/d26/d1c/f7c x:0 0 0 2024-04-26T20:18:49.077 INFO:tasks.workunit.client.0.smithi016.stdout:3/383: unlink d3/df/c54 0 2024-04-26T20:18:49.077 INFO:tasks.workunit.client.0.smithi016.stdout:2/444: link d1d/d27/d2d/d6b/f71 d1d/d27/d2d/f96 0 2024-04-26T20:18:49.077 INFO:tasks.workunit.client.0.smithi016.stdout:1/557: sync 2024-04-26T20:18:49.077 INFO:tasks.workunit.client.0.smithi016.stdout:9/539: sync 2024-04-26T20:18:49.080 INFO:tasks.workunit.client.0.smithi016.stdout:7/472: unlink d0/d1/d46/f2e 0 2024-04-26T20:18:49.082 INFO:tasks.workunit.client.0.smithi016.stdout:9/540: creat d1/d2e/d40/fb8 x:0 0 0 2024-04-26T20:18:49.082 INFO:tasks.workunit.client.0.smithi016.stdout:9/541: readlink d1/d2e/d40/l96 0 2024-04-26T20:18:49.082 INFO:tasks.workunit.client.0.smithi016.stdout:3/384: mknod d3/df/d25/d2a/d4a/c78 0 2024-04-26T20:18:49.083 INFO:tasks.workunit.client.0.smithi016.stdout:0/419: dwrite d2/f15 [0,4194304] 0 2024-04-26T20:18:49.084 INFO:tasks.workunit.client.0.smithi016.stdout:0/420: stat d2/dc/d1e/f3a 0 2024-04-26T20:18:49.088 INFO:tasks.workunit.client.0.smithi016.stdout:7/473: creat d0/d1/f93 x:0 0 0 2024-04-26T20:18:49.088 INFO:tasks.workunit.client.0.smithi016.stdout:7/474: write d0/d83/f60 [1669403,69682] 0 2024-04-26T20:18:49.088 INFO:tasks.workunit.client.0.smithi016.stdout:7/475: stat d0/d1/d34/d25/d3f/d6d/d87/c78 0 2024-04-26T20:18:49.088 INFO:tasks.workunit.client.0.smithi016.stdout:3/385: symlink d3/d9/d2d/d4f/l79 0 2024-04-26T20:18:49.090 INFO:tasks.workunit.client.0.smithi016.stdout:7/476: truncate d0/f31 6503420 0 2024-04-26T20:18:49.090 INFO:tasks.workunit.client.0.smithi016.stdout:7/477: fdatasync d0/f14 0 2024-04-26T20:18:49.093 INFO:tasks.workunit.client.0.smithi016.stdout:8/481: sync 2024-04-26T20:18:49.093 INFO:tasks.workunit.client.0.smithi016.stdout:8/482: readlink d9/d19/l4f 0 2024-04-26T20:18:49.095 INFO:tasks.workunit.client.0.smithi016.stdout:8/483: creat d9/d19/d45/d9e/fa4 x:0 0 0 2024-04-26T20:18:49.098 INFO:tasks.workunit.client.0.smithi016.stdout:8/484: mknod d9/d66/d73/ca5 0 2024-04-26T20:18:49.106 INFO:tasks.workunit.client.0.smithi016.stdout:8/485: getdents d9/d19/d45/d9e 0 2024-04-26T20:18:49.109 INFO:tasks.workunit.client.0.smithi016.stdout:8/486: mkdir d9/d19/d45/da6 0 2024-04-26T20:18:49.147 INFO:tasks.workunit.client.0.smithi016.stdout:5/637: dwrite d1/d9/d1c/d52/f63 [0,4194304] 0 2024-04-26T20:18:49.147 INFO:tasks.workunit.client.0.smithi016.stdout:5/638: truncate d1/d9/d11/d4d/f6d 1471081 0 2024-04-26T20:18:49.147 INFO:tasks.workunit.client.0.smithi016.stdout:5/639: rmdir d1/d9/d1c/d52 39 2024-04-26T20:18:49.149 INFO:tasks.workunit.client.0.smithi016.stdout:5/640: getdents d1/d9 0 2024-04-26T20:18:49.149 INFO:tasks.workunit.client.0.smithi016.stdout:5/641: stat d1/d9/d1c/d52/d74/d98 0 2024-04-26T20:18:49.150 INFO:tasks.workunit.client.0.smithi016.stdout:5/642: mkdir d1/d9/d4b/d8f/db6/dcc 0 2024-04-26T20:18:49.150 INFO:tasks.workunit.client.0.smithi016.stdout:5/643: chown d1/d9/d4b/d8f/db6/fc8 29479068 1 2024-04-26T20:18:49.151 INFO:tasks.workunit.client.0.smithi016.stdout:5/644: rename d1/la5 to d1/d9/d11/d4d/d72/lcd 0 2024-04-26T20:18:49.167 INFO:tasks.workunit.client.0.smithi016.stdout:9/542: dwrite d1/d59/d52/f7c [0,4194304] 0 2024-04-26T20:18:49.169 INFO:tasks.workunit.client.0.smithi016.stdout:9/543: getdents d1/d2/d79 0 2024-04-26T20:18:49.172 INFO:tasks.workunit.client.0.smithi016.stdout:0/421: dwrite d2/d20/d41/d4c/f8f [0,4194304] 0 2024-04-26T20:18:49.173 INFO:tasks.workunit.client.0.smithi016.stdout:2/445: dwrite f7 [0,4194304] 0 2024-04-26T20:18:49.177 INFO:tasks.workunit.client.0.smithi016.stdout:2/446: symlink d1d/d52/l97 0 2024-04-26T20:18:49.180 INFO:tasks.workunit.client.0.smithi016.stdout:2/447: mkdir d1d/d20/d22/d98 0 2024-04-26T20:18:49.185 INFO:tasks.workunit.client.0.smithi016.stdout:5/645: dread d1/d9/f49 [0,4194304] 0 2024-04-26T20:18:49.185 INFO:tasks.workunit.client.0.smithi016.stdout:2/448: creat d1d/d2a/d3b/f99 x:0 0 0 2024-04-26T20:18:49.186 INFO:tasks.workunit.client.0.smithi016.stdout:6/340: dwrite d1/f13 [0,4194304] 0 2024-04-26T20:18:49.187 INFO:tasks.workunit.client.0.smithi016.stdout:5/646: creat d1/d9/d1c/d52/dc4/fce x:0 0 0 2024-04-26T20:18:49.190 INFO:tasks.workunit.client.0.smithi016.stdout:2/449: rename d1d/d2a/d3d/f7b to d1d/d27/d49/f9a 0 2024-04-26T20:18:49.191 INFO:tasks.workunit.client.0.smithi016.stdout:5/647: rmdir d1/d78/d99 39 2024-04-26T20:18:49.191 INFO:tasks.workunit.client.0.smithi016.stdout:5/648: dread - d1/f5a zero size 2024-04-26T20:18:49.191 INFO:tasks.workunit.client.0.smithi016.stdout:5/649: readlink d1/d9/d1c/d52/d74/d5f/lc5 0 2024-04-26T20:18:49.191 INFO:tasks.workunit.client.0.smithi016.stdout:5/650: readlink d1/d9/d25/la7 0 2024-04-26T20:18:49.196 INFO:tasks.workunit.client.0.smithi016.stdout:2/450: link d1d/d27/d2d/f30 d1d/d20/d22/d98/f9b 0 2024-04-26T20:18:49.196 INFO:tasks.workunit.client.0.smithi016.stdout:5/651: mkdir d1/d9/d4b/d8f/db6/dcc/dcf 0 2024-04-26T20:18:49.203 INFO:tasks.workunit.client.0.smithi016.stdout:3/386: dwrite d3/df/f1e [4194304,4194304] 0 2024-04-26T20:18:49.203 INFO:tasks.workunit.client.0.smithi016.stdout:3/387: write d3/d9/d2d/f5f [465563,6111] 0 2024-04-26T20:18:49.204 INFO:tasks.workunit.client.0.smithi016.stdout:0/422: write d2/d8/f11 [3125826,42169] 0 2024-04-26T20:18:49.204 INFO:tasks.workunit.client.0.smithi016.stdout:0/423: write d2/dc/d1e/d25/f55 [1872998,94445] 0 2024-04-26T20:18:49.204 INFO:tasks.workunit.client.0.smithi016.stdout:0/424: dread - d2/d20/d41/f65 zero size 2024-04-26T20:18:49.211 INFO:tasks.workunit.client.0.smithi016.stdout:0/425: mkdir d2/d40/d61/d91 0 2024-04-26T20:18:49.211 INFO:tasks.workunit.client.0.smithi016.stdout:2/451: rename d1d/d2a/d3b to d1d/d27/d2d/d5a/d9c 0 2024-04-26T20:18:49.211 INFO:tasks.workunit.client.0.smithi016.stdout:0/426: write d2/d8/f11 [2181596,106669] 0 2024-04-26T20:18:49.214 INFO:tasks.workunit.client.0.smithi016.stdout:2/452: link d1d/d27/d2d/f70 d1d/d20/d22/d98/f9d 0 2024-04-26T20:18:49.217 INFO:tasks.workunit.client.0.smithi016.stdout:0/427: rmdir d2/d20/d41/d4c/d4e 39 2024-04-26T20:18:49.230 INFO:tasks.workunit.client.0.smithi016.stdout:2/453: dread d1d/d20/d22/d98/f9b [0,4194304] 0 2024-04-26T20:18:49.230 INFO:tasks.workunit.client.0.smithi016.stdout:2/454: read - d1d/d27/d49/f6d zero size 2024-04-26T20:18:49.231 INFO:tasks.workunit.client.0.smithi016.stdout:7/478: dwrite d0/d1/d6/d6e/f86 [0,4194304] 0 2024-04-26T20:18:49.235 INFO:tasks.workunit.client.0.smithi016.stdout:2/455: getdents d1d/d27/d2d/d6b/d7e 0 2024-04-26T20:18:49.237 INFO:tasks.workunit.client.0.smithi016.stdout:9/544: dread d1/d2/d43/fb7 [0,4194304] 0 2024-04-26T20:18:49.239 INFO:tasks.workunit.client.0.smithi016.stdout:7/479: creat d0/f94 x:0 0 0 2024-04-26T20:18:49.239 INFO:tasks.workunit.client.0.smithi016.stdout:5/652: dread d1/d9/d1c/d52/f63 [0,4194304] 0 2024-04-26T20:18:49.245 INFO:tasks.workunit.client.0.smithi016.stdout:6/341: dwrite d1/f7 [4194304,4194304] 0 2024-04-26T20:18:49.248 INFO:tasks.workunit.client.0.smithi016.stdout:9/545: symlink d1/d2/d20/d49/d77/lb9 0 2024-04-26T20:18:49.248 INFO:tasks.workunit.client.0.smithi016.stdout:9/546: truncate d1/d59/d52/d8c/fa2 621482 0 2024-04-26T20:18:49.248 INFO:tasks.workunit.client.0.smithi016.stdout:2/456: dread d1d/d27/f3f [0,4194304] 0 2024-04-26T20:18:49.248 INFO:tasks.workunit.client.0.smithi016.stdout:6/342: symlink d1/d21/d78/l7d 0 2024-04-26T20:18:49.252 INFO:tasks.workunit.client.0.smithi016.stdout:7/480: mkdir d0/d1/d95 0 2024-04-26T20:18:49.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/457: rmdir d1d/d2a 39 2024-04-26T20:18:49.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/458: link d1d/d27/d2d/d6b/d7e/f8a d1d/d27/d2d/d5a/f9e 0 2024-04-26T20:18:49.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/459: truncate d1d/d27/d2d/d6b/d7e/f8a 88015 0 2024-04-26T20:18:49.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/460: truncate d1d/d20/d22/f2c 68177 0 2024-04-26T20:18:49.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/461: write d1d/d27/d49/f5c [425526,71283] 0 2024-04-26T20:18:49.258 INFO:tasks.workunit.client.0.smithi016.stdout:6/343: symlink d1/d21/l7e 0 2024-04-26T20:18:49.258 INFO:tasks.workunit.client.0.smithi016.stdout:6/344: write d1/d21/d26/d25/f35 [1117337,73795] 0 2024-04-26T20:18:49.270 INFO:tasks.workunit.client.0.smithi016.stdout:3/388: dwrite d3/f1b [0,4194304] 0 2024-04-26T20:18:49.271 INFO:tasks.workunit.client.0.smithi016.stdout:2/462: read d1d/d20/d22/d39/f45 [3711710,63763] 0 2024-04-26T20:18:49.272 INFO:tasks.workunit.client.0.smithi016.stdout:9/547: write d1/fa7 [3475890,15121] 0 2024-04-26T20:18:49.272 INFO:tasks.workunit.client.0.smithi016.stdout:0/428: dwrite d2/d20/f67 [0,4194304] 0 2024-04-26T20:18:49.272 INFO:tasks.workunit.client.0.smithi016.stdout:0/429: write d2/d8/f11 [1438147,63746] 0 2024-04-26T20:18:49.273 INFO:tasks.workunit.client.0.smithi016.stdout:0/430: write d2/dc/d45/f89 [867409,102171] 0 2024-04-26T20:18:49.277 INFO:tasks.workunit.client.0.smithi016.stdout:0/431: creat d2/dc/d45/f92 x:0 0 0 2024-04-26T20:18:49.278 INFO:tasks.workunit.client.0.smithi016.stdout:9/548: creat d1/d59/d52/fba x:0 0 0 2024-04-26T20:18:49.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.275+0000 7f3e17a00640 1 Processor -- start 2024-04-26T20:18:49.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.275+0000 7f3e17a00640 1 -- start start 2024-04-26T20:18:49.279 INFO:tasks.workunit.client.0.smithi016.stdout:0/432: link d2/fb d2/d8/d37/d70/f93 0 2024-04-26T20:18:49.280 INFO:tasks.workunit.client.0.smithi016.stdout:0/433: fdatasync d2/dc/d1e/f1f 0 2024-04-26T20:18:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e17a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3e1006c380 0x7f3e100c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e17a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e100c1b50 0x7f3e1006c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e17a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1015c1b0 con 0x7f3e1006cca0 2024-04-26T20:18:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e17a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1015c490 con 0x7f3e1006c380 2024-04-26T20:18:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e17a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1015c770 con 0x7f3e100c1b50 2024-04-26T20:18:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e0fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e100c1b50 0x7f3e1006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:49.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e0fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e100c1b50 0x7f3e1006c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:55744/0 (socket says 172.21.15.16:55744) 2024-04-26T20:18:49.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.279+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1380875279 learned_addr learned my addr 172.21.15.16:0/1380875279 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:49.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.283+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1380875279 >> v2:172.21.15.16:3300/0 conn(0x7f3e1006c380 msgr2=0x7f3e100c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:49.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.283+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/1380875279 >> v2:172.21.15.16:3300/0 conn(0x7f3e1006c380 0x7f3e100c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.283+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1380875279 >> v1:172.21.15.16:6789/0 conn(0x7f3e1006cca0 legacy=0x7f3e100737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:49.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.283+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1380875279 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1015ca50 con 0x7f3e100c1b50 2024-04-26T20:18:49.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.287+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/1380875279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e100c1b50 0x7f3e1006c760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e10159af0 tx=0x7f3dfc01c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6999808a16943f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:49.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.287+0000 7f3e0f400640 1 -- 172.21.15.16:0/1380875279 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0b1070 con 0x7f3e100c1b50 2024-04-26T20:18:49.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.287+0000 7f3e0f400640 1 -- 172.21.15.16:0/1380875279 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0ac630 con 0x7f3e100c1b50 2024-04-26T20:18:49.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.287+0000 7f3e0f400640 1 -- 172.21.15.16:0/1380875279 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0a8050 con 0x7f3e100c1b50 2024-04-26T20:18:49.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.287+0000 7f3e17a00640 1 -- 172.21.15.16:0/1380875279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e100c1b50 msgr2=0x7f3e1006c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:49.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.287+0000 7f3e17a00640 1 --2- 172.21.15.16:0/1380875279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e100c1b50 0x7f3e1006c760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e10159af0 tx=0x7f3dfc01c4e0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.292 INFO:tasks.workunit.client.0.smithi016.stdout:9/549: rename d1/d2e/fb to d1/d2/d20/d49/d77/d3e/d5e/fbb 0 2024-04-26T20:18:49.292 INFO:tasks.workunit.client.0.smithi016.stdout:0/434: symlink d2/dc/d18/d24/l94 0 2024-04-26T20:18:49.292 INFO:tasks.workunit.client.0.smithi016.stdout:9/550: write d1/d2/d43/f46 [700859,59853] 0 2024-04-26T20:18:49.292 INFO:tasks.workunit.client.0.smithi016.stdout:9/551: truncate d1/d59/d52/fba 533286 0 2024-04-26T20:18:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.291+0000 7f3e17a00640 1 -- 172.21.15.16:0/1380875279 shutdown_connections 2024-04-26T20:18:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.291+0000 7f3e17a00640 1 --2- 172.21.15.16:0/1380875279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e100c1b50 0x7f3e1006c760 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.291+0000 7f3e17a00640 1 --2- 172.21.15.16:0/1380875279 >> v2:172.21.15.16:3300/0 conn(0x7f3e1006c380 0x7f3e100c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.291+0000 7f3e17a00640 1 -- 172.21.15.16:0/1380875279 >> 172.21.15.16:0/1380875279 conn(0x7f3e100cad20 msgr2=0x7f3e100cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:49.296 INFO:tasks.workunit.client.0.smithi016.stdout:9/552: creat d1/fbc x:0 0 0 2024-04-26T20:18:49.296 INFO:tasks.workunit.client.0.smithi016.stdout:9/553: write d1/fbc [542541,524] 0 2024-04-26T20:18:49.297 INFO:tasks.workunit.client.0.smithi016.stdout:9/554: dread - d1/d2/d20/d49/d77/d2a/d75/d85/fb4 zero size 2024-04-26T20:18:49.297 INFO:tasks.workunit.client.0.smithi016.stdout:6/345: write d1/f7 [7574176,115516] 0 2024-04-26T20:18:49.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.295+0000 7f3e17a00640 1 -- 172.21.15.16:0/1380875279 shutdown_connections 2024-04-26T20:18:49.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.295+0000 7f3e17a00640 1 -- 172.21.15.16:0/1380875279 wait complete. 2024-04-26T20:18:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.299+0000 7f3e17a00640 1 Processor -- start 2024-04-26T20:18:49.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.303+0000 7f3e17a00640 1 -- start start 2024-04-26T20:18:49.312 INFO:tasks.workunit.client.0.smithi016.stdout:7/481: dwrite d0/d1/d34/d25/d3f/d6d/f77 [0,4194304] 0 2024-04-26T20:18:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e1006c380 0x7f3e1014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e1006cca0 0x7f3e1014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e100c1b50 0x7f3e1014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101566a0 con 0x7f3e100c1b50 2024-04-26T20:18:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10156520 con 0x7f3e1006c380 2024-04-26T20:18:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3e10168f80 con 0x7f3e1006cca0 2024-04-26T20:18:49.313 INFO:tasks.workunit.client.0.smithi016.stdout:9/555: creat d1/d59/d52/fbd x:0 0 0 2024-04-26T20:18:49.313 INFO:tasks.workunit.client.0.smithi016.stdout:9/556: fsync d1/d2/d20/d49/d77/d2a/d33/d44/f65 0 2024-04-26T20:18:49.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e1006cca0 0x7f3e1014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e1006cca0 0x7f3e1014d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:51094/0 (socket says 172.21.15.16:51094) 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 -- 172.21.15.16:0/3267346749 learned_addr learned my addr 172.21.15.16:0/3267346749 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 -- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e1006c380 msgr2=0x7f3e1014fc80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e1006c380 0x7f3e1014fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 -- 172.21.15.16:0/3267346749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e100c1b50 msgr2=0x7f3e1014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e100c1b50 0x7f3e1014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 -- 172.21.15.16:0/3267346749 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1014eea0 con 0x7f3e1006cca0 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e1006cca0 0x7f3e1014d7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc01ab90 tx=0x7f3dfc019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0cc00640 1 -- 172.21.15.16:0/3267346749 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0a8050 con 0x7f3e1006cca0 2024-04-26T20:18:49.316 INFO:tasks.workunit.client.0.smithi016.stdout:9/557: creat d1/d2/d20/d49/d77/fbe x:0 0 0 2024-04-26T20:18:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0cc00640 1 -- 172.21.15.16:0/3267346749 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0bc070 con 0x7f3e1006cca0 2024-04-26T20:18:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e0cc00640 1 -- 172.21.15.16:0/3267346749 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0b1040 con 0x7f3e1006cca0 2024-04-26T20:18:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1014f160 con 0x7f3e1006cca0 2024-04-26T20:18:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.311+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e100c7c90 con 0x7f3e1006cca0 2024-04-26T20:18:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.315+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1014ec10 con 0x7f3e1006cca0 2024-04-26T20:18:49.317 INFO:tasks.workunit.client.0.smithi016.stdout:9/558: link d1/d2/d20/d49/d77/lb9 d1/d2/d20/d49/d77/d2a/d75/d85/d9b/lbf 0 2024-04-26T20:18:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.315+0000 7f3e0cc00640 1 -- 172.21.15.16:0/3267346749 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3dfc0b78a0 con 0x7f3e1006cca0 2024-04-26T20:18:49.320 INFO:tasks.workunit.client.0.smithi016.stdout:9/559: rename d1/d2e/d40/fb8 to d1/d2/d20/fc0 0 2024-04-26T20:18:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.319+0000 7f3e0cc00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3df0068380 0x7f3df006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.319+0000 7f3e0cc00640 1 -- 172.21.15.16:0/3267346749 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f3dfc121f20 con 0x7f3e1006cca0 2024-04-26T20:18:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.319+0000 7f3e15000640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3df0068380 0x7f3df006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:49.322 INFO:tasks.workunit.client.0.smithi016.stdout:9/560: creat d1/d59/fc1 x:0 0 0 2024-04-26T20:18:49.322 INFO:tasks.workunit.client.0.smithi016.stdout:9/561: write d1/d2/d43/f88 [939878,15773] 0 2024-04-26T20:18:49.323 INFO:tasks.workunit.client.0.smithi016.stdout:9/562: link d1/d59/d52/d8c/ca4 d1/d2/d20/d49/d77/d2a/d75/cc2 0 2024-04-26T20:18:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.319+0000 7f3e15000640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3df0068380 0x7f3df006a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009670 tx=0x7f3e04006b90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:49.334 INFO:tasks.workunit.client.0.smithi016.stdout:3/389: dwrite d3/d9/f1a [0,4194304] 0 2024-04-26T20:18:49.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.335+0000 7f3e0cc00640 1 -- 172.21.15.16:0/3267346749 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3dfc0160d0 con 0x7f3e1006cca0 2024-04-26T20:18:49.343 INFO:tasks.workunit.client.0.smithi016.stdout:2/463: dwrite d1d/d20/d22/d98/f9d [4194304,4194304] 0 2024-04-26T20:18:49.343 INFO:tasks.workunit.client.0.smithi016.stdout:2/464: chown d1d/d20/d22/d39/c4b 7349156 1 2024-04-26T20:18:49.348 INFO:tasks.workunit.client.0.smithi016.stdout:7/482: dread d0/d1/d34/d25/d3f/d6d/f77 [0,4194304] 0 2024-04-26T20:18:49.349 INFO:tasks.workunit.client.0.smithi016.stdout:7/483: chown d0/d1/d6/l35 2443 1 2024-04-26T20:18:49.349 INFO:tasks.workunit.client.0.smithi016.stdout:7/484: stat d0/f94 0 2024-04-26T20:18:49.353 INFO:tasks.workunit.client.0.smithi016.stdout:3/390: creat d3/df/d25/d2a/f7a x:0 0 0 2024-04-26T20:18:49.353 INFO:tasks.workunit.client.0.smithi016.stdout:3/391: readlink d3/d9/lc 0 2024-04-26T20:18:49.353 INFO:tasks.workunit.client.0.smithi016.stdout:7/485: mknod d0/d1/d6/d6e/c96 0 2024-04-26T20:18:49.353 INFO:tasks.workunit.client.0.smithi016.stdout:5/653: dwrite d1/d9/d25/f47 [0,4194304] 0 2024-04-26T20:18:49.353 INFO:tasks.workunit.client.0.smithi016.stdout:5/654: stat d1/d7d/l81 0 2024-04-26T20:18:49.356 INFO:tasks.workunit.client.0.smithi016.stdout:3/392: stat d3/df/d20/d41/l57 0 2024-04-26T20:18:49.361 INFO:tasks.workunit.client.0.smithi016.stdout:7/486: mknod d0/d1/d34/d25/d3f/d6d/d74/c97 0 2024-04-26T20:18:49.361 INFO:tasks.workunit.client.0.smithi016.stdout:7/487: readlink d0/d1/d34/d25/d3f/l70 0 2024-04-26T20:18:49.363 INFO:tasks.workunit.client.0.smithi016.stdout:5/655: rename d1/d9/d11/l30 to d1/d9/d1c/d52/ld0 0 2024-04-26T20:18:49.368 INFO:tasks.workunit.client.0.smithi016.stdout:5/656: rename d1/l15 to d1/d9/d4b/d8f/db6/ld1 0 2024-04-26T20:18:49.372 INFO:tasks.workunit.client.0.smithi016.stdout:9/563: dwrite d1/d1b/f24 [0,4194304] 0 2024-04-26T20:18:49.376 INFO:tasks.workunit.client.0.smithi016.stdout:9/564: rename d1/d59/fc1 to d1/d2/d20/d49/d77/fc3 0 2024-04-26T20:18:49.381 INFO:tasks.workunit.client.0.smithi016.stdout:9/565: rmdir d1/d2/d20/d49/d77/d2a/d33/d44 39 2024-04-26T20:18:49.381 INFO:tasks.workunit.client.0.smithi016.stdout:9/566: dread - d1/d2/d20/d49/d77/fbe zero size 2024-04-26T20:18:49.381 INFO:tasks.workunit.client.0.smithi016.stdout:9/567: creat d1/d2/d20/d49/d77/d2a/d75/d85/d9b/fc4 x:0 0 0 2024-04-26T20:18:49.381 INFO:tasks.workunit.client.0.smithi016.stdout:9/568: readlink d1/d2/d20/d49/d77/d2a/d33/d44/l6e 0 2024-04-26T20:18:49.381 INFO:tasks.workunit.client.0.smithi016.stdout:9/569: fsync d1/d59/d52/f30 0 2024-04-26T20:18:49.381 INFO:tasks.workunit.client.0.smithi016.stdout:9/570: chown d1/d2/l2c 698316444 1 2024-04-26T20:18:49.383 INFO:tasks.workunit.client.0.smithi016.stdout:9/571: mknod d1/d2/d20/d49/d77/d2a/d33/cc5 0 2024-04-26T20:18:49.386 INFO:tasks.workunit.client.0.smithi016.stdout:9/572: rename d1/d2/d20/d49/d77/d2a/d33/d44 to d1/d2e/dc6 0 2024-04-26T20:18:49.386 INFO:tasks.workunit.client.0.smithi016.stdout:9/573: chown d1/d2/f6 696707 1 2024-04-26T20:18:49.387 INFO:tasks.workunit.client.0.smithi016.stdout:9/574: chown d1/d2e/d40/c86 51562 1 2024-04-26T20:18:49.390 INFO:tasks.workunit.client.0.smithi016.stdout:9/575: rmdir d1/d2/d20/d49/d77/d2a 39 2024-04-26T20:18:49.390 INFO:tasks.workunit.client.0.smithi016.stdout:2/465: dwrite d1d/d20/d22/d98/f9b [0,4194304] 0 2024-04-26T20:18:49.392 INFO:tasks.workunit.client.0.smithi016.stdout:2/466: unlink d1d/d20/d22/d29/c58 0 2024-04-26T20:18:49.394 INFO:tasks.workunit.client.0.smithi016.stdout:2/467: creat d1d/d20/f9f x:0 0 0 2024-04-26T20:18:49.395 INFO:tasks.workunit.client.0.smithi016.stdout:5/657: write d1/d9/d11/f61 [926916,57720] 0 2024-04-26T20:18:49.398 INFO:tasks.workunit.client.0.smithi016.stdout:5/658: mknod d1/d9/d1c/cd2 0 2024-04-26T20:18:49.400 INFO:tasks.workunit.client.0.smithi016.stdout:5/659: symlink d1/d9/d4b/ld3 0 2024-04-26T20:18:49.400 INFO:tasks.workunit.client.0.smithi016.stdout:5/660: chown d1/d9/d11/d4d/d72/lbb 3588 1 2024-04-26T20:18:49.400 INFO:tasks.workunit.client.0.smithi016.stdout:5/661: truncate d1/d9/d25/f54 1507441 0 2024-04-26T20:18:49.402 INFO:tasks.workunit.client.0.smithi016.stdout:5/662: unlink d1/d9/d11/l8e 0 2024-04-26T20:18:49.425 INFO:tasks.workunit.client.0.smithi016.stdout:0/435: dwrite d2/d20/f67 [0,4194304] 0 2024-04-26T20:18:49.426 INFO:tasks.workunit.client.0.smithi016.stdout:2/468: dread d1d/d27/d2d/d5a/f9e [0,4194304] 0 2024-04-26T20:18:49.430 INFO:tasks.workunit.client.0.smithi016.stdout:9/576: dwrite d1/d2e/f9 [0,4194304] 0 2024-04-26T20:18:49.434 INFO:tasks.workunit.client.0.smithi016.stdout:7/488: dwrite d0/f27 [4194304,4194304] 0 2024-04-26T20:18:49.434 INFO:tasks.workunit.client.0.smithi016.stdout:2/469: mknod d1d/d27/d2d/d5a/d9c/ca0 0 2024-04-26T20:18:49.435 INFO:tasks.workunit.client.0.smithi016.stdout:9/577: creat d1/d1b/fc7 x:0 0 0 2024-04-26T20:18:49.437 INFO:tasks.workunit.client.0.smithi016.stdout:2/470: link d1d/d27/d49/l5d d1d/la1 0 2024-04-26T20:18:49.438 INFO:tasks.workunit.client.0.smithi016.stdout:9/578: mknod d1/d2/d43/cc8 0 2024-04-26T20:18:49.442 INFO:tasks.workunit.client.0.smithi016.stdout:9/579: write d1/d2/d20/d49/d77/d2a/d33/f5c [1330748,21589] 0 2024-04-26T20:18:49.443 INFO:tasks.workunit.client.0.smithi016.stdout:2/471: creat d1d/d27/d49/fa2 x:0 0 0 2024-04-26T20:18:49.443 INFO:tasks.workunit.client.0.smithi016.stdout:2/472: chown c16 29202664 1 2024-04-26T20:18:49.443 INFO:tasks.workunit.client.0.smithi016.stdout:3/393: dwrite d3/d9/d2d/f5f [0,4194304] 0 2024-04-26T20:18:49.444 INFO:tasks.workunit.client.0.smithi016.stdout:2/473: symlink d1d/la3 0 2024-04-26T20:18:49.444 INFO:tasks.workunit.client.0.smithi016.stdout:9/580: mknod d1/d2e/dc6/cc9 0 2024-04-26T20:18:49.444 INFO:tasks.workunit.client.0.smithi016.stdout:9/581: truncate d1/d2/d20/d49/d77/d2a/fa9 673079 0 2024-04-26T20:18:49.445 INFO:tasks.workunit.client.0.smithi016.stdout:2/474: write d1d/d27/d2d/d6b/d7e/f8a [307214,41901] 0 2024-04-26T20:18:49.445 INFO:tasks.workunit.client.0.smithi016.stdout:2/475: dread - d1d/d27/d2d/f96 zero size 2024-04-26T20:18:49.445 INFO:tasks.workunit.client.0.smithi016.stdout:3/394: mkdir d3/df/d20/d61/d7b 0 2024-04-26T20:18:49.452 INFO:tasks.workunit.client.0.smithi016.stdout:0/436: dread d2/d8/d3b/f42 [0,4194304] 0 2024-04-26T20:18:49.456 INFO:tasks.workunit.client.0.smithi016.stdout:9/582: creat d1/d2e/dc6/fca x:0 0 0 2024-04-26T20:18:49.458 INFO:tasks.workunit.client.0.smithi016.stdout:9/583: creat d1/d2/d20/d49/d77/d3e/d5e/d93/fcb x:0 0 0 2024-04-26T20:18:49.460 INFO:tasks.workunit.client.0.smithi016.stdout:9/584: rename d1/d2e/d40/l96 to d1/d2/d20/d49/d77/d3e/d5e/d93/lcc 0 2024-04-26T20:18:49.462 INFO:tasks.workunit.client.0.smithi016.stdout:9/585: mknod d1/d2/d20/d49/d77/d2a/d75/d85/d9b/ccd 0 2024-04-26T20:18:49.464 INFO:tasks.workunit.client.0.smithi016.stdout:9/586: creat d1/d2/d20/fce x:0 0 0 2024-04-26T20:18:49.466 INFO:tasks.workunit.client.0.smithi016.stdout:9/587: rename d1/d59/d52/d8c/cb3 to d1/d2/d20/ccf 0 2024-04-26T20:18:49.467 INFO:tasks.workunit.client.0.smithi016.stdout:9/588: symlink d1/d2e/dc6/ld0 0 2024-04-26T20:18:49.502 INFO:tasks.workunit.client.0.smithi016.stdout:2/476: dread d1d/d52/f61 [0,4194304] 0 2024-04-26T20:18:49.503 INFO:tasks.workunit.client.0.smithi016.stdout:2/477: write f18 [1479032,74803] 0 2024-04-26T20:18:49.503 INFO:tasks.workunit.client.0.smithi016.stdout:2/478: stat f12 0 2024-04-26T20:18:49.505 INFO:tasks.workunit.client.0.smithi016.stdout:2/479: rmdir d1d/d52 39 2024-04-26T20:18:49.506 INFO:tasks.workunit.client.0.smithi016.stdout:2/480: mkdir d1d/d20/d22/d88/da4 0 2024-04-26T20:18:49.509 INFO:tasks.workunit.client.0.smithi016.stdout:2/481: rename d1d/d52/f61 to d1d/d20/d22/d88/da4/fa5 0 2024-04-26T20:18:49.518 INFO:tasks.workunit.client.0.smithi016.stdout:3/395: dwrite d3/df/d25/d32/f38 [4194304,4194304] 0 2024-04-26T20:18:49.532 INFO:tasks.workunit.client.0.smithi016.stdout:3/396: getdents d3/df/d25/d2a/d4a 0 2024-04-26T20:18:49.536 INFO:tasks.workunit.client.0.smithi016.stdout:5/663: dwrite d1/f5a [0,4194304] 0 2024-04-26T20:18:49.537 INFO:tasks.workunit.client.0.smithi016.stdout:2/482: write fe [2723704,60682] 0 2024-04-26T20:18:49.540 INFO:tasks.workunit.client.0.smithi016.stdout:7/489: dwrite d0/d1/d34/d25/d3f/d6d/f77 [4194304,4194304] 0 2024-04-26T20:18:49.543 INFO:tasks.workunit.client.0.smithi016.stdout:0/437: dwrite d2/fb [0,4194304] 0 2024-04-26T20:18:49.544 INFO:tasks.workunit.client.0.smithi016.stdout:0/438: truncate d2/d20/d41/d4c/d4e/f86 265206 0 2024-04-26T20:18:49.565 INFO:tasks.workunit.client.0.smithi016.stdout:9/589: dwrite d1/d2/d20/d49/d77/d2a/d75/d85/fb4 [0,4194304] 0 2024-04-26T20:18:49.578 INFO:tasks.workunit.client.0.smithi016.stdout:5/664: creat d1/d78/fd4 x:0 0 0 2024-04-26T20:18:49.582 INFO:tasks.workunit.client.0.smithi016.stdout:0/439: dwrite d2/dc/d1e/f38 [0,4194304] 0 2024-04-26T20:18:49.582 INFO:tasks.workunit.client.0.smithi016.stdout:2/483: symlink d1d/d20/la6 0 2024-04-26T20:18:49.584 INFO:tasks.workunit.client.0.smithi016.stdout:7/490: unlink d0/d1/d88/c8a 0 2024-04-26T20:18:49.589 INFO:tasks.workunit.client.0.smithi016.stdout:5/665: dread d1/d9/d1c/d52/f63 [0,4194304] 0 2024-04-26T20:18:49.596 INFO:tasks.workunit.client.0.smithi016.stdout:3/397: dwrite d3/f7 [0,4194304] 0 2024-04-26T20:18:49.598 INFO:tasks.workunit.client.0.smithi016.stdout:0/440: dread d2/dc/d18/d5b/f5e [0,4194304] 0 2024-04-26T20:18:49.598 INFO:tasks.workunit.client.0.smithi016.stdout:0/441: chown d2/d20/d41/f62 102575 1 2024-04-26T20:18:49.611 INFO:tasks.workunit.client.0.smithi016.stdout:9/590: mkdir d1/d59/d52/d8c/dd1 0 2024-04-26T20:18:49.615 INFO:tasks.workunit.client.0.smithi016.stdout:2/484: link d1d/d52/l59 d1d/d2a/la7 0 2024-04-26T20:18:49.617 INFO:tasks.workunit.client.0.smithi016.stdout:7/491: rename d0/d1/d6/fa to d0/d1/d46/f98 0 2024-04-26T20:18:49.619 INFO:tasks.workunit.client.0.smithi016.stdout:5/666: creat d1/d9/d4b/d8f/fd5 x:0 0 0 2024-04-26T20:18:49.626 INFO:tasks.workunit.client.0.smithi016.stdout:0/442: symlink d2/d8/l95 0 2024-04-26T20:18:49.626 INFO:tasks.workunit.client.0.smithi016.stdout:0/443: chown d2/dc/d45 29773 1 2024-04-26T20:18:49.626 INFO:tasks.workunit.client.0.smithi016.stdout:0/444: fdatasync d2/d20/d41/d4c/d4e/f54 0 2024-04-26T20:18:49.627 INFO:tasks.workunit.client.0.smithi016.stdout:2/485: creat d1d/d52/fa8 x:0 0 0 2024-04-26T20:18:49.627 INFO:tasks.workunit.client.0.smithi016.stdout:2/486: readlink d1d/d27/d49/l5d 0 2024-04-26T20:18:49.627 INFO:tasks.workunit.client.0.smithi016.stdout:2/487: fsync d1d/d2a/f51 0 2024-04-26T20:18:49.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/492: dread d0/d1/d34/d25/d3f/d6d/d87/f53 [0,4194304] 0 2024-04-26T20:18:49.632 INFO:tasks.workunit.client.0.smithi016.stdout:9/591: rename d1/d66/l8f to d1/d59/da5/ld2 0 2024-04-26T20:18:49.632 INFO:tasks.workunit.client.0.smithi016.stdout:9/592: dread - d1/d2/d20/d49/d77/fbe zero size 2024-04-26T20:18:49.632 INFO:tasks.workunit.client.0.smithi016.stdout:9/593: write d1/d2/d20/d49/d77/d3e/f99 [905495,27329] 0 2024-04-26T20:18:49.632 INFO:tasks.workunit.client.0.smithi016.stdout:9/594: write d1/d2/d20/fc0 [1041850,29858] 0 2024-04-26T20:18:49.632 INFO:tasks.workunit.client.0.smithi016.stdout:3/398: dwrite d3/df/f64 [0,4194304] 0 2024-04-26T20:18:49.632 INFO:tasks.workunit.client.0.smithi016.stdout:5/667: creat d1/d9/d25/dc0/fd6 x:0 0 0 2024-04-26T20:18:49.636 INFO:tasks.workunit.client.0.smithi016.stdout:0/445: creat d2/dc/d18/f96 x:0 0 0 2024-04-26T20:18:49.636 INFO:tasks.workunit.client.0.smithi016.stdout:2/488: rename d1d/d20/d22/d39/d3e/c46 to d1d/d27/d2d/d6b/d7e/ca9 0 2024-04-26T20:18:49.639 INFO:tasks.workunit.client.0.smithi016.stdout:5/668: rmdir d1/d9/d1c/d52/d74/d5f 39 2024-04-26T20:18:49.641 INFO:tasks.workunit.client.0.smithi016.stdout:0/446: rename d2/d8/d3b/f42 to d2/d8/d37/d70/f97 0 2024-04-26T20:18:49.641 INFO:tasks.workunit.client.0.smithi016.stdout:0/447: fdatasync d2/fb 0 2024-04-26T20:18:49.643 INFO:tasks.workunit.client.0.smithi016.stdout:2/489: link c16 d1d/d20/d22/d98/caa 0 2024-04-26T20:18:49.676 INFO:tasks.workunit.client.0.smithi016.stdout:3/399: read d3/df/f40 [3319251,46147] 0 2024-04-26T20:18:49.677 INFO:tasks.workunit.client.0.smithi016.stdout:0/448: dread d2/dc/d18/d5b/f5e [0,4194304] 0 2024-04-26T20:18:49.677 INFO:tasks.workunit.client.0.smithi016.stdout:0/449: fsync d2/d8/f36 0 2024-04-26T20:18:49.681 INFO:tasks.workunit.client.0.smithi016.stdout:3/400: rmdir d3/df/d25/d2a/d4a 39 2024-04-26T20:18:49.681 INFO:tasks.workunit.client.0.smithi016.stdout:3/401: dread - d3/df/d25/f53 zero size 2024-04-26T20:18:49.683 INFO:tasks.workunit.client.0.smithi016.stdout:7/493: dwrite d0/d1/d4b/f4d [0,4194304] 0 2024-04-26T20:18:49.686 INFO:tasks.workunit.client.0.smithi016.stdout:3/402: unlink d3/df/d25/d32/f38 0 2024-04-26T20:18:49.687 INFO:tasks.workunit.client.0.smithi016.stdout:3/403: fdatasync d3/d9/d2d/f47 0 2024-04-26T20:18:49.687 INFO:tasks.workunit.client.0.smithi016.stdout:3/404: chown d3/df/d25/d2a/d4a/f77 15 1 2024-04-26T20:18:49.692 INFO:tasks.workunit.client.0.smithi016.stdout:9/595: dwrite d1/d2/d20/fc0 [0,4194304] 0 2024-04-26T20:18:49.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.691+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e100696e0 con 0x7f3e1006cca0 2024-04-26T20:18:49.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.691+0000 7f3e0cc00640 1 -- 172.21.15.16:0/3267346749 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7f3dfc0f1f50 con 0x7f3e1006cca0 2024-04-26T20:18:49.697 INFO:tasks.workunit.client.0.smithi016.stdout:6/346: sync 2024-04-26T20:18:49.697 INFO:tasks.workunit.client.0.smithi016.stdout:7/494: rmdir d0/d67 39 2024-04-26T20:18:49.697 INFO:tasks.workunit.client.0.smithi016.stdout:6/347: truncate d1/fd 4699290 0 2024-04-26T20:18:49.697 INFO:tasks.workunit.client.0.smithi016.stdout:1/558: sync 2024-04-26T20:18:49.697 INFO:tasks.workunit.client.0.smithi016.stdout:4/383: sync 2024-04-26T20:18:49.697 INFO:tasks.workunit.client.0.smithi016.stdout:8/487: sync 2024-04-26T20:18:49.698 INFO:tasks.workunit.client.0.smithi016.stdout:1/559: write d3/d5/d6/f89 [572183,2501] 0 2024-04-26T20:18:49.698 INFO:tasks.workunit.client.0.smithi016.stdout:1/560: stat d3/d5/da/f30 0 2024-04-26T20:18:49.698 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:49.698 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:49.698 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:49.699 INFO:tasks.workunit.client.0.smithi016.stdout:6/348: mkdir d1/d21/d26/d1c/d2e/d53/d7f 0 2024-04-26T20:18:49.700 INFO:tasks.workunit.client.0.smithi016.stdout:8/488: getdents d9/d66/d73 0 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3df0068380 msgr2=0x7f3df006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3df0068380 0x7f3df006a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009670 tx=0x7f3e04006b90 comp rx=0 tx=0).stop 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e1006cca0 msgr2=0x7f3e1014d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e1006cca0 0x7f3e1014d7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc01ab90 tx=0x7f3dfc019280 comp rx=0 tx=0).stop 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 shutdown_connections 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3df0068380 0x7f3df006a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e100c1b50 0x7f3e1014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e1006cca0 0x7f3e1014d7f0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc01ab90 tx=0x7f3dfc019280 comp rx=0 tx=0).stop 2024-04-26T20:18:49.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 --2- 172.21.15.16:0/3267346749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e1006c380 0x7f3e1014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:49.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.695+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 >> 172.21.15.16:0/3267346749 conn(0x7f3e100cad20 msgr2=0x7f3e101512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:49.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.699+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 shutdown_connections 2024-04-26T20:18:49.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:49.699+0000 7f3e17a00640 1 -- 172.21.15.16:0/3267346749 wait complete. 2024-04-26T20:18:49.701 INFO:tasks.workunit.client.0.smithi016.stdout:6/349: getdents d1/d8/d2c 0 2024-04-26T20:18:49.701 INFO:tasks.workunit.client.0.smithi016.stdout:6/350: fdatasync d1/d8/d2c/d3d/f58 0 2024-04-26T20:18:49.702 INFO:tasks.workunit.client.0.smithi016.stdout:8/489: creat d9/fa7 x:0 0 0 2024-04-26T20:18:49.703 INFO:tasks.workunit.client.0.smithi016.stdout:7/495: symlink d0/d1/l99 0 2024-04-26T20:18:49.706 INFO:tasks.workunit.client.0.smithi016.stdout:3/405: dread d3/d9/f3d [0,4194304] 0 2024-04-26T20:18:49.706 INFO:tasks.workunit.client.0.smithi016.stdout:2/490: symlink d1d/d20/d22/d39/lab 0 2024-04-26T20:18:49.706 INFO:tasks.workunit.client.0.smithi016.stdout:2/491: chown d1d/d52/fa8 249 1 2024-04-26T20:18:49.709 INFO:tasks.workunit.client.0.smithi016.stdout:7/496: write d0/d51/f5a [204245,83185] 0 2024-04-26T20:18:49.729 INFO:tasks.workunit.client.0.smithi016.stdout:6/351: creat d1/d45/f80 x:0 0 0 2024-04-26T20:18:49.729 INFO:tasks.workunit.client.0.smithi016.stdout:6/352: stat d1/d21/d26/d1c/d2e/d53/c72 0 2024-04-26T20:18:49.734 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-26T20:18:49.734 INFO:tasks.workunit.client.0.smithi016.stdout:2/492: mkdir d1d/d27/d2d/d5a/d9c/dac 0 2024-04-26T20:18:49.734 INFO:tasks.workunit.client.0.smithi016.stdout:7/497: creat d0/d1/d95/f9a x:0 0 0 2024-04-26T20:18:49.735 INFO:tasks.workunit.client.0.smithi016.stdout:6/353: link d1/d8/d2c/d3d/f58 d1/d21/d26/d1c/f81 0 2024-04-26T20:18:49.736 INFO:tasks.workunit.client.0.smithi016.stdout:2/493: creat d1d/d27/d2d/d6b/d7e/fad x:0 0 0 2024-04-26T20:18:49.736 INFO:tasks.workunit.client.0.smithi016.stdout:2/494: readlink d1d/d20/d22/d39/l8c 0 2024-04-26T20:18:49.737 INFO:tasks.workunit.client.0.smithi016.stdout:7/498: symlink d0/d1/d34/d25/l9b 0 2024-04-26T20:18:49.737 INFO:tasks.workunit.client.0.smithi016.stdout:7/499: write d0/d67/f90 [860183,4737] 0 2024-04-26T20:18:49.740 INFO:tasks.workunit.client.0.smithi016.stdout:6/354: mkdir d1/d21/d26/d1c/d7b/d82 0 2024-04-26T20:18:49.740 INFO:tasks.workunit.client.0.smithi016.stdout:6/355: chown d1/d45 1022858 1 2024-04-26T20:18:49.744 INFO:tasks.workunit.client.0.smithi016.stdout:2/495: symlink d1d/d27/d2d/d6b/d7e/lae 0 2024-04-26T20:18:49.745 INFO:tasks.workunit.client.0.smithi016.stdout:2/496: dread - d1d/d27/d2d/d5a/d9c/f99 zero size 2024-04-26T20:18:49.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/669: rename d1/d9/l2d to d1/d78/ld7 0 2024-04-26T20:18:49.747 INFO:tasks.workunit.client.0.smithi016.stdout:9/596: mkdir d1/d2e/dd3 0 2024-04-26T20:18:49.747 INFO:tasks.workunit.client.0.smithi016.stdout:9/597: write d1/d1b/f7d [115662,21415] 0 2024-04-26T20:18:49.749 INFO:tasks.workunit.client.0.smithi016.stdout:6/356: mknod d1/d21/c83 0 2024-04-26T20:18:49.749 INFO:tasks.workunit.client.0.smithi016.stdout:4/384: dwrite d0/d1e/d41/f5f [0,4194304] 0 2024-04-26T20:18:49.750 INFO:tasks.workunit.client.0.smithi016.stdout:3/406: write d3/df/d20/d41/f4e [3282004,86656] 0 2024-04-26T20:18:49.750 INFO:tasks.workunit.client.0.smithi016.stdout:3/407: dread - d3/df/d25/d2a/f42 zero size 2024-04-26T20:18:49.755 INFO:tasks.workunit.client.0.smithi016.stdout:0/450: rename d2/d20/f27 to d2/dc/d1e/d35/f98 0 2024-04-26T20:18:49.755 INFO:tasks.workunit.client.0.smithi016.stdout:5/670: getdents d1/d9/d1c/d52/d74/d5f/d82 0 2024-04-26T20:18:49.755 INFO:tasks.workunit.client.0.smithi016.stdout:5/671: fdatasync d1/d78/f80 0 2024-04-26T20:18:49.759 INFO:tasks.workunit.client.0.smithi016.stdout:6/357: symlink d1/l84 0 2024-04-26T20:18:49.761 INFO:tasks.workunit.client.0.smithi016.stdout:4/385: mkdir d0/dd/d66/d6f/d7f 0 2024-04-26T20:18:49.762 INFO:tasks.workunit.client.0.smithi016.stdout:4/386: write d0/dd/f2a [774831,79192] 0 2024-04-26T20:18:49.762 INFO:tasks.workunit.client.0.smithi016.stdout:4/387: truncate d0/dd/f2a 1712896 0 2024-04-26T20:18:49.763 INFO:tasks.workunit.client.0.smithi016.stdout:3/408: getdents d3/d9/d18 0 2024-04-26T20:18:49.763 INFO:tasks.workunit.client.0.smithi016.stdout:2/497: dread d1d/d27/d49/f56 [0,4194304] 0 2024-04-26T20:18:49.763 INFO:tasks.workunit.client.0.smithi016.stdout:2/498: readlink d1d/d20/la6 0 2024-04-26T20:18:49.765 INFO:tasks.workunit.client.0.smithi016.stdout:1/561: rename d3/d5/d6/d9/d2a/d3b/l70 to d3/d5/d8d/lae 0 2024-04-26T20:18:49.766 INFO:tasks.workunit.client.0.smithi016.stdout:4/388: dread d0/dd/f3b [0,4194304] 0 2024-04-26T20:18:49.767 INFO:tasks.workunit.client.0.smithi016.stdout:5/672: stat d1/d9/d25/l93 0 2024-04-26T20:18:49.767 INFO:tasks.workunit.client.0.smithi016.stdout:5/673: truncate d1/d9/d25/f79 981244 0 2024-04-26T20:18:49.767 INFO:tasks.workunit.client.0.smithi016.stdout:5/674: dread - d1/d9/d11/d4d/d72/f7c zero size 2024-04-26T20:18:49.768 INFO:tasks.workunit.client.0.smithi016.stdout:2/499: getdents d1d/d27/d2d/d5a 0 2024-04-26T20:18:49.768 INFO:tasks.workunit.client.0.smithi016.stdout:2/500: chown d1d/d20/d22/d39/d3e/f86 37 1 2024-04-26T20:18:49.769 INFO:tasks.workunit.client.0.smithi016.stdout:1/562: creat d3/d5/d8d/dab/faf x:0 0 0 2024-04-26T20:18:49.771 INFO:tasks.workunit.client.0.smithi016.stdout:8/490: rename d9/d23/d26/f2d to d9/d19/fa8 0 2024-04-26T20:18:49.772 INFO:tasks.workunit.client.0.smithi016.stdout:8/491: write d9/d19/d45/f30 [1922767,76753] 0 2024-04-26T20:18:49.772 INFO:tasks.workunit.client.0.smithi016.stdout:8/492: dread - d9/fa7 zero size 2024-04-26T20:18:49.772 INFO:tasks.workunit.client.0.smithi016.stdout:8/493: readlink d9/d19/l6a 0 2024-04-26T20:18:49.774 INFO:tasks.workunit.client.0.smithi016.stdout:2/501: creat d1d/d20/d22/d29/faf x:0 0 0 2024-04-26T20:18:49.774 INFO:tasks.workunit.client.0.smithi016.stdout:2/502: truncate d1d/d27/d2d/d6b/d7e/f8e 631621 0 2024-04-26T20:18:49.776 INFO:tasks.workunit.client.0.smithi016.stdout:0/451: symlink d2/l99 0 2024-04-26T20:18:49.780 INFO:tasks.workunit.client.0.smithi016.stdout:6/358: rename d1/d21/d26/d25/c37 to d1/d21/d26/d1c/d2e/d53/d7f/c85 0 2024-04-26T20:18:49.783 INFO:tasks.workunit.client.0.smithi016.stdout:3/409: rename d3/d9/f4d to d3/df/d25/d32/f7c 0 2024-04-26T20:18:49.787 INFO:tasks.workunit.client.0.smithi016.stdout:1/563: rename d3/d5/d8d/f91 to d3/d5/d6/d5a/fb0 0 2024-04-26T20:18:49.787 INFO:tasks.workunit.client.0.smithi016.stdout:1/564: stat d3/d5/d6/l2f 0 2024-04-26T20:18:49.787 INFO:tasks.workunit.client.0.smithi016.stdout:1/565: chown d3/d57/f6e 121680931 1 2024-04-26T20:18:49.789 INFO:tasks.workunit.client.0.smithi016.stdout:1/566: rename d3/d5/da/d66/l7c to d3/d5/da/lb1 0 2024-04-26T20:18:49.794 INFO:tasks.workunit.client.0.smithi016.stdout:1/567: creat d3/d5/d6/fb2 x:0 0 0 2024-04-26T20:18:49.823 INFO:tasks.workunit.client.0.smithi016.stdout:1/568: write d3/d5/da/fc [3681343,54374] 0 2024-04-26T20:18:49.824 INFO:tasks.workunit.client.0.smithi016.stdout:1/569: mknod d3/d5/cb3 0 2024-04-26T20:18:49.826 INFO:tasks.workunit.client.0.smithi016.stdout:1/570: mknod d3/d5/cb4 0 2024-04-26T20:18:49.828 INFO:tasks.workunit.client.0.smithi016.stdout:1/571: truncate d3/d5/d6/d50/d58/f69 3112407 0 2024-04-26T20:18:49.829 INFO:tasks.workunit.client.0.smithi016.stdout:1/572: creat d3/d5/fb5 x:0 0 0 2024-04-26T20:18:49.844 INFO:tasks.workunit.client.0.smithi016.stdout:7/500: dwrite d0/f29 [0,4194304] 0 2024-04-26T20:18:49.844 INFO:tasks.workunit.client.0.smithi016.stdout:8/494: dwrite d9/f90 [0,4194304] 0 2024-04-26T20:18:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:8/495: mkdir d9/d19/d45/d9e/d50/da9 0 2024-04-26T20:18:49.846 INFO:tasks.workunit.client.0.smithi016.stdout:8/496: dread - d9/d19/f91 zero size 2024-04-26T20:18:49.847 INFO:tasks.workunit.client.0.smithi016.stdout:3/410: dwrite d3/df/f2b [4194304,4194304] 0 2024-04-26T20:18:49.861 INFO:tasks.workunit.client.0.smithi016.stdout:8/497: rmdir d9/d66/d73 39 2024-04-26T20:18:49.861 INFO:tasks.workunit.client.0.smithi016.stdout:8/498: chown d9/d19/d45/d9e/c8d 64188235 1 2024-04-26T20:18:49.863 INFO:tasks.workunit.client.0.smithi016.stdout:8/499: mknod d9/d23/d26/caa 0 2024-04-26T20:18:49.903 INFO:tasks.workunit.client.0.smithi016.stdout:7/501: dwrite d0/f31 [0,4194304] 0 2024-04-26T20:18:49.905 INFO:tasks.workunit.client.0.smithi016.stdout:7/502: getdents d0/d1/d95 0 2024-04-26T20:18:49.906 INFO:tasks.workunit.client.0.smithi016.stdout:8/500: write d9/d19/d45/d9e/f6f [3632038,113414] 0 2024-04-26T20:18:49.906 INFO:tasks.workunit.client.0.smithi016.stdout:8/501: write d9/fa2 [294159,73884] 0 2024-04-26T20:18:49.908 INFO:tasks.workunit.client.0.smithi016.stdout:7/503: unlink d0/d1/d34/d25/d3f/d6d/d87/f53 0 2024-04-26T20:18:49.909 INFO:tasks.workunit.client.0.smithi016.stdout:8/502: getdents d9/d19/d45/d3f/d64 0 2024-04-26T20:18:49.911 INFO:tasks.workunit.client.0.smithi016.stdout:7/504: truncate d0/d1/d34/d25/d50/f54 3491855 0 2024-04-26T20:18:49.914 INFO:tasks.workunit.client.0.smithi016.stdout:8/503: rmdir d9/d19/d45/da6 0 2024-04-26T20:18:49.914 INFO:tasks.workunit.client.0.smithi016.stdout:8/504: stat d9/d66/c89 0 2024-04-26T20:18:49.915 INFO:tasks.workunit.client.0.smithi016.stdout:7/505: symlink d0/d1/d6/l9c 0 2024-04-26T20:18:49.918 INFO:tasks.workunit.client.0.smithi016.stdout:8/505: mknod d9/d2f/cab 0 2024-04-26T20:18:49.919 INFO:tasks.workunit.client.0.smithi016.stdout:7/506: mknod d0/d1/d95/c9d 0 2024-04-26T20:18:49.919 INFO:tasks.workunit.client.0.smithi016.stdout:7/507: chown d0/d1/d34/l8b 202594 1 2024-04-26T20:18:49.940 INFO:tasks.workunit.client.0.smithi016.stdout:7/508: write d0/d1/d4b/f4d [3579521,104272] 0 2024-04-26T20:18:49.940 INFO:tasks.workunit.client.0.smithi016.stdout:7/509: stat d0/d1/c18 0 2024-04-26T20:18:49.940 INFO:tasks.workunit.client.0.smithi016.stdout:8/506: mkdir d9/d19/d45/d9e/d50/da9/dac 0 2024-04-26T20:18:49.940 INFO:tasks.workunit.client.0.smithi016.stdout:8/507: readlink d9/l3a 0 2024-04-26T20:18:49.954 INFO:tasks.workunit.client.0.smithi016.stdout:7/510: rename d0/d1/d34/d25/d3f/d6d/f76 to d0/d1/d34/d25/d50/f9e 0 2024-04-26T20:18:49.954 INFO:tasks.workunit.client.0.smithi016.stdout:7/511: fdatasync d0/d1/d34/d25/d3f/d6d/d87/f7c 0 2024-04-26T20:18:49.960 INFO:tasks.workunit.client.0.smithi016.stdout:7/512: creat d0/d1/d34/f9f x:0 0 0 2024-04-26T20:18:49.962 INFO:tasks.workunit.client.0.smithi016.stdout:5/675: dwrite d1/d9/d25/dc0/fd6 [0,4194304] 0 2024-04-26T20:18:49.977 INFO:tasks.workunit.client.0.smithi016.stdout:7/513: rename d0/d51/f5d to d0/d83/fa0 0 2024-04-26T20:18:49.977 INFO:tasks.workunit.client.0.smithi016.stdout:7/514: readlink d0/d1/d6/d73/l7e 0 2024-04-26T20:18:49.977 INFO:tasks.workunit.client.0.smithi016.stdout:7/515: readlink d0/d1/d34/d25/l91 0 2024-04-26T20:18:49.979 INFO:tasks.workunit.client.0.smithi016.stdout:7/516: write d0/f94 [388450,36843] 0 2024-04-26T20:18:49.988 INFO:tasks.workunit.client.0.smithi016.stdout:5/676: creat d1/d9/d11/daa/fd8 x:0 0 0 2024-04-26T20:18:49.989 INFO:tasks.workunit.client.0.smithi016.stdout:5/677: chown d1/d9/d1c/d52/d74 17127856 1 2024-04-26T20:18:49.991 INFO:tasks.workunit.client.0.smithi016.stdout:5/678: truncate d1/d9/d25/f42 3966441 0 2024-04-26T20:18:49.995 INFO:tasks.workunit.client.0.smithi016.stdout:5/679: link d1/d9/d11/c2e d1/d9/d4b/db4/cd9 0 2024-04-26T20:18:49.995 INFO:tasks.workunit.client.0.smithi016.stdout:5/680: write d1/d9/d11/f18 [431689,22067] 0 2024-04-26T20:18:49.996 INFO:tasks.workunit.client.0.smithi016.stdout:5/681: write d1/d9/d1c/d52/d74/d5f/fb5 [412423,49263] 0 2024-04-26T20:18:49.998 INFO:tasks.workunit.client.0.smithi016.stdout:5/682: mkdir d1/d9/d1c/d52/d74/d98/dcb/dda 0 2024-04-26T20:18:49.999 INFO:tasks.workunit.client.0.smithi016.stdout:9/598: dwrite d1/d2/d20/d49/d77/d3e/f84 [0,4194304] 0 2024-04-26T20:18:50.005 INFO:tasks.workunit.client.0.smithi016.stdout:0/452: dread d2/f15 [0,4194304] 0 2024-04-26T20:18:50.005 INFO:tasks.workunit.client.0.smithi016.stdout:5/683: mknod d1/d9/d4b/cdb 0 2024-04-26T20:18:50.005 INFO:tasks.workunit.client.0.smithi016.stdout:9/599: rmdir d1/d2/d20/d49 39 2024-04-26T20:18:50.005 INFO:tasks.workunit.client.0.smithi016.stdout:5/684: creat d1/d78/fdc x:0 0 0 2024-04-26T20:18:50.007 INFO:tasks.workunit.client.0.smithi016.stdout:9/600: creat d1/d2/d20/d49/d77/fd4 x:0 0 0 2024-04-26T20:18:50.007 INFO:tasks.workunit.client.0.smithi016.stdout:9/601: readlink d1/d66/la3 0 2024-04-26T20:18:50.019 INFO:tasks.workunit.client.0.smithi016.stdout:7/517: dread d0/f29 [0,4194304] 0 2024-04-26T20:18:50.021 INFO:tasks.workunit.client.0.smithi016.stdout:5/685: creat d1/fdd x:0 0 0 2024-04-26T20:18:50.021 INFO:tasks.workunit.client.0.smithi016.stdout:9/602: dread d1/d2/d20/d49/d77/d2a/d75/f83 [0,4194304] 0 2024-04-26T20:18:50.021 INFO:tasks.workunit.client.0.smithi016.stdout:9/603: stat d1/d59/d52/d8c/fa2 0 2024-04-26T20:18:50.021 INFO:tasks.workunit.client.0.smithi016.stdout:0/453: write d2/dc/d1e/d25/f28 [1163297,97962] 0 2024-04-26T20:18:50.023 INFO:tasks.workunit.client.0.smithi016.stdout:1/573: dwrite d3/d5/f8f [4194304,4194304] 0 2024-04-26T20:18:50.023 INFO:tasks.workunit.client.0.smithi016.stdout:7/518: symlink d0/d1/d34/d25/d3f/la1 0 2024-04-26T20:18:50.023 INFO:tasks.workunit.client.0.smithi016.stdout:7/519: read d0/d1/d4b/f4d [1346277,87673] 0 2024-04-26T20:18:50.023 INFO:tasks.workunit.client.0.smithi016.stdout:7/520: write d0/d1/d46/f98 [2560227,4048] 0 2024-04-26T20:18:50.027 INFO:tasks.workunit.client.0.smithi016.stdout:9/604: link d1/d2e/d40/l8a d1/d2/d20/d49/d77/d2a/d33/ld5 0 2024-04-26T20:18:50.029 INFO:tasks.workunit.client.0.smithi016.stdout:1/574: creat d3/d5/da/d66/d8c/fb6 x:0 0 0 2024-04-26T20:18:50.029 INFO:tasks.workunit.client.0.smithi016.stdout:6/359: dread d1/d21/d26/d1c/d2e/f33 [0,4194304] 0 2024-04-26T20:18:50.031 INFO:tasks.workunit.client.0.smithi016.stdout:9/605: mknod d1/d2/d79/cd6 0 2024-04-26T20:18:50.031 INFO:tasks.workunit.client.0.smithi016.stdout:3/411: dread d3/d9/d2d/d4f/f50 [0,4194304] 0 2024-04-26T20:18:50.032 INFO:tasks.workunit.client.0.smithi016.stdout:1/575: symlink d3/d57/lb7 0 2024-04-26T20:18:50.034 INFO:tasks.workunit.client.0.smithi016.stdout:1/576: fdatasync d3/d5/d6/d5a/f4a 0 2024-04-26T20:18:50.034 INFO:tasks.workunit.client.0.smithi016.stdout:8/508: dread d9/f1b [0,4194304] 0 2024-04-26T20:18:50.036 INFO:tasks.workunit.client.0.smithi016.stdout:6/360: rename d1/d21/d26/d25/l30 to d1/d21/d26/d1c/d5d/l86 0 2024-04-26T20:18:50.036 INFO:tasks.workunit.client.0.smithi016.stdout:6/361: chown d1/d12/c43 30177 1 2024-04-26T20:18:50.041 INFO:tasks.workunit.client.0.smithi016.stdout:2/503: dwrite d1d/d27/d2d/f2f [0,4194304] 0 2024-04-26T20:18:50.044 INFO:tasks.workunit.client.0.smithi016.stdout:8/509: getdents d9/d23 0 2024-04-26T20:18:50.091 INFO:tasks.workunit.client.0.smithi016.stdout:6/362: dwrite d1/d3a/f55 [0,4194304] 0 2024-04-26T20:18:50.091 INFO:tasks.workunit.client.0.smithi016.stdout:6/363: fsync d1/fd 0 2024-04-26T20:18:50.091 INFO:tasks.workunit.client.0.smithi016.stdout:6/364: write d1/f7 [3436629,30999] 0 2024-04-26T20:18:50.091 INFO:tasks.workunit.client.0.smithi016.stdout:6/365: stat d1/d8/d2c/d3d/f58 0 2024-04-26T20:18:50.091 INFO:tasks.workunit.client.0.smithi016.stdout:6/366: chown d1/d21/d26/f54 7886842 1 2024-04-26T20:18:50.098 INFO:tasks.workunit.client.0.smithi016.stdout:5/686: dwrite d1/d9/d1c/d52/f63 [0,4194304] 0 2024-04-26T20:18:50.098 INFO:tasks.workunit.client.0.smithi016.stdout:8/510: mkdir d9/d19/d45/d9e/d50/dad 0 2024-04-26T20:18:50.098 INFO:tasks.workunit.client.0.smithi016.stdout:5/687: truncate d1/f1b 3370534 0 2024-04-26T20:18:50.098 INFO:tasks.workunit.client.0.smithi016.stdout:5/688: truncate d1/d9/f95 629748 0 2024-04-26T20:18:50.099 INFO:tasks.workunit.client.0.smithi016.stdout:8/511: mknod d9/d72/da3/cae 0 2024-04-26T20:18:50.099 INFO:tasks.workunit.client.0.smithi016.stdout:8/512: chown d9/d72/da3/cae 14311804 1 2024-04-26T20:18:50.100 INFO:tasks.workunit.client.0.smithi016.stdout:5/689: rename d1/d9/d4b to d1/d78/d99/dde 0 2024-04-26T20:18:50.101 INFO:tasks.workunit.client.0.smithi016.stdout:8/513: creat d9/d23/d26/faf x:0 0 0 2024-04-26T20:18:50.102 INFO:tasks.workunit.client.0.smithi016.stdout:5/690: rmdir d1/d78/d99/dde/d8f/db6/dcc/dcf 0 2024-04-26T20:18:50.104 INFO:tasks.workunit.client.0.smithi016.stdout:1/577: dwrite d3/d5/d6/d9/f73 [0,4194304] 0 2024-04-26T20:18:50.106 INFO:tasks.workunit.client.0.smithi016.stdout:8/514: creat d9/d66/fb0 x:0 0 0 2024-04-26T20:18:50.114 INFO:tasks.workunit.client.0.smithi016.stdout:2/504: dwrite d1d/d27/d2d/d6b/f71 [0,4194304] 0 2024-04-26T20:18:50.115 INFO:tasks.workunit.client.0.smithi016.stdout:1/578: getdents d3/d57/da4 0 2024-04-26T20:18:50.120 INFO:tasks.workunit.client.0.smithi016.stdout:2/505: symlink d1d/d27/d2d/d6b/lb0 0 2024-04-26T20:18:50.121 INFO:tasks.workunit.client.0.smithi016.stdout:1/579: creat d3/d5/d6/d5a/fb8 x:0 0 0 2024-04-26T20:18:50.121 INFO:tasks.workunit.client.0.smithi016.stdout:1/580: dread - d3/d57/da4/fa6 zero size 2024-04-26T20:18:50.135 INFO:tasks.workunit.client.0.smithi016.stdout:5/691: write d1/d9/d11/f18 [10407431,49650] 0 2024-04-26T20:18:50.143 INFO:tasks.workunit.client.0.smithi016.stdout:7/521: dwrite d0/f42 [0,4194304] 0 2024-04-26T20:18:50.143 INFO:tasks.workunit.client.0.smithi016.stdout:7/522: write d0/d1/d34/d25/d3f/f65 [4370141,80139] 0 2024-04-26T20:18:50.143 INFO:tasks.workunit.client.0.smithi016.stdout:7/523: readlink d0/d1/d34/d25/d3f/la1 0 2024-04-26T20:18:50.144 INFO:tasks.workunit.client.0.smithi016.stdout:2/506: symlink d1d/d27/lb1 0 2024-04-26T20:18:50.149 INFO:tasks.workunit.client.0.smithi016.stdout:7/524: unlink d0/f15 0 2024-04-26T20:18:50.150 INFO:tasks.workunit.client.0.smithi016.stdout:7/525: write d0/d1/d34/d25/f26 [517409,67238] 0 2024-04-26T20:18:50.151 INFO:tasks.workunit.client.0.smithi016.stdout:8/515: dwrite d9/d23/d26/f2a [0,4194304] 0 2024-04-26T20:18:50.154 INFO:tasks.workunit.client.0.smithi016.stdout:7/526: symlink d0/d1/la2 0 2024-04-26T20:18:50.154 INFO:tasks.workunit.client.0.smithi016.stdout:7/527: fdatasync d0/d1/f30 0 2024-04-26T20:18:50.158 INFO:tasks.workunit.client.0.smithi016.stdout:8/516: symlink d9/d19/d45/d3f/lb1 0 2024-04-26T20:18:50.159 INFO:tasks.workunit.client.0.smithi016.stdout:8/517: chown d9/d19/d45/f30 246499 1 2024-04-26T20:18:50.159 INFO:tasks.workunit.client.0.smithi016.stdout:8/518: dread - d9/d66/f78 zero size 2024-04-26T20:18:50.241 INFO:tasks.workunit.client.0.smithi016.stdout:9/606: dwrite d1/d2/d43/f46 [0,4194304] 0 2024-04-26T20:18:50.241 INFO:tasks.workunit.client.0.smithi016.stdout:9/607: chown d1/d2/d20/d49/faa 1 1 2024-04-26T20:18:50.244 INFO:tasks.workunit.client.0.smithi016.stdout:7/528: unlink d0/f59 0 2024-04-26T20:18:50.244 INFO:tasks.workunit.client.0.smithi016.stdout:7/529: dread - d0/d1/d4b/f8e zero size 2024-04-26T20:18:50.244 INFO:tasks.workunit.client.0.smithi016.stdout:7/530: fsync d0/d1/d4b/f72 0 2024-04-26T20:18:50.256 INFO:tasks.workunit.client.0.smithi016.stdout:3/412: dwrite d3/df/d25/f5c [4194304,4194304] 0 2024-04-26T20:18:50.258 INFO:tasks.workunit.client.0.smithi016.stdout:3/413: creat d3/df/d25/d32/f7d x:0 0 0 2024-04-26T20:18:50.262 INFO:tasks.workunit.client.0.smithi016.stdout:3/414: creat d3/df/d25/d2a/d4a/f7e x:0 0 0 2024-04-26T20:18:50.266 INFO:tasks.workunit.client.0.smithi016.stdout:7/531: write d0/d83/fa0 [3672511,101782] 0 2024-04-26T20:18:50.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/415: mknod d3/c7f 0 2024-04-26T20:18:50.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/416: fsync d3/df/f26 0 2024-04-26T20:18:50.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/417: dread - d3/df/d25/d32/f3b zero size 2024-04-26T20:18:50.266 INFO:tasks.workunit.client.0.smithi016.stdout:7/532: stat d0/l1e 0 2024-04-26T20:18:50.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/418: mknod d3/df/d20/d61/d7b/c80 0 2024-04-26T20:18:50.267 INFO:tasks.workunit.client.0.smithi016.stdout:3/419: getdents d3/df/d25 0 2024-04-26T20:18:50.269 INFO:tasks.workunit.client.0.smithi016.stdout:7/533: mkdir d0/d1/d34/d25/d3f/d6d/d87/da3 0 2024-04-26T20:18:50.296 INFO:tasks.workunit.client.0.smithi016.stdout:9/608: dwrite d1/d2e/dc6/f65 [0,4194304] 0 2024-04-26T20:18:50.298 INFO:tasks.workunit.client.0.smithi016.stdout:9/609: mknod d1/d2/d43/cd7 0 2024-04-26T20:18:50.301 INFO:tasks.workunit.client.0.smithi016.stdout:6/367: dwrite d1/d8/d2c/d3d/f56 [0,4194304] 0 2024-04-26T20:18:50.301 INFO:tasks.workunit.client.0.smithi016.stdout:6/368: fdatasync d1/d21/d26/d1c/f4d 0 2024-04-26T20:18:50.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/369: mkdir d1/d8/d87 0 2024-04-26T20:18:50.329 INFO:tasks.workunit.client.0.smithi016.stdout:2/507: dwrite d1d/d27/d2d/f44 [0,4194304] 0 2024-04-26T20:18:50.329 INFO:tasks.workunit.client.0.smithi016.stdout:8/519: dread d9/d19/d45/d3f/f63 [0,4194304] 0 2024-04-26T20:18:50.329 INFO:tasks.workunit.client.0.smithi016.stdout:2/508: chown d1d/d27/d2d/l68 99496 1 2024-04-26T20:18:50.330 INFO:tasks.workunit.client.0.smithi016.stdout:8/520: creat d9/d19/fb2 x:0 0 0 2024-04-26T20:18:50.330 INFO:tasks.workunit.client.0.smithi016.stdout:8/521: chown d9/d23/f3c 583 1 2024-04-26T20:18:50.333 INFO:tasks.workunit.client.0.smithi016.stdout:8/522: creat d9/d19/d45/d9e/d50/da9/dac/fb3 x:0 0 0 2024-04-26T20:18:50.342 INFO:tasks.workunit.client.0.smithi016.stdout:2/509: dread d1d/d27/d2d/f30 [0,4194304] 0 2024-04-26T20:18:50.346 INFO:tasks.workunit.client.0.smithi016.stdout:2/510: read d1d/d20/d22/d88/f95 [1080947,95280] 0 2024-04-26T20:18:50.346 INFO:tasks.workunit.client.0.smithi016.stdout:8/523: dread d9/d19/d45/f7c [0,4194304] 0 2024-04-26T20:18:50.346 INFO:tasks.workunit.client.0.smithi016.stdout:8/524: write f5 [378399,79754] 0 2024-04-26T20:18:50.347 INFO:tasks.workunit.client.0.smithi016.stdout:8/525: symlink d9/d19/d45/d3f/d4d/lb4 0 2024-04-26T20:18:50.347 INFO:tasks.workunit.client.0.smithi016.stdout:8/526: stat d9/d19/d45/d9e/l75 0 2024-04-26T20:18:50.348 INFO:tasks.workunit.client.0.smithi016.stdout:8/527: creat d9/d19/d45/d3f/d4d/fb5 x:0 0 0 2024-04-26T20:18:50.349 INFO:tasks.workunit.client.0.smithi016.stdout:8/528: mkdir d9/d19/d45/d3f/d64/db6 0 2024-04-26T20:18:50.350 INFO:tasks.workunit.client.0.smithi016.stdout:8/529: creat d9/d19/d45/d9e/d50/da9/dac/fb7 x:0 0 0 2024-04-26T20:18:50.353 INFO:tasks.workunit.client.0.smithi016.stdout:8/530: rename d9/d72/d74/d9f/c92 to d9/d23/cb8 0 2024-04-26T20:18:50.354 INFO:tasks.workunit.client.0.smithi016.stdout:8/531: symlink d9/d2f/lb9 0 2024-04-26T20:18:50.354 INFO:tasks.workunit.client.0.smithi016.stdout:8/532: write d9/d19/d45/d9e/d50/f58 [1570480,65194] 0 2024-04-26T20:18:50.374 INFO:tasks.workunit.client.0.smithi016.stdout:2/511: read d1d/d20/d22/d39/d3e/f47 [1186158,93302] 0 2024-04-26T20:18:50.375 INFO:tasks.workunit.client.0.smithi016.stdout:9/610: dwrite d1/d2/f10 [0,4194304] 0 2024-04-26T20:18:50.375 INFO:tasks.workunit.client.0.smithi016.stdout:9/611: dread - d1/d2/d20/d49/d77/f7e zero size 2024-04-26T20:18:50.382 INFO:tasks.workunit.client.0.smithi016.stdout:6/370: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:50.382 INFO:tasks.workunit.client.0.smithi016.stdout:6/371: dread - d1/d45/f80 zero size 2024-04-26T20:18:50.394 INFO:tasks.workunit.client.0.smithi016.stdout:6/372: dread d1/d3a/f55 [0,4194304] 0 2024-04-26T20:18:50.394 INFO:tasks.workunit.client.0.smithi016.stdout:6/373: dread - d1/d8/d76/f77 zero size 2024-04-26T20:18:50.395 INFO:tasks.workunit.client.0.smithi016.stdout:6/374: rmdir d1/d8/d87 0 2024-04-26T20:18:50.436 INFO:tasks.workunit.client.0.smithi016.stdout:8/533: dwrite d9/d19/f41 [0,4194304] 0 2024-04-26T20:18:50.436 INFO:tasks.workunit.client.0.smithi016.stdout:8/534: fdatasync d9/d72/d74/d9f/f9c 0 2024-04-26T20:18:50.438 INFO:tasks.workunit.client.0.smithi016.stdout:8/535: truncate d9/d23/d26/f2e 2996249 0 2024-04-26T20:18:50.438 INFO:tasks.workunit.client.0.smithi016.stdout:8/536: rmdir d9/d19/d45/d3f/d4d 39 2024-04-26T20:18:50.444 INFO:tasks.workunit.client.0.smithi016.stdout:3/420: dwrite d3/f19 [0,4194304] 0 2024-04-26T20:18:50.444 INFO:tasks.workunit.client.0.smithi016.stdout:3/421: chown d3/df/d20/d61/d7b 119 1 2024-04-26T20:18:50.446 INFO:tasks.workunit.client.0.smithi016.stdout:3/422: link d3/d9/lc d3/df/d20/d61/d76/l81 0 2024-04-26T20:18:50.447 INFO:tasks.workunit.client.0.smithi016.stdout:3/423: mkdir d3/d9/d18/d82 0 2024-04-26T20:18:50.456 INFO:tasks.workunit.client.0.smithi016.stdout:8/537: write d9/d72/d74/f95 [2670719,104648] 0 2024-04-26T20:18:50.457 INFO:tasks.workunit.client.0.smithi016.stdout:8/538: mkdir d9/d19/d45/d3f/d4d/dba 0 2024-04-26T20:18:50.458 INFO:tasks.workunit.client.0.smithi016.stdout:8/539: creat d9/d2f/fbb x:0 0 0 2024-04-26T20:18:50.458 INFO:tasks.workunit.client.0.smithi016.stdout:8/540: readlink d9/d72/d74/d9f/l7d 0 2024-04-26T20:18:50.459 INFO:tasks.workunit.client.0.smithi016.stdout:8/541: creat d9/d19/d45/d3f/d4d/fbc x:0 0 0 2024-04-26T20:18:50.460 INFO:tasks.workunit.client.0.smithi016.stdout:8/542: mknod d9/d72/cbd 0 2024-04-26T20:18:50.461 INFO:tasks.workunit.client.0.smithi016.stdout:8/543: mknod d9/d19/d45/d9e/d50/da9/dac/cbe 0 2024-04-26T20:18:50.498 INFO:tasks.workunit.client.0.smithi016.stdout:8/544: dwrite d9/d19/f8f [0,4194304] 0 2024-04-26T20:18:50.510 INFO:tasks.workunit.client.0.smithi016.stdout:8/545: dread d9/d19/d45/d9e/f8c [0,4194304] 0 2024-04-26T20:18:50.511 INFO:tasks.workunit.client.0.smithi016.stdout:8/546: rename d9/d19/d45/d3f/f48 to d9/d23/d26/fbf 0 2024-04-26T20:18:50.555 INFO:tasks.workunit.client.0.smithi016.stdout:2/512: dwrite d1d/d27/d2d/f2f [0,4194304] 0 2024-04-26T20:18:50.587 INFO:tasks.workunit.client.0.smithi016.stdout:3/424: dread d3/df/f26 [0,4194304] 0 2024-04-26T20:18:50.588 INFO:tasks.workunit.client.0.smithi016.stdout:3/425: mknod d3/df/d20/c83 0 2024-04-26T20:18:50.588 INFO:tasks.workunit.client.0.smithi016.stdout:3/426: chown d3/d9/d18/d59/c5d 84639 1 2024-04-26T20:18:50.588 INFO:tasks.workunit.client.0.smithi016.stdout:3/427: readlink d3/l6 0 2024-04-26T20:18:50.589 INFO:tasks.workunit.client.0.smithi016.stdout:3/428: symlink d3/d9/d2d/d62/l84 0 2024-04-26T20:18:50.592 INFO:tasks.workunit.client.0.smithi016.stdout:3/429: symlink d3/df/d20/d61/l85 0 2024-04-26T20:18:50.593 INFO:tasks.workunit.client.0.smithi016.stdout:3/430: symlink d3/df/d20/d61/l86 0 2024-04-26T20:18:50.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/431: truncate d3/df/f13 474128 0 2024-04-26T20:18:50.595 INFO:tasks.workunit.client.0.smithi016.stdout:3/432: fdatasync d3/df/d20/d5b/f6d 0 2024-04-26T20:18:50.596 INFO:tasks.workunit.client.0.smithi016.stdout:3/433: mknod d3/d9/d18/d82/c87 0 2024-04-26T20:18:50.597 INFO:tasks.workunit.client.0.smithi016.stdout:3/434: symlink d3/d9/l88 0 2024-04-26T20:18:50.597 INFO:tasks.workunit.client.0.smithi016.stdout:3/435: dread - d3/df/d20/f4b zero size 2024-04-26T20:18:50.613 INFO:tasks.workunit.client.0.smithi016.stdout:2/513: dwrite d1d/d27/d2d/d5a/f9e [0,4194304] 0 2024-04-26T20:18:50.643 INFO:tasks.workunit.client.0.smithi016.stdout:3/436: dwrite d3/f1b [0,4194304] 0 2024-04-26T20:18:50.656 INFO:tasks.workunit.client.0.smithi016.stdout:6/375: dwrite d1/d21/f39 [0,4194304] 0 2024-04-26T20:18:50.661 INFO:tasks.workunit.client.0.smithi016.stdout:6/376: mkdir d1/d21/d26/d1c/d5d/d88 0 2024-04-26T20:18:50.661 INFO:tasks.workunit.client.0.smithi016.stdout:6/377: chown d1/d21/d26/d1c/d7b 42000 1 2024-04-26T20:18:50.662 INFO:tasks.workunit.client.0.smithi016.stdout:6/378: readlink d1/d21/d26/d1c/d5d/l86 0 2024-04-26T20:18:50.662 INFO:tasks.workunit.client.0.smithi016.stdout:6/379: fsync d1/f27 0 2024-04-26T20:18:50.662 INFO:tasks.workunit.client.0.smithi016.stdout:6/380: chown d1/d21/d26/d1c/f7c 83589 1 2024-04-26T20:18:50.662 INFO:tasks.workunit.client.0.smithi016.stdout:6/381: link d1/d8/d2c/d3d/f58 d1/d21/d26/d1c/d7b/f89 0 2024-04-26T20:18:50.664 INFO:tasks.workunit.client.0.smithi016.stdout:6/382: getdents d1 0 2024-04-26T20:18:50.665 INFO:tasks.workunit.client.0.smithi016.stdout:6/383: mkdir d1/d21/d26/d1c/d8a 0 2024-04-26T20:18:50.666 INFO:tasks.workunit.client.0.smithi016.stdout:6/384: creat d1/d21/d26/d1c/d4e/f8b x:0 0 0 2024-04-26T20:18:50.667 INFO:tasks.workunit.client.0.smithi016.stdout:6/385: chown d1/d21/c83 104064 1 2024-04-26T20:18:50.668 INFO:tasks.workunit.client.0.smithi016.stdout:6/386: symlink d1/d21/d48/l8c 0 2024-04-26T20:18:50.723 INFO:tasks.workunit.client.0.smithi016.stdout:8/547: dwrite d9/d19/d45/d3f/f63 [0,4194304] 0 2024-04-26T20:18:50.724 INFO:tasks.workunit.client.0.smithi016.stdout:3/437: dread f2 [0,4194304] 0 2024-04-26T20:18:50.724 INFO:tasks.workunit.client.0.smithi016.stdout:8/548: dread - d9/d66/fb0 zero size 2024-04-26T20:18:50.724 INFO:tasks.workunit.client.0.smithi016.stdout:3/438: mkdir d3/d9/d2d/d89 0 2024-04-26T20:18:50.730 INFO:tasks.workunit.client.0.smithi016.stdout:6/387: dwrite d1/f4 [0,4194304] 0 2024-04-26T20:18:50.732 INFO:tasks.workunit.client.0.smithi016.stdout:6/388: rename d1/d8/d2c/d47/f5a to d1/d3a/f8d 0 2024-04-26T20:18:50.732 INFO:tasks.workunit.client.0.smithi016.stdout:6/389: chown d1/d3a/f55 12 1 2024-04-26T20:18:50.733 INFO:tasks.workunit.client.0.smithi016.stdout:6/390: creat d1/d8/d2c/d47/d67/f8e x:0 0 0 2024-04-26T20:18:50.734 INFO:tasks.workunit.client.0.smithi016.stdout:6/391: mkdir d1/d21/d26/d1c/d7b/d82/d8f 0 2024-04-26T20:18:50.735 INFO:tasks.workunit.client.0.smithi016.stdout:4/389: sync 2024-04-26T20:18:50.737 INFO:tasks.workunit.client.0.smithi016.stdout:4/390: mknod d0/d1e/d4e/d52/c80 0 2024-04-26T20:18:50.737 INFO:tasks.workunit.client.0.smithi016.stdout:6/392: dread d1/d8/d2c/f42 [4194304,4194304] 0 2024-04-26T20:18:50.737 INFO:tasks.workunit.client.0.smithi016.stdout:6/393: readlink d1/l1a 0 2024-04-26T20:18:50.737 INFO:tasks.workunit.client.0.smithi016.stdout:6/394: write d1/f27 [915641,20979] 0 2024-04-26T20:18:50.737 INFO:tasks.workunit.client.0.smithi016.stdout:4/391: mknod d0/dd/c81 0 2024-04-26T20:18:50.738 INFO:tasks.workunit.client.0.smithi016.stdout:4/392: chown d0/dd/d19/d1f/f45 189 1 2024-04-26T20:18:50.738 INFO:tasks.workunit.client.0.smithi016.stdout:6/395: mkdir d1/d12/d90 0 2024-04-26T20:18:50.739 INFO:tasks.workunit.client.0.smithi016.stdout:4/393: mkdir d0/dd/d1b/d82 0 2024-04-26T20:18:50.740 INFO:tasks.workunit.client.0.smithi016.stdout:6/396: rename d1/d8/f5c to d1/d21/d26/d1c/f91 0 2024-04-26T20:18:50.741 INFO:tasks.workunit.client.0.smithi016.stdout:6/397: write d1/d21/f39 [4409429,72372] 0 2024-04-26T20:18:50.741 INFO:tasks.workunit.client.0.smithi016.stdout:4/394: mknod d0/d1e/d41/d43/d5a/c83 0 2024-04-26T20:18:50.743 INFO:tasks.workunit.client.0.smithi016.stdout:6/398: getdents d1/d8/d2c/d3d 0 2024-04-26T20:18:50.770 INFO:tasks.workunit.client.0.smithi016.stdout:8/549: dwrite d9/f90 [0,4194304] 0 2024-04-26T20:18:50.772 INFO:tasks.workunit.client.0.smithi016.stdout:8/550: creat d9/d23/d26/d2c/fc0 x:0 0 0 2024-04-26T20:18:50.772 INFO:tasks.workunit.client.0.smithi016.stdout:8/551: read - d9/d19/d45/d3f/d4d/fbc zero size 2024-04-26T20:18:50.788 INFO:tasks.workunit.client.0.smithi016.stdout:4/395: dwrite d0/dd/d19/d1f/d7b/f7e [0,4194304] 0 2024-04-26T20:18:50.815 INFO:tasks.workunit.client.0.smithi016.stdout:4/396: write d0/d1e/d4e/d52/d54/f55 [4546000,92405] 0 2024-04-26T20:18:50.815 INFO:tasks.workunit.client.0.smithi016.stdout:4/397: chown d0/d1e/d41/c3d 84687970 1 2024-04-26T20:18:50.815 INFO:tasks.workunit.client.0.smithi016.stdout:4/398: read d0/dd/f25 [1330826,46906] 0 2024-04-26T20:18:50.815 INFO:tasks.workunit.client.0.smithi016.stdout:4/399: stat d0/dd/d66/d6f 0 2024-04-26T20:18:50.815 INFO:tasks.workunit.client.0.smithi016.stdout:4/400: link d0/f11 d0/dd/f84 0 2024-04-26T20:18:50.817 INFO:tasks.workunit.client.0.smithi016.stdout:4/401: rename d0/dd/f25 to d0/d1e/d64/f85 0 2024-04-26T20:18:50.831 INFO:tasks.workunit.client.0.smithi016.stdout:6/399: dwrite d1/d21/f39 [0,4194304] 0 2024-04-26T20:18:50.861 INFO:tasks.workunit.client.0.smithi016.stdout:8/552: dwrite d9/d19/d45/d3f/d64/f62 [4194304,4194304] 0 2024-04-26T20:18:50.868 INFO:tasks.workunit.client.0.smithi016.stdout:6/400: dwrite d1/d3a/f8d [0,4194304] 0 2024-04-26T20:18:50.878 INFO:tasks.workunit.client.0.smithi016.stdout:6/401: dread d1/f7 [0,4194304] 0 2024-04-26T20:18:50.878 INFO:tasks.workunit.client.0.smithi016.stdout:6/402: fdatasync d1/d8/d76/f77 0 2024-04-26T20:18:50.879 INFO:tasks.workunit.client.0.smithi016.stdout:6/403: chown d1/d21/d26/d1c/d7b/d82/d8f 209991674 1 2024-04-26T20:18:50.928 INFO:tasks.workunit.client.0.smithi016.stdout:6/404: dwrite d1/d8/d2c/f42 [0,4194304] 0 2024-04-26T20:18:50.938 INFO:tasks.workunit.client.0.smithi016.stdout:6/405: dread d1/f6 [0,4194304] 0 2024-04-26T20:18:50.997 INFO:tasks.workunit.client.0.smithi016.stdout:6/406: dwrite d1/fd [0,4194304] 0 2024-04-26T20:18:51.070 INFO:tasks.workunit.client.0.smithi016.stdout:4/402: unlink d0/dd/d66/f77 0 2024-04-26T20:18:51.070 INFO:tasks.workunit.client.0.smithi016.stdout:8/553: unlink d9/d19/d45/d9e/d50/da9/dac/fb3 0 2024-04-26T20:18:51.072 INFO:tasks.workunit.client.0.smithi016.stdout:0/454: sync 2024-04-26T20:18:51.074 INFO:tasks.workunit.client.0.smithi016.stdout:6/407: rmdir d1/d21/d26/d1c/d2e 39 2024-04-26T20:18:51.075 INFO:tasks.workunit.client.0.smithi016.stdout:4/403: mknod d0/dd/d66/d6f/c86 0 2024-04-26T20:18:51.075 INFO:tasks.workunit.client.0.smithi016.stdout:4/404: fdatasync d0/dd/f6d 0 2024-04-26T20:18:51.076 INFO:tasks.workunit.client.0.smithi016.stdout:8/554: rename d9/d2f/l87 to d9/d66/lc1 0 2024-04-26T20:18:51.077 INFO:tasks.workunit.client.0.smithi016.stdout:0/455: unlink d2/dc/l2a 0 2024-04-26T20:18:51.077 INFO:tasks.workunit.client.0.smithi016.stdout:0/456: chown d2/l99 165030825 1 2024-04-26T20:18:51.077 INFO:tasks.workunit.client.0.smithi016.stdout:6/408: creat d1/d8/f92 x:0 0 0 2024-04-26T20:18:51.078 INFO:tasks.workunit.client.0.smithi016.stdout:6/409: chown d1/d21/d26/d1c/d2e/d53/f69 1697371 1 2024-04-26T20:18:51.078 INFO:tasks.workunit.client.0.smithi016.stdout:8/555: symlink d9/d19/lc2 0 2024-04-26T20:18:51.079 INFO:tasks.workunit.client.0.smithi016.stdout:0/457: symlink d2/dc/d1e/d35/l9a 0 2024-04-26T20:18:51.079 INFO:tasks.workunit.client.0.smithi016.stdout:6/410: mkdir d1/d21/d26/d1c/d2e/d53/d93 0 2024-04-26T20:18:51.080 INFO:tasks.workunit.client.0.smithi016.stdout:8/556: getdents d9/d23/d26/d2c 0 2024-04-26T20:18:51.081 INFO:tasks.workunit.client.0.smithi016.stdout:6/411: creat d1/d8/d2c/d47/f94 x:0 0 0 2024-04-26T20:18:51.081 INFO:tasks.workunit.client.0.smithi016.stdout:6/412: rename d1/d21/d26/d1c to d1/d21/d26/d1c/d2e/d95 22 2024-04-26T20:18:51.081 INFO:tasks.workunit.client.0.smithi016.stdout:4/405: dread d0/d1e/f73 [0,4194304] 0 2024-04-26T20:18:51.082 INFO:tasks.workunit.client.0.smithi016.stdout:4/406: stat d0/dd/f2a 0 2024-04-26T20:18:51.082 INFO:tasks.workunit.client.0.smithi016.stdout:8/557: rmdir d9 39 2024-04-26T20:18:51.083 INFO:tasks.workunit.client.0.smithi016.stdout:6/413: symlink d1/d8/d2c/d47/l96 0 2024-04-26T20:18:51.083 INFO:tasks.workunit.client.0.smithi016.stdout:6/414: dread - d1/d21/d26/d1c/d2e/d53/f5f zero size 2024-04-26T20:18:51.085 INFO:tasks.workunit.client.0.smithi016.stdout:0/458: dread d2/dc/f79 [0,4194304] 0 2024-04-26T20:18:51.100 INFO:tasks.workunit.client.0.smithi016.stdout:0/459: write d2/f14 [5730449,87661] 0 2024-04-26T20:18:51.334 INFO:tasks.workunit.client.0.smithi016.stdout:4/407: rename d0/dd/d1b/d82 to d0/d1e/d4e/d52/d54/d87 0 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:8/558: mknod d9/d72/cc3 0 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:6/415: mknod d1/d21/d26/d1c/d2e/d53/c97 0 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:6/416: dread - d1/d21/d26/d1c/d4e/f8b zero size 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:6/417: readlink d1/l84 0 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:7/534: sync 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:1/581: sync 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:7/535: getdents d0/d1/d34/d25/d3f/d6d/d79 0 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:2/514: sync 2024-04-26T20:18:51.335 INFO:tasks.workunit.client.0.smithi016.stdout:3/439: sync 2024-04-26T20:18:51.336 INFO:tasks.workunit.client.0.smithi016.stdout:5/692: sync 2024-04-26T20:18:51.336 INFO:tasks.workunit.client.0.smithi016.stdout:9/612: sync 2024-04-26T20:18:51.337 INFO:tasks.workunit.client.0.smithi016.stdout:0/460: rename d2/d20/d41/c43 to d2/d8/c9b 0 2024-04-26T20:18:51.337 INFO:tasks.workunit.client.0.smithi016.stdout:0/461: chown d2/dc/d1e/d25/f55 2163482 1 2024-04-26T20:18:51.338 INFO:tasks.workunit.client.0.smithi016.stdout:6/418: unlink d1/d8/d3b/l40 0 2024-04-26T20:18:51.338 INFO:tasks.workunit.client.0.smithi016.stdout:6/419: write d1/d8/d2c/d47/f94 [435578,15347] 0 2024-04-26T20:18:51.340 INFO:tasks.workunit.client.0.smithi016.stdout:5/693: read d1/d9/d25/f79 [157844,119249] 0 2024-04-26T20:18:51.341 INFO:tasks.workunit.client.0.smithi016.stdout:3/440: getdents d3/df/d20/d61/d7b 0 2024-04-26T20:18:51.341 INFO:tasks.workunit.client.0.smithi016.stdout:3/441: write d3/d9/d2d/d62/f6c [831088,40459] 0 2024-04-26T20:18:51.341 INFO:tasks.workunit.client.0.smithi016.stdout:3/442: read d3/df/d25/f5c [2791522,92640] 0 2024-04-26T20:18:51.341 INFO:tasks.workunit.client.0.smithi016.stdout:3/443: fsync d3/d9/f3d 0 2024-04-26T20:18:51.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/613: link d1/d2/d20/d49/d77/d2a/f5d d1/d2/d43/fd8 0 2024-04-26T20:18:51.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/614: stat d1/d1b/c27 0 2024-04-26T20:18:51.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/615: chown d1/d1b/l37 222920 1 2024-04-26T20:18:51.344 INFO:tasks.workunit.client.0.smithi016.stdout:4/408: rename d0/d1e/d41 to d0/d1e/d4e/d52/d88 0 2024-04-26T20:18:51.352 INFO:tasks.workunit.client.0.smithi016.stdout:0/462: creat d2/d40/d61/d91/f9c x:0 0 0 2024-04-26T20:18:51.361 INFO:tasks.workunit.client.0.smithi016.stdout:6/420: link d1/d21/d26/d1c/d2e/c73 d1/d21/d26/d1c/d8a/c98 0 2024-04-26T20:18:51.361 INFO:tasks.workunit.client.0.smithi016.stdout:7/536: mknod d0/d67/ca4 0 2024-04-26T20:18:51.361 INFO:tasks.workunit.client.0.smithi016.stdout:5/694: creat d1/d7d/fdf x:0 0 0 2024-04-26T20:18:51.361 INFO:tasks.workunit.client.0.smithi016.stdout:5/695: write d1/d7d/fba [369963,45338] 0 2024-04-26T20:18:51.361 INFO:tasks.workunit.client.0.smithi016.stdout:5/696: write d1/d78/f80 [5150578,7521] 0 2024-04-26T20:18:51.361 INFO:tasks.workunit.client.0.smithi016.stdout:5/697: dread - d1/fdd zero size 2024-04-26T20:18:51.362 INFO:tasks.workunit.client.0.smithi016.stdout:4/409: creat d0/dd/d19/d57/f89 x:0 0 0 2024-04-26T20:18:51.365 INFO:tasks.workunit.client.0.smithi016.stdout:0/463: mkdir d2/d20/d41/d87/d9d 0 2024-04-26T20:18:51.365 INFO:tasks.workunit.client.0.smithi016.stdout:0/464: chown d2/d8/d37/d70/f75 24142 1 2024-04-26T20:18:51.370 INFO:tasks.workunit.client.0.smithi016.stdout:6/421: mknod d1/d21/d26/d1c/c99 0 2024-04-26T20:18:51.375 INFO:tasks.workunit.client.0.smithi016.stdout:2/515: write d1d/d27/d49/f56 [47281,121548] 0 2024-04-26T20:18:51.375 INFO:tasks.workunit.client.0.smithi016.stdout:5/698: link d1/d9/d11/l84 d1/d9/d11/daa/le0 0 2024-04-26T20:18:51.376 INFO:tasks.workunit.client.0.smithi016.stdout:4/410: creat d0/dd/d19/f8a x:0 0 0 2024-04-26T20:18:51.377 INFO:tasks.workunit.client.0.smithi016.stdout:0/465: creat d2/d20/f9e x:0 0 0 2024-04-26T20:18:51.379 INFO:tasks.workunit.client.0.smithi016.stdout:6/422: creat d1/d8/d76/f9a x:0 0 0 2024-04-26T20:18:51.381 INFO:tasks.workunit.client.0.smithi016.stdout:2/516: symlink d1d/d27/d2d/lb2 0 2024-04-26T20:18:51.383 INFO:tasks.workunit.client.0.smithi016.stdout:5/699: creat d1/d9/d1c/d52/d74/d98/fe1 x:0 0 0 2024-04-26T20:18:51.384 INFO:tasks.workunit.client.0.smithi016.stdout:5/700: write d1/d7d/fba [86996,50691] 0 2024-04-26T20:18:51.384 INFO:tasks.workunit.client.0.smithi016.stdout:4/411: creat d0/d1e/d4e/d52/f8b x:0 0 0 2024-04-26T20:18:51.385 INFO:tasks.workunit.client.0.smithi016.stdout:2/517: creat d1d/d2a/fb3 x:0 0 0 2024-04-26T20:18:51.385 INFO:tasks.workunit.client.0.smithi016.stdout:2/518: truncate d1d/d20/d7c/f91 1678930 0 2024-04-26T20:18:51.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/701: rename d1/d9/d1c/d52/d74/d5f/d82/c96 to d1/d9/d1c/d52/dc4/ce2 0 2024-04-26T20:18:51.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/702: chown d1/d9/d11/d4d/f6d 25736 1 2024-04-26T20:18:51.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/703: fsync d1/d9/d11/d4d/f6d 0 2024-04-26T20:18:51.388 INFO:tasks.workunit.client.0.smithi016.stdout:5/704: dread - d1/d78/fdc zero size 2024-04-26T20:18:51.388 INFO:tasks.workunit.client.0.smithi016.stdout:5/705: chown d1/d9/d11/c24 1 1 2024-04-26T20:18:51.388 INFO:tasks.workunit.client.0.smithi016.stdout:4/412: symlink d0/d1e/d4e/d52/d54/l8c 0 2024-04-26T20:18:51.390 INFO:tasks.workunit.client.0.smithi016.stdout:2/519: rmdir d1d/d27/d2d/d5a/d9c/dac 0 2024-04-26T20:18:51.390 INFO:tasks.workunit.client.0.smithi016.stdout:2/520: readlink l1a 0 2024-04-26T20:18:51.392 INFO:tasks.workunit.client.0.smithi016.stdout:5/706: mkdir d1/d9/d11/d4d/d72/dac/de3 0 2024-04-26T20:18:51.394 INFO:tasks.workunit.client.0.smithi016.stdout:4/413: creat d0/f8d x:0 0 0 2024-04-26T20:18:51.394 INFO:tasks.workunit.client.0.smithi016.stdout:2/521: rmdir d1d/d27 39 2024-04-26T20:18:51.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/414: creat d0/d1e/d64/f8e x:0 0 0 2024-04-26T20:18:51.398 INFO:tasks.workunit.client.0.smithi016.stdout:2/522: creat d1d/d27/d2d/d6b/d7e/fb4 x:0 0 0 2024-04-26T20:18:51.402 INFO:tasks.workunit.client.0.smithi016.stdout:0/466: dread d2/d20/f2f [0,4194304] 0 2024-04-26T20:18:51.403 INFO:tasks.workunit.client.0.smithi016.stdout:3/444: dwrite d3/df/d20/d41/f4e [0,4194304] 0 2024-04-26T20:18:51.403 INFO:tasks.workunit.client.0.smithi016.stdout:3/445: dread - d3/df/d25/d32/f3b zero size 2024-04-26T20:18:51.403 INFO:tasks.workunit.client.0.smithi016.stdout:3/446: stat d3/d9/d18/c75 0 2024-04-26T20:18:51.404 INFO:tasks.workunit.client.0.smithi016.stdout:4/415: creat d0/d1e/d4e/f8f x:0 0 0 2024-04-26T20:18:51.414 INFO:tasks.workunit.client.0.smithi016.stdout:4/416: creat d0/f90 x:0 0 0 2024-04-26T20:18:51.419 INFO:tasks.workunit.client.0.smithi016.stdout:5/707: dread f0 [0,4194304] 0 2024-04-26T20:18:51.423 INFO:tasks.workunit.client.0.smithi016.stdout:6/423: dread d1/f6 [0,4194304] 0 2024-04-26T20:18:51.424 INFO:tasks.workunit.client.0.smithi016.stdout:6/424: write d1/d21/d26/d1c/d4e/f8b [492914,92214] 0 2024-04-26T20:18:51.424 INFO:tasks.workunit.client.0.smithi016.stdout:6/425: getdents d1/d21/d26/d25/d6f 0 2024-04-26T20:18:51.433 INFO:tasks.workunit.client.0.smithi016.stdout:0/467: dread d2/dc/d1e/f3a [0,4194304] 0 2024-04-26T20:18:51.437 INFO:tasks.workunit.client.0.smithi016.stdout:7/537: dwrite d0/d1/d34/d25/d3f/d6d/f77 [0,4194304] 0 2024-04-26T20:18:51.437 INFO:tasks.workunit.client.0.smithi016.stdout:3/447: write d3/df/d25/f5c [6623604,111138] 0 2024-04-26T20:18:51.441 INFO:tasks.workunit.client.0.smithi016.stdout:1/582: dwrite d3/d5/d6/d9/d2a/f76 [0,4194304] 0 2024-04-26T20:18:51.472 INFO:tasks.workunit.client.0.smithi016.stdout:1/583: dwrite d3/d5/da/d66/d8c/f83 [0,4194304] 0 2024-04-26T20:18:51.472 INFO:tasks.workunit.client.0.smithi016.stdout:1/584: fdatasync d3/d5/d6/d5a/f99 0 2024-04-26T20:18:51.666 INFO:tasks.workunit.client.0.smithi016.stdout:4/417: rmdir d0/d1e/d4e/d52/d54 39 2024-04-26T20:18:51.667 INFO:tasks.workunit.client.0.smithi016.stdout:2/523: write d1d/d20/f2b [1682036,62942] 0 2024-04-26T20:18:51.667 INFO:tasks.workunit.client.0.smithi016.stdout:5/708: truncate d1/d9/f38 2251786 0 2024-04-26T20:18:51.667 INFO:tasks.workunit.client.0.smithi016.stdout:6/426: creat d1/d21/f9b x:0 0 0 2024-04-26T20:18:51.667 INFO:tasks.workunit.client.0.smithi016.stdout:6/427: dread - d1/d8/d46/f6c zero size 2024-04-26T20:18:51.668 INFO:tasks.workunit.client.0.smithi016.stdout:6/428: chown d1/d21/d26/d25/l52 10121 1 2024-04-26T20:18:51.668 INFO:tasks.workunit.client.0.smithi016.stdout:0/468: link d2/dc/d1e/d35/c6b d2/dc/d18/d5b/c9f 0 2024-04-26T20:18:51.668 INFO:tasks.workunit.client.0.smithi016.stdout:0/469: dread - d2/d40/d61/f81 zero size 2024-04-26T20:18:51.668 INFO:tasks.workunit.client.0.smithi016.stdout:7/538: write d0/fc [3346714,36155] 0 2024-04-26T20:18:51.669 INFO:tasks.workunit.client.0.smithi016.stdout:3/448: creat d3/d9/d18/d59/f8a x:0 0 0 2024-04-26T20:18:51.673 INFO:tasks.workunit.client.0.smithi016.stdout:1/585: creat d3/d5/da/d66/da2/fb9 x:0 0 0 2024-04-26T20:18:51.675 INFO:tasks.workunit.client.0.smithi016.stdout:4/418: mknod d0/d1e/d4e/d52/c91 0 2024-04-26T20:18:51.677 INFO:tasks.workunit.client.0.smithi016.stdout:2/524: creat d1d/d2a/fb5 x:0 0 0 2024-04-26T20:18:51.681 INFO:tasks.workunit.client.0.smithi016.stdout:6/429: truncate d1/d21/d26/d1c/d7b/f89 1845808 0 2024-04-26T20:18:51.681 INFO:tasks.workunit.client.0.smithi016.stdout:6/430: write d1/d12/f70 [309158,5015] 0 2024-04-26T20:18:51.681 INFO:tasks.workunit.client.0.smithi016.stdout:6/431: dread - d1/d8/d2c/d47/d67/f8e zero size 2024-04-26T20:18:51.682 INFO:tasks.workunit.client.0.smithi016.stdout:0/470: link d2/dc/d1e/d35/c4a d2/d20/d41/d87/d9d/ca0 0 2024-04-26T20:18:51.685 INFO:tasks.workunit.client.0.smithi016.stdout:4/419: creat d0/d1e/d64/f92 x:0 0 0 2024-04-26T20:18:51.685 INFO:tasks.workunit.client.0.smithi016.stdout:2/525: symlink d1d/d27/d2d/d6b/d7e/lb6 0 2024-04-26T20:18:51.685 INFO:tasks.workunit.client.0.smithi016.stdout:2/526: chown d1d/d27/d2d/l68 236340 1 2024-04-26T20:18:51.686 INFO:tasks.workunit.client.0.smithi016.stdout:2/527: readlink d1d/d20/l4f 0 2024-04-26T20:18:51.686 INFO:tasks.workunit.client.0.smithi016.stdout:2/528: chown d1d/d27/d2d/d5a/f9e 1213018 1 2024-04-26T20:18:51.686 INFO:tasks.workunit.client.0.smithi016.stdout:5/709: read d1/d9/d25/f54 [406105,90532] 0 2024-04-26T20:18:51.686 INFO:tasks.workunit.client.0.smithi016.stdout:5/710: readlink d1/d9/d25/l87 0 2024-04-26T20:18:51.688 INFO:tasks.workunit.client.0.smithi016.stdout:6/432: mknod d1/d8/d2c/d47/c9c 0 2024-04-26T20:18:51.691 INFO:tasks.workunit.client.0.smithi016.stdout:1/586: dread d3/d5/da/d66/d8c/fa0 [0,4194304] 0 2024-04-26T20:18:51.691 INFO:tasks.workunit.client.0.smithi016.stdout:1/587: chown d3/f77 1 1 2024-04-26T20:18:51.691 INFO:tasks.workunit.client.0.smithi016.stdout:1/588: write d3/d5/d6/d50/d79/f85 [1328282,38682] 0 2024-04-26T20:18:51.691 INFO:tasks.workunit.client.0.smithi016.stdout:1/589: chown d3/d5/f18 1923123 1 2024-04-26T20:18:51.692 INFO:tasks.workunit.client.0.smithi016.stdout:0/471: creat d2/d20/d41/d4c/d4e/fa1 x:0 0 0 2024-04-26T20:18:51.693 INFO:tasks.workunit.client.0.smithi016.stdout:7/539: symlink d0/la5 0 2024-04-26T20:18:51.694 INFO:tasks.workunit.client.0.smithi016.stdout:2/529: symlink d1d/d27/d2d/d6b/lb7 0 2024-04-26T20:18:51.697 INFO:tasks.workunit.client.0.smithi016.stdout:8/559: sync 2024-04-26T20:18:51.697 INFO:tasks.workunit.client.0.smithi016.stdout:9/616: sync 2024-04-26T20:18:51.697 INFO:tasks.workunit.client.0.smithi016.stdout:1/590: link d3/d5/d6/d5a/fb8 d3/d5/da/d66/d8c/d84/d96/fba 0 2024-04-26T20:18:51.699 INFO:tasks.workunit.client.0.smithi016.stdout:0/472: getdents d2/d8/d37/d5d/d60 0 2024-04-26T20:18:51.702 INFO:tasks.workunit.client.0.smithi016.stdout:7/540: truncate d0/d83/fa0 5188749 0 2024-04-26T20:18:51.705 INFO:tasks.workunit.client.0.smithi016.stdout:9/617: dread d1/d2/d43/f88 [0,4194304] 0 2024-04-26T20:18:51.706 INFO:tasks.workunit.client.0.smithi016.stdout:4/420: dread d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:18:51.706 INFO:tasks.workunit.client.0.smithi016.stdout:4/421: write d0/f90 [460573,7814] 0 2024-04-26T20:18:51.717 INFO:tasks.workunit.client.0.smithi016.stdout:2/530: link d1d/d27/f50 d1d/d27/d49/fb8 0 2024-04-26T20:18:51.718 INFO:tasks.workunit.client.0.smithi016.stdout:2/531: chown d1d/d20/d22/d98/caa 54214882 1 2024-04-26T20:18:51.718 INFO:tasks.workunit.client.0.smithi016.stdout:2/532: dread - d1d/d27/d49/fa2 zero size 2024-04-26T20:18:51.718 INFO:tasks.workunit.client.0.smithi016.stdout:2/533: chown d1d/d27/d2d/f96 118 1 2024-04-26T20:18:51.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/591: truncate d3/d57/f6e 960449 0 2024-04-26T20:18:51.718 INFO:tasks.workunit.client.0.smithi016.stdout:9/618: dread d1/d2/d20/d49/d77/d2a/d75/f83 [0,4194304] 0 2024-04-26T20:18:51.719 INFO:tasks.workunit.client.0.smithi016.stdout:8/560: rename d9/f11 to d9/d19/d45/d9e/d50/dad/fc4 0 2024-04-26T20:18:51.734 INFO:tasks.workunit.client.0.smithi016.stdout:7/541: dread d0/d1/d46/f84 [0,4194304] 0 2024-04-26T20:18:51.734 INFO:tasks.workunit.client.0.smithi016.stdout:7/542: chown d0/d1/d95/c9d 0 1 2024-04-26T20:18:51.734 INFO:tasks.workunit.client.0.smithi016.stdout:7/543: write d0/d1/d4b/f8e [360656,56227] 0 2024-04-26T20:18:51.735 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:51.735 INFO:tasks.workunit.client.0.smithi016.stdout:0/473: rename d2/d20/d41/f49 to d2/d8/d37/d5d/fa2 0 2024-04-26T20:18:51.735 INFO:tasks.workunit.client.0.smithi016.stdout:3/449: dwrite d3/df/f2b [4194304,4194304] 0 2024-04-26T20:18:51.745 INFO:tasks.workunit.client.0.smithi016.stdout:0/474: rename d2/dc/d1e/d35/f98 to d2/d8/d3b/fa3 0 2024-04-26T20:18:51.747 INFO:tasks.workunit.client.0.smithi016.stdout:0/475: creat d2/d20/d57/fa4 x:0 0 0 2024-04-26T20:18:51.756 INFO:tasks.workunit.client.0.smithi016.stdout:3/450: rename d3/df/d20/d61/d7b to d3/d70/d8b 0 2024-04-26T20:18:51.756 INFO:tasks.workunit.client.0.smithi016.stdout:0/476: mkdir d2/dc/d1e/d35/da5 0 2024-04-26T20:18:51.765 INFO:tasks.workunit.client.0.smithi016.stdout:6/433: dwrite d1/d8/f2f [8388608,4194304] 0 2024-04-26T20:18:51.765 INFO:tasks.workunit.client.0.smithi016.stdout:6/434: chown d1/d21/d26/d1c/d7b/d82 1108 1 2024-04-26T20:18:51.766 INFO:tasks.workunit.client.0.smithi016.stdout:6/435: readlink d1/l1a 0 2024-04-26T20:18:51.767 INFO:tasks.workunit.client.0.smithi016.stdout:6/436: read - d1/d21/d26/f75 zero size 2024-04-26T20:18:51.777 INFO:tasks.workunit.client.0.smithi016.stdout:0/477: truncate d2/dc/d1e/d25/f55 913267 0 2024-04-26T20:18:51.777 INFO:tasks.workunit.client.0.smithi016.stdout:6/437: truncate f0 3658418 0 2024-04-26T20:18:51.778 INFO:tasks.workunit.client.0.smithi016.stdout:0/478: rmdir d2/d8/d37/d70 39 2024-04-26T20:18:51.778 INFO:tasks.workunit.client.0.smithi016.stdout:0/479: read - d2/d20/f9e zero size 2024-04-26T20:18:51.778 INFO:tasks.workunit.client.0.smithi016.stdout:0/480: chown d2/d40/f5c 41 1 2024-04-26T20:18:51.778 INFO:tasks.workunit.client.0.smithi016.stdout:0/481: chown d2/dc/d45/f78 51674051 1 2024-04-26T20:18:51.781 INFO:tasks.workunit.client.0.smithi016.stdout:0/482: creat d2/d8/d37/d70/fa6 x:0 0 0 2024-04-26T20:18:51.788 INFO:tasks.workunit.client.0.smithi016.stdout:0/483: rename d2/dc/d18/d24/l94 to d2/d8/la7 0 2024-04-26T20:18:51.788 INFO:tasks.workunit.client.0.smithi016.stdout:0/484: chown d2/d8/d37/d5d/d60 456344 1 2024-04-26T20:18:51.788 INFO:tasks.workunit.client.0.smithi016.stdout:0/485: write d2/d8/f11 [1224798,13394] 0 2024-04-26T20:18:51.788 INFO:tasks.workunit.client.0.smithi016.stdout:9/619: dread d1/d2e/f63 [0,4194304] 0 2024-04-26T20:18:51.789 INFO:tasks.workunit.client.0.smithi016.stdout:5/711: dwrite d1/f8d [0,4194304] 0 2024-04-26T20:18:51.789 INFO:tasks.workunit.client.0.smithi016.stdout:5/712: chown d1/d9/d25/f64 152606546 1 2024-04-26T20:18:51.797 INFO:tasks.workunit.client.0.smithi016.stdout:8/561: dwrite d9/d2f/f96 [0,4194304] 0 2024-04-26T20:18:51.798 INFO:tasks.workunit.client.0.smithi016.stdout:1/592: dwrite d3/d5/f4f [0,4194304] 0 2024-04-26T20:18:51.804 INFO:tasks.workunit.client.0.smithi016.stdout:8/562: rename d9/d23/d26/d2c/l9b to d9/d72/lc5 0 2024-04-26T20:18:51.805 INFO:tasks.workunit.client.0.smithi016.stdout:8/563: chown d9/d19/d45/d9e 837155900 1 2024-04-26T20:18:51.808 INFO:tasks.workunit.client.0.smithi016.stdout:1/593: link d3/d57/f35 d3/d5/d6/d5a/fbb 0 2024-04-26T20:18:51.811 INFO:tasks.workunit.client.0.smithi016.stdout:8/564: link d9/d2f/f96 d9/d19/d45/d9e/fc6 0 2024-04-26T20:18:51.811 INFO:tasks.workunit.client.0.smithi016.stdout:8/565: dread - d9/d19/fb2 zero size 2024-04-26T20:18:51.811 INFO:tasks.workunit.client.0.smithi016.stdout:8/566: readlink d9/l36 0 2024-04-26T20:18:51.813 INFO:tasks.workunit.client.0.smithi016.stdout:7/544: dwrite d0/f31 [4194304,4194304] 0 2024-04-26T20:18:51.813 INFO:tasks.workunit.client.0.smithi016.stdout:7/545: truncate d0/d1/f30 3463206 0 2024-04-26T20:18:51.813 INFO:tasks.workunit.client.0.smithi016.stdout:7/546: fsync d0/d1/d34/d25/f26 0 2024-04-26T20:18:51.818 INFO:tasks.workunit.client.0.smithi016.stdout:0/486: write d2/d8/d37/d70/f93 [1523085,48447] 0 2024-04-26T20:18:51.820 INFO:tasks.workunit.client.0.smithi016.stdout:7/547: creat d0/d1/d34/d25/d50/fa6 x:0 0 0 2024-04-26T20:18:51.820 INFO:tasks.workunit.client.0.smithi016.stdout:1/594: symlink d3/d57/lbc 0 2024-04-26T20:18:51.822 INFO:tasks.workunit.client.0.smithi016.stdout:5/713: write d1/d9/d25/f54 [1010825,77634] 0 2024-04-26T20:18:51.822 INFO:tasks.workunit.client.0.smithi016.stdout:5/714: truncate d1/d9/d1c/d52/d74/d5f/fb5 1488034 0 2024-04-26T20:18:51.825 INFO:tasks.workunit.client.0.smithi016.stdout:0/487: rename d2/d20/d41/d4c/f8f to d2/dc/d18/d5b/fa8 0 2024-04-26T20:18:51.826 INFO:tasks.workunit.client.0.smithi016.stdout:0/488: write d2/d40/d61/d91/f9c [280569,100162] 0 2024-04-26T20:18:51.826 INFO:tasks.workunit.client.0.smithi016.stdout:0/489: readlink d2/dc/d1e/l68 0 2024-04-26T20:18:51.826 INFO:tasks.workunit.client.0.smithi016.stdout:0/490: stat d2/dc/l47 0 2024-04-26T20:18:51.826 INFO:tasks.workunit.client.0.smithi016.stdout:0/491: truncate d2/dc/d45/f78 18320 0 2024-04-26T20:18:51.826 INFO:tasks.workunit.client.0.smithi016.stdout:0/492: chown d2/d8/f80 34 1 2024-04-26T20:18:51.836 INFO:tasks.workunit.client.0.smithi016.stdout:8/567: dread d9/d23/d26/f2e [0,4194304] 0 2024-04-26T20:18:51.836 INFO:tasks.workunit.client.0.smithi016.stdout:8/568: write d9/d19/f41 [4972254,10810] 0 2024-04-26T20:18:51.836 INFO:tasks.workunit.client.0.smithi016.stdout:1/595: symlink d3/d5/da/d66/d8c/d84/lbd 0 2024-04-26T20:18:51.836 INFO:tasks.workunit.client.0.smithi016.stdout:0/493: symlink d2/dc/d45/la9 0 2024-04-26T20:18:51.837 INFO:tasks.workunit.client.0.smithi016.stdout:8/569: dread d9/d19/d45/d3f/d64/f57 [0,4194304] 0 2024-04-26T20:18:51.845 INFO:tasks.workunit.client.0.smithi016.stdout:1/596: unlink d3/d5/da/d66/da2/fad 0 2024-04-26T20:18:51.845 INFO:tasks.workunit.client.0.smithi016.stdout:2/534: dwrite d1d/d20/d7c/f91 [0,4194304] 0 2024-04-26T20:18:51.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/715: dread d1/d9/f16 [4194304,4194304] 0 2024-04-26T20:18:51.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/716: write d1/d9/d25/f2a [4123795,22362] 0 2024-04-26T20:18:51.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/717: fdatasync d1/d9/d1c/d52/d74/f32 0 2024-04-26T20:18:51.867 INFO:tasks.workunit.client.0.smithi016.stdout:7/548: mkdir d0/d51/da7 0 2024-04-26T20:18:51.872 INFO:tasks.workunit.client.0.smithi016.stdout:5/718: mknod d1/d9f/ce4 0 2024-04-26T20:18:51.881 INFO:tasks.workunit.client.0.smithi016.stdout:1/597: rename d3/d5/d6/d50/d79/c7e to d3/d5/da/d66/d8c/d84/cbe 0 2024-04-26T20:18:51.881 INFO:tasks.workunit.client.0.smithi016.stdout:1/598: chown d3/d5/da/d66/d8c/f6a 1630 1 2024-04-26T20:18:51.882 INFO:tasks.workunit.client.0.smithi016.stdout:1/599: mkdir d3/d5/d6/d5a/dbf 0 2024-04-26T20:18:51.882 INFO:tasks.workunit.client.0.smithi016.stdout:1/600: fdatasync d3/d5/d6/d50/f60 0 2024-04-26T20:18:51.886 INFO:tasks.workunit.client.0.smithi016.stdout:7/549: truncate d0/f29 2624504 0 2024-04-26T20:18:51.888 INFO:tasks.workunit.client.0.smithi016.stdout:0/494: dwrite d2/dc/d18/d5b/fa8 [0,4194304] 0 2024-04-26T20:18:51.888 INFO:tasks.workunit.client.0.smithi016.stdout:5/719: dread d1/d78/d99/fc6 [0,4194304] 0 2024-04-26T20:18:51.889 INFO:tasks.workunit.client.0.smithi016.stdout:0/495: read - d2/d20/d57/f7f zero size 2024-04-26T20:18:51.889 INFO:tasks.workunit.client.0.smithi016.stdout:5/720: dread - d1/d9/d11/fa9 zero size 2024-04-26T20:18:51.890 INFO:tasks.workunit.client.0.smithi016.stdout:7/550: creat d0/d1/d34/d25/d50/fa8 x:0 0 0 2024-04-26T20:18:51.890 INFO:tasks.workunit.client.0.smithi016.stdout:1/601: read d3/d5/d6/d50/d79/f85 [647181,85564] 0 2024-04-26T20:18:51.891 INFO:tasks.workunit.client.0.smithi016.stdout:0/496: mknod d2/dc/d45/caa 0 2024-04-26T20:18:51.893 INFO:tasks.workunit.client.0.smithi016.stdout:5/721: creat d1/d9/d1c/d52/d74/d5f/d82/fe5 x:0 0 0 2024-04-26T20:18:51.894 INFO:tasks.workunit.client.0.smithi016.stdout:7/551: creat d0/d1/d34/d25/d3f/d6d/d74/fa9 x:0 0 0 2024-04-26T20:18:51.895 INFO:tasks.workunit.client.0.smithi016.stdout:1/602: symlink d3/d5/d6/d5a/dbf/lc0 0 2024-04-26T20:18:51.907 INFO:tasks.workunit.client.0.smithi016.stdout:1/603: creat d3/d5/d6/d50/d58/fc1 x:0 0 0 2024-04-26T20:18:51.907 INFO:tasks.workunit.client.0.smithi016.stdout:1/604: write d3/d5/da/d66/d8c/f93 [1427978,15083] 0 2024-04-26T20:18:51.907 INFO:tasks.workunit.client.0.smithi016.stdout:3/451: dwrite d3/df/d20/f4b [0,4194304] 0 2024-04-26T20:18:51.908 INFO:tasks.workunit.client.0.smithi016.stdout:4/422: dwrite d0/f90 [0,4194304] 0 2024-04-26T20:18:51.908 INFO:tasks.workunit.client.0.smithi016.stdout:4/423: chown d0/d1e/d4e/d52 83159206 1 2024-04-26T20:18:51.908 INFO:tasks.workunit.client.0.smithi016.stdout:4/424: write d0/dd/d19/d1f/f58 [3604515,122479] 0 2024-04-26T20:18:51.912 INFO:tasks.workunit.client.0.smithi016.stdout:9/620: dread d1/f15 [0,4194304] 0 2024-04-26T20:18:51.912 INFO:tasks.workunit.client.0.smithi016.stdout:9/621: stat d1/d2/f5 0 2024-04-26T20:18:51.913 INFO:tasks.workunit.client.0.smithi016.stdout:9/622: write d1/d2/d20/d49/d77/d2a/d75/d85/f9e [710146,74834] 0 2024-04-26T20:18:51.913 INFO:tasks.workunit.client.0.smithi016.stdout:9/623: chown d1/d2/d20/d49/d77/d2a/d33/f6f 20208 1 2024-04-26T20:18:51.917 INFO:tasks.workunit.client.0.smithi016.stdout:8/570: dwrite d9/d19/d45/d3f/d64/f5a [0,4194304] 0 2024-04-26T20:18:51.922 INFO:tasks.workunit.client.0.smithi016.stdout:7/552: dread d0/f14 [0,4194304] 0 2024-04-26T20:18:51.930 INFO:tasks.workunit.client.0.smithi016.stdout:5/722: dwrite d1/d78/fa6 [0,4194304] 0 2024-04-26T20:18:51.930 INFO:tasks.workunit.client.0.smithi016.stdout:5/723: write d1/d9/d25/fc2 [2295376,2764] 0 2024-04-26T20:18:51.931 INFO:tasks.workunit.client.0.smithi016.stdout:5/724: getdents d1/d9/d1c/d52/d74/d98/dcb/dda 0 2024-04-26T20:18:51.946 INFO:tasks.workunit.client.0.smithi016.stdout:0/497: dwrite d2/d8/d37/d70/f93 [0,4194304] 0 2024-04-26T20:18:51.946 INFO:tasks.workunit.client.0.smithi016.stdout:9/624: dread d1/d2/d20/d49/d77/d2a/d75/d85/fb4 [0,4194304] 0 2024-04-26T20:18:51.946 INFO:tasks.workunit.client.0.smithi016.stdout:9/625: fdatasync d1/d2/d20/fc0 0 2024-04-26T20:18:51.956 INFO:tasks.workunit.client.0.smithi016.stdout:7/553: dwrite d0/d1/d34/f2c [0,4194304] 0 2024-04-26T20:18:51.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d7000640 1 Processor -- start 2024-04-26T20:18:51.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d7000640 1 -- start start 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d7000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16d00c7b80 0x7f16d00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d7000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c9010 0x7f16d00c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d7000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d00c99c0 con 0x7f16d0153af0 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d7000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f16d015dec0 con 0x7f16d00c7b80 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d7000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f16d00ca630 con 0x7f16d00c9010 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16c7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16d00c7b80 0x7f16d00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16c7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16d00c7b80 0x7f16d00c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36924/0 (socket says 172.21.15.16:36924) 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16c7e00640 1 -- 172.21.15.16:0/77678204 learned_addr learned my addr 172.21.15.16:0/77678204 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:51.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16d5000640 1 --2- 172.21.15.16:0/77678204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c9010 0x7f16d00c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16c7e00640 1 -- 172.21.15.16:0/77678204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c9010 msgr2=0x7f16d00c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:51.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16c7e00640 1 --2- 172.21.15.16:0/77678204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c9010 0x7f16d00c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:51.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16c7e00640 1 -- 172.21.15.16:0/77678204 >> v1:172.21.15.192:6789/0 conn(0x7f16d0153af0 legacy=0x7f16d015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:51.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.967+0000 7f16c7e00640 1 -- 172.21.15.16:0/77678204 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d00c9d90 con 0x7f16d00c7b80 2024-04-26T20:18:51.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16c7e00640 1 --2- 172.21.15.16:0/77678204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d00c7b80 0x7f16d00c7f80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009870 tx=0x7f16b801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc1cdf4fc6b4d90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16cf400640 1 -- 172.21.15.16:0/77678204 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b80b5070 con 0x7f16d00c7b80 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16cf400640 1 -- 172.21.15.16:0/77678204 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b80a8a50 con 0x7f16d00c7b80 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16cf400640 1 -- 172.21.15.16:0/77678204 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b80a8e20 con 0x7f16d00c7b80 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 -- 172.21.15.16:0/77678204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d00c7b80 msgr2=0x7f16d00c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 --2- 172.21.15.16:0/77678204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d00c7b80 0x7f16d00c7f80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009870 tx=0x7f16b801ed50 comp rx=0 tx=0).stop 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 -- 172.21.15.16:0/77678204 shutdown_connections 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 --2- 172.21.15.16:0/77678204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c9010 0x7f16d00c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 --2- 172.21.15.16:0/77678204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d00c7b80 0x7f16d00c7f80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:51.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 -- 172.21.15.16:0/77678204 >> 172.21.15.16:0/77678204 conn(0x7f16d006c380 msgr2=0x7f16d006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:51.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 -- 172.21.15.16:0/77678204 shutdown_connections 2024-04-26T20:18:51.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.971+0000 7f16d7000640 1 -- 172.21.15.16:0/77678204 wait complete. 2024-04-26T20:18:51.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 Processor -- start 2024-04-26T20:18:51.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 -- start start 2024-04-26T20:18:51.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c7b80 0x7f16d01f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00c9010 0x7f16d01e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d0153af0 0x7f16d00bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f16d015cfb0 con 0x7f16d0153af0 2024-04-26T20:18:51.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16d00ca350 con 0x7f16d00c9010 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f16d015d290 con 0x7f16d00c7b80 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d0153af0 0x7f16d00bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d0153af0 0x7f16d00bf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36930/0 (socket says 172.21.15.16:36930) 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 -- 172.21.15.16:0/1299971067 learned_addr learned my addr 172.21.15.16:0/1299971067 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16c7e00640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00c9010 0x7f16d01e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16cfe00640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c7b80 0x7f16d01f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 -- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c7b80 msgr2=0x7f16d01f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c7b80 0x7f16d01f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 -- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00c9010 msgr2=0x7f16d01e4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00c9010 0x7f16d01e4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:51.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 -- 172.21.15.16:0/1299971067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d01f5b40 con 0x7f16d0153af0 2024-04-26T20:18:51.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d5000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d0153af0 0x7f16d00bf2d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f16c8007e70 tx=0x7f16c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:51.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16ccc00640 1 -- 172.21.15.16:0/1299971067 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8014620 con 0x7f16d0153af0 2024-04-26T20:18:51.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16ccc00640 1 -- 172.21.15.16:0/1299971067 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c8019070 con 0x7f16d0153af0 2024-04-26T20:18:51.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d00c3300 con 0x7f16d0153af0 2024-04-26T20:18:51.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16ccc00640 1 -- 172.21.15.16:0/1299971067 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8014a20 con 0x7f16d0153af0 2024-04-26T20:18:51.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d01f2620 con 0x7f16d0153af0 2024-04-26T20:18:51.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.975+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d0077c20 con 0x7f16d0153af0 2024-04-26T20:18:51.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.979+0000 7f16ccc00640 1 -- 172.21.15.16:0/1299971067 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f16c8014bc0 con 0x7f16d0153af0 2024-04-26T20:18:51.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.979+0000 7f16ccc00640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f16ac0683b0 0x7f16ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:51.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.979+0000 7f16ccc00640 1 -- 172.21.15.16:0/1299971067 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f16c80875e0 con 0x7f16d0153af0 2024-04-26T20:18:51.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.979+0000 7f16cfe00640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f16ac0683b0 0x7f16ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:51.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.979+0000 7f16cfe00640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f16ac0683b0 0x7f16ac06a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f16c0007fd0 tx=0x7f16c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:51.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:51.983+0000 7f16ccc00640 1 -- 172.21.15.16:0/1299971067 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f16c80570e0 con 0x7f16d0153af0 2024-04-26T20:18:52.160 INFO:tasks.workunit.client.0.smithi016.stdout:3/452: creat d3/df/d25/d32/d3f/f8c x:0 0 0 2024-04-26T20:18:52.160 INFO:tasks.workunit.client.0.smithi016.stdout:3/453: fdatasync d3/f19 0 2024-04-26T20:18:52.161 INFO:tasks.workunit.client.0.smithi016.stdout:4/425: symlink d0/d1e/d4e/d52/d88/d43/d5a/l93 0 2024-04-26T20:18:52.161 INFO:tasks.workunit.client.0.smithi016.stdout:4/426: chown d0/f8d 58935 1 2024-04-26T20:18:52.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/571: symlink d9/d23/lc7 0 2024-04-26T20:18:52.166 INFO:tasks.workunit.client.0.smithi016.stdout:5/725: creat d1/d9/d11/d4d/d72/dac/fe6 x:0 0 0 2024-04-26T20:18:52.166 INFO:tasks.workunit.client.0.smithi016.stdout:5/726: stat d1/d9/d11/f61 0 2024-04-26T20:18:52.167 INFO:tasks.workunit.client.0.smithi016.stdout:0/498: mknod d2/dc/d18/cab 0 2024-04-26T20:18:52.168 INFO:tasks.workunit.client.0.smithi016.stdout:9/626: creat d1/d2e/d40/fd9 x:0 0 0 2024-04-26T20:18:52.171 INFO:tasks.workunit.client.0.smithi016.stdout:7/554: rename d0/d1/d34/d25/d3f/c64 to d0/d67/caa 0 2024-04-26T20:18:52.175 INFO:tasks.workunit.client.0.smithi016.stdout:1/605: symlink d3/d5/d6/lc2 0 2024-04-26T20:18:52.177 INFO:tasks.workunit.client.0.smithi016.stdout:3/454: link d3/d9/d18/f34 d3/df/d20/d61/d74/f8d 0 2024-04-26T20:18:52.179 INFO:tasks.workunit.client.0.smithi016.stdout:5/727: creat d1/d9/d11/d4d/d72/dac/de3/fe7 x:0 0 0 2024-04-26T20:18:52.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/499: mknod d2/d8/cac 0 2024-04-26T20:18:52.182 INFO:tasks.workunit.client.0.smithi016.stdout:7/555: link d0/d1/c18 d0/d1/d88/cab 0 2024-04-26T20:18:52.182 INFO:tasks.workunit.client.0.smithi016.stdout:8/572: dread d9/d23/d26/d2c/f77 [0,4194304] 0 2024-04-26T20:18:52.183 INFO:tasks.workunit.client.0.smithi016.stdout:1/606: rename d3/d57/da4/fa6 to d3/d5/da/d66/d8c/d84/d86/fc3 0 2024-04-26T20:18:52.183 INFO:tasks.workunit.client.0.smithi016.stdout:1/607: truncate d3/d5/da/d66/d8c/fb6 528171 0 2024-04-26T20:18:52.184 INFO:tasks.workunit.client.0.smithi016.stdout:5/728: creat d1/d7d/fe8 x:0 0 0 2024-04-26T20:18:52.185 INFO:tasks.workunit.client.0.smithi016.stdout:0/500: creat d2/d20/fad x:0 0 0 2024-04-26T20:18:52.185 INFO:tasks.workunit.client.0.smithi016.stdout:0/501: truncate d2/d40/d61/f81 312700 0 2024-04-26T20:18:52.189 INFO:tasks.workunit.client.0.smithi016.stdout:7/556: creat d0/d67/fac x:0 0 0 2024-04-26T20:18:52.191 INFO:tasks.workunit.client.0.smithi016.stdout:3/455: rename d3/d9/l43 to d3/d9/d2d/l8e 0 2024-04-26T20:18:52.198 INFO:tasks.workunit.client.0.smithi016.stdout:3/456: creat d3/d9/d18/f8f x:0 0 0 2024-04-26T20:18:52.201 INFO:tasks.workunit.client.0.smithi016.stdout:3/457: symlink d3/df/d25/d32/d3f/l90 0 2024-04-26T20:18:52.201 INFO:tasks.workunit.client.0.smithi016.stdout:3/458: dread - d3/df/d25/d2a/f7a zero size 2024-04-26T20:18:52.202 INFO:tasks.workunit.client.0.smithi016.stdout:3/459: creat d3/df/d25/d2a/d4a/f91 x:0 0 0 2024-04-26T20:18:52.206 INFO:tasks.workunit.client.0.smithi016.stdout:0/502: getdents d2/dc/d18/d5b 0 2024-04-26T20:18:52.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.203+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16d0073df0 con 0x7f16d0153af0 2024-04-26T20:18:52.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.207+0000 7f16ccc00640 1 -- 172.21.15.16:0/1299971067 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7f16c805b3e0 con 0x7f16d0153af0 2024-04-26T20:18:52.210 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:52.210 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:52.210 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.207+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f16ac0683b0 msgr2=0x7f16ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.207+0000 7f16d7000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f16ac0683b0 0x7f16ac06a870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f16c0007fd0 tx=0x7f16c0009040 comp rx=0 tx=0).stop 2024-04-26T20:18:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.207+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d0153af0 msgr2=0x7f16d00bf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.207+0000 7f16d7000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d0153af0 0x7f16d00bf2d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f16c8007e70 tx=0x7f16c800e4b0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.219 INFO:tasks.workunit.client.0.smithi016.stdout:6/438: sync 2024-04-26T20:18:52.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 shutdown_connections 2024-04-26T20:18:52.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f16ac0683b0 0x7f16ac06a870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16d0153af0 0x7f16d00bf2d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16d00c9010 0x7f16d01e4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 --2- 172.21.15.16:0/1299971067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16d00c7b80 0x7f16d01f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:52.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 >> 172.21.15.16:0/1299971067 conn(0x7f16d006c380 msgr2=0x7f16d006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:52.220 INFO:tasks.workunit.client.0.smithi016.stdout:2/535: sync 2024-04-26T20:18:52.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 shutdown_connections 2024-04-26T20:18:52.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:52.215+0000 7f16d7000640 1 -- 172.21.15.16:0/1299971067 wait complete. 2024-04-26T20:18:52.225 INFO:tasks.workunit.client.0.smithi016.stdout:6/439: creat d1/d21/d26/d1c/d2e/d53/d93/f9d x:0 0 0 2024-04-26T20:18:52.225 INFO:tasks.workunit.client.0.smithi016.stdout:6/440: fsync d1/d21/f39 0 2024-04-26T20:18:52.225 INFO:tasks.workunit.client.0.smithi016.stdout:6/441: read - d1/d21/d26/d1c/d2e/d53/f5f zero size 2024-04-26T20:18:52.225 INFO:tasks.workunit.client.0.smithi016.stdout:0/503: getdents d2/d40/d61 0 2024-04-26T20:18:52.225 INFO:tasks.workunit.client.0.smithi016.stdout:0/504: fsync d2/d20/d41/d87/f8b 0 2024-04-26T20:18:52.226 INFO:tasks.workunit.client.0.smithi016.stdout:0/505: mknod d2/d20/d41/d87/cae 0 2024-04-26T20:18:52.227 INFO:tasks.workunit.client.0.smithi016.stdout:0/506: mknod d2/d20/d41/d87/caf 0 2024-04-26T20:18:52.227 INFO:tasks.workunit.client.0.smithi016.stdout:0/507: getdents d2/d8/d3b 0 2024-04-26T20:18:52.228 INFO:tasks.workunit.client.0.smithi016.stdout:2/536: mknod d1d/d27/d2d/d5a/cb9 0 2024-04-26T20:18:52.237 INFO:tasks.workunit.client.0.smithi016.stdout:2/537: truncate d1d/d27/d2d/d6b/d7e/fb4 670432 0 2024-04-26T20:18:52.238 INFO:tasks.workunit.client.0.smithi016.stdout:0/508: mknod d2/d20/d41/d4c/cb0 0 2024-04-26T20:18:52.238 INFO:tasks.workunit.client.0.smithi016.stdout:7/557: dwrite d0/f14 [4194304,4194304] 0 2024-04-26T20:18:52.239 INFO:tasks.workunit.client.0.smithi016.stdout:2/538: truncate d1d/d27/d2d/d5a/f7a 958175 0 2024-04-26T20:18:52.239 INFO:tasks.workunit.client.0.smithi016.stdout:0/509: creat d2/d40/d61/fb1 x:0 0 0 2024-04-26T20:18:52.239 INFO:tasks.workunit.client.0.smithi016.stdout:2/539: write d1d/d20/d22/d39/f7d [458641,119619] 0 2024-04-26T20:18:52.239 INFO:tasks.workunit.client.0.smithi016.stdout:2/540: fsync d1d/d27/d2d/d6b/d7e/f8e 0 2024-04-26T20:18:52.239 INFO:tasks.workunit.client.0.smithi016.stdout:2/541: chown f12 189 1 2024-04-26T20:18:52.241 INFO:tasks.workunit.client.0.smithi016.stdout:7/558: symlink d0/d1/d6/lad 0 2024-04-26T20:18:52.244 INFO:tasks.workunit.client.0.smithi016.stdout:2/542: mkdir d1d/d20/d22/d88/da4/dba 0 2024-04-26T20:18:52.244 INFO:tasks.workunit.client.0.smithi016.stdout:2/543: chown d1d/d20/d22/d29/faf 1454 1 2024-04-26T20:18:52.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/559: symlink d0/lae 0 2024-04-26T20:18:52.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/560: readlink d0/d1/l32 0 2024-04-26T20:18:52.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/561: chown d0/d1/c18 0 1 2024-04-26T20:18:52.249 INFO:tasks.workunit.client.0.smithi016.stdout:7/562: readlink d0/d1/d46/l7b 0 2024-04-26T20:18:52.250 INFO:tasks.workunit.client.0.smithi016.stdout:7/563: rename d0/d1/d34/c47 to d0/d1/d46/caf 0 2024-04-26T20:18:52.259 INFO:tasks.workunit.client.0.smithi016.stdout:7/564: symlink d0/d83/lb0 0 2024-04-26T20:18:52.259 INFO:tasks.workunit.client.0.smithi016.stdout:1/608: write d3/d57/f44 [8019,83615] 0 2024-04-26T20:18:52.259 INFO:tasks.workunit.client.0.smithi016.stdout:3/460: dread d3/d9/d18/f34 [0,4194304] 0 2024-04-26T20:18:52.259 INFO:tasks.workunit.client.0.smithi016.stdout:3/461: stat d3/df/d25/d32/f3b 0 2024-04-26T20:18:52.261 INFO:tasks.workunit.client.0.smithi016.stdout:8/573: dwrite d9/d19/f33 [0,4194304] 0 2024-04-26T20:18:52.261 INFO:tasks.workunit.client.0.smithi016.stdout:8/574: dread - d9/d19/d45/d9e/f8e zero size 2024-04-26T20:18:52.272 INFO:tasks.workunit.client.0.smithi016.stdout:8/575: creat d9/d2f/fc8 x:0 0 0 2024-04-26T20:18:52.272 INFO:tasks.workunit.client.0.smithi016.stdout:8/576: dread - d9/d72/f98 zero size 2024-04-26T20:18:52.275 INFO:tasks.workunit.client.0.smithi016.stdout:5/729: dwrite f0 [4194304,4194304] 0 2024-04-26T20:18:52.275 INFO:tasks.workunit.client.0.smithi016.stdout:2/544: write d1d/d27/d2d/f70 [7092010,87263] 0 2024-04-26T20:18:52.275 INFO:tasks.workunit.client.0.smithi016.stdout:5/730: dread - d1/fa0 zero size 2024-04-26T20:18:52.275 INFO:tasks.workunit.client.0.smithi016.stdout:5/731: dread - d1/d78/d99/dde/d8f/fd5 zero size 2024-04-26T20:18:52.280 INFO:tasks.workunit.client.0.smithi016.stdout:4/427: dwrite d0/d1e/f4c [0,4194304] 0 2024-04-26T20:18:52.280 INFO:tasks.workunit.client.0.smithi016.stdout:5/732: truncate d1/d9/d11/f34 911646 0 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/733: chown d1/d9/d11/d4d/d72/dac/de3 97 1 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/734: creat d1/d9/d1c/d52/d74/fe9 x:0 0 0 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/735: read d1/d7d/fba [258955,68968] 0 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/736: readlink d1/d9/d1c/d52/d74/d5f/lc5 0 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/737: fsync d1/d9/d1c/d52/d74/f4f 0 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/738: read d1/d9/d11/f61 [309524,130294] 0 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:6/442: dread d1/f7 [8388608,4194304] 0 2024-04-26T20:18:52.281 INFO:tasks.workunit.client.0.smithi016.stdout:5/739: truncate d1/d9/d1c/d52/d74/d5f/fb5 1338312 0 2024-04-26T20:18:52.282 INFO:tasks.workunit.client.0.smithi016.stdout:5/740: truncate d1/d78/d99/fc6 4449315 0 2024-04-26T20:18:52.282 INFO:tasks.workunit.client.0.smithi016.stdout:6/443: truncate d1/d21/d26/d1c/d4e/f8b 472784 0 2024-04-26T20:18:52.282 INFO:tasks.workunit.client.0.smithi016.stdout:6/444: write d1/d12/f16 [1090773,14679] 0 2024-04-26T20:18:52.283 INFO:tasks.workunit.client.0.smithi016.stdout:6/445: write d1/f7 [5353445,87333] 0 2024-04-26T20:18:52.283 INFO:tasks.workunit.client.0.smithi016.stdout:5/741: link d1/d9f/ce4 d1/d9/d11/d4d/cea 0 2024-04-26T20:18:52.284 INFO:tasks.workunit.client.0.smithi016.stdout:6/446: symlink d1/d8/d2c/d3d/l9e 0 2024-04-26T20:18:52.292 INFO:tasks.workunit.client.0.smithi016.stdout:6/447: link d1/d21/d26/d1c/d2e/l65 d1/d21/d26/d1c/d4e/l9f 0 2024-04-26T20:18:52.292 INFO:tasks.workunit.client.0.smithi016.stdout:6/448: read - d1/d8/d46/f6c zero size 2024-04-26T20:18:52.292 INFO:tasks.workunit.client.0.smithi016.stdout:6/449: chown d1/l1a 178 1 2024-04-26T20:18:52.292 INFO:tasks.workunit.client.0.smithi016.stdout:0/510: dwrite d2/dc/d1e/d35/f63 [0,4194304] 0 2024-04-26T20:18:52.295 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-26T20:18:52.312 INFO:tasks.workunit.client.0.smithi016.stdout:9/627: dwrite d1/d2/d20/d49/d77/fbe [0,4194304] 0 2024-04-26T20:18:52.312 INFO:tasks.workunit.client.0.smithi016.stdout:9/628: write d1/d2/d20/d49/f7b [509980,2602] 0 2024-04-26T20:18:52.314 INFO:tasks.workunit.client.0.smithi016.stdout:7/565: dread d0/d1/d34/d25/d3f/d6d/f77 [0,4194304] 0 2024-04-26T20:18:52.342 INFO:tasks.workunit.client.0.smithi016.stdout:3/462: dwrite d3/df/d25/d32/f3b [0,4194304] 0 2024-04-26T20:18:52.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/629: mkdir d1/d2/d20/dda 0 2024-04-26T20:18:52.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/630: write d1/d59/d52/f98 [252166,31106] 0 2024-04-26T20:18:52.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/631: chown d1/d1b/f7d 912930714 1 2024-04-26T20:18:52.342 INFO:tasks.workunit.client.0.smithi016.stdout:9/632: truncate d1/d2/d20/d49/d77/fc3 188018 0 2024-04-26T20:18:52.343 INFO:tasks.workunit.client.0.smithi016.stdout:1/609: dwrite d3/d5/da/d66/da2/fb9 [0,4194304] 0 2024-04-26T20:18:52.346 INFO:tasks.workunit.client.0.smithi016.stdout:9/633: symlink d1/d2/d20/d49/d77/d2a/d75/d85/d9b/ldb 0 2024-04-26T20:18:52.349 INFO:tasks.workunit.client.0.smithi016.stdout:5/742: dread d1/d9/d1c/d52/d74/d5f/fb5 [0,4194304] 0 2024-04-26T20:18:52.349 INFO:tasks.workunit.client.0.smithi016.stdout:5/743: write d1/d78/d99/dde/f39 [712620,20179] 0 2024-04-26T20:18:52.351 INFO:tasks.workunit.client.0.smithi016.stdout:5/744: symlink d1/db8/leb 0 2024-04-26T20:18:52.351 INFO:tasks.workunit.client.0.smithi016.stdout:1/610: symlink d3/d5/d6/lc4 0 2024-04-26T20:18:52.361 INFO:tasks.workunit.client.0.smithi016.stdout:6/450: dwrite d1/d21/d26/f75 [0,4194304] 0 2024-04-26T20:18:52.361 INFO:tasks.workunit.client.0.smithi016.stdout:4/428: dwrite d0/d1e/d4e/d52/d88/d43/f4a [4194304,4194304] 0 2024-04-26T20:18:52.362 INFO:tasks.workunit.client.0.smithi016.stdout:1/611: write d3/d5/d6/d9/d2a/d3b/f98 [1793676,51199] 0 2024-04-26T20:18:52.365 INFO:tasks.workunit.client.0.smithi016.stdout:4/429: mknod d0/d1e/d4e/d52/d54/d87/c94 0 2024-04-26T20:18:52.373 INFO:tasks.workunit.client.0.smithi016.stdout:5/745: creat d1/d78/d99/dde/d8f/fec x:0 0 0 2024-04-26T20:18:52.373 INFO:tasks.workunit.client.0.smithi016.stdout:4/430: creat d0/d1e/d64/f95 x:0 0 0 2024-04-26T20:18:52.373 INFO:tasks.workunit.client.0.smithi016.stdout:4/431: stat d0/dd/d1b/f48 0 2024-04-26T20:18:52.373 INFO:tasks.workunit.client.0.smithi016.stdout:1/612: symlink d3/d5/lc5 0 2024-04-26T20:18:52.373 INFO:tasks.workunit.client.0.smithi016.stdout:4/432: mkdir d0/d96 0 2024-04-26T20:18:52.373 INFO:tasks.workunit.client.0.smithi016.stdout:4/433: mknod d0/d1e/d4e/d52/d54/d87/c97 0 2024-04-26T20:18:52.374 INFO:tasks.workunit.client.0.smithi016.stdout:1/613: dread d3/d5/d6/f7f [0,4194304] 0 2024-04-26T20:18:52.392 INFO:tasks.workunit.client.0.smithi016.stdout:9/634: dwrite d1/d2e/dc6/fca [0,4194304] 0 2024-04-26T20:18:52.392 INFO:tasks.workunit.client.0.smithi016.stdout:9/635: write d1/d2e/d40/fd9 [700267,98751] 0 2024-04-26T20:18:52.392 INFO:tasks.workunit.client.0.smithi016.stdout:9/636: chown d1/d2/fd 3 1 2024-04-26T20:18:52.424 INFO:tasks.workunit.client.0.smithi016.stdout:7/566: read d0/f14 [5679421,46195] 0 2024-04-26T20:18:52.426 INFO:tasks.workunit.client.0.smithi016.stdout:1/614: dread d3/d57/f6e [0,4194304] 0 2024-04-26T20:18:52.431 INFO:tasks.workunit.client.0.smithi016.stdout:7/567: mknod d0/d1/d34/d25/d50/cb1 0 2024-04-26T20:18:52.432 INFO:tasks.workunit.client.0.smithi016.stdout:7/568: mknod d0/d1/cb2 0 2024-04-26T20:18:52.434 INFO:tasks.workunit.client.0.smithi016.stdout:7/569: mkdir d0/d1/d88/db3 0 2024-04-26T20:18:52.435 INFO:tasks.workunit.client.0.smithi016.stdout:7/570: mkdir d0/d1/d46/db4 0 2024-04-26T20:18:52.436 INFO:tasks.workunit.client.0.smithi016.stdout:7/571: write d0/d1/d34/d25/d3f/f5f [808722,78479] 0 2024-04-26T20:18:52.436 INFO:tasks.workunit.client.0.smithi016.stdout:7/572: readlink d0/l1e 0 2024-04-26T20:18:52.437 INFO:tasks.workunit.client.0.smithi016.stdout:8/577: dwrite d9/d2f/f5e [0,4194304] 0 2024-04-26T20:18:52.438 INFO:tasks.workunit.client.0.smithi016.stdout:8/578: write d9/d23/d26/d2c/f85 [351728,91239] 0 2024-04-26T20:18:52.442 INFO:tasks.workunit.client.0.smithi016.stdout:7/573: link d0/d1/d34/d25/l91 d0/d1/d95/lb5 0 2024-04-26T20:18:52.442 INFO:tasks.workunit.client.0.smithi016.stdout:7/574: dread - d0/d1/d34/d25/d3f/d6d/d87/f7c zero size 2024-04-26T20:18:52.442 INFO:tasks.workunit.client.0.smithi016.stdout:0/511: write d2/d20/f67 [1844625,98509] 0 2024-04-26T20:18:52.442 INFO:tasks.workunit.client.0.smithi016.stdout:0/512: chown d2/dc/d45/f89 14443 1 2024-04-26T20:18:52.444 INFO:tasks.workunit.client.0.smithi016.stdout:0/513: getdents d2/d40/d61 0 2024-04-26T20:18:52.445 INFO:tasks.workunit.client.0.smithi016.stdout:9/637: write d1/d2e/dc6/fca [3517806,90765] 0 2024-04-26T20:18:52.445 INFO:tasks.workunit.client.0.smithi016.stdout:9/638: readlink d1/d2/d20/d49/d77/d2a/l34 0 2024-04-26T20:18:52.474 INFO:tasks.workunit.client.0.smithi016.stdout:4/434: dread d0/f46 [0,4194304] 0 2024-04-26T20:18:52.474 INFO:tasks.workunit.client.0.smithi016.stdout:2/545: dwrite d1d/d20/d7c/f91 [0,4194304] 0 2024-04-26T20:18:52.480 INFO:tasks.workunit.client.0.smithi016.stdout:7/575: write d0/f29 [2024854,32121] 0 2024-04-26T20:18:52.480 INFO:tasks.workunit.client.0.smithi016.stdout:4/435: creat d0/dd/f98 x:0 0 0 2024-04-26T20:18:52.481 INFO:tasks.workunit.client.0.smithi016.stdout:2/546: mknod d1d/d27/d2d/d5a/d9c/cbb 0 2024-04-26T20:18:52.486 INFO:tasks.workunit.client.0.smithi016.stdout:2/547: mkdir d1d/d20/d7c/dbc 0 2024-04-26T20:18:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:4/436: read d0/dd/d19/d1f/f45 [821388,94350] 0 2024-04-26T20:18:52.487 INFO:tasks.workunit.client.0.smithi016.stdout:7/576: creat d0/d67/fb6 x:0 0 0 2024-04-26T20:18:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:2/548: creat d1d/d20/d22/d89/fbd x:0 0 0 2024-04-26T20:18:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:2/549: fdatasync d1d/d2a/fb3 0 2024-04-26T20:18:52.488 INFO:tasks.workunit.client.0.smithi016.stdout:2/550: getdents d1d/d20/d22/d88/da4/dba 0 2024-04-26T20:18:52.489 INFO:tasks.workunit.client.0.smithi016.stdout:7/577: mkdir d0/d1/d34/db7 0 2024-04-26T20:18:52.489 INFO:tasks.workunit.client.0.smithi016.stdout:7/578: write d0/d1/d4b/f72 [1281200,105618] 0 2024-04-26T20:18:52.491 INFO:tasks.workunit.client.0.smithi016.stdout:2/551: rename d1d/d27/d2d/l68 to d1d/d27/d2d/d5a/d9c/lbe 0 2024-04-26T20:18:52.493 INFO:tasks.workunit.client.0.smithi016.stdout:8/579: dwrite d9/d2f/f5e [0,4194304] 0 2024-04-26T20:18:52.496 INFO:tasks.workunit.client.0.smithi016.stdout:2/552: mknod d1d/d2a/cbf 0 2024-04-26T20:18:52.497 INFO:tasks.workunit.client.0.smithi016.stdout:1/615: dwrite d3/d5/da/f26 [0,4194304] 0 2024-04-26T20:18:52.504 INFO:tasks.workunit.client.0.smithi016.stdout:2/553: creat d1d/d52/fc0 x:0 0 0 2024-04-26T20:18:52.504 INFO:tasks.workunit.client.0.smithi016.stdout:2/554: chown d1d/d20/d22/d39/f45 19903933 1 2024-04-26T20:18:52.504 INFO:tasks.workunit.client.0.smithi016.stdout:2/555: readlink d1d/d27/d2d/d6b/l93 0 2024-04-26T20:18:52.507 INFO:tasks.workunit.client.0.smithi016.stdout:2/556: truncate f7 5682761 0 2024-04-26T20:18:52.507 INFO:tasks.workunit.client.0.smithi016.stdout:0/514: dwrite d2/dc/d45/f84 [0,4194304] 0 2024-04-26T20:18:52.537 INFO:tasks.workunit.client.0.smithi016.stdout:1/616: write d3/d5/da/d66/d8c/f6a [679997,99459] 0 2024-04-26T20:18:52.542 INFO:tasks.workunit.client.0.smithi016.stdout:8/580: dwrite d9/d23/d26/fbf [0,4194304] 0 2024-04-26T20:18:52.543 INFO:tasks.workunit.client.0.smithi016.stdout:8/581: rmdir d9/d19 39 2024-04-26T20:18:52.544 INFO:tasks.workunit.client.0.smithi016.stdout:8/582: rename d9/d66/c89 to d9/d72/cc9 0 2024-04-26T20:18:52.545 INFO:tasks.workunit.client.0.smithi016.stdout:8/583: rename d9/ca1 to d9/d23/d26/cca 0 2024-04-26T20:18:52.546 INFO:tasks.workunit.client.0.smithi016.stdout:8/584: mknod d9/d66/d73/ccb 0 2024-04-26T20:18:52.641 INFO:tasks.workunit.client.0.smithi016.stdout:2/557: dwrite d1d/d2a/f31 [0,4194304] 0 2024-04-26T20:18:52.676 INFO:tasks.workunit.client.0.smithi016.stdout:5/746: dwrite d1/d9/d25/dc0/fd6 [0,4194304] 0 2024-04-26T20:18:52.678 INFO:tasks.workunit.client.0.smithi016.stdout:5/747: mknod d1/d9/d11/d4d/ced 0 2024-04-26T20:18:52.684 INFO:tasks.workunit.client.0.smithi016.stdout:5/748: write d1/d78/d99/dde/f6a [962396,31188] 0 2024-04-26T20:18:52.684 INFO:tasks.workunit.client.0.smithi016.stdout:5/749: stat d1/d78 0 2024-04-26T20:18:52.707 INFO:tasks.workunit.client.0.smithi016.stdout:4/437: write d0/dd/d1b/f48 [698984,38875] 0 2024-04-26T20:18:52.707 INFO:tasks.workunit.client.0.smithi016.stdout:4/438: read - d0/dd/d1b/f27 zero size 2024-04-26T20:18:52.708 INFO:tasks.workunit.client.0.smithi016.stdout:4/439: write d0/dd/d19/f8a [764674,115203] 0 2024-04-26T20:18:52.708 INFO:tasks.workunit.client.0.smithi016.stdout:4/440: chown d0/f46 133 1 2024-04-26T20:18:52.708 INFO:tasks.workunit.client.0.smithi016.stdout:4/441: write d0/dd/d19/d57/f89 [209825,88837] 0 2024-04-26T20:18:52.709 INFO:tasks.workunit.client.0.smithi016.stdout:4/442: link d0/dd/d1b/l47 d0/dd/d66/d6f/d7f/l99 0 2024-04-26T20:18:52.710 INFO:tasks.workunit.client.0.smithi016.stdout:4/443: read - d0/f36 zero size 2024-04-26T20:18:52.711 INFO:tasks.workunit.client.0.smithi016.stdout:4/444: mknod d0/dd/d19/d57/c9a 0 2024-04-26T20:18:52.711 INFO:tasks.workunit.client.0.smithi016.stdout:4/445: chown d0/fa 5836 1 2024-04-26T20:18:52.712 INFO:tasks.workunit.client.0.smithi016.stdout:4/446: unlink d0/d1e/d4e/d52/d88/d43/d5a/l93 0 2024-04-26T20:18:52.712 INFO:tasks.workunit.client.0.smithi016.stdout:4/447: stat d0/dd/d1b/f27 0 2024-04-26T20:18:52.718 INFO:tasks.workunit.client.0.smithi016.stdout:8/585: dwrite d9/d19/d45/d3f/d64/f57 [0,4194304] 0 2024-04-26T20:18:52.718 INFO:tasks.workunit.client.0.smithi016.stdout:5/750: dread d1/d9/f16 [4194304,4194304] 0 2024-04-26T20:18:52.718 INFO:tasks.workunit.client.0.smithi016.stdout:5/751: chown d1/d9/d25/fc2 120698 1 2024-04-26T20:18:52.729 INFO:tasks.workunit.client.0.smithi016.stdout:4/448: dread d0/fa [0,4194304] 0 2024-04-26T20:18:52.732 INFO:tasks.workunit.client.0.smithi016.stdout:4/449: creat d0/dd/d19/d1f/f9b x:0 0 0 2024-04-26T20:18:52.748 INFO:tasks.workunit.client.0.smithi016.stdout:7/579: dwrite d0/d1/d46/f84 [0,4194304] 0 2024-04-26T20:18:52.778 INFO:tasks.workunit.client.0.smithi016.stdout:7/580: rename d0/d1/d34/d25/d50/fa6 to d0/d1/d34/d25/fb8 0 2024-04-26T20:18:52.780 INFO:tasks.workunit.client.0.smithi016.stdout:7/581: mknod d0/d1/d34/db7/cb9 0 2024-04-26T20:18:52.780 INFO:tasks.workunit.client.0.smithi016.stdout:7/582: chown d0/d1/d34/d25/d3f/d6d/d87/da3 19507 1 2024-04-26T20:18:52.780 INFO:tasks.workunit.client.0.smithi016.stdout:7/583: fsync d0/d1/d34/d25/d3f/d6d/f77 0 2024-04-26T20:18:52.813 INFO:tasks.workunit.client.0.smithi016.stdout:2/558: dread d1d/d20/d22/f2c [0,4194304] 0 2024-04-26T20:18:52.827 INFO:tasks.workunit.client.0.smithi016.stdout:1/617: dread d3/d5/da/d66/d8c/f93 [0,4194304] 0 2024-04-26T20:18:52.827 INFO:tasks.workunit.client.0.smithi016.stdout:1/618: chown d3/d5/d6/d9/d2a/d3d/c64 2037743503 1 2024-04-26T20:18:52.832 INFO:tasks.workunit.client.0.smithi016.stdout:0/515: dwrite d2/d20/fad [0,4194304] 0 2024-04-26T20:18:52.841 INFO:tasks.workunit.client.0.smithi016.stdout:1/619: write d3/d57/f35 [595502,20267] 0 2024-04-26T20:18:52.841 INFO:tasks.workunit.client.0.smithi016.stdout:7/584: dwrite d0/d1/d4b/f8e [0,4194304] 0 2024-04-26T20:18:52.841 INFO:tasks.workunit.client.0.smithi016.stdout:1/620: fdatasync d3/d5/d6/d9/d2a/d3b/faa 0 2024-04-26T20:18:52.845 INFO:tasks.workunit.client.0.smithi016.stdout:7/585: mkdir d0/d51/dba 0 2024-04-26T20:18:52.846 INFO:tasks.workunit.client.0.smithi016.stdout:1/621: creat d3/d5/d6/d50/d79/da7/fc6 x:0 0 0 2024-04-26T20:18:52.849 INFO:tasks.workunit.client.0.smithi016.stdout:7/586: truncate d0/f94 163340 0 2024-04-26T20:18:52.856 INFO:tasks.workunit.client.0.smithi016.stdout:4/450: dwrite d0/d1e/f21 [0,4194304] 0 2024-04-26T20:18:52.862 INFO:tasks.workunit.client.0.smithi016.stdout:7/587: write d0/d1/f30 [918875,48381] 0 2024-04-26T20:18:52.864 INFO:tasks.workunit.client.0.smithi016.stdout:7/588: rmdir d0/d1/d34/d25 39 2024-04-26T20:18:52.864 INFO:tasks.workunit.client.0.smithi016.stdout:7/589: truncate d0/d1/d34/d25/d50/fa8 250109 0 2024-04-26T20:18:52.865 INFO:tasks.workunit.client.0.smithi016.stdout:7/590: mknod d0/d83/cbb 0 2024-04-26T20:18:52.876 INFO:tasks.workunit.client.0.smithi016.stdout:2/559: dwrite d1d/d27/d2d/f70 [4194304,4194304] 0 2024-04-26T20:18:52.877 INFO:tasks.workunit.client.0.smithi016.stdout:2/560: rename d1d/d20/d22/d98/caa to d1d/d27/d2d/d5a/d9c/cc1 0 2024-04-26T20:18:52.879 INFO:tasks.workunit.client.0.smithi016.stdout:2/561: rename d1d/d27/d2d/d6b/d7e/f8e to d1d/d20/d22/fc2 0 2024-04-26T20:18:52.879 INFO:tasks.workunit.client.0.smithi016.stdout:2/562: rmdir d1d/d52 39 2024-04-26T20:18:52.881 INFO:tasks.workunit.client.0.smithi016.stdout:2/563: rename d1d/la1 to d1d/d27/d49/lc3 0 2024-04-26T20:18:52.881 INFO:tasks.workunit.client.0.smithi016.stdout:2/564: write d1d/d27/d49/f92 [560519,52010] 0 2024-04-26T20:18:52.883 INFO:tasks.workunit.client.0.smithi016.stdout:0/516: dwrite d2/d8/d37/d5d/f64 [0,4194304] 0 2024-04-26T20:18:52.884 INFO:tasks.workunit.client.0.smithi016.stdout:2/565: rmdir d1d/d20/d22/d88/da4/dba 0 2024-04-26T20:18:52.885 INFO:tasks.workunit.client.0.smithi016.stdout:2/566: mknod d1d/cc4 0 2024-04-26T20:18:52.885 INFO:tasks.workunit.client.0.smithi016.stdout:2/567: readlink d1d/d27/d2d/d5a/d9c/l65 0 2024-04-26T20:18:52.886 INFO:tasks.workunit.client.0.smithi016.stdout:2/568: dread - d1d/d27/d2d/d6b/d7e/fad zero size 2024-04-26T20:18:52.886 INFO:tasks.workunit.client.0.smithi016.stdout:2/569: write d1d/d20/d22/d88/f95 [552250,27574] 0 2024-04-26T20:18:52.913 INFO:tasks.workunit.client.0.smithi016.stdout:1/622: dread d3/d5/da/d66/d8c/f6a [0,4194304] 0 2024-04-26T20:18:52.915 INFO:tasks.workunit.client.0.smithi016.stdout:1/623: rename d3/l7d to d3/d5/d6/d9/lc7 0 2024-04-26T20:18:52.932 INFO:tasks.workunit.client.0.smithi016.stdout:4/451: dwrite d0/dd/d19/d1f/f3e [0,4194304] 0 2024-04-26T20:18:52.944 INFO:tasks.workunit.client.0.smithi016.stdout:4/452: mkdir d0/d1e/d4e/d52/d88/d43/d9c 0 2024-04-26T20:18:52.947 INFO:tasks.workunit.client.0.smithi016.stdout:0/517: dwrite d2/d20/f9e [0,4194304] 0 2024-04-26T20:18:52.953 INFO:tasks.workunit.client.0.smithi016.stdout:0/518: getdents d2/dc/d45 0 2024-04-26T20:18:52.953 INFO:tasks.workunit.client.0.smithi016.stdout:0/519: chown d2/dc/d1e/d25 363457 1 2024-04-26T20:18:52.955 INFO:tasks.workunit.client.0.smithi016.stdout:0/520: unlink d2/d40/d61/f8a 0 2024-04-26T20:18:52.957 INFO:tasks.workunit.client.0.smithi016.stdout:0/521: getdents d2/d8/d37/d70 0 2024-04-26T20:18:52.957 INFO:tasks.workunit.client.0.smithi016.stdout:0/522: chown d2/d20/d41/d4c/d4e/f86 350881 1 2024-04-26T20:18:52.957 INFO:tasks.workunit.client.0.smithi016.stdout:0/523: write d2/d20/d41/d87/f8b [329709,25326] 0 2024-04-26T20:18:52.957 INFO:tasks.workunit.client.0.smithi016.stdout:0/524: chown d2/dc/d45/c76 29 1 2024-04-26T20:18:52.958 INFO:tasks.workunit.client.0.smithi016.stdout:0/525: mknod d2/dc/d1e/cb2 0 2024-04-26T20:18:52.958 INFO:tasks.workunit.client.0.smithi016.stdout:0/526: truncate d2/dc/f1d 2685585 0 2024-04-26T20:18:52.966 INFO:tasks.workunit.client.0.smithi016.stdout:0/527: dread d2/dc/f71 [0,4194304] 0 2024-04-26T20:18:52.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/528: creat d2/dc/d18/d24/fb3 x:0 0 0 2024-04-26T20:18:52.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/529: fsync d2/dc/d1e/d35/f7a 0 2024-04-26T20:18:52.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/530: chown d2/d20/d41/f50 13655 1 2024-04-26T20:18:52.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/531: chown d2/d8/d37/d5d/d60 498820 1 2024-04-26T20:18:52.974 INFO:tasks.workunit.client.0.smithi016.stdout:2/570: dwrite d1d/d20/d22/d88/da4/fa5 [0,4194304] 0 2024-04-26T20:18:52.985 INFO:tasks.workunit.client.0.smithi016.stdout:2/571: dread d1d/d27/d49/f56 [0,4194304] 0 2024-04-26T20:18:52.987 INFO:tasks.workunit.client.0.smithi016.stdout:2/572: mknod d1d/d27/d2d/d6b/cc5 0 2024-04-26T20:18:53.019 INFO:tasks.workunit.client.0.smithi016.stdout:0/532: dwrite d2/d20/d41/d4c/d4e/f6d [0,4194304] 0 2024-04-26T20:18:53.022 INFO:tasks.workunit.client.0.smithi016.stdout:0/533: symlink d2/d8/d37/d70/lb4 0 2024-04-26T20:18:53.022 INFO:tasks.workunit.client.0.smithi016.stdout:0/534: chown d2/d40 5 1 2024-04-26T20:18:53.023 INFO:tasks.workunit.client.0.smithi016.stdout:0/535: creat d2/d8/d37/d70/fb5 x:0 0 0 2024-04-26T20:18:53.028 INFO:tasks.workunit.client.0.smithi016.stdout:4/453: dwrite d0/dd/d19/d1f/f58 [0,4194304] 0 2024-04-26T20:18:53.029 INFO:tasks.workunit.client.0.smithi016.stdout:4/454: readlink d0/d1e/d4e/d52/d88/d43/l5d 0 2024-04-26T20:18:53.056 INFO:tasks.workunit.client.0.smithi016.stdout:7/591: dwrite d0/d67/fb6 [0,4194304] 0 2024-04-26T20:18:53.063 INFO:tasks.workunit.client.0.smithi016.stdout:7/592: mkdir d0/d1/d34/d25/dbc 0 2024-04-26T20:18:53.069 INFO:tasks.workunit.client.0.smithi016.stdout:3/463: sync 2024-04-26T20:18:53.072 INFO:tasks.workunit.client.0.smithi016.stdout:2/573: dread d1d/d27/f3f [0,4194304] 0 2024-04-26T20:18:53.074 INFO:tasks.workunit.client.0.smithi016.stdout:2/574: creat d1d/d27/fc6 x:0 0 0 2024-04-26T20:18:53.086 INFO:tasks.workunit.client.0.smithi016.stdout:3/464: dread d3/d9/f3d [0,4194304] 0 2024-04-26T20:18:53.093 INFO:tasks.workunit.client.0.smithi016.stdout:4/455: write d0/d1e/f4c [158758,22355] 0 2024-04-26T20:18:53.093 INFO:tasks.workunit.client.0.smithi016.stdout:4/456: chown d0/fa 166537 1 2024-04-26T20:18:53.093 INFO:tasks.workunit.client.0.smithi016.stdout:4/457: fdatasync d0/dd/d19/f24 0 2024-04-26T20:18:53.103 INFO:tasks.workunit.client.0.smithi016.stdout:7/593: dread d0/d51/f5a [0,4194304] 0 2024-04-26T20:18:53.103 INFO:tasks.workunit.client.0.smithi016.stdout:4/458: dread d0/dd/f12 [0,4194304] 0 2024-04-26T20:18:53.103 INFO:tasks.workunit.client.0.smithi016.stdout:1/624: dwrite d3/d5/fb5 [0,4194304] 0 2024-04-26T20:18:53.107 INFO:tasks.workunit.client.0.smithi016.stdout:7/594: creat d0/d1/d34/db7/fbd x:0 0 0 2024-04-26T20:18:53.108 INFO:tasks.workunit.client.0.smithi016.stdout:1/625: creat d3/d5/da/d66/d8c/d84/d86/fc8 x:0 0 0 2024-04-26T20:18:53.108 INFO:tasks.workunit.client.0.smithi016.stdout:1/626: stat d3/d5/d6/l3a 0 2024-04-26T20:18:53.109 INFO:tasks.workunit.client.0.smithi016.stdout:5/752: sync 2024-04-26T20:18:53.109 INFO:tasks.workunit.client.0.smithi016.stdout:9/639: sync 2024-04-26T20:18:53.109 INFO:tasks.workunit.client.0.smithi016.stdout:9/640: chown d1/d2/d20/d49/cb5 105332 1 2024-04-26T20:18:53.110 INFO:tasks.workunit.client.0.smithi016.stdout:6/451: sync 2024-04-26T20:18:53.110 INFO:tasks.workunit.client.0.smithi016.stdout:8/586: sync 2024-04-26T20:18:53.111 INFO:tasks.workunit.client.0.smithi016.stdout:9/641: creat d1/d66/db1/fdc x:0 0 0 2024-04-26T20:18:53.111 INFO:tasks.workunit.client.0.smithi016.stdout:9/642: chown d1/d2/d20/d49/c4f 1 1 2024-04-26T20:18:53.111 INFO:tasks.workunit.client.0.smithi016.stdout:9/643: fdatasync d1/d2/d43/fd8 0 2024-04-26T20:18:53.112 INFO:tasks.workunit.client.0.smithi016.stdout:6/452: creat d1/d21/d26/d1c/d4e/fa0 x:0 0 0 2024-04-26T20:18:53.112 INFO:tasks.workunit.client.0.smithi016.stdout:6/453: write d1/d21/d26/d1c/d2e/f33 [1506981,67671] 0 2024-04-26T20:18:53.112 INFO:tasks.workunit.client.0.smithi016.stdout:6/454: chown d1/d21/d26/d1c/f4d 24520 1 2024-04-26T20:18:53.113 INFO:tasks.workunit.client.0.smithi016.stdout:5/753: getdents d1/d9/d1c/d52 0 2024-04-26T20:18:53.113 INFO:tasks.workunit.client.0.smithi016.stdout:8/587: symlink d9/d19/d45/lcc 0 2024-04-26T20:18:53.118 INFO:tasks.workunit.client.0.smithi016.stdout:9/644: link d1/d2e/d40/f5a d1/d2/fdd 0 2024-04-26T20:18:53.119 INFO:tasks.workunit.client.0.smithi016.stdout:9/645: write d1/d2/d20/d49/d77/d3e/d5e/d93/fcb [540059,90454] 0 2024-04-26T20:18:53.120 INFO:tasks.workunit.client.0.smithi016.stdout:5/754: mknod d1/d78/cee 0 2024-04-26T20:18:53.120 INFO:tasks.workunit.client.0.smithi016.stdout:5/755: stat d1/fa0 0 2024-04-26T20:18:53.120 INFO:tasks.workunit.client.0.smithi016.stdout:5/756: fdatasync d1/d78/d99/dde/f6a 0 2024-04-26T20:18:53.122 INFO:tasks.workunit.client.0.smithi016.stdout:5/757: link d1/d9/d1c/d52/d74/f32 d1/d9/fef 0 2024-04-26T20:18:53.124 INFO:tasks.workunit.client.0.smithi016.stdout:5/758: symlink d1/d78/d99/dde/lf0 0 2024-04-26T20:18:53.129 INFO:tasks.workunit.client.0.smithi016.stdout:5/759: creat d1/d9/d25/ff1 x:0 0 0 2024-04-26T20:18:53.130 INFO:tasks.workunit.client.0.smithi016.stdout:5/760: symlink d1/d9/d1c/d52/lf2 0 2024-04-26T20:18:53.131 INFO:tasks.workunit.client.0.smithi016.stdout:1/627: dread d3/d5/d6/d9/f4e [0,4194304] 0 2024-04-26T20:18:53.131 INFO:tasks.workunit.client.0.smithi016.stdout:5/761: mknod d1/d9/d1c/cf3 0 2024-04-26T20:18:53.131 INFO:tasks.workunit.client.0.smithi016.stdout:5/762: chown d1/d9f/fb7 30106 1 2024-04-26T20:18:53.133 INFO:tasks.workunit.client.0.smithi016.stdout:1/628: creat d3/d5/da/d66/d8c/fc9 x:0 0 0 2024-04-26T20:18:53.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/629: fdatasync d3/d5/da/f29 0 2024-04-26T20:18:53.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/630: chown d3/d5/lc5 6168 1 2024-04-26T20:18:53.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/631: readlink d3/d5/d6/l3a 0 2024-04-26T20:18:53.134 INFO:tasks.workunit.client.0.smithi016.stdout:5/763: rename d1/d9/d11/d4d/c6c to d1/d9f/cf4 0 2024-04-26T20:18:53.134 INFO:tasks.workunit.client.0.smithi016.stdout:5/764: stat d1/d9/d1c/d52/d74/lad 0 2024-04-26T20:18:53.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/632: getdents d3/d5/d6/d50/d58 0 2024-04-26T20:18:53.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/633: chown d3/d5/d6/d9/c2b 50 1 2024-04-26T20:18:53.136 INFO:tasks.workunit.client.0.smithi016.stdout:3/465: dwrite d3/f19 [4194304,4194304] 0 2024-04-26T20:18:53.138 INFO:tasks.workunit.client.0.smithi016.stdout:5/765: unlink d1/d9/d11/d4d/c4e 0 2024-04-26T20:18:53.138 INFO:tasks.workunit.client.0.smithi016.stdout:5/766: chown d1/d78/ld7 440 1 2024-04-26T20:18:53.140 INFO:tasks.workunit.client.0.smithi016.stdout:1/634: creat d3/d5/d8d/dab/fca x:0 0 0 2024-04-26T20:18:53.141 INFO:tasks.workunit.client.0.smithi016.stdout:1/635: chown d3/d5/da/d66/d8c/d84/lbd 71122572 1 2024-04-26T20:18:53.141 INFO:tasks.workunit.client.0.smithi016.stdout:1/636: truncate d3/d5/d6/d9/d2a/d3b/faa 30467 0 2024-04-26T20:18:53.145 INFO:tasks.workunit.client.0.smithi016.stdout:3/466: creat d3/df/d25/d2a/d69/f92 x:0 0 0 2024-04-26T20:18:53.146 INFO:tasks.workunit.client.0.smithi016.stdout:4/459: dread d0/d1e/d4e/d52/d88/d43/f4a [0,4194304] 0 2024-04-26T20:18:53.146 INFO:tasks.workunit.client.0.smithi016.stdout:1/637: creat d3/d5/d6/d5a/dbf/fcb x:0 0 0 2024-04-26T20:18:53.146 INFO:tasks.workunit.client.0.smithi016.stdout:4/460: mkdir d0/d1e/d64/d9d 0 2024-04-26T20:18:53.152 INFO:tasks.workunit.client.0.smithi016.stdout:1/638: creat d3/d5/d6/d5a/dbf/fcc x:0 0 0 2024-04-26T20:18:53.152 INFO:tasks.workunit.client.0.smithi016.stdout:4/461: creat d0/dd/d66/d6f/d7f/f9e x:0 0 0 2024-04-26T20:18:53.162 INFO:tasks.workunit.client.0.smithi016.stdout:5/767: write d1/d9/d25/f42 [2720878,58267] 0 2024-04-26T20:18:53.164 INFO:tasks.workunit.client.0.smithi016.stdout:6/455: dwrite d1/d21/d26/d1c/d2e/f64 [0,4194304] 0 2024-04-26T20:18:53.171 INFO:tasks.workunit.client.0.smithi016.stdout:4/462: write d0/d1e/d4e/d52/d88/d43/f56 [542600,21247] 0 2024-04-26T20:18:53.175 INFO:tasks.workunit.client.0.smithi016.stdout:6/456: truncate d1/d21/d26/f75 2276385 0 2024-04-26T20:18:53.176 INFO:tasks.workunit.client.0.smithi016.stdout:9/646: dread d1/d2e/f35 [0,4194304] 0 2024-04-26T20:18:53.181 INFO:tasks.workunit.client.0.smithi016.stdout:9/647: mkdir d1/d2/d20/dde 0 2024-04-26T20:18:53.181 INFO:tasks.workunit.client.0.smithi016.stdout:9/648: write d1/d2/d43/fd8 [2016361,46127] 0 2024-04-26T20:18:53.182 INFO:tasks.workunit.client.0.smithi016.stdout:3/467: dwrite d3/df/d25/f28 [0,4194304] 0 2024-04-26T20:18:53.183 INFO:tasks.workunit.client.0.smithi016.stdout:9/649: creat d1/d2/d20/d49/d77/d2a/d33/fdf x:0 0 0 2024-04-26T20:18:53.185 INFO:tasks.workunit.client.0.smithi016.stdout:3/468: creat d3/d70/d8b/f93 x:0 0 0 2024-04-26T20:18:53.188 INFO:tasks.workunit.client.0.smithi016.stdout:9/650: rename d1/d66/f70 to d1/d2/d20/d49/d77/d3e/d5e/fe0 0 2024-04-26T20:18:53.191 INFO:tasks.workunit.client.0.smithi016.stdout:9/651: rename d1/d2/d20/d49/d77/d2a/d75/d85/l9a to d1/d59/d52/d8c/le1 0 2024-04-26T20:18:53.195 INFO:tasks.workunit.client.0.smithi016.stdout:7/595: dwrite d0/d1/d34/d25/d50/f9e [0,4194304] 0 2024-04-26T20:18:53.197 INFO:tasks.workunit.client.0.smithi016.stdout:7/596: rmdir d0/d51/da7 0 2024-04-26T20:18:53.198 INFO:tasks.workunit.client.0.smithi016.stdout:9/652: write d1/d2e/dc6/f54 [222825,10654] 0 2024-04-26T20:18:53.200 INFO:tasks.workunit.client.0.smithi016.stdout:7/597: mknod d0/d1/d34/d25/d3f/d6d/cbe 0 2024-04-26T20:18:53.202 INFO:tasks.workunit.client.0.smithi016.stdout:9/653: rename d1/d2e/dc6/ld0 to d1/d2e/dd3/le2 0 2024-04-26T20:18:53.220 INFO:tasks.workunit.client.0.smithi016.stdout:8/588: dwrite d9/fa2 [0,4194304] 0 2024-04-26T20:18:53.221 INFO:tasks.workunit.client.0.smithi016.stdout:5/768: dread d1/d9/d25/f79 [0,4194304] 0 2024-04-26T20:18:53.241 INFO:tasks.workunit.client.0.smithi016.stdout:6/457: dread f0 [0,4194304] 0 2024-04-26T20:18:53.241 INFO:tasks.workunit.client.0.smithi016.stdout:6/458: truncate d1/d3a/f8d 5223466 0 2024-04-26T20:18:53.244 INFO:tasks.workunit.client.0.smithi016.stdout:6/459: mknod d1/d21/d26/d1c/d7b/d82/d8f/ca1 0 2024-04-26T20:18:53.244 INFO:tasks.workunit.client.0.smithi016.stdout:6/460: write d1/d21/d26/d25/f35 [1878164,92524] 0 2024-04-26T20:18:53.248 INFO:tasks.workunit.client.0.smithi016.stdout:6/461: mknod d1/d12/d90/ca2 0 2024-04-26T20:18:53.254 INFO:tasks.workunit.client.0.smithi016.stdout:5/769: write d1/f5a [688124,96346] 0 2024-04-26T20:18:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:5/770: dread - d1/d9/d1c/d52/d74/fc7 zero size 2024-04-26T20:18:53.257 INFO:tasks.workunit.client.0.smithi016.stdout:5/771: fsync d1/d9/d11/d4d/f6d 0 2024-04-26T20:18:53.271 INFO:tasks.workunit.client.0.smithi016.stdout:8/589: read d9/f90 [238293,120205] 0 2024-04-26T20:18:53.272 INFO:tasks.workunit.client.0.smithi016.stdout:1/639: dwrite d3/d5/d6/d50/d58/fc1 [0,4194304] 0 2024-04-26T20:18:53.275 INFO:tasks.workunit.client.0.smithi016.stdout:6/462: write d1/fd [4096790,33017] 0 2024-04-26T20:18:53.276 INFO:tasks.workunit.client.0.smithi016.stdout:8/590: mkdir d9/d72/d74/dcd 0 2024-04-26T20:18:53.276 INFO:tasks.workunit.client.0.smithi016.stdout:8/591: dread - d9/fa7 zero size 2024-04-26T20:18:53.276 INFO:tasks.workunit.client.0.smithi016.stdout:8/592: fdatasync d9/d19/d45/d9e/d50/dad/fc4 0 2024-04-26T20:18:53.278 INFO:tasks.workunit.client.0.smithi016.stdout:1/640: mknod d3/d5/d6/d9/ccd 0 2024-04-26T20:18:53.280 INFO:tasks.workunit.client.0.smithi016.stdout:8/593: mknod d9/d19/d45/d9e/d50/cce 0 2024-04-26T20:18:53.280 INFO:tasks.workunit.client.0.smithi016.stdout:8/594: chown d9/f1b 66 1 2024-04-26T20:18:53.281 INFO:tasks.workunit.client.0.smithi016.stdout:9/654: dwrite d1/d2/f6 [0,4194304] 0 2024-04-26T20:18:53.281 INFO:tasks.workunit.client.0.smithi016.stdout:9/655: chown d1/d59/d52/fba 0 1 2024-04-26T20:18:53.282 INFO:tasks.workunit.client.0.smithi016.stdout:1/641: rename d3/d5/d6/d50/f60 to d3/d5/d6/d9/fce 0 2024-04-26T20:18:53.282 INFO:tasks.workunit.client.0.smithi016.stdout:1/642: dread - d3/d5/d8d/dab/fca zero size 2024-04-26T20:18:53.285 INFO:tasks.workunit.client.0.smithi016.stdout:3/469: dwrite d3/d9/d2d/f47 [0,4194304] 0 2024-04-26T20:18:53.285 INFO:tasks.workunit.client.0.smithi016.stdout:7/598: dwrite d0/f42 [0,4194304] 0 2024-04-26T20:18:53.285 INFO:tasks.workunit.client.0.smithi016.stdout:7/599: dread - d0/d1/d34/d25/d3f/d6d/d87/f7c zero size 2024-04-26T20:18:53.286 INFO:tasks.workunit.client.0.smithi016.stdout:1/643: unlink d3/d5/cb3 0 2024-04-26T20:18:53.289 INFO:tasks.workunit.client.0.smithi016.stdout:8/595: rename d9/d2f/f96 to d9/d66/d73/fcf 0 2024-04-26T20:18:53.291 INFO:tasks.workunit.client.0.smithi016.stdout:6/463: rmdir d1/d8/d3b 0 2024-04-26T20:18:53.292 INFO:tasks.workunit.client.0.smithi016.stdout:7/600: dread - d0/f8c zero size 2024-04-26T20:18:53.296 INFO:tasks.workunit.client.0.smithi016.stdout:3/470: rename d3/df/f1e to d3/df/d25/d2a/f94 0 2024-04-26T20:18:53.297 INFO:tasks.workunit.client.0.smithi016.stdout:7/601: creat d0/d1/fbf x:0 0 0 2024-04-26T20:18:53.297 INFO:tasks.workunit.client.0.smithi016.stdout:6/464: dread d1/d12/f16 [0,4194304] 0 2024-04-26T20:18:53.300 INFO:tasks.workunit.client.0.smithi016.stdout:3/471: unlink f2 0 2024-04-26T20:18:53.301 INFO:tasks.workunit.client.0.smithi016.stdout:7/602: getdents d0/d1/d95 0 2024-04-26T20:18:53.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/465: truncate d1/d3a/f55 2190335 0 2024-04-26T20:18:53.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/466: chown d1/d21/d26/d1c/f4d 1804 1 2024-04-26T20:18:53.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/467: readlink d1/d21/d78/l7d 0 2024-04-26T20:18:53.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/468: chown d1/d45 111825247 1 2024-04-26T20:18:53.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/469: chown d1/d45/c49 348730313 1 2024-04-26T20:18:53.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/470: chown d1/d8/d2c/d47/l96 1774 1 2024-04-26T20:18:53.303 INFO:tasks.workunit.client.0.smithi016.stdout:6/471: write d1/d8/d2c/f42 [1679736,26209] 0 2024-04-26T20:18:53.307 INFO:tasks.workunit.client.0.smithi016.stdout:6/472: symlink d1/d21/d26/d1c/d8a/la3 0 2024-04-26T20:18:53.307 INFO:tasks.workunit.client.0.smithi016.stdout:6/473: fsync d1/d12/f70 0 2024-04-26T20:18:53.309 INFO:tasks.workunit.client.0.smithi016.stdout:6/474: symlink d1/d21/d26/d1c/d5d/d88/la4 0 2024-04-26T20:18:53.309 INFO:tasks.workunit.client.0.smithi016.stdout:7/603: mknod d0/d1/d34/db7/cc0 0 2024-04-26T20:18:53.310 INFO:tasks.workunit.client.0.smithi016.stdout:7/604: write d0/d1/d34/d25/d3f/f7a [607290,49402] 0 2024-04-26T20:18:53.324 INFO:tasks.workunit.client.0.smithi016.stdout:3/472: dread d3/d9/f3d [0,4194304] 0 2024-04-26T20:18:53.328 INFO:tasks.workunit.client.0.smithi016.stdout:5/772: dwrite d1/d9/d11/d4d/d72/f7c [0,4194304] 0 2024-04-26T20:18:53.328 INFO:tasks.workunit.client.0.smithi016.stdout:5/773: truncate d1/d9/d1c/d52/d74/fc7 274058 0 2024-04-26T20:18:53.328 INFO:tasks.workunit.client.0.smithi016.stdout:5/774: fsync d1/d7d/fba 0 2024-04-26T20:18:53.328 INFO:tasks.workunit.client.0.smithi016.stdout:3/473: creat d3/df/d25/d32/f95 x:0 0 0 2024-04-26T20:18:53.328 INFO:tasks.workunit.client.0.smithi016.stdout:3/474: getdents d3/df/d25 0 2024-04-26T20:18:53.393 INFO:tasks.workunit.client.0.smithi016.stdout:3/475: dread d3/f7 [0,4194304] 0 2024-04-26T20:18:53.394 INFO:tasks.workunit.client.0.smithi016.stdout:3/476: getdents d3/df/d20/d61/d76 0 2024-04-26T20:18:53.394 INFO:tasks.workunit.client.0.smithi016.stdout:3/477: fsync d3/df/f2f 0 2024-04-26T20:18:53.397 INFO:tasks.workunit.client.0.smithi016.stdout:8/596: dwrite d9/d23/d26/d2c/f9d [4194304,4194304] 0 2024-04-26T20:18:53.397 INFO:tasks.workunit.client.0.smithi016.stdout:8/597: fsync d9/d23/d26/fbf 0 2024-04-26T20:18:53.398 INFO:tasks.workunit.client.0.smithi016.stdout:8/598: rmdir d9/d23/d26/d2c 39 2024-04-26T20:18:53.400 INFO:tasks.workunit.client.0.smithi016.stdout:8/599: mknod d9/d19/d45/d3f/d64/db6/cd0 0 2024-04-26T20:18:53.401 INFO:tasks.workunit.client.0.smithi016.stdout:8/600: mknod d9/d19/d45/d3f/d4d/cd1 0 2024-04-26T20:18:53.406 INFO:tasks.workunit.client.0.smithi016.stdout:7/605: dread d0/f29 [0,4194304] 0 2024-04-26T20:18:53.406 INFO:tasks.workunit.client.0.smithi016.stdout:7/606: write d0/d67/f90 [1400117,28604] 0 2024-04-26T20:18:53.414 INFO:tasks.workunit.client.0.smithi016.stdout:1/644: dwrite d3/d5/d6/d50/d58/f69 [0,4194304] 0 2024-04-26T20:18:53.414 INFO:tasks.workunit.client.0.smithi016.stdout:5/775: write d1/f1f [2463063,54858] 0 2024-04-26T20:18:53.418 INFO:tasks.workunit.client.0.smithi016.stdout:1/645: rename d3/d5/d6/d50/ca1 to d3/d5/da/d66/d8c/d84/d96/ccf 0 2024-04-26T20:18:53.418 INFO:tasks.workunit.client.0.smithi016.stdout:1/646: truncate d3/d5/d6/d5a/f90 1244660 0 2024-04-26T20:18:53.420 INFO:tasks.workunit.client.0.smithi016.stdout:5/776: rename d1/d9/d1c/d52/d74/d98/l9d to d1/d9/d25/lf5 0 2024-04-26T20:18:53.420 INFO:tasks.workunit.client.0.smithi016.stdout:5/777: fdatasync d1/d9/d11/f34 0 2024-04-26T20:18:53.422 INFO:tasks.workunit.client.0.smithi016.stdout:5/778: symlink d1/d78/d99/dde/d8f/lf6 0 2024-04-26T20:18:53.423 INFO:tasks.workunit.client.0.smithi016.stdout:5/779: symlink d1/d9/d1c/d52/d74/d98/dcb/lf7 0 2024-04-26T20:18:53.424 INFO:tasks.workunit.client.0.smithi016.stdout:5/780: chown d1/fdd 5764695 1 2024-04-26T20:18:53.465 INFO:tasks.workunit.client.0.smithi016.stdout:3/478: dwrite d3/df/d25/d32/f95 [0,4194304] 0 2024-04-26T20:18:53.482 INFO:tasks.workunit.client.0.smithi016.stdout:8/601: dwrite d9/d19/d45/d3f/d4d/fbc [0,4194304] 0 2024-04-26T20:18:53.484 INFO:tasks.workunit.client.0.smithi016.stdout:3/479: dread d3/df/f40 [0,4194304] 0 2024-04-26T20:18:53.486 INFO:tasks.workunit.client.0.smithi016.stdout:3/480: creat d3/d9/d18/d5a/f96 x:0 0 0 2024-04-26T20:18:53.487 INFO:tasks.workunit.client.0.smithi016.stdout:5/781: dwrite d1/d9/f95 [0,4194304] 0 2024-04-26T20:18:53.488 INFO:tasks.workunit.client.0.smithi016.stdout:3/481: creat d3/d9/d2d/d62/f97 x:0 0 0 2024-04-26T20:18:53.489 INFO:tasks.workunit.client.0.smithi016.stdout:5/782: creat d1/d78/ff8 x:0 0 0 2024-04-26T20:18:53.491 INFO:tasks.workunit.client.0.smithi016.stdout:3/482: mkdir d3/d70/d8b/d98 0 2024-04-26T20:18:53.491 INFO:tasks.workunit.client.0.smithi016.stdout:3/483: write d3/df/f26 [1616072,129800] 0 2024-04-26T20:18:53.497 INFO:tasks.workunit.client.0.smithi016.stdout:1/647: dwrite d3/d5/da/d66/d8c/f6a [0,4194304] 0 2024-04-26T20:18:53.508 INFO:tasks.workunit.client.0.smithi016.stdout:3/484: write d3/df/f2b [8345549,43936] 0 2024-04-26T20:18:53.509 INFO:tasks.workunit.client.0.smithi016.stdout:3/485: stat d3/df/f13 0 2024-04-26T20:18:53.516 INFO:tasks.workunit.client.0.smithi016.stdout:3/486: fsync d3/df/f26 0 2024-04-26T20:18:53.518 INFO:tasks.workunit.client.0.smithi016.stdout:3/487: creat d3/df/f99 x:0 0 0 2024-04-26T20:18:53.525 INFO:tasks.workunit.client.0.smithi016.stdout:5/783: write d1/d9/f49 [1218997,31328] 0 2024-04-26T20:18:53.525 INFO:tasks.workunit.client.0.smithi016.stdout:5/784: truncate d1/d78/fdc 793972 0 2024-04-26T20:18:53.547 INFO:tasks.workunit.client.0.smithi016.stdout:5/785: write d1/f8a [835346,14601] 0 2024-04-26T20:18:53.547 INFO:tasks.workunit.client.0.smithi016.stdout:9/656: dwrite d1/d2/d20/d49/d77/d2a/fa9 [0,4194304] 0 2024-04-26T20:18:53.560 INFO:tasks.workunit.client.0.smithi016.stdout:3/488: dwrite f0 [4194304,4194304] 0 2024-04-26T20:18:53.563 INFO:tasks.workunit.client.0.smithi016.stdout:3/489: creat d3/d9/d2d/f9a x:0 0 0 2024-04-26T20:18:53.563 INFO:tasks.workunit.client.0.smithi016.stdout:3/490: fdatasync d3/df/d20/d5b/f6e 0 2024-04-26T20:18:53.563 INFO:tasks.workunit.client.0.smithi016.stdout:3/491: chown d3/df/d25/d2a/d69 28238 1 2024-04-26T20:18:53.563 INFO:tasks.workunit.client.0.smithi016.stdout:3/492: chown d3/d9/d18/f34 1019817202 1 2024-04-26T20:18:53.580 INFO:tasks.workunit.client.0.smithi016.stdout:3/493: write d3/d9/f1a [1096626,28594] 0 2024-04-26T20:18:53.582 INFO:tasks.workunit.client.0.smithi016.stdout:3/494: write d3/df/d25/d2a/d4a/f7e [217208,123872] 0 2024-04-26T20:18:53.605 INFO:tasks.workunit.client.0.smithi016.stdout:9/657: dwrite d1/d2/d20/d49/d77/d2a/d75/d85/fb4 [0,4194304] 0 2024-04-26T20:18:53.605 INFO:tasks.workunit.client.0.smithi016.stdout:9/658: truncate d1/d2e/dc6/f65 4564624 0 2024-04-26T20:18:53.632 INFO:tasks.workunit.client.0.smithi016.stdout:3/495: read d3/df/d20/d61/d74/f8d [235784,78666] 0 2024-04-26T20:18:53.633 INFO:tasks.workunit.client.0.smithi016.stdout:3/496: symlink d3/df/d25/d2a/l9b 0 2024-04-26T20:18:53.650 INFO:tasks.workunit.client.0.smithi016.stdout:5/786: dwrite d1/d9/d25/dc0/fd6 [0,4194304] 0 2024-04-26T20:18:53.655 INFO:tasks.workunit.client.0.smithi016.stdout:1/648: dwrite d3/d5/d6/d50/d58/f69 [0,4194304] 0 2024-04-26T20:18:53.655 INFO:tasks.workunit.client.0.smithi016.stdout:1/649: truncate d3/d5/f33 1544141 0 2024-04-26T20:18:53.655 INFO:tasks.workunit.client.0.smithi016.stdout:1/650: dread - d3/d5/da/d66/d8c/fc9 zero size 2024-04-26T20:18:53.655 INFO:tasks.workunit.client.0.smithi016.stdout:1/651: truncate d3/d5/d6/f89 1278759 0 2024-04-26T20:18:53.657 INFO:tasks.workunit.client.0.smithi016.stdout:1/652: creat d3/d5/d6/d5a/dbf/fd0 x:0 0 0 2024-04-26T20:18:53.668 INFO:tasks.workunit.client.0.smithi016.stdout:9/659: dwrite d1/d2/d43/fb7 [0,4194304] 0 2024-04-26T20:18:53.670 INFO:tasks.workunit.client.0.smithi016.stdout:9/660: mknod d1/d2/d20/dde/ce3 0 2024-04-26T20:18:53.706 INFO:tasks.workunit.client.0.smithi016.stdout:3/497: dwrite d3/df/d25/d2a/f94 [0,4194304] 0 2024-04-26T20:18:53.707 INFO:tasks.workunit.client.0.smithi016.stdout:3/498: rename d3/df to d3/df/d20/d41/d9c 22 2024-04-26T20:18:53.707 INFO:tasks.workunit.client.0.smithi016.stdout:3/499: fsync d3/f29 0 2024-04-26T20:18:53.709 INFO:tasks.workunit.client.0.smithi016.stdout:3/500: symlink d3/df/d20/l9d 0 2024-04-26T20:18:53.710 INFO:tasks.workunit.client.0.smithi016.stdout:9/661: dread d1/d2e/f17 [0,4194304] 0 2024-04-26T20:18:53.719 INFO:tasks.workunit.client.0.smithi016.stdout:5/787: dwrite d1/d9/d11/daa/fd8 [0,4194304] 0 2024-04-26T20:18:53.720 INFO:tasks.workunit.client.0.smithi016.stdout:5/788: chown d1/d78/d99/dde/f85 477626 1 2024-04-26T20:18:53.721 INFO:tasks.workunit.client.0.smithi016.stdout:1/653: dwrite d3/d5/d6/d9/d2a/d3b/f98 [0,4194304] 0 2024-04-26T20:18:53.724 INFO:tasks.workunit.client.0.smithi016.stdout:1/654: mknod d3/d5/da/cd1 0 2024-04-26T20:18:53.732 INFO:tasks.workunit.client.0.smithi016.stdout:9/662: write d1/d2/d43/f46 [2260498,128799] 0 2024-04-26T20:18:53.734 INFO:tasks.workunit.client.0.smithi016.stdout:5/789: dread d1/d9/f49 [0,4194304] 0 2024-04-26T20:18:53.734 INFO:tasks.workunit.client.0.smithi016.stdout:5/790: dread - d1/d9/d11/d4d/f76 zero size 2024-04-26T20:18:53.747 INFO:tasks.workunit.client.0.smithi016.stdout:3/501: dwrite d3/d9/f3d [0,4194304] 0 2024-04-26T20:18:53.823 INFO:tasks.workunit.client.0.smithi016.stdout:9/663: dwrite d1/d59/d52/f98 [0,4194304] 0 2024-04-26T20:18:53.823 INFO:tasks.workunit.client.0.smithi016.stdout:9/664: write d1/d2/d20/d49/d77/d2a/f5d [5271435,84058] 0 2024-04-26T20:18:53.824 INFO:tasks.workunit.client.0.smithi016.stdout:9/665: rename d1/d2/d20/d49/d77/d2a/d75/d85/d9b/fc4 to d1/d2/fe4 0 2024-04-26T20:18:53.841 INFO:tasks.workunit.client.0.smithi016.stdout:5/791: dwrite d1/d9/d1c/d52/d74/d98/fe1 [0,4194304] 0 2024-04-26T20:18:53.841 INFO:tasks.workunit.client.0.smithi016.stdout:9/666: write d1/d2e/f35 [4737607,51242] 0 2024-04-26T20:18:53.844 INFO:tasks.workunit.client.0.smithi016.stdout:5/792: link d1/f8d d1/d9/d11/d4d/d72/ff9 0 2024-04-26T20:18:53.845 INFO:tasks.workunit.client.0.smithi016.stdout:5/793: link d1/d78/d99/cbe d1/d78/d99/dde/db4/cfa 0 2024-04-26T20:18:53.846 INFO:tasks.workunit.client.0.smithi016.stdout:5/794: mkdir d1/d9/d11/d4d/d72/dfb 0 2024-04-26T20:18:53.846 INFO:tasks.workunit.client.0.smithi016.stdout:5/795: fsync d1/d9/d1c/d52/d74/f4f 0 2024-04-26T20:18:53.847 INFO:tasks.workunit.client.0.smithi016.stdout:5/796: creat d1/d78/d99/ffc x:0 0 0 2024-04-26T20:18:53.859 INFO:tasks.workunit.client.0.smithi016.stdout:5/797: write d1/d9/d1c/d52/f63 [3251068,27531] 0 2024-04-26T20:18:53.860 INFO:tasks.workunit.client.0.smithi016.stdout:5/798: symlink d1/d78/d99/dde/d8f/lfd 0 2024-04-26T20:18:53.861 INFO:tasks.workunit.client.0.smithi016.stdout:5/799: rmdir d1/d78/d99/dde/d8f/db6 39 2024-04-26T20:18:53.862 INFO:tasks.workunit.client.0.smithi016.stdout:5/800: link d1/d9/d25/f67 d1/d78/d99/dde/d8f/db6/dcc/ffe 0 2024-04-26T20:18:53.863 INFO:tasks.workunit.client.0.smithi016.stdout:5/801: creat d1/d9/d11/d4d/d72/fff x:0 0 0 2024-04-26T20:18:53.863 INFO:tasks.workunit.client.0.smithi016.stdout:5/802: fsync d1/d78/d99/dde/f6a 0 2024-04-26T20:18:53.864 INFO:tasks.workunit.client.0.smithi016.stdout:5/803: creat d1/d9/d11/d4d/d72/dac/f100 x:0 0 0 2024-04-26T20:18:53.865 INFO:tasks.workunit.client.0.smithi016.stdout:5/804: creat d1/d9/d25/dc0/f101 x:0 0 0 2024-04-26T20:18:53.889 INFO:tasks.workunit.client.0.smithi016.stdout:4/463: sync 2024-04-26T20:18:53.889 INFO:tasks.workunit.client.0.smithi016.stdout:0/536: sync 2024-04-26T20:18:53.890 INFO:tasks.workunit.client.0.smithi016.stdout:2/575: sync 2024-04-26T20:18:53.890 INFO:tasks.workunit.client.0.smithi016.stdout:4/464: readlink d0/dd/d1b/l72 0 2024-04-26T20:18:53.890 INFO:tasks.workunit.client.0.smithi016.stdout:2/576: chown d1d/d20/d22/d88 29195020 1 2024-04-26T20:18:53.890 INFO:tasks.workunit.client.0.smithi016.stdout:2/577: chown d1d/d20/d7c/f91 206 1 2024-04-26T20:18:53.890 INFO:tasks.workunit.client.0.smithi016.stdout:0/537: write d2/d8/f80 [1026270,118985] 0 2024-04-26T20:18:53.892 INFO:tasks.workunit.client.0.smithi016.stdout:0/538: link d2/d20/d41/d4c/d4e/f88 d2/dc/d18/d5b/fb6 0 2024-04-26T20:18:53.892 INFO:tasks.workunit.client.0.smithi016.stdout:0/539: chown d2/d20/f67 58748003 1 2024-04-26T20:18:53.896 INFO:tasks.workunit.client.0.smithi016.stdout:2/578: dread d1d/d20/d22/f8f [0,4194304] 0 2024-04-26T20:18:53.896 INFO:tasks.workunit.client.0.smithi016.stdout:2/579: dread - d1d/d27/d49/f6d zero size 2024-04-26T20:18:53.897 INFO:tasks.workunit.client.0.smithi016.stdout:9/667: dwrite d1/d2/d43/f46 [0,4194304] 0 2024-04-26T20:18:53.897 INFO:tasks.workunit.client.0.smithi016.stdout:9/668: truncate d1/d59/d52/f98 4281608 0 2024-04-26T20:18:53.897 INFO:tasks.workunit.client.0.smithi016.stdout:9/669: truncate d1/d1b/f80 3977237 0 2024-04-26T20:18:53.897 INFO:tasks.workunit.client.0.smithi016.stdout:9/670: chown d1/d2/d20/d49/d77/d2a/l34 917028 1 2024-04-26T20:18:53.899 INFO:tasks.workunit.client.0.smithi016.stdout:0/540: symlink d2/lb7 0 2024-04-26T20:18:53.899 INFO:tasks.workunit.client.0.smithi016.stdout:0/541: chown d2/d20/f2f 3879633 1 2024-04-26T20:18:53.900 INFO:tasks.workunit.client.0.smithi016.stdout:9/671: mknod d1/d2/d20/d49/d77/d3e/d5e/ce5 0 2024-04-26T20:18:53.900 INFO:tasks.workunit.client.0.smithi016.stdout:9/672: readlink d1/d2/d20/d49/d77/d3e/l87 0 2024-04-26T20:18:53.902 INFO:tasks.workunit.client.0.smithi016.stdout:5/805: dwrite d1/d9/d11/d4d/d72/dac/fe6 [0,4194304] 0 2024-04-26T20:18:53.902 INFO:tasks.workunit.client.0.smithi016.stdout:0/542: mkdir d2/d20/d41/d87/d9d/db8 0 2024-04-26T20:18:53.902 INFO:tasks.workunit.client.0.smithi016.stdout:0/543: write d2/dc/d18/f96 [501595,5060] 0 2024-04-26T20:18:53.903 INFO:tasks.workunit.client.0.smithi016.stdout:9/673: unlink d1/d2/l2c 0 2024-04-26T20:18:53.905 INFO:tasks.workunit.client.0.smithi016.stdout:5/806: rename d1/d9/d11/d4d/d72/dac/de3/fe7 to d1/d9/d1c/d52/f102 0 2024-04-26T20:18:53.905 INFO:tasks.workunit.client.0.smithi016.stdout:5/807: truncate d1/d9/d11/fa9 414683 0 2024-04-26T20:18:53.908 INFO:tasks.workunit.client.0.smithi016.stdout:0/544: unlink d2/l4 0 2024-04-26T20:18:53.908 INFO:tasks.workunit.client.0.smithi016.stdout:0/545: chown d2/d20/d41/f69 1709690602 1 2024-04-26T20:18:53.908 INFO:tasks.workunit.client.0.smithi016.stdout:0/546: chown d2/d8/d37/d5d/d60/l73 4285 1 2024-04-26T20:18:53.908 INFO:tasks.workunit.client.0.smithi016.stdout:9/674: creat d1/d2/d20/d49/d77/d3e/d5e/fe6 x:0 0 0 2024-04-26T20:18:53.908 INFO:tasks.workunit.client.0.smithi016.stdout:9/675: write d1/d59/d52/f7c [5151888,110726] 0 2024-04-26T20:18:53.909 INFO:tasks.workunit.client.0.smithi016.stdout:9/676: creat d1/d59/d52/fe7 x:0 0 0 2024-04-26T20:18:53.911 INFO:tasks.workunit.client.0.smithi016.stdout:5/808: dread d1/d9/d11/f34 [0,4194304] 0 2024-04-26T20:18:53.935 INFO:tasks.workunit.client.0.smithi016.stdout:5/809: dread d1/d9/f16 [0,4194304] 0 2024-04-26T20:18:53.965 INFO:tasks.workunit.client.0.smithi016.stdout:4/465: dwrite d0/d1e/f75 [0,4194304] 0 2024-04-26T20:18:53.972 INFO:tasks.workunit.client.0.smithi016.stdout:4/466: symlink d0/d1e/d4e/d52/d88/d43/d9c/l9f 0 2024-04-26T20:18:53.972 INFO:tasks.workunit.client.0.smithi016.stdout:4/467: write d0/dd/d1b/f48 [829616,56467] 0 2024-04-26T20:18:53.984 INFO:tasks.workunit.client.0.smithi016.stdout:9/677: dwrite d1/d2/f61 [0,4194304] 0 2024-04-26T20:18:53.987 INFO:tasks.workunit.client.0.smithi016.stdout:2/580: dwrite d1d/d20/f42 [0,4194304] 0 2024-04-26T20:18:53.987 INFO:tasks.workunit.client.0.smithi016.stdout:2/581: chown d1d/d27/d49/c90 43 1 2024-04-26T20:18:54.026 INFO:tasks.workunit.client.0.smithi016.stdout:7/607: sync 2024-04-26T20:18:54.026 INFO:tasks.workunit.client.0.smithi016.stdout:8/602: sync 2024-04-26T20:18:54.028 INFO:tasks.workunit.client.0.smithi016.stdout:5/810: dwrite d1/d9/d25/f42 [0,4194304] 0 2024-04-26T20:18:54.028 INFO:tasks.workunit.client.0.smithi016.stdout:5/811: chown d1/d9/d11/c70 832905 1 2024-04-26T20:18:54.028 INFO:tasks.workunit.client.0.smithi016.stdout:7/608: truncate d0/f42 1622120 0 2024-04-26T20:18:54.029 INFO:tasks.workunit.client.0.smithi016.stdout:8/603: creat d9/d19/d45/d9e/d50/dad/fd2 x:0 0 0 2024-04-26T20:18:54.030 INFO:tasks.workunit.client.0.smithi016.stdout:5/812: mkdir d1/d9/d11/d4d/d72/dfb/d103 0 2024-04-26T20:18:54.030 INFO:tasks.workunit.client.0.smithi016.stdout:5/813: readlink d1/d9/d11/l3f 0 2024-04-26T20:18:54.030 INFO:tasks.workunit.client.0.smithi016.stdout:5/814: chown d1/d9/f73 3250 1 2024-04-26T20:18:54.030 INFO:tasks.workunit.client.0.smithi016.stdout:9/678: dread d1/d2e/dc6/f54 [0,4194304] 0 2024-04-26T20:18:54.031 INFO:tasks.workunit.client.0.smithi016.stdout:9/679: fdatasync d1/d2/d20/d49/d77/fc3 0 2024-04-26T20:18:54.031 INFO:tasks.workunit.client.0.smithi016.stdout:7/609: mkdir d0/d1/d88/db3/dc1 0 2024-04-26T20:18:54.032 INFO:tasks.workunit.client.0.smithi016.stdout:7/610: mkdir d0/d1/d34/d25/d3f/d6d/dc2 0 2024-04-26T20:18:54.032 INFO:tasks.workunit.client.0.smithi016.stdout:7/611: chown d0/d1/d88/db3/dc1 352376354 1 2024-04-26T20:18:54.032 INFO:tasks.workunit.client.0.smithi016.stdout:7/612: fdatasync d0/d1/d34/d25/d50/f54 0 2024-04-26T20:18:54.033 INFO:tasks.workunit.client.0.smithi016.stdout:2/582: dread d1d/d27/d49/f5c [0,4194304] 0 2024-04-26T20:18:54.033 INFO:tasks.workunit.client.0.smithi016.stdout:5/815: mknod d1/db8/c104 0 2024-04-26T20:18:54.034 INFO:tasks.workunit.client.0.smithi016.stdout:5/816: getdents d1/d9/d11/d4d 0 2024-04-26T20:18:54.035 INFO:tasks.workunit.client.0.smithi016.stdout:5/817: read d1/d9/d11/f18 [11530711,28754] 0 2024-04-26T20:18:54.036 INFO:tasks.workunit.client.0.smithi016.stdout:5/818: mkdir d1/db8/d105 0 2024-04-26T20:18:54.036 INFO:tasks.workunit.client.0.smithi016.stdout:5/819: dread - d1/d78/d99/ffc zero size 2024-04-26T20:18:54.037 INFO:tasks.workunit.client.0.smithi016.stdout:5/820: unlink d1/d78/d99/cab 0 2024-04-26T20:18:54.038 INFO:tasks.workunit.client.0.smithi016.stdout:5/821: symlink d1/d9/d1c/d52/dc4/l106 0 2024-04-26T20:18:54.040 INFO:tasks.workunit.client.0.smithi016.stdout:6/475: sync 2024-04-26T20:18:54.066 INFO:tasks.workunit.client.0.smithi016.stdout:5/822: read d1/d9/d11/d4d/fa3 [3308306,122638] 0 2024-04-26T20:18:54.079 INFO:tasks.workunit.client.0.smithi016.stdout:9/680: read d1/d2/d20/d49/d77/d3e/d5e/fe0 [16344,82279] 0 2024-04-26T20:18:54.079 INFO:tasks.workunit.client.0.smithi016.stdout:8/604: dwrite d9/d2f/f5e [4194304,4194304] 0 2024-04-26T20:18:54.079 INFO:tasks.workunit.client.0.smithi016.stdout:9/681: write d1/d59/d52/f74 [1071007,46076] 0 2024-04-26T20:18:54.082 INFO:tasks.workunit.client.0.smithi016.stdout:8/605: mknod d9/d19/d45/d9e/d50/da9/dac/cd3 0 2024-04-26T20:18:54.085 INFO:tasks.workunit.client.0.smithi016.stdout:9/682: dread d1/f97 [0,4194304] 0 2024-04-26T20:18:54.089 INFO:tasks.workunit.client.0.smithi016.stdout:9/683: mkdir d1/d2/d20/de8 0 2024-04-26T20:18:54.090 INFO:tasks.workunit.client.0.smithi016.stdout:9/684: rename d1/d2/l45 to d1/d2/d20/d49/d77/d3e/d5e/d93/le9 0 2024-04-26T20:18:54.092 INFO:tasks.workunit.client.0.smithi016.stdout:9/685: creat d1/d2/d20/d49/d77/d2a/d75/fea x:0 0 0 2024-04-26T20:18:54.093 INFO:tasks.workunit.client.0.smithi016.stdout:9/686: symlink d1/d2/d20/d49/d77/d3e/d5e/d93/leb 0 2024-04-26T20:18:54.094 INFO:tasks.workunit.client.0.smithi016.stdout:9/687: mknod d1/d59/d52/d8c/cec 0 2024-04-26T20:18:54.094 INFO:tasks.workunit.client.0.smithi016.stdout:9/688: chown d1/d2/d79/cd6 241043566 1 2024-04-26T20:18:54.094 INFO:tasks.workunit.client.0.smithi016.stdout:9/689: rmdir d1/d2/d20/d49/d77/d3e 39 2024-04-26T20:18:54.100 INFO:tasks.workunit.client.0.smithi016.stdout:9/690: link d1/d2/d20/d49/d77/d3e/d5e/d93/le9 d1/d2/d20/d49/d77/d2a/led 0 2024-04-26T20:18:54.103 INFO:tasks.workunit.client.0.smithi016.stdout:9/691: creat d1/d2/d20/d49/d77/d2a/d75/d85/fee x:0 0 0 2024-04-26T20:18:54.104 INFO:tasks.workunit.client.0.smithi016.stdout:9/692: rmdir d1/d2e 39 2024-04-26T20:18:54.106 INFO:tasks.workunit.client.0.smithi016.stdout:9/693: dread d1/d59/d52/d8c/fa2 [0,4194304] 0 2024-04-26T20:18:54.107 INFO:tasks.workunit.client.0.smithi016.stdout:9/694: chown d1/d2/d79/cd6 3 1 2024-04-26T20:18:54.107 INFO:tasks.workunit.client.0.smithi016.stdout:9/695: rename d1/d59/d52/d8c/dd1 to d1/d59/d52/d8c/dd1/def 22 2024-04-26T20:18:54.107 INFO:tasks.workunit.client.0.smithi016.stdout:9/696: chown d1/d59/d52/d8c/fa2 1781 1 2024-04-26T20:18:54.107 INFO:tasks.workunit.client.0.smithi016.stdout:9/697: write d1/d2e/dc6/f54 [431294,34399] 0 2024-04-26T20:18:54.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/698: symlink d1/lf0 0 2024-04-26T20:18:54.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/699: write d1/f15 [5772667,62063] 0 2024-04-26T20:18:54.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/700: write d1/d2e/fad [725200,14408] 0 2024-04-26T20:18:54.111 INFO:tasks.workunit.client.0.smithi016.stdout:7/613: dwrite d0/d1/fbf [0,4194304] 0 2024-04-26T20:18:54.129 INFO:tasks.workunit.client.0.smithi016.stdout:2/583: dwrite d1d/d2a/fb3 [0,4194304] 0 2024-04-26T20:18:54.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/584: fdatasync d1d/d27/d2d/f2f 0 2024-04-26T20:18:54.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/585: dread - d1d/d20/f9f zero size 2024-04-26T20:18:54.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/586: dread - d1d/d20/d22/d29/faf zero size 2024-04-26T20:18:54.132 INFO:tasks.workunit.client.0.smithi016.stdout:2/587: getdents d1d/d20 0 2024-04-26T20:18:54.133 INFO:tasks.workunit.client.0.smithi016.stdout:2/588: write f1b [5490519,92230] 0 2024-04-26T20:18:54.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/589: dread d1d/d27/d49/f92 [0,4194304] 0 2024-04-26T20:18:54.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/590: write d1d/f43 [4255555,65528] 0 2024-04-26T20:18:54.139 INFO:tasks.workunit.client.0.smithi016.stdout:2/591: mkdir d1d/d27/d2d/d5a/dc7 0 2024-04-26T20:18:54.141 INFO:tasks.workunit.client.0.smithi016.stdout:2/592: creat d1d/d20/d22/d29/fc8 x:0 0 0 2024-04-26T20:18:54.143 INFO:tasks.workunit.client.0.smithi016.stdout:2/593: creat d1d/d20/fc9 x:0 0 0 2024-04-26T20:18:54.144 INFO:tasks.workunit.client.0.smithi016.stdout:2/594: chown d1d/d20/d22/d39/c54 464 1 2024-04-26T20:18:54.144 INFO:tasks.workunit.client.0.smithi016.stdout:2/595: truncate d1d/d2a/d3d/f85 841876 0 2024-04-26T20:18:54.144 INFO:tasks.workunit.client.0.smithi016.stdout:5/823: dwrite d1/f8d [0,4194304] 0 2024-04-26T20:18:54.144 INFO:tasks.workunit.client.0.smithi016.stdout:2/596: rename d1d/d20/d22/d39/f7d to d1d/d20/fca 0 2024-04-26T20:18:54.145 INFO:tasks.workunit.client.0.smithi016.stdout:5/824: mknod d1/d78/d99/dde/d8f/db6/dcc/c107 0 2024-04-26T20:18:54.146 INFO:tasks.workunit.client.0.smithi016.stdout:8/606: dwrite d9/d23/d26/d2c/f85 [0,4194304] 0 2024-04-26T20:18:54.146 INFO:tasks.workunit.client.0.smithi016.stdout:8/607: truncate d9/d19/d45/d9e/d50/da9/dac/fb7 535866 0 2024-04-26T20:18:54.147 INFO:tasks.workunit.client.0.smithi016.stdout:8/608: read - d9/d23/d26/faf zero size 2024-04-26T20:18:54.202 INFO:tasks.workunit.client.0.smithi016.stdout:9/701: dwrite f0 [0,4194304] 0 2024-04-26T20:18:54.203 INFO:tasks.workunit.client.0.smithi016.stdout:9/702: write d1/d2e/dc6/fca [3296649,10114] 0 2024-04-26T20:18:54.203 INFO:tasks.workunit.client.0.smithi016.stdout:8/609: mknod d9/d72/d74/dcd/cd4 0 2024-04-26T20:18:54.217 INFO:tasks.workunit.client.0.smithi016.stdout:2/597: write d1d/d20/d22/d29/f37 [343741,45949] 0 2024-04-26T20:18:54.233 INFO:tasks.workunit.client.0.smithi016.stdout:5/825: dread d1/d9/d11/d4d/f9b [0,4194304] 0 2024-04-26T20:18:54.233 INFO:tasks.workunit.client.0.smithi016.stdout:9/703: unlink d1/d2/d20/d49/d77/d2a/led 0 2024-04-26T20:18:54.240 INFO:tasks.workunit.client.0.smithi016.stdout:2/598: fdatasync d1d/d20/d22/d29/f37 0 2024-04-26T20:18:54.240 INFO:tasks.workunit.client.0.smithi016.stdout:7/614: dwrite d0/d1/d34/f2c [0,4194304] 0 2024-04-26T20:18:54.241 INFO:tasks.workunit.client.0.smithi016.stdout:9/704: mkdir d1/d59/d52/d8c/df1 0 2024-04-26T20:18:54.242 INFO:tasks.workunit.client.0.smithi016.stdout:2/599: rmdir d1d/d27 39 2024-04-26T20:18:54.254 INFO:tasks.workunit.client.0.smithi016.stdout:7/615: write d0/d1/d6/f3d [1620932,56094] 0 2024-04-26T20:18:54.254 INFO:tasks.workunit.client.0.smithi016.stdout:8/610: dwrite d9/f16 [0,4194304] 0 2024-04-26T20:18:54.258 INFO:tasks.workunit.client.0.smithi016.stdout:9/705: rename d1/d2e/d40/lab to d1/d59/lf2 0 2024-04-26T20:18:54.263 INFO:tasks.workunit.client.0.smithi016.stdout:7/616: creat d0/d1/d88/db3/fc3 x:0 0 0 2024-04-26T20:18:54.276 INFO:tasks.workunit.client.0.smithi016.stdout:5/826: dwrite d1/d78/f80 [4194304,4194304] 0 2024-04-26T20:18:54.279 INFO:tasks.workunit.client.0.smithi016.stdout:7/617: creat d0/d1/d34/d25/d3f/d6d/d79/fc4 x:0 0 0 2024-04-26T20:18:54.280 INFO:tasks.workunit.client.0.smithi016.stdout:7/618: fdatasync d0/d1/d34/d25/d3f/d6d/f77 0 2024-04-26T20:18:54.287 INFO:tasks.workunit.client.0.smithi016.stdout:9/706: write d1/d2/d20/fc0 [3665647,78276] 0 2024-04-26T20:18:54.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:54.306 INFO:tasks.workunit.client.0.smithi016.stdout:9/707: write d1/d2/fd [12346900,36835] 0 2024-04-26T20:18:54.308 INFO:tasks.workunit.client.0.smithi016.stdout:8/611: dwrite d9/d19/d45/d9e/d50/f97 [0,4194304] 0 2024-04-26T20:18:54.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65cac00640 1 Processor -- start 2024-04-26T20:18:54.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65cac00640 1 -- start start 2024-04-26T20:18:54.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65cac00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f65c41594f0 0x7f65c40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65cac00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c415ca90 0x7f65c4070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65cac00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65c4160240 con 0x7f65c40712e0 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65cac00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f65c41598d0 con 0x7f65c41594f0 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65cac00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f65c415f6c0 con 0x7f65c415ca90 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c8c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f65c40712e0 0x7f65c40ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52502/0 (socket says 172.21.15.16:52502) 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c8c00640 1 -- 172.21.15.16:0/3254434875 learned_addr learned my addr 172.21.15.16:0/3254434875 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65bbe00640 1 --2- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c415ca90 0x7f65c4070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3e00640 1 --2- 172.21.15.16:0/3254434875 >> v2:172.21.15.192:3300/0 conn(0x7f65c41594f0 0x7f65c40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3400640 1 -- 172.21.15.16:0/3254434875 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812377282 0 0) 0x7f65c4160240 con 0x7f65c40712e0 2024-04-26T20:18:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3400640 1 -- 172.21.15.16:0/3254434875 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a8003530 con 0x7f65c40712e0 2024-04-26T20:18:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3e00640 1 -- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c415ca90 msgr2=0x7f65c4070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3e00640 1 --2- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c415ca90 0x7f65c4070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3400640 1 -- 172.21.15.16:0/3254434875 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1825543086 0 0) 0x7f65a8003530 con 0x7f65c40712e0 2024-04-26T20:18:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3e00640 1 -- 172.21.15.16:0/3254434875 >> v1:172.21.15.16:6789/0 conn(0x7f65c40712e0 legacy=0x7f65c40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.447+0000 7f65c3e00640 1 -- 172.21.15.16:0/3254434875 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c415f9a0 con 0x7f65c41594f0 2024-04-26T20:18:54.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65c3e00640 1 --2- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c41594f0 0x7f65c40c8e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f65b40097c0 tx=0x7f65b401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1dbbb8d5aaaf4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:54.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65c3400640 1 -- 172.21.15.16:0/3254434875 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b40b5070 con 0x7f65c41594f0 2024-04-26T20:18:54.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65c3400640 1 -- 172.21.15.16:0/3254434875 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b40a85f0 con 0x7f65c41594f0 2024-04-26T20:18:54.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65c3400640 1 -- 172.21.15.16:0/3254434875 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc001a00 con 0x7f65c41594f0 2024-04-26T20:18:54.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 -- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c41594f0 msgr2=0x7f65c40c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 --2- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c41594f0 0x7f65c40c8e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f65b40097c0 tx=0x7f65b401ebb0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 -- 172.21.15.16:0/3254434875 shutdown_connections 2024-04-26T20:18:54.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 --2- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c415ca90 0x7f65c4070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 --2- 172.21.15.16:0/3254434875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c41594f0 0x7f65c40c8e50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 -- 172.21.15.16:0/3254434875 >> 172.21.15.16:0/3254434875 conn(0x7f65c40ce2c0 msgr2=0x7f65c40ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:54.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 -- 172.21.15.16:0/3254434875 shutdown_connections 2024-04-26T20:18:54.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.451+0000 7f65cac00640 1 -- 172.21.15.16:0/3254434875 wait complete. 2024-04-26T20:18:54.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 Processor -- start 2024-04-26T20:18:54.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 -- start start 2024-04-26T20:18:54.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c40712e0 0x7f65c4154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65c41594f0 0x7f65c41f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c415ca90 0x7f65c41f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f65c40c9c50 con 0x7f65c41594f0 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65c415ff60 con 0x7f65c415ca90 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f65c415f360 con 0x7f65c40712e0 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65c41594f0 0x7f65c41f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65c41594f0 0x7f65c41f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36936/0 (socket says 172.21.15.16:36936) 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 -- 172.21.15.16:0/43619088 learned_addr learned my addr 172.21.15.16:0/43619088 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65c8c00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c415ca90 0x7f65c41f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65c3e00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c40712e0 0x7f65c4154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 -- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c40712e0 msgr2=0x7f65c4154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c40712e0 0x7f65c4154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 -- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c415ca90 msgr2=0x7f65c41f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c415ca90 0x7f65c41f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 -- 172.21.15.16:0/43619088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c41f4e10 con 0x7f65c41594f0 2024-04-26T20:18:54.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65c8c00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c415ca90 0x7f65c41f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:18:54.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65bbe00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65c41594f0 0x7f65c41f1700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00e960 tx=0x7f65ac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:54.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65c0c00640 1 -- 172.21.15.16:0/43619088 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac017070 con 0x7f65c41594f0 2024-04-26T20:18:54.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65c0c00640 1 -- 172.21.15.16:0/43619088 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac00ca00 con 0x7f65c41594f0 2024-04-26T20:18:54.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65c0c00640 1 -- 172.21.15.16:0/43619088 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00cdb0 con 0x7f65c41594f0 2024-04-26T20:18:54.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c41f50f0 con 0x7f65c41594f0 2024-04-26T20:18:54.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c4154660 con 0x7f65c41594f0 2024-04-26T20:18:54.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.455+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c4077c20 con 0x7f65c41594f0 2024-04-26T20:18:54.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.459+0000 7f65c0c00640 1 -- 172.21.15.16:0/43619088 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f65ac01a070 con 0x7f65c41594f0 2024-04-26T20:18:54.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.459+0000 7f65c0c00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65a00683b0 0x7f65a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:54.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.459+0000 7f65c0c00640 1 -- 172.21.15.16:0/43619088 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f65ac0872e0 con 0x7f65c41594f0 2024-04-26T20:18:54.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.459+0000 7f65c3e00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65a00683b0 0x7f65a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:54.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.459+0000 7f65c3e00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65a00683b0 0x7f65a006a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f65b40b2000 tx=0x7f65b40aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:54.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.463+0000 7f65c0c00640 1 -- 172.21.15.16:0/43619088 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f65ac057320 con 0x7f65c41594f0 2024-04-26T20:18:54.558 INFO:tasks.workunit.client.0.smithi016.stdout:9/708: creat d1/ff3 x:0 0 0 2024-04-26T20:18:54.562 INFO:tasks.workunit.client.0.smithi016.stdout:8/612: symlink d9/d19/d45/d3f/d64/db6/ld5 0 2024-04-26T20:18:54.564 INFO:tasks.workunit.client.0.smithi016.stdout:9/709: getdents d1/d2/d20/d49/d77/d2a/d75/d85 0 2024-04-26T20:18:54.564 INFO:tasks.workunit.client.0.smithi016.stdout:9/710: dread - d1/ff3 zero size 2024-04-26T20:18:54.567 INFO:tasks.workunit.client.0.smithi016.stdout:9/711: symlink d1/d2e/dd3/lf4 0 2024-04-26T20:18:54.567 INFO:tasks.workunit.client.0.smithi016.stdout:9/712: fdatasync d1/d2/d20/d49/d77/d2a/d33/f4a 0 2024-04-26T20:18:54.569 INFO:tasks.workunit.client.0.smithi016.stdout:9/713: creat d1/d2/d20/d49/d77/d2a/d75/d85/d9b/ff5 x:0 0 0 2024-04-26T20:18:54.569 INFO:tasks.workunit.client.0.smithi016.stdout:9/714: dread - d1/d2/d20/d49/d77/fd4 zero size 2024-04-26T20:18:54.571 INFO:tasks.workunit.client.0.smithi016.stdout:9/715: read d1/d2e/d40/f5a [1165904,17081] 0 2024-04-26T20:18:54.571 INFO:tasks.workunit.client.0.smithi016.stdout:9/716: dread - d1/d2/d20/d49/f9f zero size 2024-04-26T20:18:54.571 INFO:tasks.workunit.client.0.smithi016.stdout:9/717: chown d1/d2/d20/d49/cb5 32370079 1 2024-04-26T20:18:54.582 INFO:tasks.workunit.client.0.smithi016.stdout:8/613: dread d9/d19/d45/d9e/d50/f97 [0,4194304] 0 2024-04-26T20:18:54.582 INFO:tasks.workunit.client.0.smithi016.stdout:8/614: readlink d9/d19/d45/l4c 0 2024-04-26T20:18:54.649 INFO:tasks.workunit.client.0.smithi016.stdout:9/718: dwrite d1/fa7 [0,4194304] 0 2024-04-26T20:18:54.651 INFO:tasks.workunit.client.0.smithi016.stdout:9/719: rename d1/d2/d20/d49/d77/d3e/d5e/fe6 to d1/d2/d20/dda/ff6 0 2024-04-26T20:18:54.656 INFO:tasks.workunit.client.0.smithi016.stdout:9/720: write d1/d59/d52/fbd [714780,29606] 0 2024-04-26T20:18:54.656 INFO:tasks.workunit.client.0.smithi016.stdout:9/721: fdatasync d1/d59/d52/f30 0 2024-04-26T20:18:54.657 INFO:tasks.workunit.client.0.smithi016.stdout:9/722: dread - d1/d1b/fc7 zero size 2024-04-26T20:18:54.657 INFO:tasks.workunit.client.0.smithi016.stdout:9/723: readlink d1/d2/d20/d49/d77/d3e/d5e/d93/leb 0 2024-04-26T20:18:54.668 INFO:tasks.workunit.client.0.smithi016.stdout:8/615: dwrite d9/d19/d45/d9e/d50/f97 [0,4194304] 0 2024-04-26T20:18:54.688 INFO:tasks.workunit.client.0.smithi016.stdout:8/616: dread d9/d23/d26/f76 [0,4194304] 0 2024-04-26T20:18:54.688 INFO:tasks.workunit.client.0.smithi016.stdout:8/617: dread - d9/d2f/fbb zero size 2024-04-26T20:18:54.690 INFO:tasks.workunit.client.0.smithi016.stdout:8/618: creat d9/d66/d73/fd6 x:0 0 0 2024-04-26T20:18:54.693 INFO:tasks.workunit.client.0.smithi016.stdout:8/619: mkdir d9/d72/d74/dcd/dd7 0 2024-04-26T20:18:54.693 INFO:tasks.workunit.client.0.smithi016.stdout:8/620: link d9/d19/d45/d3f/d64/c59 d9/d19/d45/d3f/d4d/cd8 0 2024-04-26T20:18:54.726 INFO:tasks.workunit.client.0.smithi016.stdout:2/600: dwrite d1d/d20/d22/d39/d3e/f77 [0,4194304] 0 2024-04-26T20:18:54.726 INFO:tasks.workunit.client.0.smithi016.stdout:5/827: dwrite d1/d9/d1c/d52/d74/f32 [4194304,4194304] 0 2024-04-26T20:18:54.729 INFO:tasks.workunit.client.0.smithi016.stdout:5/828: link d1/d9/d11/d4d/d72/f7c d1/d9/d11/d4d/dc1/f108 0 2024-04-26T20:18:54.731 INFO:tasks.workunit.client.0.smithi016.stdout:5/829: creat d1/d78/f109 x:0 0 0 2024-04-26T20:18:54.737 INFO:tasks.workunit.client.0.smithi016.stdout:5/830: dread d1/d9/d11/fa9 [0,4194304] 0 2024-04-26T20:18:54.739 INFO:tasks.workunit.client.0.smithi016.stdout:5/831: dread d1/d9/d1c/d52/d74/fc7 [0,4194304] 0 2024-04-26T20:18:54.739 INFO:tasks.workunit.client.0.smithi016.stdout:5/832: write d1/d78/d99/dde/d8f/db6/fc8 [348649,19739] 0 2024-04-26T20:18:54.741 INFO:tasks.workunit.client.0.smithi016.stdout:5/833: mknod d1/d78/d99/dde/d8f/db6/dcc/c10a 0 2024-04-26T20:18:54.742 INFO:tasks.workunit.client.0.smithi016.stdout:5/834: mkdir d1/d9/d11/daa/d10b 0 2024-04-26T20:18:54.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.747+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65c4158920 con 0x7f65c41594f0 2024-04-26T20:18:54.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.755+0000 7f65c0c00640 1 -- 172.21.15.16:0/43619088 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7f65ac056c20 con 0x7f65c41594f0 2024-04-26T20:18:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:54.757 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:54.757 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:54.761 INFO:tasks.workunit.client.0.smithi016.stdout:5/835: dread d1/d78/d99/dde/f44 [0,4194304] 0 2024-04-26T20:18:54.763 INFO:tasks.workunit.client.0.smithi016.stdout:9/724: dread d1/f8 [0,4194304] 0 2024-04-26T20:18:54.763 INFO:tasks.workunit.client.0.smithi016.stdout:9/725: chown d1/d2/d20/d49/d77/d2a/d75/fea 12105872 1 2024-04-26T20:18:54.765 INFO:tasks.workunit.client.0.smithi016.stdout:5/836: getdents d1/db8 0 2024-04-26T20:18:54.765 INFO:tasks.workunit.client.0.smithi016.stdout:7/619: dwrite d0/d1/d95/f9a [0,4194304] 0 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65a00683b0 msgr2=0x7f65a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65a00683b0 0x7f65a006a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f65b40b2000 tx=0x7f65b40aa070 comp rx=0 tx=0).stop 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65c41594f0 msgr2=0x7f65c41f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65c41594f0 0x7f65c41f1700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00e960 tx=0x7f65ac00ee20 comp rx=0 tx=0).stop 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 shutdown_connections 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f65a00683b0 0x7f65a006a870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65c415ca90 0x7f65c41f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65c41594f0 0x7f65c41f1700 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 --2- 172.21.15.16:0/43619088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65c40712e0 0x7f65c4154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:54.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 >> 172.21.15.16:0/43619088 conn(0x7f65c40ce2c0 msgr2=0x7f65c41572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:54.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 shutdown_connections 2024-04-26T20:18:54.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:54.759+0000 7f65cac00640 1 -- 172.21.15.16:0/43619088 wait complete. 2024-04-26T20:18:54.767 INFO:tasks.workunit.client.0.smithi016.stdout:2/601: dwrite d1d/d20/fca [0,4194304] 0 2024-04-26T20:18:54.767 INFO:tasks.workunit.client.0.smithi016.stdout:2/602: write d1d/d2a/f4a [8558480,37222] 0 2024-04-26T20:18:54.772 INFO:tasks.workunit.client.0.smithi016.stdout:7/620: link d0/d1/f93 d0/d1/d34/d25/d50/fc5 0 2024-04-26T20:18:54.772 INFO:tasks.workunit.client.0.smithi016.stdout:7/621: truncate d0/d1/d34/d25/d3f/d6d/d74/fa9 437773 0 2024-04-26T20:18:54.774 INFO:tasks.workunit.client.0.smithi016.stdout:7/622: truncate d0/d1/d34/d25/d3f/f5f 189607 0 2024-04-26T20:18:54.794 INFO:tasks.workunit.client.0.smithi016.stdout:6/476: sync 2024-04-26T20:18:54.796 INFO:tasks.workunit.client.0.smithi016.stdout:1/655: sync 2024-04-26T20:18:54.796 INFO:tasks.workunit.client.0.smithi016.stdout:0/547: sync 2024-04-26T20:18:54.797 INFO:tasks.workunit.client.0.smithi016.stdout:3/502: sync 2024-04-26T20:18:54.797 INFO:tasks.workunit.client.0.smithi016.stdout:3/503: chown d3/df/d25/d32/d3f/c45 31 1 2024-04-26T20:18:54.797 INFO:tasks.workunit.client.0.smithi016.stdout:4/468: sync 2024-04-26T20:18:54.797 INFO:tasks.workunit.client.0.smithi016.stdout:4/469: dread - d0/d1e/d64/f92 zero size 2024-04-26T20:18:54.797 INFO:tasks.workunit.client.0.smithi016.stdout:6/477: symlink d1/d8/d2c/la5 0 2024-04-26T20:18:54.798 INFO:tasks.workunit.client.0.smithi016.stdout:6/478: truncate d1/d21/d26/d1c/d4e/fa0 916704 0 2024-04-26T20:18:54.798 INFO:tasks.workunit.client.0.smithi016.stdout:8/621: dwrite d9/d2f/fbb [0,4194304] 0 2024-04-26T20:18:54.800 INFO:tasks.workunit.client.0.smithi016.stdout:0/548: unlink d2/d20/d41/d87/f8b 0 2024-04-26T20:18:54.800 INFO:tasks.workunit.client.0.smithi016.stdout:0/549: read - d2/d40/f90 zero size 2024-04-26T20:18:54.801 INFO:tasks.workunit.client.0.smithi016.stdout:3/504: mkdir d3/df/d25/d32/d9e 0 2024-04-26T20:18:54.806 INFO:tasks.workunit.client.0.smithi016.stdout:6/479: creat d1/d21/d26/d1c/d7b/d82/d8f/fa6 x:0 0 0 2024-04-26T20:18:54.807 INFO:tasks.workunit.client.0.smithi016.stdout:4/470: truncate d0/d1e/d4e/d52/d88/d43/f4a 4086305 0 2024-04-26T20:18:54.807 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-26T20:18:54.808 INFO:tasks.workunit.client.0.smithi016.stdout:3/505: creat d3/df/d20/d61/f9f x:0 0 0 2024-04-26T20:18:54.808 INFO:tasks.workunit.client.0.smithi016.stdout:3/506: chown d3/df/d25/d2a/l71 130648283 1 2024-04-26T20:18:54.812 INFO:tasks.workunit.client.0.smithi016.stdout:4/471: creat d0/d1e/d4e/d52/d88/d43/fa0 x:0 0 0 2024-04-26T20:18:54.812 INFO:tasks.workunit.client.0.smithi016.stdout:3/507: rename d3/df/d20/d61/l86 to d3/df/d25/d2a/la0 0 2024-04-26T20:18:54.814 INFO:tasks.workunit.client.0.smithi016.stdout:4/472: mkdir d0/dd/d19/da1 0 2024-04-26T20:18:54.816 INFO:tasks.workunit.client.0.smithi016.stdout:3/508: symlink d3/d70/d8b/d98/la1 0 2024-04-26T20:18:54.816 INFO:tasks.workunit.client.0.smithi016.stdout:3/509: stat d3/d9/f3d 0 2024-04-26T20:18:54.817 INFO:tasks.workunit.client.0.smithi016.stdout:3/510: write d3/df/d25/d2a/d4a/f91 [396431,60861] 0 2024-04-26T20:18:54.818 INFO:tasks.workunit.client.0.smithi016.stdout:4/473: rmdir d0/d1e/d4e/d52/d54 39 2024-04-26T20:18:54.828 INFO:tasks.workunit.client.0.smithi016.stdout:2/603: dread d1d/d20/d7c/f91 [0,4194304] 0 2024-04-26T20:18:54.829 INFO:tasks.workunit.client.0.smithi016.stdout:5/837: dwrite d1/d9/d11/d4d/f9b [0,4194304] 0 2024-04-26T20:18:54.830 INFO:tasks.workunit.client.0.smithi016.stdout:5/838: creat d1/d9f/f10c x:0 0 0 2024-04-26T20:18:54.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/839: fsync d1/d9/d1c/d52/d74/fe9 0 2024-04-26T20:18:54.831 INFO:tasks.workunit.client.0.smithi016.stdout:5/840: mknod d1/d9/d1c/c10d 0 2024-04-26T20:18:54.835 INFO:tasks.workunit.client.0.smithi016.stdout:5/841: unlink d1/d9/d11/c27 0 2024-04-26T20:18:54.835 INFO:tasks.workunit.client.0.smithi016.stdout:5/842: fsync d1/d9/d1c/d52/d74/f32 0 2024-04-26T20:18:54.838 INFO:tasks.workunit.client.0.smithi016.stdout:5/843: symlink d1/d7d/l10e 0 2024-04-26T20:18:54.838 INFO:tasks.workunit.client.0.smithi016.stdout:5/844: getdents d1/d9/d11/d4d/d72/dfb/d103 0 2024-04-26T20:18:54.843 INFO:tasks.workunit.client.0.smithi016.stdout:8/622: dwrite d9/d19/d45/d9e/f8c [0,4194304] 0 2024-04-26T20:18:54.845 INFO:tasks.workunit.client.0.smithi016.stdout:5/845: stat d1/d78/d99/dde/d8f/db6/ld1 0 2024-04-26T20:18:54.846 INFO:tasks.workunit.client.0.smithi016.stdout:8/623: link d9/d19/d45/d9e/l75 d9/d19/d45/d3f/d64/db6/ld9 0 2024-04-26T20:18:54.846 INFO:tasks.workunit.client.0.smithi016.stdout:8/624: chown d9/d19/d45/d3f/lb1 86953677 1 2024-04-26T20:18:54.846 INFO:tasks.workunit.client.0.smithi016.stdout:5/846: mkdir d1/d9/d1c/d52/d74/d98/d10f 0 2024-04-26T20:18:54.848 INFO:tasks.workunit.client.0.smithi016.stdout:8/625: creat d9/d19/d45/d9e/d50/da9/dac/fda x:0 0 0 2024-04-26T20:18:54.848 INFO:tasks.workunit.client.0.smithi016.stdout:5/847: creat d1/d9/d1c/d52/d74/d98/dcb/f110 x:0 0 0 2024-04-26T20:18:54.861 INFO:tasks.workunit.client.0.smithi016.stdout:5/848: read d1/d9/d1c/d52/d74/f32 [3625677,101806] 0 2024-04-26T20:18:54.888 INFO:tasks.workunit.client.0.smithi016.stdout:5/849: write d1/d78/d99/dde/f44 [3629906,8392] 0 2024-04-26T20:18:54.888 INFO:tasks.workunit.client.0.smithi016.stdout:5/850: dread - d1/d78/fd4 zero size 2024-04-26T20:18:54.890 INFO:tasks.workunit.client.0.smithi016.stdout:5/851: link d1/d9/d11/c2e d1/d78/d99/dde/d8f/c111 0 2024-04-26T20:18:54.892 INFO:tasks.workunit.client.0.smithi016.stdout:8/626: mkdir d9/ddb 0 2024-04-26T20:18:54.892 INFO:tasks.workunit.client.0.smithi016.stdout:8/627: fdatasync d9/d23/f3c 0 2024-04-26T20:18:54.892 INFO:tasks.workunit.client.0.smithi016.stdout:8/628: write d9/d23/d26/faf [815170,125415] 0 2024-04-26T20:18:54.899 INFO:tasks.workunit.client.0.smithi016.stdout:7/623: dwrite d0/d1/d6/f3d [0,4194304] 0 2024-04-26T20:18:54.901 INFO:tasks.workunit.client.0.smithi016.stdout:5/852: mkdir d1/d9/d11/d4d/d72/dfb/d103/d112 0 2024-04-26T20:18:54.903 INFO:tasks.workunit.client.0.smithi016.stdout:7/624: creat d0/d1/d6/d73/fc6 x:0 0 0 2024-04-26T20:18:54.906 INFO:tasks.workunit.client.0.smithi016.stdout:1/656: dread d3/d5/da/d66/d8c/f83 [0,4194304] 0 2024-04-26T20:18:54.907 INFO:tasks.workunit.client.0.smithi016.stdout:5/853: mkdir d1/d9/d11/d4d/d72/dfb/d103/d113 0 2024-04-26T20:18:54.907 INFO:tasks.workunit.client.0.smithi016.stdout:6/480: dread d1/d8/d2c/d3d/f58 [0,4194304] 0 2024-04-26T20:18:54.907 INFO:tasks.workunit.client.0.smithi016.stdout:6/481: truncate d1/d12/f16 2116706 0 2024-04-26T20:18:54.915 INFO:tasks.workunit.client.0.smithi016.stdout:0/550: dwrite d2/f14 [4194304,4194304] 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:4/474: dread d0/d1e/d64/f85 [0,4194304] 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:4/475: dread - d0/f8d zero size 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:5/854: truncate d1/d9/f49 396477 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:5/855: fsync d1/d9/d11/d4d/f9c 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/625: mkdir d0/d51/dc7 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/626: truncate d0/f8c 367936 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/627: truncate d0/d1/d34/db7/fbd 293356 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/628: write d0/d1/d34/db7/fbd [596736,52611] 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/629: chown d0/d1/d34/d25/f26 569196 1 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:5/856: mkdir d1/d9/d114 0 2024-04-26T20:18:54.916 INFO:tasks.workunit.client.0.smithi016.stdout:1/657: creat d3/d5/da/d66/d8c/d84/d86/fd2 x:0 0 0 2024-04-26T20:18:54.921 INFO:tasks.workunit.client.0.smithi016.stdout:5/857: truncate d1/d9/f10 5838560 0 2024-04-26T20:18:54.924 INFO:tasks.workunit.client.0.smithi016.stdout:1/658: link d3/d5/d6/d9/d2a/d3b/c55 d3/d5/d6/d9/d9e/cd3 0 2024-04-26T20:18:54.924 INFO:tasks.workunit.client.0.smithi016.stdout:1/659: chown d3/d5/d6/d5a/f90 2 1 2024-04-26T20:18:54.928 INFO:tasks.workunit.client.0.smithi016.stdout:2/604: dwrite d1d/d27/f53 [0,4194304] 0 2024-04-26T20:18:54.928 INFO:tasks.workunit.client.0.smithi016.stdout:2/605: write d1d/d27/d2d/f94 [2676941,90801] 0 2024-04-26T20:18:54.928 INFO:tasks.workunit.client.0.smithi016.stdout:7/630: link d0/la5 d0/d89/lc8 0 2024-04-26T20:18:54.936 INFO:tasks.workunit.client.0.smithi016.stdout:5/858: rename d1/d9/d11/d4d/f9c to d1/d7d/f115 0 2024-04-26T20:18:54.944 INFO:tasks.workunit.client.0.smithi016.stdout:1/660: link d3/d5/d6/d50/d79/fa5 d3/d5/da/d66/d8c/fd4 0 2024-04-26T20:18:54.944 INFO:tasks.workunit.client.0.smithi016.stdout:1/661: write d3/d5/d6/d50/d79/da7/fc6 [781933,76320] 0 2024-04-26T20:18:54.944 INFO:tasks.workunit.client.0.smithi016.stdout:1/662: chown d3/d5/d6/d50/d58 62903180 1 2024-04-26T20:18:54.945 INFO:tasks.workunit.client.0.smithi016.stdout:1/663: dread d3/d5/d6/d50/d79/f9f [0,4194304] 0 2024-04-26T20:18:54.947 INFO:tasks.workunit.client.0.smithi016.stdout:5/859: rmdir d1 39 2024-04-26T20:18:54.947 INFO:tasks.workunit.client.0.smithi016.stdout:5/860: write d1/d78/d99/dde/d8f/db6/fc8 [805892,41650] 0 2024-04-26T20:18:54.961 INFO:tasks.workunit.client.0.smithi016.stdout:0/551: dwrite d2/dc/d18/d5b/fa8 [4194304,4194304] 0 2024-04-26T20:18:54.964 INFO:tasks.workunit.client.0.smithi016.stdout:0/552: stat d2/l19 0 2024-04-26T20:18:54.977 INFO:tasks.workunit.client.0.smithi016.stdout:2/606: read d1d/d27/d2d/f70 [4071316,61982] 0 2024-04-26T20:18:54.977 INFO:tasks.workunit.client.0.smithi016.stdout:6/482: dwrite d1/d21/d26/d1c/d7b/d82/d8f/fa6 [0,4194304] 0 2024-04-26T20:18:54.977 INFO:tasks.workunit.client.0.smithi016.stdout:6/483: write d1/d21/d48/f4f [538985,41920] 0 2024-04-26T20:18:54.978 INFO:tasks.workunit.client.0.smithi016.stdout:6/484: read - d1/d21/d26/d1c/f91 zero size 2024-04-26T20:18:54.980 INFO:tasks.workunit.client.0.smithi016.stdout:0/553: link d2/d20/d41/d4c/d4e/f6d d2/d20/d41/d87/fb9 0 2024-04-26T20:18:54.984 INFO:tasks.workunit.client.0.smithi016.stdout:6/485: creat d1/d21/d26/d1c/d2e/d53/d93/fa7 x:0 0 0 2024-04-26T20:18:54.988 INFO:tasks.workunit.client.0.smithi016.stdout:0/554: creat d2/d20/d41/d87/d9d/fba x:0 0 0 2024-04-26T20:18:54.990 INFO:tasks.workunit.client.0.smithi016.stdout:6/486: unlink d1/f27 0 2024-04-26T20:18:54.993 INFO:tasks.workunit.client.0.smithi016.stdout:1/664: dwrite d3/d5/da/d66/d8c/f93 [4194304,4194304] 0 2024-04-26T20:18:54.993 INFO:tasks.workunit.client.0.smithi016.stdout:1/665: chown d3/d5/f18 25 1 2024-04-26T20:18:54.993 INFO:tasks.workunit.client.0.smithi016.stdout:8/629: dwrite d9/d23/d26/d2c/f6b [0,4194304] 0 2024-04-26T20:18:54.993 INFO:tasks.workunit.client.0.smithi016.stdout:4/476: write d0/d1e/d4e/d52/d88/d43/f4a [517725,57702] 0 2024-04-26T20:18:54.993 INFO:tasks.workunit.client.0.smithi016.stdout:4/477: dread - d0/d1e/d4e/d52/d88/d43/fa0 zero size 2024-04-26T20:18:54.995 INFO:tasks.workunit.client.0.smithi016.stdout:0/555: getdents d2/dc/d1e 0 2024-04-26T20:18:54.995 INFO:tasks.workunit.client.0.smithi016.stdout:1/666: symlink d3/d57/ld5 0 2024-04-26T20:18:54.997 INFO:tasks.workunit.client.0.smithi016.stdout:8/630: mknod d9/d23/d26/cdc 0 2024-04-26T20:18:54.997 INFO:tasks.workunit.client.0.smithi016.stdout:8/631: truncate d9/d66/fb0 923342 0 2024-04-26T20:18:54.998 INFO:tasks.workunit.client.0.smithi016.stdout:4/478: mknod d0/d1e/d30/ca2 0 2024-04-26T20:18:55.000 INFO:tasks.workunit.client.0.smithi016.stdout:6/487: dread d1/d21/d26/d1c/d7b/f89 [0,4194304] 0 2024-04-26T20:18:55.010 INFO:tasks.workunit.client.0.smithi016.stdout:5/861: dwrite d1/d9/d11/d4d/fa3 [0,4194304] 0 2024-04-26T20:18:55.010 INFO:tasks.workunit.client.0.smithi016.stdout:5/862: truncate d1/d7d/fba 751713 0 2024-04-26T20:18:55.013 INFO:tasks.workunit.client.0.smithi016.stdout:1/667: link d3/d5/d6/d5a/dbf/lc0 d3/d5/d6/d50/ld6 0 2024-04-26T20:18:55.015 INFO:tasks.workunit.client.0.smithi016.stdout:8/632: link d9/d19/d45/d3f/d4d/fb5 d9/d19/d45/d3f/fdd 0 2024-04-26T20:18:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:4/479: creat d0/dd/d66/d6f/fa3 x:0 0 0 2024-04-26T20:18:55.016 INFO:tasks.workunit.client.0.smithi016.stdout:4/480: write d0/d1e/f4c [3452954,6093] 0 2024-04-26T20:18:55.018 INFO:tasks.workunit.client.0.smithi016.stdout:6/488: symlink d1/d8/d2c/d3d/la8 0 2024-04-26T20:18:55.018 INFO:tasks.workunit.client.0.smithi016.stdout:6/489: stat d1/d21/d26/c17 0 2024-04-26T20:18:55.018 INFO:tasks.workunit.client.0.smithi016.stdout:6/490: chown d1/d8/d2c/d47/d67 1236 1 2024-04-26T20:18:55.018 INFO:tasks.workunit.client.0.smithi016.stdout:0/556: write d2/dc/d1e/d35/f63 [1729674,104131] 0 2024-04-26T20:18:55.020 INFO:tasks.workunit.client.0.smithi016.stdout:5/863: rmdir d1/d9/d11/d4d/d72 39 2024-04-26T20:18:55.026 INFO:tasks.workunit.client.0.smithi016.stdout:1/668: creat d3/d5/d6/d5a/dbf/fd7 x:0 0 0 2024-04-26T20:18:55.028 INFO:tasks.workunit.client.0.smithi016.stdout:4/481: rename d0/d1e/d4e/d52/d54/l59 to d0/d1e/d4e/d52/d88/d43/d9c/la4 0 2024-04-26T20:18:55.029 INFO:tasks.workunit.client.0.smithi016.stdout:2/607: dwrite d1d/d27/d49/fa2 [0,4194304] 0 2024-04-26T20:18:55.030 INFO:tasks.workunit.client.0.smithi016.stdout:5/864: creat d1/d78/d99/f116 x:0 0 0 2024-04-26T20:18:55.031 INFO:tasks.workunit.client.0.smithi016.stdout:1/669: creat d3/d5/d6/d9/d2a/fd8 x:0 0 0 2024-04-26T20:18:55.032 INFO:tasks.workunit.client.0.smithi016.stdout:0/557: symlink d2/d8/d37/d5d/lbb 0 2024-04-26T20:18:55.032 INFO:tasks.workunit.client.0.smithi016.stdout:0/558: readlink d2/d8/d37/d5d/lbb 0 2024-04-26T20:18:55.034 INFO:tasks.workunit.client.0.smithi016.stdout:0/559: dread d2/d40/d61/f81 [0,4194304] 0 2024-04-26T20:18:55.034 INFO:tasks.workunit.client.0.smithi016.stdout:6/491: rename d1/d21/d26/d1c/f20 to d1/d21/d26/d1c/d7b/d82/fa9 0 2024-04-26T20:18:55.034 INFO:tasks.workunit.client.0.smithi016.stdout:8/633: write d9/d66/d73/fcf [1876731,37089] 0 2024-04-26T20:18:55.038 INFO:tasks.workunit.client.0.smithi016.stdout:2/608: unlink d1d/d20/d22/f2e 0 2024-04-26T20:18:55.041 INFO:tasks.workunit.client.0.smithi016.stdout:1/670: symlink d3/d5/d6/d50/d79/da7/ld9 0 2024-04-26T20:18:55.044 INFO:tasks.workunit.client.0.smithi016.stdout:4/482: creat d0/dd/d66/d6f/fa5 x:0 0 0 2024-04-26T20:18:55.044 INFO:tasks.workunit.client.0.smithi016.stdout:4/483: write d0/f36 [866744,61685] 0 2024-04-26T20:18:55.045 INFO:tasks.workunit.client.0.smithi016.stdout:0/560: dread d2/dc/d18/d5b/fb6 [0,4194304] 0 2024-04-26T20:18:55.045 INFO:tasks.workunit.client.0.smithi016.stdout:0/561: fdatasync d2/dc/d1e/d25/f55 0 2024-04-26T20:18:55.046 INFO:tasks.workunit.client.0.smithi016.stdout:6/492: creat d1/faa x:0 0 0 2024-04-26T20:18:55.046 INFO:tasks.workunit.client.0.smithi016.stdout:6/493: chown d1/d21/c22 45312 1 2024-04-26T20:18:55.052 INFO:tasks.workunit.client.0.smithi016.stdout:1/671: link d3/d5/d6/le d3/d5/d6/d5a/lda 0 2024-04-26T20:18:55.090 INFO:tasks.workunit.client.0.smithi016.stdout:2/609: dread f12 [0,4194304] 0 2024-04-26T20:18:55.090 INFO:tasks.workunit.client.0.smithi016.stdout:2/610: chown d1d/d27/d2d 0 1 2024-04-26T20:18:55.097 INFO:tasks.workunit.client.0.smithi016.stdout:8/634: dwrite d9/f1b [0,4194304] 0 2024-04-26T20:18:55.100 INFO:tasks.workunit.client.0.smithi016.stdout:4/484: rename d0/dd/d19/c1a to d0/d1e/d4e/ca6 0 2024-04-26T20:18:55.100 INFO:tasks.workunit.client.0.smithi016.stdout:0/562: mknod d2/dc/d18/d24/cbc 0 2024-04-26T20:18:55.113 INFO:tasks.workunit.client.0.smithi016.stdout:5/865: getdents d1/d78/d99 0 2024-04-26T20:18:55.113 INFO:tasks.workunit.client.0.smithi016.stdout:8/635: dread d9/d66/d73/fcf [0,4194304] 0 2024-04-26T20:18:55.120 INFO:tasks.workunit.client.0.smithi016.stdout:6/494: dwrite d1/d8/d76/f9a [0,4194304] 0 2024-04-26T20:18:55.120 INFO:tasks.workunit.client.0.smithi016.stdout:2/611: write f12 [1260757,87843] 0 2024-04-26T20:18:55.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/636: link f5 d9/d72/d74/d9f/fde 0 2024-04-26T20:18:55.128 INFO:tasks.workunit.client.0.smithi016.stdout:8/637: fdatasync d9/d19/f41 0 2024-04-26T20:18:55.130 INFO:tasks.workunit.client.0.smithi016.stdout:1/672: rename d3/d5/d8d/dab/faf to d3/d5/da/d66/d8c/fdb 0 2024-04-26T20:18:55.130 INFO:tasks.workunit.client.0.smithi016.stdout:8/638: symlink d9/d23/d26/ldf 0 2024-04-26T20:18:55.132 INFO:tasks.workunit.client.0.smithi016.stdout:5/866: rename d1/d9/d1c/d52/d74/d5f/d82/fe5 to d1/d7d/f117 0 2024-04-26T20:18:55.132 INFO:tasks.workunit.client.0.smithi016.stdout:5/867: write d1/d78/d99/fc6 [556096,126444] 0 2024-04-26T20:18:55.132 INFO:tasks.workunit.client.0.smithi016.stdout:5/868: chown d1/d9/d1c/l5b 24 1 2024-04-26T20:18:55.133 INFO:tasks.workunit.client.0.smithi016.stdout:1/673: symlink d3/d5/d6/d50/d79/ldc 0 2024-04-26T20:18:55.134 INFO:tasks.workunit.client.0.smithi016.stdout:8/639: mknod d9/d72/d74/dcd/ce0 0 2024-04-26T20:18:55.134 INFO:tasks.workunit.client.0.smithi016.stdout:8/640: readlink d9/d19/d45/d3f/d64/l83 0 2024-04-26T20:18:55.135 INFO:tasks.workunit.client.0.smithi016.stdout:8/641: write d9/d19/d45/f67 [3025342,127145] 0 2024-04-26T20:18:55.137 INFO:tasks.workunit.client.0.smithi016.stdout:5/869: creat d1/d9/d1c/d52/d74/d5f/f118 x:0 0 0 2024-04-26T20:18:55.137 INFO:tasks.workunit.client.0.smithi016.stdout:5/870: fsync d1/d9/d25/dc0/f101 0 2024-04-26T20:18:55.137 INFO:tasks.workunit.client.0.smithi016.stdout:5/871: dread - d1/d7d/fdf zero size 2024-04-26T20:18:55.137 INFO:tasks.workunit.client.0.smithi016.stdout:1/674: creat d3/d5/d8d/fdd x:0 0 0 2024-04-26T20:18:55.146 INFO:tasks.workunit.client.0.smithi016.stdout:4/485: read d0/dd/f6d [347787,85646] 0 2024-04-26T20:18:55.146 INFO:tasks.workunit.client.0.smithi016.stdout:0/563: dwrite d2/d20/fad [4194304,4194304] 0 2024-04-26T20:18:55.165 INFO:tasks.workunit.client.0.smithi016.stdout:5/872: write d1/d9/d11/d4d/fa3 [1279846,74288] 0 2024-04-26T20:18:55.165 INFO:tasks.workunit.client.0.smithi016.stdout:5/873: chown d1/d78/d99/dde/d8f/db6/dcc/c107 3705333 1 2024-04-26T20:18:55.165 INFO:tasks.workunit.client.0.smithi016.stdout:5/874: fdatasync f0 0 2024-04-26T20:18:55.165 INFO:tasks.workunit.client.0.smithi016.stdout:5/875: dread - d1/d78/f109 zero size 2024-04-26T20:18:55.170 INFO:tasks.workunit.client.0.smithi016.stdout:1/675: dread d3/d5/fb5 [0,4194304] 0 2024-04-26T20:18:55.171 INFO:tasks.workunit.client.0.smithi016.stdout:4/486: rename d0/dd/d19/d1f/l6e to d0/dd/d66/la7 0 2024-04-26T20:18:55.173 INFO:tasks.workunit.client.0.smithi016.stdout:1/676: link d3/d5/d6/f7f d3/d5/d6/d9/d9e/fde 0 2024-04-26T20:18:55.177 INFO:tasks.workunit.client.0.smithi016.stdout:6/495: write d1/d3a/f55 [2083009,128717] 0 2024-04-26T20:18:55.177 INFO:tasks.workunit.client.0.smithi016.stdout:2/612: dwrite d1d/d20/f42 [0,4194304] 0 2024-04-26T20:18:55.177 INFO:tasks.workunit.client.0.smithi016.stdout:6/496: chown d1/d21/d26/d1c/f7c 9410310 1 2024-04-26T20:18:55.177 INFO:tasks.workunit.client.0.smithi016.stdout:6/497: dread - d1/d21/d26/d1c/f91 zero size 2024-04-26T20:18:55.178 INFO:tasks.workunit.client.0.smithi016.stdout:4/487: symlink d0/dd/la8 0 2024-04-26T20:18:55.178 INFO:tasks.workunit.client.0.smithi016.stdout:4/488: write d0/d1e/d4e/d52/d88/d43/f56 [4148631,56787] 0 2024-04-26T20:18:55.178 INFO:tasks.workunit.client.0.smithi016.stdout:4/489: write d0/f8d [686845,51920] 0 2024-04-26T20:18:55.180 INFO:tasks.workunit.client.0.smithi016.stdout:5/876: rename d1/d9/d1c/d52/d74/f4f to d1/d9/d11/daa/d10b/f119 0 2024-04-26T20:18:55.192 INFO:tasks.workunit.client.0.smithi016.stdout:6/498: mknod d1/d21/d48/cab 0 2024-04-26T20:18:55.192 INFO:tasks.workunit.client.0.smithi016.stdout:8/642: dwrite d9/d19/d45/d9e/f68 [0,4194304] 0 2024-04-26T20:18:55.192 INFO:tasks.workunit.client.0.smithi016.stdout:8/643: read - d9/d19/d45/d9e/fa4 zero size 2024-04-26T20:18:55.192 INFO:tasks.workunit.client.0.smithi016.stdout:5/877: rename d1/d9/f10 to d1/db8/f11a 0 2024-04-26T20:18:55.192 INFO:tasks.workunit.client.0.smithi016.stdout:5/878: chown d1/d9/d1c/la2 2034455887 1 2024-04-26T20:18:55.193 INFO:tasks.workunit.client.0.smithi016.stdout:1/677: rename d3/d5/d6/d5a/dbf/fcb to d3/d5/da/fdf 0 2024-04-26T20:18:55.193 INFO:tasks.workunit.client.0.smithi016.stdout:1/678: readlink d3/d5/d6/l15 0 2024-04-26T20:18:55.193 INFO:tasks.workunit.client.0.smithi016.stdout:5/879: symlink d1/d9/d11/d4d/d72/dfb/d103/d113/l11b 0 2024-04-26T20:18:55.194 INFO:tasks.workunit.client.0.smithi016.stdout:8/644: symlink d9/le1 0 2024-04-26T20:18:55.194 INFO:tasks.workunit.client.0.smithi016.stdout:8/645: chown d9/f1b 17 1 2024-04-26T20:18:55.194 INFO:tasks.workunit.client.0.smithi016.stdout:8/646: write d9/d19/fa8 [5294342,69331] 0 2024-04-26T20:18:55.197 INFO:tasks.workunit.client.0.smithi016.stdout:1/679: rename d3/d5/da/lb1 to d3/d5/da/d66/d8c/le0 0 2024-04-26T20:18:55.197 INFO:tasks.workunit.client.0.smithi016.stdout:1/680: readlink d3/d5/d6/l1f 0 2024-04-26T20:18:55.197 INFO:tasks.workunit.client.0.smithi016.stdout:5/880: rmdir d1/d78/d99/dde/d8f 39 2024-04-26T20:18:55.201 INFO:tasks.workunit.client.0.smithi016.stdout:1/681: creat d3/d5/d6/d9/d2a/fe1 x:0 0 0 2024-04-26T20:18:55.210 INFO:tasks.workunit.client.0.smithi016.stdout:0/564: dwrite d2/d20/d41/f62 [4194304,4194304] 0 2024-04-26T20:18:55.211 INFO:tasks.workunit.client.0.smithi016.stdout:0/565: fsync d2/d8/d37/d70/f75 0 2024-04-26T20:18:55.212 INFO:tasks.workunit.client.0.smithi016.stdout:0/566: dread d2/dc/d1e/f3a [0,4194304] 0 2024-04-26T20:18:55.214 INFO:tasks.workunit.client.0.smithi016.stdout:5/881: mknod d1/d9/d11/d4d/d72/dfb/d103/d113/c11c 0 2024-04-26T20:18:55.214 INFO:tasks.workunit.client.0.smithi016.stdout:5/882: fdatasync d1/d9/d11/d4d/f76 0 2024-04-26T20:18:55.215 INFO:tasks.workunit.client.0.smithi016.stdout:5/883: write d1/d78/d99/dde/f39 [1403395,13448] 0 2024-04-26T20:18:55.230 INFO:tasks.workunit.client.0.smithi016.stdout:5/884: rename d1/d9/lb3 to d1/d9/d11/d4d/d72/dfb/l11d 0 2024-04-26T20:18:55.238 INFO:tasks.workunit.client.0.smithi016.stdout:2/613: dwrite d1d/d2a/fb3 [4194304,4194304] 0 2024-04-26T20:18:55.238 INFO:tasks.workunit.client.0.smithi016.stdout:5/885: symlink d1/d78/d99/dde/d8f/db6/dcc/l11e 0 2024-04-26T20:18:55.250 INFO:tasks.workunit.client.0.smithi016.stdout:5/886: read d1/db8/f11a [2550677,63975] 0 2024-04-26T20:18:55.250 INFO:tasks.workunit.client.0.smithi016.stdout:5/887: chown d1/d9/d1c/d52/d74/d98/cc9 93166377 1 2024-04-26T20:18:55.264 INFO:tasks.workunit.client.0.smithi016.stdout:6/499: dwrite d1/d21/d26/d1c/d2e/d53/f69 [0,4194304] 0 2024-04-26T20:18:55.265 INFO:tasks.workunit.client.0.smithi016.stdout:6/500: write d1/d21/d26/d1c/d2e/f33 [2361303,7931] 0 2024-04-26T20:18:55.270 INFO:tasks.workunit.client.0.smithi016.stdout:4/490: dwrite d0/f90 [0,4194304] 0 2024-04-26T20:18:55.271 INFO:tasks.workunit.client.0.smithi016.stdout:4/491: chown d0/dd/d19/l6a 701690 1 2024-04-26T20:18:55.273 INFO:tasks.workunit.client.0.smithi016.stdout:1/682: dwrite d3/d5/da/fdf [0,4194304] 0 2024-04-26T20:18:55.288 INFO:tasks.workunit.client.0.smithi016.stdout:4/492: write d0/f11 [428096,100685] 0 2024-04-26T20:18:55.289 INFO:tasks.workunit.client.0.smithi016.stdout:1/683: mkdir d3/d5/d6/d5a/dbf/de2 0 2024-04-26T20:18:55.291 INFO:tasks.workunit.client.0.smithi016.stdout:4/493: unlink d0/dd/d19/d1f/f58 0 2024-04-26T20:18:55.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/684: truncate d3/d5/d6/d5a/fbb 2961384 0 2024-04-26T20:18:55.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/685: fsync d3/d5/da/d66/d8c/f93 0 2024-04-26T20:18:55.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/686: chown d3/d57/da4 374967 1 2024-04-26T20:18:55.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/687: chown d3/d5/d6/d9/d2a/fd8 25156 1 2024-04-26T20:18:55.293 INFO:tasks.workunit.client.0.smithi016.stdout:1/688: dread - d3/d57/f6d zero size 2024-04-26T20:18:55.300 INFO:tasks.workunit.client.0.smithi016.stdout:4/494: stat d0/d1e/d30/c40 0 2024-04-26T20:18:55.300 INFO:tasks.workunit.client.0.smithi016.stdout:4/495: dread - d0/dd/d66/d6f/fa5 zero size 2024-04-26T20:18:55.328 INFO:tasks.workunit.client.0.smithi016.stdout:4/496: creat d0/d1e/d4e/d52/d88/d43/d5a/fa9 x:0 0 0 2024-04-26T20:18:55.329 INFO:tasks.workunit.client.0.smithi016.stdout:0/567: dread d2/dc/f79 [0,4194304] 0 2024-04-26T20:18:55.347 INFO:tasks.workunit.client.0.smithi016.stdout:2/614: dwrite f12 [0,4194304] 0 2024-04-26T20:18:55.348 INFO:tasks.workunit.client.0.smithi016.stdout:6/501: dread d1/d8/d2c/f42 [4194304,4194304] 0 2024-04-26T20:18:55.348 INFO:tasks.workunit.client.0.smithi016.stdout:0/568: truncate d2/dc/d18/d5b/fb6 1798031 0 2024-04-26T20:18:55.349 INFO:tasks.workunit.client.0.smithi016.stdout:2/615: symlink d1d/d2a/lcb 0 2024-04-26T20:18:55.351 INFO:tasks.workunit.client.0.smithi016.stdout:6/502: link d1/d21/d26/c74 d1/d21/d26/d1c/d5d/d88/cac 0 2024-04-26T20:18:55.352 INFO:tasks.workunit.client.0.smithi016.stdout:0/569: creat d2/d20/d41/d87/d9d/fbd x:0 0 0 2024-04-26T20:18:55.358 INFO:tasks.workunit.client.0.smithi016.stdout:6/503: creat d1/d21/d48/fad x:0 0 0 2024-04-26T20:18:55.365 INFO:tasks.workunit.client.0.smithi016.stdout:5/888: dwrite d1/d78/d99/dde/d8f/db6/dcc/ffe [0,4194304] 0 2024-04-26T20:18:55.365 INFO:tasks.workunit.client.0.smithi016.stdout:5/889: chown d1/d9/d11/d4d/f9b 7 1 2024-04-26T20:18:55.368 INFO:tasks.workunit.client.0.smithi016.stdout:5/890: symlink d1/d9/d1c/d52/d74/d98/dcb/l11f 0 2024-04-26T20:18:55.371 INFO:tasks.workunit.client.0.smithi016.stdout:0/570: write d2/dc/d1e/d25/f55 [959617,41797] 0 2024-04-26T20:18:55.372 INFO:tasks.workunit.client.0.smithi016.stdout:6/504: rename d1/d8/d2c/d47/d67 to d1/d8/dae 0 2024-04-26T20:18:55.375 INFO:tasks.workunit.client.0.smithi016.stdout:5/891: creat d1/d9/d11/d4d/d72/dac/de3/f120 x:0 0 0 2024-04-26T20:18:55.377 INFO:tasks.workunit.client.0.smithi016.stdout:6/505: rmdir d1 39 2024-04-26T20:18:55.382 INFO:tasks.workunit.client.0.smithi016.stdout:6/506: write d1/d12/f16 [825089,75691] 0 2024-04-26T20:18:55.384 INFO:tasks.workunit.client.0.smithi016.stdout:5/892: mknod d1/db8/d105/c121 0 2024-04-26T20:18:55.386 INFO:tasks.workunit.client.0.smithi016.stdout:6/507: rename d1/d8/d2c/d3d/f56 to d1/d8/dae/faf 0 2024-04-26T20:18:55.387 INFO:tasks.workunit.client.0.smithi016.stdout:5/893: creat d1/d78/f122 x:0 0 0 2024-04-26T20:18:55.390 INFO:tasks.workunit.client.0.smithi016.stdout:3/511: sync 2024-04-26T20:18:55.390 INFO:tasks.workunit.client.0.smithi016.stdout:7/631: sync 2024-04-26T20:18:55.390 INFO:tasks.workunit.client.0.smithi016.stdout:7/632: chown d0/d67/caa 1734303 1 2024-04-26T20:18:55.394 INFO:tasks.workunit.client.0.smithi016.stdout:6/508: rename d1/d21/d26/d1c/d2e/f64 to d1/d21/d26/fb0 0 2024-04-26T20:18:55.394 INFO:tasks.workunit.client.0.smithi016.stdout:9/726: sync 2024-04-26T20:18:55.395 INFO:tasks.workunit.client.0.smithi016.stdout:3/512: creat d3/d9/fa2 x:0 0 0 2024-04-26T20:18:55.396 INFO:tasks.workunit.client.0.smithi016.stdout:3/513: truncate d3/df/d20/d61/f9f 298426 0 2024-04-26T20:18:55.411 INFO:tasks.workunit.client.0.smithi016.stdout:4/497: dwrite d0/dd/d1b/f48 [0,4194304] 0 2024-04-26T20:18:55.411 INFO:tasks.workunit.client.0.smithi016.stdout:4/498: fsync d0/d1e/f21 0 2024-04-26T20:18:55.411 INFO:tasks.workunit.client.0.smithi016.stdout:4/499: write d0/f11 [3821201,52955] 0 2024-04-26T20:18:55.411 INFO:tasks.workunit.client.0.smithi016.stdout:4/500: fdatasync d0/f8d 0 2024-04-26T20:18:55.415 INFO:tasks.workunit.client.0.smithi016.stdout:9/727: mknod d1/d2e/dd3/cf7 0 2024-04-26T20:18:55.415 INFO:tasks.workunit.client.0.smithi016.stdout:9/728: chown d1/d59/da5 124056 1 2024-04-26T20:18:55.467 INFO:tasks.workunit.client.0.smithi016.stdout:0/571: dwrite d2/dc/f44 [0,4194304] 0 2024-04-26T20:18:55.468 INFO:tasks.workunit.client.0.smithi016.stdout:9/729: truncate d1/d2/d20/d49/faa 827138 0 2024-04-26T20:18:55.471 INFO:tasks.workunit.client.0.smithi016.stdout:3/514: dwrite d3/df/f2b [0,4194304] 0 2024-04-26T20:18:55.475 INFO:tasks.workunit.client.0.smithi016.stdout:5/894: dwrite d1/d78/fa6 [0,4194304] 0 2024-04-26T20:18:55.477 INFO:tasks.workunit.client.0.smithi016.stdout:0/572: creat d2/fbe x:0 0 0 2024-04-26T20:18:55.481 INFO:tasks.workunit.client.0.smithi016.stdout:3/515: symlink d3/df/d20/la3 0 2024-04-26T20:18:55.482 INFO:tasks.workunit.client.0.smithi016.stdout:5/895: mknod d1/d78/d99/dde/d8f/c123 0 2024-04-26T20:18:55.483 INFO:tasks.workunit.client.0.smithi016.stdout:0/573: symlink d2/d20/d41/d87/lbf 0 2024-04-26T20:18:55.484 INFO:tasks.workunit.client.0.smithi016.stdout:3/516: creat d3/df/d25/d32/d9e/fa4 x:0 0 0 2024-04-26T20:18:55.488 INFO:tasks.workunit.client.0.smithi016.stdout:3/517: dread d3/df/f64 [0,4194304] 0 2024-04-26T20:18:55.491 INFO:tasks.workunit.client.0.smithi016.stdout:0/574: rmdir d2/dc/d1e/d35/da5 0 2024-04-26T20:18:55.496 INFO:tasks.workunit.client.0.smithi016.stdout:4/501: dwrite d0/dd/f84 [0,4194304] 0 2024-04-26T20:18:55.498 INFO:tasks.workunit.client.0.smithi016.stdout:3/518: link d3/d9/d18/f8f d3/d9/d2d/fa5 0 2024-04-26T20:18:55.498 INFO:tasks.workunit.client.0.smithi016.stdout:0/575: creat d2/d20/d41/d87/d9d/db8/fc0 x:0 0 0 2024-04-26T20:18:55.498 INFO:tasks.workunit.client.0.smithi016.stdout:0/576: readlink d2/d20/d41/d87/lbf 0 2024-04-26T20:18:55.498 INFO:tasks.workunit.client.0.smithi016.stdout:0/577: readlink d2/d20/l2d 0 2024-04-26T20:18:55.499 INFO:tasks.workunit.client.0.smithi016.stdout:4/502: mknod d0/d1e/d4e/d52/d88/d43/d5a/caa 0 2024-04-26T20:18:55.499 INFO:tasks.workunit.client.0.smithi016.stdout:4/503: stat d0/dd/d66/d6f/d7f 0 2024-04-26T20:18:55.500 INFO:tasks.workunit.client.0.smithi016.stdout:0/578: rename d2/dc/d1e/d35/c4a to d2/dc/cc1 0 2024-04-26T20:18:55.500 INFO:tasks.workunit.client.0.smithi016.stdout:0/579: write d2/dc/d45/f78 [608322,1474] 0 2024-04-26T20:18:55.500 INFO:tasks.workunit.client.0.smithi016.stdout:0/580: fsync d2/f15 0 2024-04-26T20:18:55.501 INFO:tasks.workunit.client.0.smithi016.stdout:3/519: creat d3/df/d20/d61/d74/fa6 x:0 0 0 2024-04-26T20:18:55.501 INFO:tasks.workunit.client.0.smithi016.stdout:4/504: creat d0/d1e/d4e/d52/d54/d87/fab x:0 0 0 2024-04-26T20:18:55.501 INFO:tasks.workunit.client.0.smithi016.stdout:4/505: stat d0/dd/d1b/l6c 0 2024-04-26T20:18:55.501 INFO:tasks.workunit.client.0.smithi016.stdout:4/506: dread - d0/dd/f98 zero size 2024-04-26T20:18:55.502 INFO:tasks.workunit.client.0.smithi016.stdout:0/581: getdents d2/d8/d37/d5d 0 2024-04-26T20:18:55.502 INFO:tasks.workunit.client.0.smithi016.stdout:7/633: dwrite d0/d1/f5e [0,4194304] 0 2024-04-26T20:18:55.503 INFO:tasks.workunit.client.0.smithi016.stdout:9/730: dread d1/d1b/f80 [0,4194304] 0 2024-04-26T20:18:55.503 INFO:tasks.workunit.client.0.smithi016.stdout:7/634: fsync d0/d1/d4b/f4d 0 2024-04-26T20:18:55.503 INFO:tasks.workunit.client.0.smithi016.stdout:7/635: write d0/d1/d4b/f4d [3534954,31501] 0 2024-04-26T20:18:55.503 INFO:tasks.workunit.client.0.smithi016.stdout:9/731: write d1/d2/d20/d49/d77/d3e/f84 [5185815,63241] 0 2024-04-26T20:18:55.507 INFO:tasks.workunit.client.0.smithi016.stdout:5/896: write d1/d9/d1c/d52/d74/d98/fe1 [1262748,19158] 0 2024-04-26T20:18:55.507 INFO:tasks.workunit.client.0.smithi016.stdout:5/897: fsync d1/d9/d25/f47 0 2024-04-26T20:18:55.512 INFO:tasks.workunit.client.0.smithi016.stdout:6/509: dwrite d1/d8/d46/f71 [0,4194304] 0 2024-04-26T20:18:55.754 INFO:tasks.workunit.client.0.smithi016.stdout:4/507: mknod d0/dd/cac 0 2024-04-26T20:18:55.754 INFO:tasks.workunit.client.0.smithi016.stdout:3/520: creat d3/d9/d18/d82/fa7 x:0 0 0 2024-04-26T20:18:55.754 INFO:tasks.workunit.client.0.smithi016.stdout:0/582: unlink d2/dc/d1e/d35/f7a 0 2024-04-26T20:18:55.757 INFO:tasks.workunit.client.0.smithi016.stdout:7/636: rename d0/d1/d34/d25/d3f/f65 to d0/d1/d95/fc9 0 2024-04-26T20:18:55.757 INFO:tasks.workunit.client.0.smithi016.stdout:7/637: dread - d0/d67/f6a zero size 2024-04-26T20:18:55.759 INFO:tasks.workunit.client.0.smithi016.stdout:9/732: link d1/d2/d20/d49/d77/l8b d1/d2/d20/d49/d77/d3e/d5e/d93/lf8 0 2024-04-26T20:18:55.761 INFO:tasks.workunit.client.0.smithi016.stdout:5/898: symlink d1/d9/d11/d4d/d72/dac/de3/l124 0 2024-04-26T20:18:55.766 INFO:tasks.workunit.client.0.smithi016.stdout:6/510: unlink d1/d21/d26/d1c/d8a/c98 0 2024-04-26T20:18:55.766 INFO:tasks.workunit.client.0.smithi016.stdout:6/511: write d1/d21/d26/d1c/d4e/f8b [1365324,110074] 0 2024-04-26T20:18:55.766 INFO:tasks.workunit.client.0.smithi016.stdout:6/512: fdatasync d1/d3a/f8d 0 2024-04-26T20:18:55.766 INFO:tasks.workunit.client.0.smithi016.stdout:6/513: fdatasync d1/d21/d26/d1c/d2e/d53/d93/f9d 0 2024-04-26T20:18:55.777 INFO:tasks.workunit.client.0.smithi016.stdout:7/638: dread d0/d1/f5e [0,4194304] 0 2024-04-26T20:18:55.782 INFO:tasks.workunit.client.0.smithi016.stdout:3/521: mknod d3/d9/d18/ca8 0 2024-04-26T20:18:55.782 INFO:tasks.workunit.client.0.smithi016.stdout:0/583: creat d2/d8/d37/fc2 x:0 0 0 2024-04-26T20:18:55.787 INFO:tasks.workunit.client.0.smithi016.stdout:9/733: rename d1/d2/c78 to d1/cf9 0 2024-04-26T20:18:55.791 INFO:tasks.workunit.client.0.smithi016.stdout:3/522: creat d3/d9/d2d/d4f/fa9 x:0 0 0 2024-04-26T20:18:55.791 INFO:tasks.workunit.client.0.smithi016.stdout:3/523: chown d3/df/l68 380544 1 2024-04-26T20:18:55.793 INFO:tasks.workunit.client.0.smithi016.stdout:5/899: rename d1/d9/d1c/d52/d74/lad to d1/d9/d25/l125 0 2024-04-26T20:18:55.793 INFO:tasks.workunit.client.0.smithi016.stdout:5/900: truncate d1/d9/d1c/d52/dc4/fce 502824 0 2024-04-26T20:18:55.795 INFO:tasks.workunit.client.0.smithi016.stdout:9/734: creat d1/d2/d20/dde/ffa x:0 0 0 2024-04-26T20:18:55.798 INFO:tasks.workunit.client.0.smithi016.stdout:7/639: truncate d0/f27 3319612 0 2024-04-26T20:18:55.798 INFO:tasks.workunit.client.0.smithi016.stdout:7/640: fsync d0/d83/f3c 0 2024-04-26T20:18:55.799 INFO:tasks.workunit.client.0.smithi016.stdout:3/524: creat d3/df/faa x:0 0 0 2024-04-26T20:18:55.799 INFO:tasks.workunit.client.0.smithi016.stdout:3/525: dread - d3/df/d20/d61/d74/fa6 zero size 2024-04-26T20:18:55.800 INFO:tasks.workunit.client.0.smithi016.stdout:3/526: write d3/df/f99 [759366,77372] 0 2024-04-26T20:18:55.800 INFO:tasks.workunit.client.0.smithi016.stdout:5/901: rmdir d1/d9/d11/d4d/d72/dac/de3 39 2024-04-26T20:18:55.801 INFO:tasks.workunit.client.0.smithi016.stdout:5/902: chown d1/d9/d11/daa/d10b/f119 742839 1 2024-04-26T20:18:55.802 INFO:tasks.workunit.client.0.smithi016.stdout:4/508: dwrite d0/d1e/d4e/f8f [0,4194304] 0 2024-04-26T20:18:55.804 INFO:tasks.workunit.client.0.smithi016.stdout:9/735: rename d1/d59/lf2 to d1/d2/d20/lfb 0 2024-04-26T20:18:55.805 INFO:tasks.workunit.client.0.smithi016.stdout:9/736: dread - d1/ff3 zero size 2024-04-26T20:18:55.807 INFO:tasks.workunit.client.0.smithi016.stdout:7/641: symlink d0/d51/dc7/lca 0 2024-04-26T20:18:55.820 INFO:tasks.workunit.client.0.smithi016.stdout:1/689: sync 2024-04-26T20:18:55.820 INFO:tasks.workunit.client.0.smithi016.stdout:1/690: write d3/d5/da/d66/d8c/d84/d86/fc8 [443428,91179] 0 2024-04-26T20:18:55.822 INFO:tasks.workunit.client.0.smithi016.stdout:8/647: sync 2024-04-26T20:18:55.822 INFO:tasks.workunit.client.0.smithi016.stdout:2/616: sync 2024-04-26T20:18:55.828 INFO:tasks.workunit.client.0.smithi016.stdout:6/514: write d1/d8/dae/faf [3767991,107058] 0 2024-04-26T20:18:55.828 INFO:tasks.workunit.client.0.smithi016.stdout:2/617: truncate d1d/d20/d22/d39/d3e/f77 1787409 0 2024-04-26T20:18:55.828 INFO:tasks.workunit.client.0.smithi016.stdout:9/737: link d1/d2/d20/d49/d77/d2a/d75/d85/fee d1/d2/d20/d49/d77/d2a/ffc 0 2024-04-26T20:18:55.830 INFO:tasks.workunit.client.0.smithi016.stdout:2/618: mknod d1d/d20/d22/d89/ccc 0 2024-04-26T20:18:55.836 INFO:tasks.workunit.client.0.smithi016.stdout:9/738: rename d1/d2/d20/dda to d1/d2/d20/d49/d77/d2a/dfd 0 2024-04-26T20:18:55.838 INFO:tasks.workunit.client.0.smithi016.stdout:2/619: creat d1d/d20/d22/fcd x:0 0 0 2024-04-26T20:18:55.842 INFO:tasks.workunit.client.0.smithi016.stdout:9/739: mkdir d1/d2/d20/d49/d77/d3e/d5e/d93/dfe 0 2024-04-26T20:18:55.849 INFO:tasks.workunit.client.0.smithi016.stdout:3/527: write d3/df/d25/d2a/f94 [7279750,5671] 0 2024-04-26T20:18:55.850 INFO:tasks.workunit.client.0.smithi016.stdout:1/691: read d3/d5/da/d66/d8c/f83 [2235138,79393] 0 2024-04-26T20:18:55.850 INFO:tasks.workunit.client.0.smithi016.stdout:1/692: readlink d3/d5/da/d66/lac 0 2024-04-26T20:18:55.850 INFO:tasks.workunit.client.0.smithi016.stdout:6/515: rename d1/d21/d26/d1c/d5d/l86 to d1/d21/d26/d1c/d2e/d53/lb1 0 2024-04-26T20:18:55.853 INFO:tasks.workunit.client.0.smithi016.stdout:3/528: creat d3/df/d25/d32/fab x:0 0 0 2024-04-26T20:18:55.853 INFO:tasks.workunit.client.0.smithi016.stdout:3/529: write d3/d9/d2d/d62/f97 [918627,34477] 0 2024-04-26T20:18:55.855 INFO:tasks.workunit.client.0.smithi016.stdout:1/693: link d3/d5/da/d66/lac d3/d5/da/d66/d8c/le3 0 2024-04-26T20:18:55.855 INFO:tasks.workunit.client.0.smithi016.stdout:1/694: chown d3/d57/lb7 4000 1 2024-04-26T20:18:55.856 INFO:tasks.workunit.client.0.smithi016.stdout:6/516: creat d1/d3a/fb2 x:0 0 0 2024-04-26T20:18:55.858 INFO:tasks.workunit.client.0.smithi016.stdout:3/530: mkdir d3/d9/d2d/d62/dac 0 2024-04-26T20:18:55.864 INFO:tasks.workunit.client.0.smithi016.stdout:6/517: unlink d1/d21/d26/d1c/c4a 0 2024-04-26T20:18:55.864 INFO:tasks.workunit.client.0.smithi016.stdout:6/518: chown d1/d3a 8268 1 2024-04-26T20:18:55.864 INFO:tasks.workunit.client.0.smithi016.stdout:1/695: rename d3/d5/d6/d5a/dbf/fd0 to d3/d5/d6/d50/fe4 0 2024-04-26T20:18:55.865 INFO:tasks.workunit.client.0.smithi016.stdout:3/531: creat d3/df/d25/d32/d9e/fad x:0 0 0 2024-04-26T20:18:55.880 INFO:tasks.workunit.client.0.smithi016.stdout:4/509: dwrite d0/d1e/d4e/d52/d88/d43/d5a/fa9 [0,4194304] 0 2024-04-26T20:18:55.888 INFO:tasks.workunit.client.0.smithi016.stdout:4/510: rmdir d0/d1e/d4e 39 2024-04-26T20:18:55.888 INFO:tasks.workunit.client.0.smithi016.stdout:1/696: dread d3/d5/da/f21 [0,4194304] 0 2024-04-26T20:18:55.890 INFO:tasks.workunit.client.0.smithi016.stdout:4/511: mkdir d0/d1e/d4e/d52/d54/dad 0 2024-04-26T20:18:55.892 INFO:tasks.workunit.client.0.smithi016.stdout:6/519: dread d1/d8/fc [0,4194304] 0 2024-04-26T20:18:55.892 INFO:tasks.workunit.client.0.smithi016.stdout:6/520: write d1/d8/d76/f77 [906404,113289] 0 2024-04-26T20:18:55.892 INFO:tasks.workunit.client.0.smithi016.stdout:6/521: chown d1/l1e 532401414 1 2024-04-26T20:18:55.892 INFO:tasks.workunit.client.0.smithi016.stdout:5/903: dwrite d1/d78/d99/dde/f39 [0,4194304] 0 2024-04-26T20:18:55.892 INFO:tasks.workunit.client.0.smithi016.stdout:5/904: dread - d1/d9f/fb7 zero size 2024-04-26T20:18:55.893 INFO:tasks.workunit.client.0.smithi016.stdout:1/697: symlink d3/le5 0 2024-04-26T20:18:55.893 INFO:tasks.workunit.client.0.smithi016.stdout:1/698: fdatasync d3/d5/fb5 0 2024-04-26T20:18:55.896 INFO:tasks.workunit.client.0.smithi016.stdout:2/620: dread d1d/d27/d2d/f2f [0,4194304] 0 2024-04-26T20:18:55.896 INFO:tasks.workunit.client.0.smithi016.stdout:2/621: write d1d/d27/d2d/d6b/d7e/f8a [4322127,13137] 0 2024-04-26T20:18:55.896 INFO:tasks.workunit.client.0.smithi016.stdout:8/648: dwrite f5 [0,4194304] 0 2024-04-26T20:18:55.896 INFO:tasks.workunit.client.0.smithi016.stdout:0/584: dwrite d2/d8/d3b/fa3 [0,4194304] 0 2024-04-26T20:18:55.896 INFO:tasks.workunit.client.0.smithi016.stdout:0/585: dread - d2/d20/d57/fa4 zero size 2024-04-26T20:18:55.897 INFO:tasks.workunit.client.0.smithi016.stdout:9/740: dwrite d1/d2/d20/d49/d77/d2a/d75/d85/fee [0,4194304] 0 2024-04-26T20:18:55.900 INFO:tasks.workunit.client.0.smithi016.stdout:4/512: creat d0/d1e/d64/fae x:0 0 0 2024-04-26T20:18:55.910 INFO:tasks.workunit.client.0.smithi016.stdout:2/622: mkdir d1d/d27/d2d/d5a/dc7/dce 0 2024-04-26T20:18:55.912 INFO:tasks.workunit.client.0.smithi016.stdout:0/586: mknod d2/d8/d37/d70/cc3 0 2024-04-26T20:18:55.915 INFO:tasks.workunit.client.0.smithi016.stdout:5/905: dread d1/d9/d11/d4d/d72/dac/fe6 [0,4194304] 0 2024-04-26T20:18:55.916 INFO:tasks.workunit.client.0.smithi016.stdout:6/522: truncate d1/d21/d26/d1c/d7b/d82/fa9 2384446 0 2024-04-26T20:18:55.916 INFO:tasks.workunit.client.0.smithi016.stdout:6/523: readlink d1/d8/d2c/d47/l96 0 2024-04-26T20:18:55.919 INFO:tasks.workunit.client.0.smithi016.stdout:9/741: mkdir d1/d2/d20/dff 0 2024-04-26T20:18:55.919 INFO:tasks.workunit.client.0.smithi016.stdout:4/513: rmdir d0/dd/d19/da1 0 2024-04-26T20:18:55.930 INFO:tasks.workunit.client.0.smithi016.stdout:2/623: link d1d/d52/f5f d1d/d27/d2d/d5a/dc7/fcf 0 2024-04-26T20:18:55.934 INFO:tasks.workunit.client.0.smithi016.stdout:0/587: rename d2/d8/d37/d5d/lbb to d2/d20/d41/lc4 0 2024-04-26T20:18:55.940 INFO:tasks.workunit.client.0.smithi016.stdout:5/906: symlink d1/d78/d99/l126 0 2024-04-26T20:18:55.952 INFO:tasks.workunit.client.0.smithi016.stdout:3/532: dwrite d3/df/d25/d2a/f42 [0,4194304] 0 2024-04-26T20:18:55.963 INFO:tasks.workunit.client.0.smithi016.stdout:6/524: rename d1/d8/d2c/la5 to d1/d21/d26/lb3 0 2024-04-26T20:18:55.963 INFO:tasks.workunit.client.0.smithi016.stdout:5/907: dread d1/d9/f95 [0,4194304] 0 2024-04-26T20:18:55.963 INFO:tasks.workunit.client.0.smithi016.stdout:5/908: chown d1/d9/f16 2120766783 1 2024-04-26T20:18:55.963 INFO:tasks.workunit.client.0.smithi016.stdout:5/909: fsync d1/d7d/fe8 0 2024-04-26T20:18:55.967 INFO:tasks.workunit.client.0.smithi016.stdout:6/525: truncate d1/fd 2323654 0 2024-04-26T20:18:55.968 INFO:tasks.workunit.client.0.smithi016.stdout:5/910: creat d1/d9/d1c/d52/d74/d98/f127 x:0 0 0 2024-04-26T20:18:55.980 INFO:tasks.workunit.client.0.smithi016.stdout:3/533: creat d3/d9/d2d/d62/dac/fae x:0 0 0 2024-04-26T20:18:55.980 INFO:tasks.workunit.client.0.smithi016.stdout:5/911: creat d1/d78/d99/dde/d8f/db6/dcc/f128 x:0 0 0 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:6/526: rmdir d1/d21/d26/d25/d6f 0 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:6/527: write d1/d21/d26/d1c/f91 [370572,114196] 0 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:6/528: write d1/f1f [4818790,30372] 0 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:1/699: dwrite d3/d5/d6/d50/d79/fa5 [0,4194304] 0 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:1/700: mkdir d3/d5/d6/d9/d9e/de6 0 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:1/701: dread - d3/d5/d8d/fdd zero size 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:1/702: mkdir d3/d5/da/d66/de7 0 2024-04-26T20:18:55.981 INFO:tasks.workunit.client.0.smithi016.stdout:1/703: getdents d3/d5/da/d66/de7 0 2024-04-26T20:18:55.982 INFO:tasks.workunit.client.0.smithi016.stdout:1/704: rename d3/d5/da/d66/d8c/fdb to d3/d5/d6/d9/fe8 0 2024-04-26T20:18:55.983 INFO:tasks.workunit.client.0.smithi016.stdout:1/705: mknod d3/d5/d6/d9/d2a/d3b/ce9 0 2024-04-26T20:18:55.984 INFO:tasks.workunit.client.0.smithi016.stdout:1/706: stat d3/d5/da/d66/lac 0 2024-04-26T20:18:55.985 INFO:tasks.workunit.client.0.smithi016.stdout:1/707: dread - d3/d5/d6/d5a/fb8 zero size 2024-04-26T20:18:56.020 INFO:tasks.workunit.client.0.smithi016.stdout:8/649: dwrite d9/d23/d26/d2c/fc0 [0,4194304] 0 2024-04-26T20:18:56.023 INFO:tasks.workunit.client.0.smithi016.stdout:8/650: unlink d9/d19/lc2 0 2024-04-26T20:18:56.024 INFO:tasks.workunit.client.0.smithi016.stdout:8/651: creat d9/d19/d45/d9e/d50/dad/fe2 x:0 0 0 2024-04-26T20:18:56.025 INFO:tasks.workunit.client.0.smithi016.stdout:8/652: mknod d9/d23/d26/d2c/ce3 0 2024-04-26T20:18:56.025 INFO:tasks.workunit.client.0.smithi016.stdout:8/653: write d9/d19/d45/d9e/d50/dad/fd2 [239929,605] 0 2024-04-26T20:18:56.027 INFO:tasks.workunit.client.0.smithi016.stdout:8/654: mknod d9/d19/d45/d3f/d4d/dba/ce4 0 2024-04-26T20:18:56.028 INFO:tasks.workunit.client.0.smithi016.stdout:8/655: rmdir d9/d19/d45/d9e/d50/da9/dac 39 2024-04-26T20:18:56.028 INFO:tasks.workunit.client.0.smithi016.stdout:8/656: fsync d9/d72/f98 0 2024-04-26T20:18:56.028 INFO:tasks.workunit.client.0.smithi016.stdout:3/534: write d3/df/d25/d2a/d4a/f91 [116261,117884] 0 2024-04-26T20:18:56.030 INFO:tasks.workunit.client.0.smithi016.stdout:8/657: mkdir d9/d19/d45/d9e/de5 0 2024-04-26T20:18:56.031 INFO:tasks.workunit.client.0.smithi016.stdout:4/514: write d0/d1e/d4e/d52/d88/d43/d5a/fa9 [653906,123153] 0 2024-04-26T20:18:56.036 INFO:tasks.workunit.client.0.smithi016.stdout:3/535: link d3/df/d25/f5c d3/df/d20/d41/faf 0 2024-04-26T20:18:56.037 INFO:tasks.workunit.client.0.smithi016.stdout:2/624: dwrite d1d/d20/d22/d39/f45 [0,4194304] 0 2024-04-26T20:18:56.038 INFO:tasks.workunit.client.0.smithi016.stdout:4/515: mkdir d0/dd/d66/d6f/d7f/daf 0 2024-04-26T20:18:56.038 INFO:tasks.workunit.client.0.smithi016.stdout:4/516: fsync d0/d1e/d4e/d52/d54/d87/fab 0 2024-04-26T20:18:56.038 INFO:tasks.workunit.client.0.smithi016.stdout:3/536: getdents d3/d9/d18/d82 0 2024-04-26T20:18:56.040 INFO:tasks.workunit.client.0.smithi016.stdout:2/625: truncate d1d/d27/d2d/d6b/d7e/f8a 4330216 0 2024-04-26T20:18:56.047 INFO:tasks.workunit.client.0.smithi016.stdout:3/537: mkdir d3/df/d20/db0 0 2024-04-26T20:18:56.048 INFO:tasks.workunit.client.0.smithi016.stdout:2/626: creat d1d/d2a/d3d/fd0 x:0 0 0 2024-04-26T20:18:56.048 INFO:tasks.workunit.client.0.smithi016.stdout:2/627: readlink d1d/d20/d22/d39/d3e/l6c 0 2024-04-26T20:18:56.049 INFO:tasks.workunit.client.0.smithi016.stdout:2/628: write d1d/d52/f5f [452578,85912] 0 2024-04-26T20:18:56.049 INFO:tasks.workunit.client.0.smithi016.stdout:8/658: dread d9/d19/f34 [0,4194304] 0 2024-04-26T20:18:56.049 INFO:tasks.workunit.client.0.smithi016.stdout:8/659: stat d9/d19/d45/d3f/d64/f62 0 2024-04-26T20:18:56.049 INFO:tasks.workunit.client.0.smithi016.stdout:8/660: fdatasync d9/d23/d26/f76 0 2024-04-26T20:18:56.057 INFO:tasks.workunit.client.0.smithi016.stdout:9/742: dwrite d1/f97 [0,4194304] 0 2024-04-26T20:18:56.060 INFO:tasks.workunit.client.0.smithi016.stdout:3/538: mknod d3/cb1 0 2024-04-26T20:18:56.060 INFO:tasks.workunit.client.0.smithi016.stdout:2/629: rename d1d/d20/d22/d29/f35 to d1d/d20/d7c/dbc/fd1 0 2024-04-26T20:18:56.061 INFO:tasks.workunit.client.0.smithi016.stdout:8/661: mkdir d9/d19/de6 0 2024-04-26T20:18:56.063 INFO:tasks.workunit.client.0.smithi016.stdout:9/743: creat d1/d59/d52/d8c/df1/f100 x:0 0 0 2024-04-26T20:18:56.064 INFO:tasks.workunit.client.0.smithi016.stdout:3/539: symlink d3/d9/lb2 0 2024-04-26T20:18:56.064 INFO:tasks.workunit.client.0.smithi016.stdout:2/630: mknod d1d/d27/cd2 0 2024-04-26T20:18:56.064 INFO:tasks.workunit.client.0.smithi016.stdout:2/631: readlink d1d/l48 0 2024-04-26T20:18:56.068 INFO:tasks.workunit.client.0.smithi016.stdout:8/662: creat d9/d72/d74/dcd/fe7 x:0 0 0 2024-04-26T20:18:56.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/540: creat d3/df/d20/d61/d74/fb3 x:0 0 0 2024-04-26T20:18:56.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/541: dread - d3/d9/d18/d5a/f96 zero size 2024-04-26T20:18:56.068 INFO:tasks.workunit.client.0.smithi016.stdout:2/632: stat d1d/d27/d2d/l73 0 2024-04-26T20:18:56.068 INFO:tasks.workunit.client.0.smithi016.stdout:8/663: symlink d9/d72/d74/dcd/le8 0 2024-04-26T20:18:56.068 INFO:tasks.workunit.client.0.smithi016.stdout:8/664: chown d9/d19/d45/l4c 5444017 1 2024-04-26T20:18:56.073 INFO:tasks.workunit.client.0.smithi016.stdout:6/529: write d1/d21/d26/fb0 [1151466,69365] 0 2024-04-26T20:18:56.073 INFO:tasks.workunit.client.0.smithi016.stdout:6/530: dread d1/d21/d26/d1c/d4e/fa0 [0,4194304] 0 2024-04-26T20:18:56.075 INFO:tasks.workunit.client.0.smithi016.stdout:2/633: creat d1d/d27/d2d/d5a/dc7/dce/fd3 x:0 0 0 2024-04-26T20:18:56.076 INFO:tasks.workunit.client.0.smithi016.stdout:2/634: fdatasync d1d/d20/d22/d29/f37 0 2024-04-26T20:18:56.085 INFO:tasks.workunit.client.0.smithi016.stdout:5/912: dwrite d1/d9/d1c/d52/d74/f32 [8388608,4194304] 0 2024-04-26T20:18:56.085 INFO:tasks.workunit.client.0.smithi016.stdout:5/913: dread - d1/d9/d25/dc0/f101 zero size 2024-04-26T20:18:56.085 INFO:tasks.workunit.client.0.smithi016.stdout:5/914: truncate d1/d9/d25/f2a 4857721 0 2024-04-26T20:18:56.087 INFO:tasks.workunit.client.0.smithi016.stdout:6/531: mknod d1/d21/d26/d1c/d7b/d82/cb4 0 2024-04-26T20:18:56.087 INFO:tasks.workunit.client.0.smithi016.stdout:6/532: dread - d1/d21/d26/d1c/f4d zero size 2024-04-26T20:18:56.104 INFO:tasks.workunit.client.0.smithi016.stdout:1/708: dwrite d3/d5/da/fdf [0,4194304] 0 2024-04-26T20:18:56.109 INFO:tasks.workunit.client.0.smithi016.stdout:6/533: creat d1/d12/fb5 x:0 0 0 2024-04-26T20:18:56.130 INFO:tasks.workunit.client.0.smithi016.stdout:5/915: dread d1/d9/d11/f34 [0,4194304] 0 2024-04-26T20:18:56.131 INFO:tasks.workunit.client.0.smithi016.stdout:2/635: write d1d/d2a/f4a [4241347,74007] 0 2024-04-26T20:18:56.131 INFO:tasks.workunit.client.0.smithi016.stdout:8/665: dwrite d9/d19/d45/d9e/d50/dad/fe2 [0,4194304] 0 2024-04-26T20:18:56.131 INFO:tasks.workunit.client.0.smithi016.stdout:2/636: write d1d/d27/f50 [1037531,25562] 0 2024-04-26T20:18:56.131 INFO:tasks.workunit.client.0.smithi016.stdout:2/637: chown d1d/d27/d2d/d6b/c87 152873 1 2024-04-26T20:18:56.134 INFO:tasks.workunit.client.0.smithi016.stdout:1/709: symlink d3/d5/da/d66/d8c/d84/d86/lea 0 2024-04-26T20:18:56.136 INFO:tasks.workunit.client.0.smithi016.stdout:3/542: dwrite d3/df/f99 [0,4194304] 0 2024-04-26T20:18:56.136 INFO:tasks.workunit.client.0.smithi016.stdout:3/543: write d3/d9/fa2 [530843,115772] 0 2024-04-26T20:18:56.137 INFO:tasks.workunit.client.0.smithi016.stdout:3/544: dread d3/df/d20/d61/f9f [0,4194304] 0 2024-04-26T20:18:56.137 INFO:tasks.workunit.client.0.smithi016.stdout:9/744: dwrite f0 [0,4194304] 0 2024-04-26T20:18:56.139 INFO:tasks.workunit.client.0.smithi016.stdout:2/638: creat d1d/d20/d22/d98/fd4 x:0 0 0 2024-04-26T20:18:56.140 INFO:tasks.workunit.client.0.smithi016.stdout:2/639: stat l1a 0 2024-04-26T20:18:56.140 INFO:tasks.workunit.client.0.smithi016.stdout:1/710: getdents d3/d5/d6/d9 0 2024-04-26T20:18:56.142 INFO:tasks.workunit.client.0.smithi016.stdout:3/545: rmdir d3/d9/d2d 39 2024-04-26T20:18:56.142 INFO:tasks.workunit.client.0.smithi016.stdout:3/546: fdatasync d3/d9/d2d/fa5 0 2024-04-26T20:18:56.144 INFO:tasks.workunit.client.0.smithi016.stdout:3/547: chown d3/df/d25/d2a/la0 12 1 2024-04-26T20:18:56.146 INFO:tasks.workunit.client.0.smithi016.stdout:2/640: truncate d1d/d20/f42 1808994 0 2024-04-26T20:18:56.146 INFO:tasks.workunit.client.0.smithi016.stdout:2/641: truncate d1d/d20/f81 987402 0 2024-04-26T20:18:56.152 INFO:tasks.workunit.client.0.smithi016.stdout:3/548: chown d3/df/d20/d41/l55 488 1 2024-04-26T20:18:56.156 INFO:tasks.workunit.client.0.smithi016.stdout:2/642: creat d1d/d27/d2d/d5a/fd5 x:0 0 0 2024-04-26T20:18:56.157 INFO:tasks.workunit.client.0.smithi016.stdout:5/916: read d1/d9/d25/f67 [2132961,99555] 0 2024-04-26T20:18:56.159 INFO:tasks.workunit.client.0.smithi016.stdout:3/549: unlink d3/df/f40 0 2024-04-26T20:18:56.160 INFO:tasks.workunit.client.0.smithi016.stdout:3/550: write d3/d9/d2d/d62/f6c [1355050,58918] 0 2024-04-26T20:18:56.163 INFO:tasks.workunit.client.0.smithi016.stdout:5/917: link d1/d9/d11/d4d/l7e d1/d9/d1c/d52/dc4/l129 0 2024-04-26T20:18:56.165 INFO:tasks.workunit.client.0.smithi016.stdout:3/551: getdents d3/d9/d2d 0 2024-04-26T20:18:56.166 INFO:tasks.workunit.client.0.smithi016.stdout:5/918: truncate d1/d9/d1c/d52/d74/f1d 2645487 0 2024-04-26T20:18:56.167 INFO:tasks.workunit.client.0.smithi016.stdout:5/919: write d1/d9/d1c/d52/d74/fc7 [249518,55923] 0 2024-04-26T20:18:56.174 INFO:tasks.workunit.client.0.smithi016.stdout:8/666: dread d9/d19/d45/d3f/f7f [0,4194304] 0 2024-04-26T20:18:56.180 INFO:tasks.workunit.client.0.smithi016.stdout:3/552: creat d3/df/d25/d2a/d4a/fb4 x:0 0 0 2024-04-26T20:18:56.187 INFO:tasks.workunit.client.0.smithi016.stdout:4/517: dwrite d0/d1e/d4e/d52/d88/d43/f4a [4194304,4194304] 0 2024-04-26T20:18:56.188 INFO:tasks.workunit.client.0.smithi016.stdout:3/553: rename d3/d9/d2d/d62 to d3/df/d25/d2a/d69/db5 0 2024-04-26T20:18:56.189 INFO:tasks.workunit.client.0.smithi016.stdout:1/711: dread d3/d5/d6/d50/d79/da7/fc6 [0,4194304] 0 2024-04-26T20:18:56.190 INFO:tasks.workunit.client.0.smithi016.stdout:3/554: truncate d3/d9/f65 7586570 0 2024-04-26T20:18:56.190 INFO:tasks.workunit.client.0.smithi016.stdout:3/555: truncate d3/d9/d18/d5a/f96 394867 0 2024-04-26T20:18:56.191 INFO:tasks.workunit.client.0.smithi016.stdout:1/712: symlink d3/d5/d6/d9/d2a/d3b/leb 0 2024-04-26T20:18:56.208 INFO:tasks.workunit.client.0.smithi016.stdout:4/518: rmdir d0/dd/d66/d6f 39 2024-04-26T20:18:56.218 INFO:tasks.workunit.client.0.smithi016.stdout:2/643: dread d1d/d20/d7c/f91 [0,4194304] 0 2024-04-26T20:18:56.222 INFO:tasks.workunit.client.0.smithi016.stdout:6/534: dwrite d1/f7 [0,4194304] 0 2024-04-26T20:18:56.222 INFO:tasks.workunit.client.0.smithi016.stdout:6/535: write d1/d12/f70 [657394,56090] 0 2024-04-26T20:18:56.231 INFO:tasks.workunit.client.0.smithi016.stdout:9/745: dwrite d1/d59/d52/fba [0,4194304] 0 2024-04-26T20:18:56.231 INFO:tasks.workunit.client.0.smithi016.stdout:6/536: unlink d1/d3a/f8d 0 2024-04-26T20:18:56.232 INFO:tasks.workunit.client.0.smithi016.stdout:6/537: write d1/d8/dae/faf [3902757,130146] 0 2024-04-26T20:18:56.238 INFO:tasks.workunit.client.0.smithi016.stdout:1/713: dwrite d3/d5/da/d66/d8c/fb6 [0,4194304] 0 2024-04-26T20:18:56.238 INFO:tasks.workunit.client.0.smithi016.stdout:1/714: write d3/d5/d6/d9/f71 [7932536,62338] 0 2024-04-26T20:18:56.238 INFO:tasks.workunit.client.0.smithi016.stdout:1/715: readlink d3/d5/d6/l15 0 2024-04-26T20:18:56.248 INFO:tasks.workunit.client.0.smithi016.stdout:8/667: dwrite d9/d23/d26/f2e [0,4194304] 0 2024-04-26T20:18:56.250 INFO:tasks.workunit.client.0.smithi016.stdout:6/538: creat d1/d21/d48/d51/fb6 x:0 0 0 2024-04-26T20:18:56.252 INFO:tasks.workunit.client.0.smithi016.stdout:9/746: rename d1/d2/d20/d49/d77/lb9 to d1/d59/d52/d8c/l101 0 2024-04-26T20:18:56.256 INFO:tasks.workunit.client.0.smithi016.stdout:6/539: rmdir d1/d21/d26/d1c/d2e/d53 39 2024-04-26T20:18:56.270 INFO:tasks.workunit.client.0.smithi016.stdout:8/668: dread d9/d23/d26/d2c/f6b [0,4194304] 0 2024-04-26T20:18:56.278 INFO:tasks.workunit.client.0.smithi016.stdout:9/747: dread d1/d2/d20/d49/d77/d3e/f84 [0,4194304] 0 2024-04-26T20:18:56.279 INFO:tasks.workunit.client.0.smithi016.stdout:9/748: chown d1/f41 416 1 2024-04-26T20:18:56.279 INFO:tasks.workunit.client.0.smithi016.stdout:8/669: creat d9/d19/d45/d9e/d50/fe9 x:0 0 0 2024-04-26T20:18:56.285 INFO:tasks.workunit.client.0.smithi016.stdout:8/670: dread d9/d19/d45/d9e/d50/dad/fc4 [0,4194304] 0 2024-04-26T20:18:56.297 INFO:tasks.workunit.client.0.smithi016.stdout:8/671: dread d9/d19/d45/d3f/d4d/f93 [0,4194304] 0 2024-04-26T20:18:56.297 INFO:tasks.workunit.client.0.smithi016.stdout:9/749: getdents d1 0 2024-04-26T20:18:56.301 INFO:tasks.workunit.client.0.smithi016.stdout:9/750: dread d1/d2e/fad [0,4194304] 0 2024-04-26T20:18:56.302 INFO:tasks.workunit.client.0.smithi016.stdout:9/751: chown d1/d1b/f24 1018 1 2024-04-26T20:18:56.303 INFO:tasks.workunit.client.0.smithi016.stdout:8/672: mkdir d9/d23/d26/d2c/dea 0 2024-04-26T20:18:56.313 INFO:tasks.workunit.client.0.smithi016.stdout:8/673: dread d9/d19/d45/d3f/f7f [0,4194304] 0 2024-04-26T20:18:56.314 INFO:tasks.workunit.client.0.smithi016.stdout:9/752: link d1/d2/d20/d49/d77/l9c d1/d2/d43/l102 0 2024-04-26T20:18:56.315 INFO:tasks.workunit.client.0.smithi016.stdout:8/674: truncate d9/d23/d26/f76 2835674 0 2024-04-26T20:18:56.315 INFO:tasks.workunit.client.0.smithi016.stdout:8/675: readlink d9/d2f/l3b 0 2024-04-26T20:18:56.320 INFO:tasks.workunit.client.0.smithi016.stdout:8/676: dread d9/d19/d45/d9e/d50/dad/fd2 [0,4194304] 0 2024-04-26T20:18:56.320 INFO:tasks.workunit.client.0.smithi016.stdout:9/753: mknod d1/d2/d20/d49/c103 0 2024-04-26T20:18:56.322 INFO:tasks.workunit.client.0.smithi016.stdout:8/677: symlink d9/d19/de6/leb 0 2024-04-26T20:18:56.369 INFO:tasks.workunit.client.0.smithi016.stdout:9/754: dwrite d1/d2/d20/d49/d77/d3e/d5e/fe0 [0,4194304] 0 2024-04-26T20:18:56.622 INFO:tasks.workunit.client.0.smithi016.stdout:8/678: rmdir d9/d19/d45/d9e/d50/da9 39 2024-04-26T20:18:56.622 INFO:tasks.workunit.client.0.smithi016.stdout:9/755: creat d1/d1b/f104 x:0 0 0 2024-04-26T20:18:56.632 INFO:tasks.workunit.client.0.smithi016.stdout:7/642: sync 2024-04-26T20:18:56.632 INFO:tasks.workunit.client.0.smithi016.stdout:0/588: sync 2024-04-26T20:18:56.632 INFO:tasks.workunit.client.0.smithi016.stdout:7/643: fsync d0/d1/d6/d6e/f86 0 2024-04-26T20:18:56.634 INFO:tasks.workunit.client.0.smithi016.stdout:0/589: mkdir d2/dc/d1e/dc5 0 2024-04-26T20:18:56.634 INFO:tasks.workunit.client.0.smithi016.stdout:0/590: chown d2/d20/d41/d87/caf 0 1 2024-04-26T20:18:56.635 INFO:tasks.workunit.client.0.smithi016.stdout:7/644: link d0/d1/fbf d0/d1/d88/fcb 0 2024-04-26T20:18:56.637 INFO:tasks.workunit.client.0.smithi016.stdout:0/591: symlink d2/d8/lc6 0 2024-04-26T20:18:56.645 INFO:tasks.workunit.client.0.smithi016.stdout:8/679: dread d9/d19/d45/d3f/d64/f5a [0,4194304] 0 2024-04-26T20:18:56.646 INFO:tasks.workunit.client.0.smithi016.stdout:7/645: getdents d0/d1/d34/d25/d3f/d6d/d74 0 2024-04-26T20:18:56.648 INFO:tasks.workunit.client.0.smithi016.stdout:8/680: creat d9/d19/d45/d9e/d50/fec x:0 0 0 2024-04-26T20:18:56.648 INFO:tasks.workunit.client.0.smithi016.stdout:8/681: readlink d9/d23/d26/ldf 0 2024-04-26T20:18:56.649 INFO:tasks.workunit.client.0.smithi016.stdout:7/646: symlink d0/d1/d46/db4/lcc 0 2024-04-26T20:18:56.649 INFO:tasks.workunit.client.0.smithi016.stdout:7/647: fsync d0/d67/f90 0 2024-04-26T20:18:56.650 INFO:tasks.workunit.client.0.smithi016.stdout:8/682: mknod d9/d23/ced 0 2024-04-26T20:18:56.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/648: symlink d0/d1/lcd 0 2024-04-26T20:18:56.652 INFO:tasks.workunit.client.0.smithi016.stdout:7/649: chown d0/d1/d34/d25/d3f/d6d/d87 21591326 1 2024-04-26T20:18:56.653 INFO:tasks.workunit.client.0.smithi016.stdout:3/556: write d3/df/d25/d32/f3b [670260,40641] 0 2024-04-26T20:18:56.654 INFO:tasks.workunit.client.0.smithi016.stdout:8/683: mknod d9/d23/d26/d2c/dea/cee 0 2024-04-26T20:18:56.678 INFO:tasks.workunit.client.0.smithi016.stdout:0/592: write d2/dc/d18/d5b/fa8 [6355655,100029] 0 2024-04-26T20:18:56.680 INFO:tasks.workunit.client.0.smithi016.stdout:9/756: dwrite d1/f97 [0,4194304] 0 2024-04-26T20:18:56.680 INFO:tasks.workunit.client.0.smithi016.stdout:8/684: rmdir d9/d19/d45/d9e 39 2024-04-26T20:18:56.680 INFO:tasks.workunit.client.0.smithi016.stdout:0/593: symlink d2/d8/lc7 0 2024-04-26T20:18:56.682 INFO:tasks.workunit.client.0.smithi016.stdout:8/685: mknod d9/d66/d73/cef 0 2024-04-26T20:18:56.691 INFO:tasks.workunit.client.0.smithi016.stdout:1/716: sync 2024-04-26T20:18:56.691 INFO:tasks.workunit.client.0.smithi016.stdout:2/644: sync 2024-04-26T20:18:56.691 INFO:tasks.workunit.client.0.smithi016.stdout:6/540: sync 2024-04-26T20:18:56.691 INFO:tasks.workunit.client.0.smithi016.stdout:6/541: write d1/d21/d48/fad [472630,99536] 0 2024-04-26T20:18:56.694 INFO:tasks.workunit.client.0.smithi016.stdout:4/519: sync 2024-04-26T20:18:56.694 INFO:tasks.workunit.client.0.smithi016.stdout:4/520: write d0/d1e/d64/f95 [771965,122680] 0 2024-04-26T20:18:56.694 INFO:tasks.workunit.client.0.smithi016.stdout:5/920: sync 2024-04-26T20:18:56.700 INFO:tasks.workunit.client.0.smithi016.stdout:2/645: write d1d/d20/f76 [4194309,58594] 0 2024-04-26T20:18:56.700 INFO:tasks.workunit.client.0.smithi016.stdout:2/646: chown d1d/d2a/l78 2052439 1 2024-04-26T20:18:56.700 INFO:tasks.workunit.client.0.smithi016.stdout:0/594: symlink d2/d40/lc8 0 2024-04-26T20:18:56.700 INFO:tasks.workunit.client.0.smithi016.stdout:0/595: fdatasync d2/dc/d45/f84 0 2024-04-26T20:18:56.703 INFO:tasks.workunit.client.0.smithi016.stdout:6/542: link d1/d21/d26/d1c/f91 d1/d12/fb7 0 2024-04-26T20:18:56.705 INFO:tasks.workunit.client.0.smithi016.stdout:3/557: dwrite d3/df/d25/d32/d9e/fad [0,4194304] 0 2024-04-26T20:18:56.706 INFO:tasks.workunit.client.0.smithi016.stdout:0/596: creat d2/dc/fc9 x:0 0 0 2024-04-26T20:18:56.706 INFO:tasks.workunit.client.0.smithi016.stdout:6/543: symlink d1/d21/d48/lb8 0 2024-04-26T20:18:56.711 INFO:tasks.workunit.client.0.smithi016.stdout:4/521: dread d0/dd/f12 [0,4194304] 0 2024-04-26T20:18:56.713 INFO:tasks.workunit.client.0.smithi016.stdout:6/544: mkdir d1/d3a/db9 0 2024-04-26T20:18:56.720 INFO:tasks.workunit.client.0.smithi016.stdout:4/522: creat d0/d1e/d4e/d52/d88/d43/fb0 x:0 0 0 2024-04-26T20:18:56.720 INFO:tasks.workunit.client.0.smithi016.stdout:4/523: fsync d0/d1e/d64/f8e 0 2024-04-26T20:18:56.734 INFO:tasks.workunit.client.0.smithi016.stdout:5/921: dread d1/d9/d11/d4d/d72/ff9 [0,4194304] 0 2024-04-26T20:18:56.734 INFO:tasks.workunit.client.0.smithi016.stdout:5/922: fdatasync d1/d9/d1c/d52/f102 0 2024-04-26T20:18:56.736 INFO:tasks.workunit.client.0.smithi016.stdout:6/545: link d1/d8/d2c/d3d/l9e d1/d21/d26/d1c/d7b/d82/lba 0 2024-04-26T20:18:56.737 INFO:tasks.workunit.client.0.smithi016.stdout:3/558: dread d3/df/d25/d2a/d69/db5/f6c [0,4194304] 0 2024-04-26T20:18:56.737 INFO:tasks.workunit.client.0.smithi016.stdout:3/559: chown d3/df/d20/l72 104512 1 2024-04-26T20:18:56.740 INFO:tasks.workunit.client.0.smithi016.stdout:5/923: truncate d1/f8a 2927934 0 2024-04-26T20:18:56.746 INFO:tasks.workunit.client.0.smithi016.stdout:9/757: dwrite d1/d59/d52/f7c [0,4194304] 0 2024-04-26T20:18:56.753 INFO:tasks.workunit.client.0.smithi016.stdout:3/560: rmdir d3/df/d25/d2a/d69/db5/dac 39 2024-04-26T20:18:56.757 INFO:tasks.workunit.client.0.smithi016.stdout:9/758: rename d1/d2/d79/la8 to d1/l105 0 2024-04-26T20:18:56.765 INFO:tasks.workunit.client.0.smithi016.stdout:0/597: dwrite d2/d20/d41/d4c/d4e/f88 [0,4194304] 0 2024-04-26T20:18:56.766 INFO:tasks.workunit.client.0.smithi016.stdout:9/759: dread d1/d2e/fad [0,4194304] 0 2024-04-26T20:18:56.773 INFO:tasks.workunit.client.0.smithi016.stdout:4/524: dread d0/d1e/d64/f85 [0,4194304] 0 2024-04-26T20:18:56.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/561: creat d3/df/d25/d32/d3f/fb6 x:0 0 0 2024-04-26T20:18:56.778 INFO:tasks.workunit.client.0.smithi016.stdout:9/760: creat d1/d2/d20/d49/d77/d2a/d75/d85/f106 x:0 0 0 2024-04-26T20:18:56.778 INFO:tasks.workunit.client.0.smithi016.stdout:9/761: chown d1/d2/fe4 5682 1 2024-04-26T20:18:56.783 INFO:tasks.workunit.client.0.smithi016.stdout:1/717: dwrite d3/d5/da/d66/d8c/fc9 [0,4194304] 0 2024-04-26T20:18:56.792 INFO:tasks.workunit.client.0.smithi016.stdout:2/647: write d1d/d27/f53 [4135287,9270] 0 2024-04-26T20:18:56.795 INFO:tasks.workunit.client.0.smithi016.stdout:5/924: dread d1/d9/d1c/d52/f63 [0,4194304] 0 2024-04-26T20:18:56.795 INFO:tasks.workunit.client.0.smithi016.stdout:5/925: write d1/d78/f80 [3941292,102696] 0 2024-04-26T20:18:56.796 INFO:tasks.workunit.client.0.smithi016.stdout:1/718: link d3/d5/d6/d9/d2a/d3b/l82 d3/d5/d6/d50/d79/lec 0 2024-04-26T20:18:56.796 INFO:tasks.workunit.client.0.smithi016.stdout:1/719: chown d3/d5/da/d66/de7 129769376 1 2024-04-26T20:18:56.797 INFO:tasks.workunit.client.0.smithi016.stdout:2/648: truncate f13 1793017 0 2024-04-26T20:18:56.797 INFO:tasks.workunit.client.0.smithi016.stdout:3/562: link d3/df/d20/d61/d74/f8d d3/df/d20/d41/fb7 0 2024-04-26T20:18:56.801 INFO:tasks.workunit.client.0.smithi016.stdout:5/926: creat d1/d9/d11/d4d/d72/dfb/d103/d112/f12a x:0 0 0 2024-04-26T20:18:56.802 INFO:tasks.workunit.client.0.smithi016.stdout:1/720: mknod d3/d5/ced 0 2024-04-26T20:18:56.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:56.809 INFO:tasks.workunit.client.0.smithi016.stdout:6/546: dwrite d1/d12/f70 [0,4194304] 0 2024-04-26T20:18:56.809 INFO:tasks.workunit.client.0.smithi016.stdout:6/547: fsync d1/d8/d2c/f42 0 2024-04-26T20:18:56.813 INFO:tasks.workunit.client.0.smithi016.stdout:5/927: rename d1/d9f/cf4 to d1/d78/d99/dde/db4/c12b 0 2024-04-26T20:18:56.814 INFO:tasks.workunit.client.0.smithi016.stdout:5/928: chown d1/d9/d1c/d52/d74/d5f/c6b 3065 1 2024-04-26T20:18:56.814 INFO:tasks.workunit.client.0.smithi016.stdout:6/548: creat d1/d21/d78/fbb x:0 0 0 2024-04-26T20:18:56.816 INFO:tasks.workunit.client.0.smithi016.stdout:5/929: rename d1/d9/d1c/c3c to d1/d9/d1c/d52/d74/d5f/d82/c12c 0 2024-04-26T20:18:56.816 INFO:tasks.workunit.client.0.smithi016.stdout:5/930: read - d1/d78/ff8 zero size 2024-04-26T20:18:56.816 INFO:tasks.workunit.client.0.smithi016.stdout:5/931: dread - d1/fa0 zero size 2024-04-26T20:18:56.816 INFO:tasks.workunit.client.0.smithi016.stdout:5/932: chown d1/d7d/fe8 29733802 1 2024-04-26T20:18:56.819 INFO:tasks.workunit.client.0.smithi016.stdout:4/525: dwrite d0/dd/d19/d1f/f3e [0,4194304] 0 2024-04-26T20:18:56.819 INFO:tasks.workunit.client.0.smithi016.stdout:4/526: readlink d0/dd/d19/l4f 0 2024-04-26T20:18:56.834 INFO:tasks.workunit.client.0.smithi016.stdout:6/549: getdents d1/d21/d78 0 2024-04-26T20:18:56.835 INFO:tasks.workunit.client.0.smithi016.stdout:8/686: dwrite d9/d19/d45/f67 [0,4194304] 0 2024-04-26T20:18:56.835 INFO:tasks.workunit.client.0.smithi016.stdout:1/721: rename d3/d5/d6/d50/ld6 to d3/d5/d6/d50/d79/da7/lee 0 2024-04-26T20:18:56.844 INFO:tasks.workunit.client.0.smithi016.stdout:4/527: symlink d0/d1e/d4e/d52/d54/d87/lb1 0 2024-04-26T20:18:56.844 INFO:tasks.workunit.client.0.smithi016.stdout:1/722: rename d3/d5/da/d66/d8c/c6f to d3/d5/d6/d5a/cef 0 2024-04-26T20:18:56.847 INFO:tasks.workunit.client.0.smithi016.stdout:8/687: mknod d9/cf0 0 2024-04-26T20:18:56.847 INFO:tasks.workunit.client.0.smithi016.stdout:8/688: stat d9/d19/d45/d9e/d50/dad/fc4 0 2024-04-26T20:18:56.849 INFO:tasks.workunit.client.0.smithi016.stdout:1/723: creat d3/d5/d6/d50/d79/ff0 x:0 0 0 2024-04-26T20:18:56.876 INFO:tasks.workunit.client.0.smithi016.stdout:9/762: dwrite d1/d2/d20/d49/d77/d2a/f5d [4194304,4194304] 0 2024-04-26T20:18:56.876 INFO:tasks.workunit.client.0.smithi016.stdout:6/550: dread d1/d21/f39 [0,4194304] 0 2024-04-26T20:18:56.878 INFO:tasks.workunit.client.0.smithi016.stdout:3/563: dwrite d3/df/d25/d2a/d69/db5/dac/fae [0,4194304] 0 2024-04-26T20:18:56.879 INFO:tasks.workunit.client.0.smithi016.stdout:7/650: sync 2024-04-26T20:18:56.879 INFO:tasks.workunit.client.0.smithi016.stdout:7/651: stat d0/d1/d6 0 2024-04-26T20:18:56.880 INFO:tasks.workunit.client.0.smithi016.stdout:7/652: chown d0/d1/la2 0 1 2024-04-26T20:18:56.884 INFO:tasks.workunit.client.0.smithi016.stdout:0/598: dwrite d2/dc/d18/d5b/fa8 [4194304,4194304] 0 2024-04-26T20:18:56.884 INFO:tasks.workunit.client.0.smithi016.stdout:0/599: write d2/d8/d37/d70/f93 [1289865,41215] 0 2024-04-26T20:18:56.890 INFO:tasks.workunit.client.0.smithi016.stdout:2/649: dwrite d1d/d2a/fb3 [4194304,4194304] 0 2024-04-26T20:18:56.890 INFO:tasks.workunit.client.0.smithi016.stdout:2/650: chown d1d/d20/d22/d88/f95 3785 1 2024-04-26T20:18:56.891 INFO:tasks.workunit.client.0.smithi016.stdout:5/933: dwrite d1/d78/d99/dde/d8f/db6/dcc/f128 [0,4194304] 0 2024-04-26T20:18:56.891 INFO:tasks.workunit.client.0.smithi016.stdout:5/934: stat d1/d9/d1c/d52/d74/d98/cc9 0 2024-04-26T20:18:56.898 INFO:tasks.workunit.client.0.smithi016.stdout:4/528: dwrite d0/d1e/d4e/d52/d54/d87/fab [0,4194304] 0 2024-04-26T20:18:56.898 INFO:tasks.workunit.client.0.smithi016.stdout:4/529: chown d0/dd/d19/f24 95230 1 2024-04-26T20:18:56.899 INFO:tasks.workunit.client.0.smithi016.stdout:4/530: chown d0/dd/d19/d1f/d7b 424867 1 2024-04-26T20:18:56.899 INFO:tasks.workunit.client.0.smithi016.stdout:8/689: mknod d9/d19/cf1 0 2024-04-26T20:18:56.899 INFO:tasks.workunit.client.0.smithi016.stdout:3/564: mkdir d3/d9/d2d/db8 0 2024-04-26T20:18:56.903 INFO:tasks.workunit.client.0.smithi016.stdout:7/653: rmdir d0/d1/d34/d25 39 2024-04-26T20:18:56.904 INFO:tasks.workunit.client.0.smithi016.stdout:5/935: mknod d1/d7d/c12d 0 2024-04-26T20:18:56.904 INFO:tasks.workunit.client.0.smithi016.stdout:5/936: write d1/d78/d99/dde/d8f/db6/dcc/ffe [3745238,46651] 0 2024-04-26T20:18:56.904 INFO:tasks.workunit.client.0.smithi016.stdout:2/651: rename d1d/d27/d49/fa2 to d1d/d2a/d3d/fd6 0 2024-04-26T20:18:56.906 INFO:tasks.workunit.client.0.smithi016.stdout:4/531: creat d0/dd/fb2 x:0 0 0 2024-04-26T20:18:56.907 INFO:tasks.workunit.client.0.smithi016.stdout:8/690: mknod d9/d72/d74/dcd/cf2 0 2024-04-26T20:18:56.921 INFO:tasks.workunit.client.0.smithi016.stdout:6/551: dread d1/d12/f70 [0,4194304] 0 2024-04-26T20:18:56.921 INFO:tasks.workunit.client.0.smithi016.stdout:5/937: write d1/d9/d25/f64 [430828,41815] 0 2024-04-26T20:18:56.921 INFO:tasks.workunit.client.0.smithi016.stdout:6/552: dread - d1/d21/d26/d1c/d2e/d53/f5f zero size 2024-04-26T20:18:56.922 INFO:tasks.workunit.client.0.smithi016.stdout:5/938: write d1/d9/d1c/d52/d74/fe9 [786062,91832] 0 2024-04-26T20:18:56.924 INFO:tasks.workunit.client.0.smithi016.stdout:0/600: read d2/d8/d3b/fa3 [3555194,62212] 0 2024-04-26T20:18:56.932 INFO:tasks.workunit.client.0.smithi016.stdout:9/763: dread f0 [0,4194304] 0 2024-04-26T20:18:56.936 INFO:tasks.workunit.client.0.smithi016.stdout:4/532: symlink d0/d1e/d4e/d52/d88/d43/d9c/lb3 0 2024-04-26T20:18:56.936 INFO:tasks.workunit.client.0.smithi016.stdout:4/533: stat d0/d1e/d4e/d52/d88/d43/d9c/lb3 0 2024-04-26T20:18:56.936 INFO:tasks.workunit.client.0.smithi016.stdout:4/534: chown d0/d1e 1076 1 2024-04-26T20:18:56.937 INFO:tasks.workunit.client.0.smithi016.stdout:5/939: mknod d1/d7d/c12e 0 2024-04-26T20:18:56.937 INFO:tasks.workunit.client.0.smithi016.stdout:4/535: write d0/dd/d1b/f27 [236477,40338] 0 2024-04-26T20:18:56.937 INFO:tasks.workunit.client.0.smithi016.stdout:8/691: dread d9/d19/d45/d9e/d50/f97 [0,4194304] 0 2024-04-26T20:18:56.937 INFO:tasks.workunit.client.0.smithi016.stdout:5/940: write d1/fa0 [968082,112199] 0 2024-04-26T20:18:56.937 INFO:tasks.workunit.client.0.smithi016.stdout:6/553: creat d1/d21/d26/d1c/d5d/d88/fbc x:0 0 0 2024-04-26T20:18:56.939 INFO:tasks.workunit.client.0.smithi016.stdout:9/764: rmdir d1/d2/d20/d49/d77/d3e/d5e/d93/dfe 0 2024-04-26T20:18:56.941 INFO:tasks.workunit.client.0.smithi016.stdout:4/536: creat d0/dd/d66/d6f/d7f/daf/fb4 x:0 0 0 2024-04-26T20:18:56.941 INFO:tasks.workunit.client.0.smithi016.stdout:4/537: read - d0/dd/d66/d6f/d7f/daf/fb4 zero size 2024-04-26T20:18:56.942 INFO:tasks.workunit.client.0.smithi016.stdout:5/941: link d1/d9/d11/d4d/fa3 d1/d9/d11/d4d/d72/dac/f12f 0 2024-04-26T20:18:56.943 INFO:tasks.workunit.client.0.smithi016.stdout:5/942: chown f0 17183737 1 2024-04-26T20:18:56.951 INFO:tasks.workunit.client.0.smithi016.stdout:1/724: dwrite d3/d5/d6/d5a/f5d [4194304,4194304] 0 2024-04-26T20:18:56.955 INFO:tasks.workunit.client.0.smithi016.stdout:3/565: dread d3/d9/d2d/f47 [4194304,4194304] 0 2024-04-26T20:18:56.955 INFO:tasks.workunit.client.0.smithi016.stdout:9/765: truncate d1/d2e/dc6/f65 2743603 0 2024-04-26T20:18:56.959 INFO:tasks.workunit.client.0.smithi016.stdout:5/943: mkdir d1/d78/d130 0 2024-04-26T20:18:56.960 INFO:tasks.workunit.client.0.smithi016.stdout:1/725: link d3/d5/lc5 d3/d5/d6/d5a/lf1 0 2024-04-26T20:18:56.960 INFO:tasks.workunit.client.0.smithi016.stdout:3/566: rmdir d3/df/d25/d2a/d69 39 2024-04-26T20:18:56.971 INFO:tasks.workunit.client.0.smithi016.stdout:5/944: creat d1/d9/d25/dc0/f131 x:0 0 0 2024-04-26T20:18:56.971 INFO:tasks.workunit.client.0.smithi016.stdout:5/945: fsync d1/d7d/fdf 0 2024-04-26T20:18:56.976 INFO:tasks.workunit.client.0.smithi016.stdout:1/726: dread d3/d57/f6e [0,4194304] 0 2024-04-26T20:18:56.979 INFO:tasks.workunit.client.0.smithi016.stdout:4/538: dread d0/d1e/d4e/f8f [0,4194304] 0 2024-04-26T20:18:56.998 INFO:tasks.workunit.client.0.smithi016.stdout:4/539: creat d0/dd/d66/fb5 x:0 0 0 2024-04-26T20:18:56.998 INFO:tasks.workunit.client.0.smithi016.stdout:4/540: truncate d0/d1e/d64/f95 966804 0 2024-04-26T20:18:57.003 INFO:tasks.workunit.client.0.smithi016.stdout:3/567: read d3/df/d20/d41/f4e [832372,71486] 0 2024-04-26T20:18:57.003 INFO:tasks.workunit.client.0.smithi016.stdout:7/654: dwrite d0/d83/f3c [0,4194304] 0 2024-04-26T20:18:57.003 INFO:tasks.workunit.client.0.smithi016.stdout:5/946: write d1/d78/d99/dde/f44 [8194507,65699] 0 2024-04-26T20:18:57.008 INFO:tasks.workunit.client.0.smithi016.stdout:4/541: unlink d0/dd/d19/c2e 0 2024-04-26T20:18:57.008 INFO:tasks.workunit.client.0.smithi016.stdout:4/542: dread - d0/dd/f98 zero size 2024-04-26T20:18:57.010 INFO:tasks.workunit.client.0.smithi016.stdout:3/568: truncate d3/d9/d2d/d4f/f50 1682815 0 2024-04-26T20:18:57.011 INFO:tasks.workunit.client.0.smithi016.stdout:1/727: write d3/d5/d6/d50/d58/f69 [2390135,37691] 0 2024-04-26T20:18:57.011 INFO:tasks.workunit.client.0.smithi016.stdout:1/728: write d3/d5/d6/d9/f71 [13013980,118050] 0 2024-04-26T20:18:57.011 INFO:tasks.workunit.client.0.smithi016.stdout:7/655: dread d0/d1/d34/d25/d3f/f7a [0,4194304] 0 2024-04-26T20:18:57.011 INFO:tasks.workunit.client.0.smithi016.stdout:7/656: write d0/f31 [3686352,47223] 0 2024-04-26T20:18:57.011 INFO:tasks.workunit.client.0.smithi016.stdout:5/947: getdents d1/d9/d11 0 2024-04-26T20:18:57.030 INFO:tasks.workunit.client.0.smithi016.stdout:1/729: write d3/d5/d6/d5a/f5d [7842473,69241] 0 2024-04-26T20:18:57.030 INFO:tasks.workunit.client.0.smithi016.stdout:1/730: chown d3/d5/d6/d5a/fbb 112020388 1 2024-04-26T20:18:57.038 INFO:tasks.workunit.client.0.smithi016.stdout:5/948: symlink d1/d9/d1c/d52/d74/d98/dcb/dda/l132 0 2024-04-26T20:18:57.038 INFO:tasks.workunit.client.0.smithi016.stdout:5/949: stat d1/d9/d25/dc0/f131 0 2024-04-26T20:18:57.049 INFO:tasks.workunit.client.0.smithi016.stdout:1/731: rename d3/d5/d6/d9/d2a/d3b/l82 to d3/d5/d6/d5a/dbf/de2/lf2 0 2024-04-26T20:18:57.055 INFO:tasks.workunit.client.0.smithi016.stdout:1/732: creat d3/d5/d6/d50/d79/da7/ff3 x:0 0 0 2024-04-26T20:18:57.060 INFO:tasks.workunit.client.0.smithi016.stdout:4/543: dwrite d0/d1e/d64/f85 [4194304,4194304] 0 2024-04-26T20:18:57.060 INFO:tasks.workunit.client.0.smithi016.stdout:4/544: dread - d0/d1e/d64/f8e zero size 2024-04-26T20:18:57.060 INFO:tasks.workunit.client.0.smithi016.stdout:4/545: readlink d0/dd/l13 0 2024-04-26T20:18:57.074 INFO:tasks.workunit.client.0.smithi016.stdout:3/569: dwrite d3/df/d25/d2a/f73 [0,4194304] 0 2024-04-26T20:18:57.074 INFO:tasks.workunit.client.0.smithi016.stdout:3/570: read - d3/df/d25/f53 zero size 2024-04-26T20:18:57.081 INFO:tasks.workunit.client.0.smithi016.stdout:3/571: creat d3/d9/d18/d82/fb9 x:0 0 0 2024-04-26T20:18:57.097 INFO:tasks.workunit.client.0.smithi016.stdout:0/601: dread d2/d40/f5c [0,4194304] 0 2024-04-26T20:18:57.097 INFO:tasks.workunit.client.0.smithi016.stdout:0/602: stat d2/dc/d18/d5b 0 2024-04-26T20:18:57.098 INFO:tasks.workunit.client.0.smithi016.stdout:3/572: getdents d3/df/d25/d32 0 2024-04-26T20:18:57.099 INFO:tasks.workunit.client.0.smithi016.stdout:3/573: chown d3/d9/d18/f8f 242322 1 2024-04-26T20:18:57.100 INFO:tasks.workunit.client.0.smithi016.stdout:2/652: dwrite d1d/d52/f5f [0,4194304] 0 2024-04-26T20:18:57.101 INFO:tasks.workunit.client.0.smithi016.stdout:2/653: dread - d1d/d20/d22/d39/d3e/f86 zero size 2024-04-26T20:18:57.116 INFO:tasks.workunit.client.0.smithi016.stdout:0/603: creat d2/d20/d41/d87/fca x:0 0 0 2024-04-26T20:18:57.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.123+0000 7faeefe00640 1 Processor -- start 2024-04-26T20:18:57.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.123+0000 7faeefe00640 1 -- start start 2024-04-26T20:18:57.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeefe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faee8153030 0x7faee80c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:57.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeefe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee8073c60 con 0x7faee8071000 2024-04-26T20:18:57.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeefe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee80c5860 con 0x7faee80713e0 2024-04-26T20:18:57.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeefe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7faee80c9100 con 0x7faee8153030 2024-04-26T20:18:57.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeed400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faee8071000 0x7faee815c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:56338/0 (socket says 172.21.15.16:56338) 2024-04-26T20:18:57.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeed400640 1 -- 172.21.15.16:0/826441096 learned_addr learned my addr 172.21.15.16:0/826441096 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:18:57.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeede00640 1 --2- 172.21.15.16:0/826441096 >> v2:172.21.15.16:3300/0 conn(0x7faee8153030 0x7faee80c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:57.131 INFO:tasks.workunit.client.0.smithi016.stdout:2/654: dread d1d/d20/d22/d39/f45 [0,4194304] 0 2024-04-26T20:18:57.131 INFO:tasks.workunit.client.0.smithi016.stdout:2/655: truncate d1d/d20/f42 2169402 0 2024-04-26T20:18:57.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeede00640 1 -- 172.21.15.16:0/826441096 >> v1:172.21.15.192:6789/0 conn(0x7faee80713e0 legacy=0x7faee8152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:57.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeede00640 1 -- 172.21.15.16:0/826441096 >> v1:172.21.15.16:6789/0 conn(0x7faee8071000 legacy=0x7faee815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:57.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.127+0000 7faeede00640 1 -- 172.21.15.16:0/826441096 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80c5b40 con 0x7faee8153030 2024-04-26T20:18:57.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.131+0000 7faeede00640 1 --2- 172.21.15.16:0/826441096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8153030 0x7faee80c8bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faee0009d90 tx=0x7faee0021330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4955a71b8746b245 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:57.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faee7e00640 1 -- 172.21.15.16:0/826441096 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee00b6070 con 0x7faee8153030 2024-04-26T20:18:57.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faee7e00640 1 -- 172.21.15.16:0/826441096 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00b1600 con 0x7faee8153030 2024-04-26T20:18:57.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faee7e00640 1 -- 172.21.15.16:0/826441096 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee00b19d0 con 0x7faee8153030 2024-04-26T20:18:57.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 -- 172.21.15.16:0/826441096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8153030 msgr2=0x7faee80c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:57.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 --2- 172.21.15.16:0/826441096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8153030 0x7faee80c8bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faee0009d90 tx=0x7faee0021330 comp rx=0 tx=0).stop 2024-04-26T20:18:57.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 -- 172.21.15.16:0/826441096 shutdown_connections 2024-04-26T20:18:57.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 --2- 172.21.15.16:0/826441096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8153030 0x7faee80c8bc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 -- 172.21.15.16:0/826441096 >> 172.21.15.16:0/826441096 conn(0x7faee80ce2c0 msgr2=0x7faee80ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:57.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 -- 172.21.15.16:0/826441096 shutdown_connections 2024-04-26T20:18:57.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 -- 172.21.15.16:0/826441096 wait complete. 2024-04-26T20:18:57.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/604: read d2/d20/f2f [8261390,69874] 0 2024-04-26T20:18:57.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 Processor -- start 2024-04-26T20:18:57.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.135+0000 7faeefe00640 1 -- start start 2024-04-26T20:18:57.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/605: link d2/dc/d1e/d35/l9a d2/dc/d1e/lcb 0 2024-04-26T20:18:57.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8071000 0x7faee8146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:57.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faee80713e0 0x7faee8146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:57.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faee8153030 0x7faee815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:57.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faee815cff0 con 0x7faee8071000 2024-04-26T20:18:57.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faee815c0e0 con 0x7faee8153030 2024-04-26T20:18:57.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faee8158af0 con 0x7faee80713e0 2024-04-26T20:18:57.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8071000 0x7faee8146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:57.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8071000 0x7faee8146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40346/0 (socket says 172.21.15.16:40346) 2024-04-26T20:18:57.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 -- 172.21.15.16:0/2329299182 learned_addr learned my addr 172.21.15.16:0/2329299182 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:57.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeede00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faee8153030 0x7faee815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:57.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 -- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faee80713e0 msgr2=0x7faee8146890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T20:18:57.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faee80713e0 0x7faee8146890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 -- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faee8153030 msgr2=0x7faee815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:57.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faee8153030 0x7faee815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 -- 172.21.15.16:0/2329299182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80cd230 con 0x7faee8071000 2024-04-26T20:18:57.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeed400640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8071000 0x7faee8146ea0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c370 tx=0x7faedc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:57.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faee5600640 1 -- 172.21.15.16:0/2329299182 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc017070 con 0x7faee8071000 2024-04-26T20:18:57.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faee5600640 1 -- 172.21.15.16:0/2329299182 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faedc005cf0 con 0x7faee8071000 2024-04-26T20:18:57.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faee5600640 1 -- 172.21.15.16:0/2329299182 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc0072d0 con 0x7faee8071000 2024-04-26T20:18:57.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee80cd510 con 0x7faee8071000 2024-04-26T20:18:57.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.139+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee815a210 con 0x7faee8071000 2024-04-26T20:18:57.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.143+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec40052a0 con 0x7faee8071000 2024-04-26T20:18:57.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.143+0000 7faee5600640 1 -- 172.21.15.16:0/2329299182 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faedc01a070 con 0x7faee8071000 2024-04-26T20:18:57.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.147+0000 7faee5600640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faec8068380 0x7faec806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:57.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.147+0000 7faee5600640 1 -- 172.21.15.16:0/2329299182 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7faedc085ff0 con 0x7faee8071000 2024-04-26T20:18:57.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.147+0000 7faeeca00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faec8068380 0x7faec806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:57.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.147+0000 7faeeca00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faec8068380 0x7faec806a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faee8158700 tx=0x7faed40079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:57.153 INFO:tasks.workunit.client.0.smithi016.stdout:2/656: write d1d/d27/d2d/d6b/f71 [2853823,43301] 0 2024-04-26T20:18:57.154 INFO:tasks.workunit.client.0.smithi016.stdout:2/657: creat d1d/d20/d22/fd7 x:0 0 0 2024-04-26T20:18:57.154 INFO:tasks.workunit.client.0.smithi016.stdout:2/658: fsync f13 0 2024-04-26T20:18:57.155 INFO:tasks.workunit.client.0.smithi016.stdout:2/659: dread - d1d/d27/d2d/d5a/d9c/f99 zero size 2024-04-26T20:18:57.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.155+0000 7faee5600640 1 -- 172.21.15.16:0/2329299182 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faedc055af0 con 0x7faee8071000 2024-04-26T20:18:57.165 INFO:tasks.workunit.client.0.smithi016.stdout:7/657: dread d0/d1/d46/f84 [0,4194304] 0 2024-04-26T20:18:57.165 INFO:tasks.workunit.client.0.smithi016.stdout:4/546: dwrite d0/dd/d66/d6f/d7f/daf/fb4 [0,4194304] 0 2024-04-26T20:18:57.166 INFO:tasks.workunit.client.0.smithi016.stdout:6/554: dwrite d1/f1f [0,4194304] 0 2024-04-26T20:18:57.166 INFO:tasks.workunit.client.0.smithi016.stdout:9/766: dwrite d1/d2/fd [4194304,4194304] 0 2024-04-26T20:18:57.170 INFO:tasks.workunit.client.0.smithi016.stdout:6/555: creat d1/d8/dae/fbd x:0 0 0 2024-04-26T20:18:57.189 INFO:tasks.workunit.client.0.smithi016.stdout:0/606: write d2/d20/fad [188034,56026] 0 2024-04-26T20:18:57.189 INFO:tasks.workunit.client.0.smithi016.stdout:3/574: dwrite d3/df/d25/d2a/f7a [0,4194304] 0 2024-04-26T20:18:57.193 INFO:tasks.workunit.client.0.smithi016.stdout:6/556: symlink d1/d21/d78/lbe 0 2024-04-26T20:18:57.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/607: rmdir d2/d8 39 2024-04-26T20:18:57.193 INFO:tasks.workunit.client.0.smithi016.stdout:6/557: chown d1/d8/dae/f8e 1775269 1 2024-04-26T20:18:57.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/608: truncate d2/d20/d41/f69 295327 0 2024-04-26T20:18:57.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/609: fsync d2/dc/d1e/f38 0 2024-04-26T20:18:57.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/610: readlink d2/d8/d37/d70/lb4 0 2024-04-26T20:18:57.193 INFO:tasks.workunit.client.0.smithi016.stdout:0/611: truncate d2/dc/d1e/f3a 1450267 0 2024-04-26T20:18:57.197 INFO:tasks.workunit.client.0.smithi016.stdout:3/575: mknod d3/df/d25/d32/d3f/cba 0 2024-04-26T20:18:57.202 INFO:tasks.workunit.client.0.smithi016.stdout:6/558: symlink d1/d21/d26/d25/lbf 0 2024-04-26T20:18:57.203 INFO:tasks.workunit.client.0.smithi016.stdout:0/612: mknod d2/dc/d1e/ccc 0 2024-04-26T20:18:57.206 INFO:tasks.workunit.client.0.smithi016.stdout:6/559: stat d1/d21/d26/d25/l52 0 2024-04-26T20:18:57.206 INFO:tasks.workunit.client.0.smithi016.stdout:0/613: rename d2/dc/d18/c4b to d2/dc/ccd 0 2024-04-26T20:18:57.208 INFO:tasks.workunit.client.0.smithi016.stdout:6/560: truncate d1/d8/d2c/f41 1225794 0 2024-04-26T20:18:57.209 INFO:tasks.workunit.client.0.smithi016.stdout:1/733: dread d3/d5/da/d66/d8c/f93 [4194304,4194304] 0 2024-04-26T20:18:57.209 INFO:tasks.workunit.client.0.smithi016.stdout:7/658: dread d0/d1/d34/d25/d3f/d6d/d74/fa9 [0,4194304] 0 2024-04-26T20:18:57.210 INFO:tasks.workunit.client.0.smithi016.stdout:0/614: rename d2/d20/d57/fa4 to d2/d20/d41/d87/d9d/db8/fce 0 2024-04-26T20:18:57.211 INFO:tasks.workunit.client.0.smithi016.stdout:6/561: symlink d1/d21/d26/d1c/d2e/d53/lc0 0 2024-04-26T20:18:57.212 INFO:tasks.workunit.client.0.smithi016.stdout:6/562: fsync d1/d21/d26/d1c/d7b/d82/fa9 0 2024-04-26T20:18:57.212 INFO:tasks.workunit.client.0.smithi016.stdout:2/660: dwrite d1d/d2a/f31 [4194304,4194304] 0 2024-04-26T20:18:57.216 INFO:tasks.workunit.client.0.smithi016.stdout:0/615: creat d2/dc/d1e/fcf x:0 0 0 2024-04-26T20:18:57.216 INFO:tasks.workunit.client.0.smithi016.stdout:0/616: write d2/d40/d61/d91/f9c [391072,57891] 0 2024-04-26T20:18:57.217 INFO:tasks.workunit.client.0.smithi016.stdout:0/617: stat d2/dc/d1e/l68 0 2024-04-26T20:18:57.217 INFO:tasks.workunit.client.0.smithi016.stdout:0/618: write d2/d8/d37/d70/fb5 [4229,77093] 0 2024-04-26T20:18:57.217 INFO:tasks.workunit.client.0.smithi016.stdout:0/619: stat d2/d20/f2f 0 2024-04-26T20:18:57.219 INFO:tasks.workunit.client.0.smithi016.stdout:6/563: getdents d1/d21/d48/d51 0 2024-04-26T20:18:57.223 INFO:tasks.workunit.client.0.smithi016.stdout:2/661: mkdir d1d/d27/d2d/d6b/d7e/dd8 0 2024-04-26T20:18:57.223 INFO:tasks.workunit.client.0.smithi016.stdout:2/662: stat d1d/d20/d7c/f91 0 2024-04-26T20:18:57.223 INFO:tasks.workunit.client.0.smithi016.stdout:2/663: read d1d/d20/d22/f8f [316741,127369] 0 2024-04-26T20:18:57.224 INFO:tasks.workunit.client.0.smithi016.stdout:6/564: mkdir d1/d21/d26/d1c/d2e/d53/d93/dc1 0 2024-04-26T20:18:57.225 INFO:tasks.workunit.client.0.smithi016.stdout:6/565: write d1/d21/d26/d1c/d2e/d53/d93/f9d [1036404,835] 0 2024-04-26T20:18:57.225 INFO:tasks.workunit.client.0.smithi016.stdout:3/576: write d3/f19 [2825382,45460] 0 2024-04-26T20:18:57.234 INFO:tasks.workunit.client.0.smithi016.stdout:7/659: dread d0/d1/fbf [0,4194304] 0 2024-04-26T20:18:57.234 INFO:tasks.workunit.client.0.smithi016.stdout:7/660: write d0/d1/d34/d25/d50/fa8 [1114096,27289] 0 2024-04-26T20:18:57.236 INFO:tasks.workunit.client.0.smithi016.stdout:7/661: read - d0/d67/fac zero size 2024-04-26T20:18:57.237 INFO:tasks.workunit.client.0.smithi016.stdout:2/664: unlink d1d/d2a/la7 0 2024-04-26T20:18:57.237 INFO:tasks.workunit.client.0.smithi016.stdout:2/665: truncate d1d/d20/d22/d29/faf 674475 0 2024-04-26T20:18:57.237 INFO:tasks.workunit.client.0.smithi016.stdout:6/566: mknod d1/d21/d26/d1c/d2e/cc2 0 2024-04-26T20:18:57.248 INFO:tasks.workunit.client.0.smithi016.stdout:2/666: dread d1d/d27/f50 [0,4194304] 0 2024-04-26T20:18:57.252 INFO:tasks.workunit.client.0.smithi016.stdout:6/567: dread f0 [0,4194304] 0 2024-04-26T20:18:57.254 INFO:tasks.workunit.client.0.smithi016.stdout:3/577: creat d3/df/d25/fbb x:0 0 0 2024-04-26T20:18:57.261 INFO:tasks.workunit.client.0.smithi016.stdout:0/620: dwrite d2/d20/d41/d4c/d4e/f6d [0,4194304] 0 2024-04-26T20:18:57.262 INFO:tasks.workunit.client.0.smithi016.stdout:0/621: truncate d2/d8/d37/fc2 809995 0 2024-04-26T20:18:57.268 INFO:tasks.workunit.client.0.smithi016.stdout:4/547: dwrite d0/dd/d19/d1f/f9b [0,4194304] 0 2024-04-26T20:18:57.270 INFO:tasks.workunit.client.0.smithi016.stdout:4/548: dread - d0/d1e/f78 zero size 2024-04-26T20:18:57.283 INFO:tasks.workunit.client.0.smithi016.stdout:9/767: dwrite d1/d2e/dc6/f65 [0,4194304] 0 2024-04-26T20:18:57.283 INFO:tasks.workunit.client.0.smithi016.stdout:9/768: chown d1/d2/d20/d49/d77/d2a/d75/d85/d9b/ldb 235836270 1 2024-04-26T20:18:57.297 INFO:tasks.workunit.client.0.smithi016.stdout:6/568: write d1/d21/d26/d1c/d2e/d53/f69 [1968386,10201] 0 2024-04-26T20:18:57.304 INFO:tasks.workunit.client.0.smithi016.stdout:7/662: dwrite d0/f94 [0,4194304] 0 2024-04-26T20:18:57.329 INFO:tasks.workunit.client.0.smithi016.stdout:9/769: dwrite d1/f15 [0,4194304] 0 2024-04-26T20:18:57.329 INFO:tasks.workunit.client.0.smithi016.stdout:9/770: dread - d1/d59/d52/fe7 zero size 2024-04-26T20:18:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faec4005590 con 0x7faee8071000 2024-04-26T20:18:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faee5600640 1 -- 172.21.15.16:0/2329299182 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7faedc059df0 con 0x7faee8071000 2024-04-26T20:18:57.426 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:57.427 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:57.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faec8068380 msgr2=0x7faec806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faec8068380 0x7faec806a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faee8158700 tx=0x7faed40079c0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8071000 msgr2=0x7faee8146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8071000 0x7faee8146ea0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c370 tx=0x7faedc00c830 comp rx=0 tx=0).stop 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 shutdown_connections 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faec8068380 0x7faec806a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faee8153030 0x7faee815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faee80713e0 0x7faee8146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 --2- 172.21.15.16:0/2329299182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faee8071000 0x7faee8146ea0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 >> 172.21.15.16:0/2329299182 conn(0x7faee80ce2c0 msgr2=0x7faee81574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.423+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 shutdown_connections 2024-04-26T20:18:57.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:57.427+0000 7faeefe00640 1 -- 172.21.15.16:0/2329299182 wait complete. 2024-04-26T20:18:57.448 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-26T20:18:57.549 INFO:tasks.workunit.client.0.smithi016.stdout:1/734: dwrite d3/d5/d8d/dab/fca [0,4194304] 0 2024-04-26T20:18:57.766 INFO:tasks.workunit.client.0.smithi016.stdout:3/578: creat d3/d9/d18/d5a/fbc x:0 0 0 2024-04-26T20:18:57.766 INFO:tasks.workunit.client.0.smithi016.stdout:2/667: mkdir d1d/d2a/d3d/dd9 0 2024-04-26T20:18:57.766 INFO:tasks.workunit.client.0.smithi016.stdout:0/622: creat d2/dc/d18/d24/d53/fd0 x:0 0 0 2024-04-26T20:18:57.766 INFO:tasks.workunit.client.0.smithi016.stdout:3/579: readlink d3/d70/d8b/d98/la1 0 2024-04-26T20:18:57.767 INFO:tasks.workunit.client.0.smithi016.stdout:3/580: chown d3/d70/d8b/c80 6656 1 2024-04-26T20:18:57.767 INFO:tasks.workunit.client.0.smithi016.stdout:0/623: fsync d2/d8/d37/d5d/f64 0 2024-04-26T20:18:57.767 INFO:tasks.workunit.client.0.smithi016.stdout:2/668: write d1d/d27/d2d/d5a/f7a [27580,99806] 0 2024-04-26T20:18:57.767 INFO:tasks.workunit.client.0.smithi016.stdout:4/549: getdents d0/d1e/d4e/d52/d88 0 2024-04-26T20:18:57.769 INFO:tasks.workunit.client.0.smithi016.stdout:6/569: creat d1/d21/d26/d1c/d7b/d82/d8f/fc3 x:0 0 0 2024-04-26T20:18:57.769 INFO:tasks.workunit.client.0.smithi016.stdout:6/570: readlink d1/d21/d26/d1c/d8a/la3 0 2024-04-26T20:18:57.771 INFO:tasks.workunit.client.0.smithi016.stdout:7/663: getdents d0/d67 0 2024-04-26T20:18:57.771 INFO:tasks.workunit.client.0.smithi016.stdout:7/664: chown d0/d1/d34/d25/l91 29295843 1 2024-04-26T20:18:57.771 INFO:tasks.workunit.client.0.smithi016.stdout:7/665: readlink d0/d1/d34/d25/d3f/la1 0 2024-04-26T20:18:57.771 INFO:tasks.workunit.client.0.smithi016.stdout:7/666: dread - d0/d1/d6/d73/fc6 zero size 2024-04-26T20:18:57.772 INFO:tasks.workunit.client.0.smithi016.stdout:9/771: mkdir d1/d2/d20/d49/d77/d107 0 2024-04-26T20:18:57.772 INFO:tasks.workunit.client.0.smithi016.stdout:9/772: write d1/d2/d20/d49/d77/d2a/d75/fea [350776,83519] 0 2024-04-26T20:18:57.790 INFO:tasks.workunit.client.0.smithi016.stdout:1/735: stat d3/d5/d6/d5a/c45 0 2024-04-26T20:18:57.791 INFO:tasks.workunit.client.0.smithi016.stdout:4/550: symlink d0/dd/d66/d6f/lb6 0 2024-04-26T20:18:57.792 INFO:tasks.workunit.client.0.smithi016.stdout:4/551: dread - d0/dd/d66/fb5 zero size 2024-04-26T20:18:57.792 INFO:tasks.workunit.client.0.smithi016.stdout:6/571: rmdir d1/d21/d26/d1c/d2e/d53/d93 39 2024-04-26T20:18:57.793 INFO:tasks.workunit.client.0.smithi016.stdout:9/773: mkdir d1/d2/d79/d108 0 2024-04-26T20:18:57.794 INFO:tasks.workunit.client.0.smithi016.stdout:4/552: symlink d0/d1e/d4e/d52/d54/lb7 0 2024-04-26T20:18:57.794 INFO:tasks.workunit.client.0.smithi016.stdout:4/553: chown d0/dd/d19/d1f/l39 16066840 1 2024-04-26T20:18:57.796 INFO:tasks.workunit.client.0.smithi016.stdout:6/572: rename d1/d12/f16 to d1/d8/dae/fc4 0 2024-04-26T20:18:57.796 INFO:tasks.workunit.client.0.smithi016.stdout:6/573: read - d1/d21/d26/d1c/f7c zero size 2024-04-26T20:18:57.798 INFO:tasks.workunit.client.0.smithi016.stdout:9/774: unlink d1/d2e/d40/f5a 0 2024-04-26T20:18:57.799 INFO:tasks.workunit.client.0.smithi016.stdout:4/554: symlink d0/d1e/d4e/d52/d88/d43/d5a/lb8 0 2024-04-26T20:18:57.803 INFO:tasks.workunit.client.0.smithi016.stdout:6/574: mknod d1/d21/d48/d51/cc5 0 2024-04-26T20:18:57.806 INFO:tasks.workunit.client.0.smithi016.stdout:9/775: rename d1/d59/d52/d8c/le1 to d1/d2/d20/d49/d77/d2a/d75/l109 0 2024-04-26T20:18:57.809 INFO:tasks.workunit.client.0.smithi016.stdout:4/555: creat d0/d1e/d4e/d52/d88/d43/d9c/fb9 x:0 0 0 2024-04-26T20:18:57.810 INFO:tasks.workunit.client.0.smithi016.stdout:1/736: read d3/d5/f4f [2254544,23919] 0 2024-04-26T20:18:57.812 INFO:tasks.workunit.client.0.smithi016.stdout:6/575: rmdir d1/d8 39 2024-04-26T20:18:57.814 INFO:tasks.workunit.client.0.smithi016.stdout:4/556: rename d0/dd/d19/l6a to d0/dd/d19/d1f/lba 0 2024-04-26T20:18:57.814 INFO:tasks.workunit.client.0.smithi016.stdout:4/557: truncate d0/d1e/d4e/d52/f8b 755492 0 2024-04-26T20:18:57.814 INFO:tasks.workunit.client.0.smithi016.stdout:4/558: chown d0/d1e/d4e/d52/d88/d43/d5a/fa9 59 1 2024-04-26T20:18:57.817 INFO:tasks.workunit.client.0.smithi016.stdout:8/692: sync 2024-04-26T20:18:57.817 INFO:tasks.workunit.client.0.smithi016.stdout:5/950: sync 2024-04-26T20:18:57.819 INFO:tasks.workunit.client.0.smithi016.stdout:9/776: dread d1/d2/f6 [4194304,4194304] 0 2024-04-26T20:18:57.820 INFO:tasks.workunit.client.0.smithi016.stdout:6/576: rename d1/d21/d26/d1c/d2e/d53/d7f/c85 to d1/d8/d76/cc6 0 2024-04-26T20:18:57.822 INFO:tasks.workunit.client.0.smithi016.stdout:4/559: getdents d0/dd/d66/d6f/d7f/daf 0 2024-04-26T20:18:57.822 INFO:tasks.workunit.client.0.smithi016.stdout:4/560: chown d0/d1e/d4e/ca6 1767233 1 2024-04-26T20:18:57.823 INFO:tasks.workunit.client.0.smithi016.stdout:4/561: fsync d0/dd/d19/f24 0 2024-04-26T20:18:57.823 INFO:tasks.workunit.client.0.smithi016.stdout:4/562: chown d0/d1e/d4e/d52/d88/d43 122645851 1 2024-04-26T20:18:57.823 INFO:tasks.workunit.client.0.smithi016.stdout:4/563: write d0/d1e/d4e/d52/d54/f55 [4893837,68279] 0 2024-04-26T20:18:57.824 INFO:tasks.workunit.client.0.smithi016.stdout:6/577: creat d1/d8/d2c/fc7 x:0 0 0 2024-04-26T20:18:57.824 INFO:tasks.workunit.client.0.smithi016.stdout:6/578: chown d1/d8/d46 7428 1 2024-04-26T20:18:57.827 INFO:tasks.workunit.client.0.smithi016.stdout:6/579: link d1/d21/d48/d51/cc5 d1/d21/d26/d1c/d7b/d82/d8f/cc8 0 2024-04-26T20:18:57.829 INFO:tasks.workunit.client.0.smithi016.stdout:6/580: symlink d1/d21/d26/d1c/d2e/d53/d7f/lc9 0 2024-04-26T20:18:57.840 INFO:tasks.workunit.client.0.smithi016.stdout:6/581: creat d1/d21/d26/d1c/d7b/d82/d8f/fca x:0 0 0 2024-04-26T20:18:57.840 INFO:tasks.workunit.client.0.smithi016.stdout:2/669: dread d1d/d20/d22/f2c [0,4194304] 0 2024-04-26T20:18:57.841 INFO:tasks.workunit.client.0.smithi016.stdout:2/670: chown d1d/d20/d22/d39/c4b 20878 1 2024-04-26T20:18:57.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/671: creat d1d/d2a/d3d/fda x:0 0 0 2024-04-26T20:18:57.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/672: chown d1d/d20/d22/d29/faf 69294651 1 2024-04-26T20:18:57.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/673: write d1d/d20/d7c/dbc/fd1 [1736582,15698] 0 2024-04-26T20:18:57.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/674: truncate d1d/d20/f2b 2028990 0 2024-04-26T20:18:57.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/675: readlink d1d/l48 0 2024-04-26T20:18:57.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/676: fdatasync d1d/d2a/d3d/fda 0 2024-04-26T20:18:57.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/677: write d1d/d2a/d3d/fd6 [4735831,18669] 0 2024-04-26T20:18:57.858 INFO:tasks.workunit.client.0.smithi016.stdout:0/624: dwrite d2/d8/d37/fc2 [0,4194304] 0 2024-04-26T20:18:57.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/564: dread d0/d1e/f75 [0,4194304] 0 2024-04-26T20:18:57.860 INFO:tasks.workunit.client.0.smithi016.stdout:2/678: getdents d1d/d27/d2d/d6b/d7e 0 2024-04-26T20:18:57.863 INFO:tasks.workunit.client.0.smithi016.stdout:1/737: write d3/d5/d6/d5a/f90 [54820,61000] 0 2024-04-26T20:18:57.865 INFO:tasks.workunit.client.0.smithi016.stdout:5/951: write d1/d9/d11/d4d/d72/f7c [15553,72875] 0 2024-04-26T20:18:57.866 INFO:tasks.workunit.client.0.smithi016.stdout:5/952: write d1/d7d/f115 [955951,96688] 0 2024-04-26T20:18:57.867 INFO:tasks.workunit.client.0.smithi016.stdout:0/625: mknod d2/d8/d3b/cd1 0 2024-04-26T20:18:57.867 INFO:tasks.workunit.client.0.smithi016.stdout:2/679: rename d1d/d20/d22/d39/d3e/l6c to d1d/d20/d22/d88/ldb 0 2024-04-26T20:18:57.875 INFO:tasks.workunit.client.0.smithi016.stdout:4/565: truncate d0/d1e/f21 3231455 0 2024-04-26T20:18:57.875 INFO:tasks.workunit.client.0.smithi016.stdout:4/566: dread - d0/dd/d66/fb5 zero size 2024-04-26T20:18:57.876 INFO:tasks.workunit.client.0.smithi016.stdout:5/953: creat d1/d9/d11/daa/d10b/f133 x:0 0 0 2024-04-26T20:18:57.880 INFO:tasks.workunit.client.0.smithi016.stdout:3/581: dwrite d3/df/d20/d61/d74/fa6 [0,4194304] 0 2024-04-26T20:18:57.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/626: mknod d2/dc/d18/cd2 0 2024-04-26T20:18:57.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/627: readlink d2/d20/d41/d72/l8e 0 2024-04-26T20:18:57.884 INFO:tasks.workunit.client.0.smithi016.stdout:1/738: rename d3/d5/da/d66/d8c/d84/c88 to d3/d5/d6/d9/d2a/cf4 0 2024-04-26T20:18:57.887 INFO:tasks.workunit.client.0.smithi016.stdout:2/680: mkdir d1d/d27/d2d/d6b/d7e/ddc 0 2024-04-26T20:18:57.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/693: dwrite d9/d19/d45/d3f/f7f [0,4194304] 0 2024-04-26T20:18:57.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/694: write d9/f1b [5184896,184] 0 2024-04-26T20:18:57.889 INFO:tasks.workunit.client.0.smithi016.stdout:4/567: dread d0/d1e/d4e/f8f [0,4194304] 0 2024-04-26T20:18:57.899 INFO:tasks.workunit.client.0.smithi016.stdout:0/628: link d2/dc/d1e/ccc d2/d20/d41/d4c/d4e/cd3 0 2024-04-26T20:18:57.899 INFO:tasks.workunit.client.0.smithi016.stdout:0/629: chown d2/dc/d1e/d25/f55 226883 1 2024-04-26T20:18:57.905 INFO:tasks.workunit.client.0.smithi016.stdout:2/681: dread d1d/d20/f2b [0,4194304] 0 2024-04-26T20:18:57.905 INFO:tasks.workunit.client.0.smithi016.stdout:1/739: rmdir d3/d5/d6/d9/d2a/d3b 39 2024-04-26T20:18:57.906 INFO:tasks.workunit.client.0.smithi016.stdout:8/695: mknod d9/d72/d74/dcd/cf3 0 2024-04-26T20:18:57.906 INFO:tasks.workunit.client.0.smithi016.stdout:2/682: mkdir d1d/d20/d22/d39/ddd 0 2024-04-26T20:18:57.909 INFO:tasks.workunit.client.0.smithi016.stdout:8/696: creat d9/d23/d26/d2c/dea/ff4 x:0 0 0 2024-04-26T20:18:57.912 INFO:tasks.workunit.client.0.smithi016.stdout:1/740: mkdir d3/d5/da/d66/d8c/d84/d96/df5 0 2024-04-26T20:18:57.917 INFO:tasks.workunit.client.0.smithi016.stdout:2/683: symlink d1d/lde 0 2024-04-26T20:18:57.921 INFO:tasks.workunit.client.0.smithi016.stdout:0/630: write d2/d8/d37/d70/f97 [4119913,10510] 0 2024-04-26T20:18:57.928 INFO:tasks.workunit.client.0.smithi016.stdout:6/582: dread d1/d8/d46/f71 [0,4194304] 0 2024-04-26T20:18:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:7/667: dwrite d0/f8c [0,4194304] 0 2024-04-26T20:18:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:7/668: chown d0/d1/d34/d25/d50/f9e 31 1 2024-04-26T20:18:57.936 INFO:tasks.workunit.client.0.smithi016.stdout:2/684: read d1d/d20/d22/d88/f95 [344820,71702] 0 2024-04-26T20:18:57.936 INFO:tasks.workunit.client.0.smithi016.stdout:2/685: write d1d/d27/f3f [686401,129669] 0 2024-04-26T20:18:57.936 INFO:tasks.workunit.client.0.smithi016.stdout:2/686: chown d1d/d27/d2d/c8b 34487771 1 2024-04-26T20:18:57.940 INFO:tasks.workunit.client.0.smithi016.stdout:5/954: dwrite d1/d9/d1c/d52/d74/f1d [0,4194304] 0 2024-04-26T20:18:57.944 INFO:tasks.workunit.client.0.smithi016.stdout:8/697: dread d9/d72/d74/d9f/fde [0,4194304] 0 2024-04-26T20:18:57.944 INFO:tasks.workunit.client.0.smithi016.stdout:2/687: unlink d1d/d27/d49/f5c 0 2024-04-26T20:18:57.944 INFO:tasks.workunit.client.0.smithi016.stdout:2/688: chown d1d/d20/d22/d29 45 1 2024-04-26T20:18:57.944 INFO:tasks.workunit.client.0.smithi016.stdout:2/689: chown d1d/d27/d49/f9a 173 1 2024-04-26T20:18:57.944 INFO:tasks.workunit.client.0.smithi016.stdout:2/690: readlink d1d/d27/d2d/d6b/l8d 0 2024-04-26T20:18:57.964 INFO:tasks.workunit.client.0.smithi016.stdout:5/955: write d1/d9/d11/d4d/d72/ff9 [2214726,114884] 0 2024-04-26T20:18:57.966 INFO:tasks.workunit.client.0.smithi016.stdout:5/956: dread - d1/d78/d99/f116 zero size 2024-04-26T20:18:57.971 INFO:tasks.workunit.client.0.smithi016.stdout:0/631: dread d2/d8/d37/d70/f97 [0,4194304] 0 2024-04-26T20:18:57.971 INFO:tasks.workunit.client.0.smithi016.stdout:0/632: chown d2/d20/c51 5 1 2024-04-26T20:18:57.973 INFO:tasks.workunit.client.0.smithi016.stdout:6/583: dread d1/d8/dae/fc4 [0,4194304] 0 2024-04-26T20:18:57.973 INFO:tasks.workunit.client.0.smithi016.stdout:6/584: chown d1/d21/d26/d1c/d2e/d53/lb1 1159 1 2024-04-26T20:18:57.973 INFO:tasks.workunit.client.0.smithi016.stdout:6/585: chown d1/d21/d26/d1c/d2e/d53/d93 6526081 1 2024-04-26T20:18:57.974 INFO:tasks.workunit.client.0.smithi016.stdout:6/586: getdents d1/d21/d26/d1c/d2e/d53/d93/dc1 0 2024-04-26T20:18:57.978 INFO:tasks.workunit.client.0.smithi016.stdout:4/568: read d0/dd/d19/d1f/f9b [265169,54682] 0 2024-04-26T20:18:57.991 INFO:tasks.workunit.client.0.smithi016.stdout:7/669: write d0/d1/d95/f9a [1327712,90322] 0 2024-04-26T20:18:57.994 INFO:tasks.workunit.client.0.smithi016.stdout:7/670: truncate d0/d67/fb6 2326360 0 2024-04-26T20:18:57.996 INFO:tasks.workunit.client.0.smithi016.stdout:3/582: dwrite d3/df/f2b [0,4194304] 0 2024-04-26T20:18:57.996 INFO:tasks.workunit.client.0.smithi016.stdout:3/583: write d3/df/d25/d2a/f94 [5005568,75183] 0 2024-04-26T20:18:57.996 INFO:tasks.workunit.client.0.smithi016.stdout:3/584: read d3/df/d25/d32/f7c [2162833,43738] 0 2024-04-26T20:18:57.997 INFO:tasks.workunit.client.0.smithi016.stdout:7/671: mknod d0/d1/d88/cce 0 2024-04-26T20:18:58.003 INFO:tasks.workunit.client.0.smithi016.stdout:3/585: mknod d3/df/d20/d5b/cbd 0 2024-04-26T20:18:58.004 INFO:tasks.workunit.client.0.smithi016.stdout:3/586: chown d3/d70/d8b/c80 14 1 2024-04-26T20:18:58.007 INFO:tasks.workunit.client.0.smithi016.stdout:2/691: dwrite d1d/d27/d2d/d5a/dc7/dce/fd3 [0,4194304] 0 2024-04-26T20:18:58.027 INFO:tasks.workunit.client.0.smithi016.stdout:8/698: dwrite d9/d19/d45/d9e/f5b [0,4194304] 0 2024-04-26T20:18:58.030 INFO:tasks.workunit.client.0.smithi016.stdout:8/699: creat d9/d19/d45/d9e/d50/ff5 x:0 0 0 2024-04-26T20:18:58.030 INFO:tasks.workunit.client.0.smithi016.stdout:8/700: chown d9/d19/d45/d3f/l82 456832100 1 2024-04-26T20:18:58.031 INFO:tasks.workunit.client.0.smithi016.stdout:8/701: getdents d9/d23 0 2024-04-26T20:18:58.034 INFO:tasks.workunit.client.0.smithi016.stdout:8/702: link d9/d19/d45/f30 d9/d19/d45/d9e/ff6 0 2024-04-26T20:18:58.035 INFO:tasks.workunit.client.0.smithi016.stdout:8/703: write d9/d2f/f86 [212286,19670] 0 2024-04-26T20:18:58.035 INFO:tasks.workunit.client.0.smithi016.stdout:8/704: fsync d9/d19/d45/d9e/d50/dad/fc4 0 2024-04-26T20:18:58.035 INFO:tasks.workunit.client.0.smithi016.stdout:8/705: getdents d9/ddb 0 2024-04-26T20:18:58.042 INFO:tasks.workunit.client.0.smithi016.stdout:6/587: dread d1/f4 [0,4194304] 0 2024-04-26T20:18:58.042 INFO:tasks.workunit.client.0.smithi016.stdout:6/588: stat d1/d21/d26/d1c/d2e/d53/f5f 0 2024-04-26T20:18:58.048 INFO:tasks.workunit.client.0.smithi016.stdout:6/589: creat d1/d3a/db9/fcb x:0 0 0 2024-04-26T20:18:58.048 INFO:tasks.workunit.client.0.smithi016.stdout:7/672: dwrite d0/d1/d34/d25/d3f/f7a [0,4194304] 0 2024-04-26T20:18:58.051 INFO:tasks.workunit.client.0.smithi016.stdout:7/673: truncate d0/d83/f85 46192 0 2024-04-26T20:18:58.074 INFO:tasks.workunit.client.0.smithi016.stdout:4/569: dread d0/dd/d1b/f48 [0,4194304] 0 2024-04-26T20:18:58.075 INFO:tasks.workunit.client.0.smithi016.stdout:3/587: dwrite d3/df/d20/d41/fb7 [0,4194304] 0 2024-04-26T20:18:58.078 INFO:tasks.workunit.client.0.smithi016.stdout:4/570: link d0/dd/d1b/l7a d0/d1e/d4e/d52/d88/d43/d5a/lbb 0 2024-04-26T20:18:58.079 INFO:tasks.workunit.client.0.smithi016.stdout:3/588: mknod d3/d9/cbe 0 2024-04-26T20:18:58.080 INFO:tasks.workunit.client.0.smithi016.stdout:8/706: dwrite d9/d19/d45/d9e/d50/fec [0,4194304] 0 2024-04-26T20:18:58.080 INFO:tasks.workunit.client.0.smithi016.stdout:0/633: dwrite d2/d8/f11 [4194304,4194304] 0 2024-04-26T20:18:58.080 INFO:tasks.workunit.client.0.smithi016.stdout:0/634: write d2/dc/d18/f96 [659790,38460] 0 2024-04-26T20:18:58.088 INFO:tasks.workunit.client.0.smithi016.stdout:0/635: rename d2/d8/d37/d70/f93 to d2/d8/d37/d5d/fd4 0 2024-04-26T20:18:58.088 INFO:tasks.workunit.client.0.smithi016.stdout:8/707: creat d9/d19/d45/d9e/d50/da9/dac/ff7 x:0 0 0 2024-04-26T20:18:58.091 INFO:tasks.workunit.client.0.smithi016.stdout:0/636: rename d2/dc/c1b to d2/cd5 0 2024-04-26T20:18:58.091 INFO:tasks.workunit.client.0.smithi016.stdout:0/637: fdatasync d2/d20/d41/d4c/d4e/f6d 0 2024-04-26T20:18:58.091 INFO:tasks.workunit.client.0.smithi016.stdout:0/638: readlink d2/d8/l4d 0 2024-04-26T20:18:58.093 INFO:tasks.workunit.client.0.smithi016.stdout:0/639: creat d2/dc/d1e/dc5/fd6 x:0 0 0 2024-04-26T20:18:58.093 INFO:tasks.workunit.client.0.smithi016.stdout:0/640: dread - d2/dc/d18/f48 zero size 2024-04-26T20:18:58.096 INFO:tasks.workunit.client.0.smithi016.stdout:0/641: mkdir d2/dc/d18/dd7 0 2024-04-26T20:18:58.097 INFO:tasks.workunit.client.0.smithi016.stdout:0/642: dread d2/d40/d61/f81 [0,4194304] 0 2024-04-26T20:18:58.102 INFO:tasks.workunit.client.0.smithi016.stdout:4/571: read d0/dd/d19/f4d [4034019,69858] 0 2024-04-26T20:18:58.102 INFO:tasks.workunit.client.0.smithi016.stdout:4/572: write d0/dd/f12 [94028,93947] 0 2024-04-26T20:18:58.136 INFO:tasks.workunit.client.0.smithi016.stdout:7/674: dwrite d0/d1/d6/d73/fc6 [0,4194304] 0 2024-04-26T20:18:58.141 INFO:tasks.workunit.client.0.smithi016.stdout:7/675: symlink d0/d1/d4b/lcf 0 2024-04-26T20:18:58.141 INFO:tasks.workunit.client.0.smithi016.stdout:7/676: stat d0/d1/d34/d25/d3f/f7a 0 2024-04-26T20:18:58.146 INFO:tasks.workunit.client.0.smithi016.stdout:3/589: dread d3/df/d20/d41/faf [4194304,4194304] 0 2024-04-26T20:18:58.159 INFO:tasks.workunit.client.0.smithi016.stdout:8/708: dwrite d9/d66/d73/fcf [0,4194304] 0 2024-04-26T20:18:58.167 INFO:tasks.workunit.client.0.smithi016.stdout:6/590: write d1/d8/d76/f9a [2362991,68912] 0 2024-04-26T20:18:58.167 INFO:tasks.workunit.client.0.smithi016.stdout:2/692: dwrite d1d/d20/d22/fd7 [0,4194304] 0 2024-04-26T20:18:58.175 INFO:tasks.workunit.client.0.smithi016.stdout:6/591: write d1/d21/d26/f75 [894015,109208] 0 2024-04-26T20:18:58.177 INFO:tasks.workunit.client.0.smithi016.stdout:6/592: mknod d1/d8/d2c/ccc 0 2024-04-26T20:18:58.178 INFO:tasks.workunit.client.0.smithi016.stdout:6/593: symlink d1/d21/d48/lcd 0 2024-04-26T20:18:58.178 INFO:tasks.workunit.client.0.smithi016.stdout:6/594: stat d1/d8/d2c/d3d 0 2024-04-26T20:18:58.178 INFO:tasks.workunit.client.0.smithi016.stdout:6/595: chown d1/d3a/db9 1 1 2024-04-26T20:18:58.178 INFO:tasks.workunit.client.0.smithi016.stdout:6/596: dread - d1/d21/d26/d1c/f7c zero size 2024-04-26T20:18:58.179 INFO:tasks.workunit.client.0.smithi016.stdout:2/693: dread d1d/d20/f42 [0,4194304] 0 2024-04-26T20:18:58.179 INFO:tasks.workunit.client.0.smithi016.stdout:4/573: dwrite d0/d1e/d4e/d52/d88/f5f [0,4194304] 0 2024-04-26T20:18:58.179 INFO:tasks.workunit.client.0.smithi016.stdout:4/574: truncate d0/dd/f98 501631 0 2024-04-26T20:18:58.180 INFO:tasks.workunit.client.0.smithi016.stdout:6/597: mknod d1/d21/d26/d1c/d2e/d53/d7f/cce 0 2024-04-26T20:18:58.181 INFO:tasks.workunit.client.0.smithi016.stdout:2/694: creat d1d/d27/d2d/fdf x:0 0 0 2024-04-26T20:18:58.183 INFO:tasks.workunit.client.0.smithi016.stdout:4/575: mkdir d0/dd/d1b/dbc 0 2024-04-26T20:18:58.184 INFO:tasks.workunit.client.0.smithi016.stdout:6/598: mkdir d1/d21/d48/dcf 0 2024-04-26T20:18:58.185 INFO:tasks.workunit.client.0.smithi016.stdout:8/709: write d9/d19/f41 [4113869,102052] 0 2024-04-26T20:18:58.185 INFO:tasks.workunit.client.0.smithi016.stdout:2/695: truncate d1d/d2a/f31 5972484 0 2024-04-26T20:18:58.187 INFO:tasks.workunit.client.0.smithi016.stdout:4/576: rename d0/d1e/d64/d9d to d0/d1e/d4e/d52/d88/dbd 0 2024-04-26T20:18:58.189 INFO:tasks.workunit.client.0.smithi016.stdout:6/599: creat d1/fd0 x:0 0 0 2024-04-26T20:18:58.190 INFO:tasks.workunit.client.0.smithi016.stdout:8/710: getdents d9/d19/d45/d9e/d50/da9 0 2024-04-26T20:18:58.192 INFO:tasks.workunit.client.0.smithi016.stdout:6/600: creat d1/d8/d2c/d47/fd1 x:0 0 0 2024-04-26T20:18:58.196 INFO:tasks.workunit.client.0.smithi016.stdout:8/711: creat d9/d23/d26/d2c/dea/ff8 x:0 0 0 2024-04-26T20:18:58.201 INFO:tasks.workunit.client.0.smithi016.stdout:0/643: dwrite d2/d20/d41/d4c/d4e/fa1 [0,4194304] 0 2024-04-26T20:18:58.204 INFO:tasks.workunit.client.0.smithi016.stdout:0/644: getdents d2/dc/d1e/d25 0 2024-04-26T20:18:58.206 INFO:tasks.workunit.client.0.smithi016.stdout:4/577: dread d0/d1e/d4e/d52/d54/d87/fab [0,4194304] 0 2024-04-26T20:18:58.213 INFO:tasks.workunit.client.0.smithi016.stdout:8/712: dread d9/d19/d45/d9e/d50/dad/fe2 [0,4194304] 0 2024-04-26T20:18:58.213 INFO:tasks.workunit.client.0.smithi016.stdout:8/713: write d9/d72/d74/f95 [2710999,47176] 0 2024-04-26T20:18:58.216 INFO:tasks.workunit.client.0.smithi016.stdout:8/714: symlink d9/d19/d45/d3f/lf9 0 2024-04-26T20:18:58.216 INFO:tasks.workunit.client.0.smithi016.stdout:8/715: readlink d9/l54 0 2024-04-26T20:18:58.216 INFO:tasks.workunit.client.0.smithi016.stdout:8/716: truncate d9/d19/d45/d9e/d50/dad/fc4 2832199 0 2024-04-26T20:18:58.224 INFO:tasks.workunit.client.0.smithi016.stdout:8/717: creat d9/d19/d45/d3f/d4d/dba/ffa x:0 0 0 2024-04-26T20:18:58.234 INFO:tasks.workunit.client.0.smithi016.stdout:8/718: dread d9/f14 [0,4194304] 0 2024-04-26T20:18:58.235 INFO:tasks.workunit.client.0.smithi016.stdout:8/719: truncate d9/d23/d26/d2c/f9d 2140268 0 2024-04-26T20:18:58.237 INFO:tasks.workunit.client.0.smithi016.stdout:8/720: creat d9/d66/d73/ffb x:0 0 0 2024-04-26T20:18:58.237 INFO:tasks.workunit.client.0.smithi016.stdout:8/721: fsync d9/d19/d45/d3f/f63 0 2024-04-26T20:18:58.237 INFO:tasks.workunit.client.0.smithi016.stdout:8/722: readlink d9/d19/l6a 0 2024-04-26T20:18:58.237 INFO:tasks.workunit.client.0.smithi016.stdout:8/723: chown d9/l54 8135422 1 2024-04-26T20:18:58.237 INFO:tasks.workunit.client.0.smithi016.stdout:8/724: write d9/d23/d26/d2c/dea/ff8 [925420,85851] 0 2024-04-26T20:18:58.243 INFO:tasks.workunit.client.0.smithi016.stdout:6/601: dwrite d1/d21/d26/d1c/d7b/d82/d8f/fca [0,4194304] 0 2024-04-26T20:18:58.248 INFO:tasks.workunit.client.0.smithi016.stdout:3/590: dwrite d3/df/d20/d5b/f6e [0,4194304] 0 2024-04-26T20:18:58.248 INFO:tasks.workunit.client.0.smithi016.stdout:3/591: chown d3/df/d25/d32/fab 10714 1 2024-04-26T20:18:58.248 INFO:tasks.workunit.client.0.smithi016.stdout:6/602: truncate d1/d8/fc 9715851 0 2024-04-26T20:18:58.251 INFO:tasks.workunit.client.0.smithi016.stdout:3/592: rename d3/df/d25/d2a/d69/db5/f6b to d3/df/d25/d2a/fbf 0 2024-04-26T20:18:58.253 INFO:tasks.workunit.client.0.smithi016.stdout:6/603: getdents d1/d21/d26 0 2024-04-26T20:18:58.254 INFO:tasks.workunit.client.0.smithi016.stdout:3/593: truncate d3/f1b 2778992 0 2024-04-26T20:18:58.256 INFO:tasks.workunit.client.0.smithi016.stdout:6/604: creat d1/d3a/db9/fd2 x:0 0 0 2024-04-26T20:18:58.262 INFO:tasks.workunit.client.0.smithi016.stdout:2/696: dwrite d1d/d20/d22/f62 [0,4194304] 0 2024-04-26T20:18:58.264 INFO:tasks.workunit.client.0.smithi016.stdout:6/605: unlink d1/d21/d26/d1c/d7b/d82/d8f/fc3 0 2024-04-26T20:18:58.265 INFO:tasks.workunit.client.0.smithi016.stdout:2/697: creat d1d/d27/d2d/d5a/fe0 x:0 0 0 2024-04-26T20:18:58.267 INFO:tasks.workunit.client.0.smithi016.stdout:6/606: rename d1/d21/d26/d1c/d4e/l9f to d1/d8/d2c/d3d/ld3 0 2024-04-26T20:18:58.267 INFO:tasks.workunit.client.0.smithi016.stdout:6/607: readlink d1/d21/d26/d25/lbf 0 2024-04-26T20:18:58.267 INFO:tasks.workunit.client.0.smithi016.stdout:6/608: write d1/d8/d2c/d47/fd1 [520368,116949] 0 2024-04-26T20:18:58.271 INFO:tasks.workunit.client.0.smithi016.stdout:2/698: mknod d1d/d20/d22/d89/ce1 0 2024-04-26T20:18:58.272 INFO:tasks.workunit.client.0.smithi016.stdout:6/609: dread d1/d21/d48/fad [0,4194304] 0 2024-04-26T20:18:58.273 INFO:tasks.workunit.client.0.smithi016.stdout:2/699: mknod d1d/d52/ce2 0 2024-04-26T20:18:58.273 INFO:tasks.workunit.client.0.smithi016.stdout:2/700: chown d1d/d27/d2d/d5a/c6e 7595572 1 2024-04-26T20:18:58.274 INFO:tasks.workunit.client.0.smithi016.stdout:6/610: rmdir d1/d45 39 2024-04-26T20:18:58.276 INFO:tasks.workunit.client.0.smithi016.stdout:2/701: rename d1d/d27/d2d/l73 to d1d/d27/d2d/d6b/d7e/dd8/le3 0 2024-04-26T20:18:58.277 INFO:tasks.workunit.client.0.smithi016.stdout:6/611: mknod d1/d21/d48/d51/cd4 0 2024-04-26T20:18:58.277 INFO:tasks.workunit.client.0.smithi016.stdout:6/612: chown d1/d21/d26/d1c/d5d/d88/la4 18134810 1 2024-04-26T20:18:58.277 INFO:tasks.workunit.client.0.smithi016.stdout:6/613: dread - d1/d8/f92 zero size 2024-04-26T20:18:58.287 INFO:tasks.workunit.client.0.smithi016.stdout:3/594: dwrite d3/df/d25/d32/d3f/fb6 [0,4194304] 0 2024-04-26T20:18:58.288 INFO:tasks.workunit.client.0.smithi016.stdout:6/614: truncate d1/d8/d2c/d3d/f58 840570 0 2024-04-26T20:18:58.289 INFO:tasks.workunit.client.0.smithi016.stdout:6/615: chown d1/d21/d26/fb0 853720236 1 2024-04-26T20:18:58.290 INFO:tasks.workunit.client.0.smithi016.stdout:3/595: mknod d3/df/d25/d2a/d69/db5/dac/cc0 0 2024-04-26T20:18:58.290 INFO:tasks.workunit.client.0.smithi016.stdout:3/596: write d3/d9/d18/f8f [67874,23561] 0 2024-04-26T20:18:58.308 INFO:tasks.workunit.client.0.smithi016.stdout:2/702: dwrite d1d/d2a/fb5 [0,4194304] 0 2024-04-26T20:18:58.309 INFO:tasks.workunit.client.0.smithi016.stdout:2/703: write d1d/d27/d2d/d6b/d7e/f8a [4617693,116167] 0 2024-04-26T20:18:58.310 INFO:tasks.workunit.client.0.smithi016.stdout:3/597: creat d3/df/d25/d2a/d4a/fc1 x:0 0 0 2024-04-26T20:18:58.310 INFO:tasks.workunit.client.0.smithi016.stdout:3/598: write d3/df/d25/d32/d3f/f8c [475773,24007] 0 2024-04-26T20:18:58.311 INFO:tasks.workunit.client.0.smithi016.stdout:3/599: chown d3/df/d20/d41/l55 1041 1 2024-04-26T20:18:58.311 INFO:tasks.workunit.client.0.smithi016.stdout:3/600: readlink d3/df/d25/d2a/d4a/l56 0 2024-04-26T20:18:58.354 INFO:tasks.workunit.client.0.smithi016.stdout:2/704: creat d1d/d20/d22/fe4 x:0 0 0 2024-04-26T20:18:58.359 INFO:tasks.workunit.client.0.smithi016.stdout:2/705: write d1d/d27/f50 [969004,38172] 0 2024-04-26T20:18:58.425 INFO:tasks.workunit.client.0.smithi016.stdout:2/706: dwrite d1d/d27/d49/f56 [0,4194304] 0 2024-04-26T20:18:58.433 INFO:tasks.workunit.client.0.smithi016.stdout:2/707: dread d1d/d20/d7c/dbc/fd1 [0,4194304] 0 2024-04-26T20:18:58.565 INFO:tasks.workunit.client.0.smithi016.stdout:4/578: dread d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:18:58.565 INFO:tasks.workunit.client.0.smithi016.stdout:4/579: fsync d0/dd/d19/d57/f63 0 2024-04-26T20:18:58.569 INFO:tasks.workunit.client.0.smithi016.stdout:4/580: dread d0/dd/d19/f8a [0,4194304] 0 2024-04-26T20:18:58.570 INFO:tasks.workunit.client.0.smithi016.stdout:2/708: mkdir d1d/d2a/d3d/dd9/de5 0 2024-04-26T20:18:58.571 INFO:tasks.workunit.client.0.smithi016.stdout:4/581: getdents d0/d1e/d4e/d52/d88/d43 0 2024-04-26T20:18:58.576 INFO:tasks.workunit.client.0.smithi016.stdout:6/616: dread d1/fa [4194304,4194304] 0 2024-04-26T20:18:58.576 INFO:tasks.workunit.client.0.smithi016.stdout:6/617: dread - d1/d3a/fb2 zero size 2024-04-26T20:18:58.576 INFO:tasks.workunit.client.0.smithi016.stdout:6/618: dread - d1/d21/d48/d51/fb6 zero size 2024-04-26T20:18:58.576 INFO:tasks.workunit.client.0.smithi016.stdout:0/645: dwrite d2/d8/f11 [4194304,4194304] 0 2024-04-26T20:18:58.577 INFO:tasks.workunit.client.0.smithi016.stdout:2/709: symlink d1d/d20/d7c/dbc/le6 0 2024-04-26T20:18:58.584 INFO:tasks.workunit.client.0.smithi016.stdout:6/619: rename d1/d12/f70 to d1/d21/d48/fd5 0 2024-04-26T20:18:58.584 INFO:tasks.workunit.client.0.smithi016.stdout:6/620: stat d1/d3a/db9/fcb 0 2024-04-26T20:18:58.584 INFO:tasks.workunit.client.0.smithi016.stdout:2/710: creat d1d/d27/d2d/d6b/d7e/ddc/fe7 x:0 0 0 2024-04-26T20:18:58.606 INFO:tasks.workunit.client.0.smithi016.stdout:3/601: dwrite d3/d70/d8b/f93 [0,4194304] 0 2024-04-26T20:18:58.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/582: dwrite d0/dd/d19/d1f/f45 [0,4194304] 0 2024-04-26T20:18:58.618 INFO:tasks.workunit.client.0.smithi016.stdout:4/583: write d0/d1e/d64/f8e [32469,39128] 0 2024-04-26T20:18:58.652 INFO:tasks.workunit.client.0.smithi016.stdout:0/646: dwrite d2/f15 [0,4194304] 0 2024-04-26T20:18:58.666 INFO:tasks.workunit.client.0.smithi016.stdout:2/711: dwrite d1d/d20/d22/d98/fd4 [0,4194304] 0 2024-04-26T20:18:58.666 INFO:tasks.workunit.client.0.smithi016.stdout:0/647: dread d2/d20/f67 [0,4194304] 0 2024-04-26T20:18:58.671 INFO:tasks.workunit.client.0.smithi016.stdout:0/648: link d2/d8/d37/d5d/fa2 d2/d8/d3b/fd8 0 2024-04-26T20:18:58.671 INFO:tasks.workunit.client.0.smithi016.stdout:0/649: chown d2/d8/lc7 162 1 2024-04-26T20:18:58.671 INFO:tasks.workunit.client.0.smithi016.stdout:0/650: chown d2/dc/d1e 394135450 1 2024-04-26T20:18:58.671 INFO:tasks.workunit.client.0.smithi016.stdout:3/602: dwrite d3/d9/d2d/f9a [0,4194304] 0 2024-04-26T20:18:58.671 INFO:tasks.workunit.client.0.smithi016.stdout:3/603: write d3/df/d20/d61/d74/fa6 [4640301,70295] 0 2024-04-26T20:18:58.673 INFO:tasks.workunit.client.0.smithi016.stdout:6/621: dwrite d1/d8/fc [4194304,4194304] 0 2024-04-26T20:18:58.676 INFO:tasks.workunit.client.0.smithi016.stdout:2/712: creat d1d/d20/d22/d39/fe8 x:0 0 0 2024-04-26T20:18:58.684 INFO:tasks.workunit.client.0.smithi016.stdout:0/651: dread d2/d20/fad [0,4194304] 0 2024-04-26T20:18:58.685 INFO:tasks.workunit.client.0.smithi016.stdout:2/713: mknod d1d/d20/d7c/ce9 0 2024-04-26T20:18:58.685 INFO:tasks.workunit.client.0.smithi016.stdout:2/714: readlink d1d/la3 0 2024-04-26T20:18:58.686 INFO:tasks.workunit.client.0.smithi016.stdout:0/652: creat d2/dc/d18/d5b/fd9 x:0 0 0 2024-04-26T20:18:58.687 INFO:tasks.workunit.client.0.smithi016.stdout:0/653: mkdir d2/d20/d41/d87/d9d/dda 0 2024-04-26T20:18:58.691 INFO:tasks.workunit.client.0.smithi016.stdout:2/715: write d1d/d20/f81 [1455393,122854] 0 2024-04-26T20:18:58.692 INFO:tasks.workunit.client.0.smithi016.stdout:0/654: creat d2/fdb x:0 0 0 2024-04-26T20:18:58.692 INFO:tasks.workunit.client.0.smithi016.stdout:6/622: dread d1/d8/d46/f71 [0,4194304] 0 2024-04-26T20:18:58.693 INFO:tasks.workunit.client.0.smithi016.stdout:2/716: mkdir d1d/d27/d2d/d5a/dea 0 2024-04-26T20:18:58.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/717: creat d1d/d20/d7c/dbc/feb x:0 0 0 2024-04-26T20:18:58.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/718: chown d1d/d27/d2d/f2f 22266670 1 2024-04-26T20:18:58.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/719: dread - d1d/d20/d22/d29/fc8 zero size 2024-04-26T20:18:58.695 INFO:tasks.workunit.client.0.smithi016.stdout:2/720: write d1d/d2a/d3d/fd0 [232167,129278] 0 2024-04-26T20:18:58.697 INFO:tasks.workunit.client.0.smithi016.stdout:2/721: fdatasync d1d/d20/d22/d39/f5e 0 2024-04-26T20:18:58.697 INFO:tasks.workunit.client.0.smithi016.stdout:3/604: write d3/f16 [562431,105556] 0 2024-04-26T20:18:58.702 INFO:tasks.workunit.client.0.smithi016.stdout:2/722: write d1d/d20/f42 [1533333,90024] 0 2024-04-26T20:18:58.703 INFO:tasks.workunit.client.0.smithi016.stdout:6/623: mknod d1/d8/cd6 0 2024-04-26T20:18:58.703 INFO:tasks.workunit.client.0.smithi016.stdout:6/624: chown d1/d21/d26/d1c/d2e/f33 425418232 1 2024-04-26T20:18:58.709 INFO:tasks.workunit.client.0.smithi016.stdout:0/655: dread d2/d20/d41/d4c/d4e/fa1 [0,4194304] 0 2024-04-26T20:18:58.709 INFO:tasks.workunit.client.0.smithi016.stdout:0/656: stat d2/d8/f9 0 2024-04-26T20:18:58.718 INFO:tasks.workunit.client.0.smithi016.stdout:3/605: write d3/d9/d18/f34 [2638641,58177] 0 2024-04-26T20:18:58.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/723: symlink d1d/d20/d7c/lec 0 2024-04-26T20:18:58.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/724: fdatasync f13 0 2024-04-26T20:18:58.737 INFO:tasks.workunit.client.0.smithi016.stdout:2/725: dread d1d/d27/d2d/d5a/f7a [0,4194304] 0 2024-04-26T20:18:58.738 INFO:tasks.workunit.client.0.smithi016.stdout:3/606: mkdir d3/df/d20/db0/dc2 0 2024-04-26T20:18:58.738 INFO:tasks.workunit.client.0.smithi016.stdout:3/607: fsync d3/d9/d18/d82/fb9 0 2024-04-26T20:18:58.739 INFO:tasks.workunit.client.0.smithi016.stdout:2/726: symlink d1d/d20/d22/d39/ddd/led 0 2024-04-26T20:18:58.740 INFO:tasks.workunit.client.0.smithi016.stdout:3/608: truncate d3/df/d25/d32/f95 3821171 0 2024-04-26T20:18:58.741 INFO:tasks.workunit.client.0.smithi016.stdout:2/727: truncate d1d/d27/d2d/d6b/f71 234096 0 2024-04-26T20:18:58.760 INFO:tasks.workunit.client.0.smithi016.stdout:4/584: dwrite d0/f11 [0,4194304] 0 2024-04-26T20:18:58.760 INFO:tasks.workunit.client.0.smithi016.stdout:6/625: dwrite d1/d21/d48/fd5 [0,4194304] 0 2024-04-26T20:18:58.762 INFO:tasks.workunit.client.0.smithi016.stdout:3/609: rename d3/df/d25/d32/f7d to d3/d9/d2d/d4f/fc3 0 2024-04-26T20:18:58.767 INFO:tasks.workunit.client.0.smithi016.stdout:6/626: rename d1/d45 to d1/d8/d2c/d47/dd7 0 2024-04-26T20:18:58.767 INFO:tasks.workunit.client.0.smithi016.stdout:6/627: write d1/fd [1474493,11958] 0 2024-04-26T20:18:58.779 INFO:tasks.workunit.client.0.smithi016.stdout:1/741: sync 2024-04-26T20:18:58.779 INFO:tasks.workunit.client.0.smithi016.stdout:9/777: sync 2024-04-26T20:18:58.779 INFO:tasks.workunit.client.0.smithi016.stdout:7/677: sync 2024-04-26T20:18:58.779 INFO:tasks.workunit.client.0.smithi016.stdout:5/957: sync 2024-04-26T20:18:58.779 INFO:tasks.workunit.client.0.smithi016.stdout:3/610: write d3/d9/d2d/d4f/f50 [2036464,33838] 0 2024-04-26T20:18:58.780 INFO:tasks.workunit.client.0.smithi016.stdout:6/628: unlink d1/d8/d2c/d47/dd7/f80 0 2024-04-26T20:18:58.781 INFO:tasks.workunit.client.0.smithi016.stdout:9/778: creat d1/d2/f10a x:0 0 0 2024-04-26T20:18:58.783 INFO:tasks.workunit.client.0.smithi016.stdout:1/742: rename d3/d5/da/cd1 to d3/d5/d6/d9/d2a/d3b/cf6 0 2024-04-26T20:18:58.783 INFO:tasks.workunit.client.0.smithi016.stdout:1/743: fsync d3/d5/f18 0 2024-04-26T20:18:58.783 INFO:tasks.workunit.client.0.smithi016.stdout:7/678: creat d0/d1/d88/db3/fd0 x:0 0 0 2024-04-26T20:18:58.800 INFO:tasks.workunit.client.0.smithi016.stdout:3/611: write d3/df/d25/f28 [2264739,19192] 0 2024-04-26T20:18:58.802 INFO:tasks.workunit.client.0.smithi016.stdout:6/629: creat d1/d8/d76/fd8 x:0 0 0 2024-04-26T20:18:58.810 INFO:tasks.workunit.client.0.smithi016.stdout:9/779: truncate d1/d2/d20/d49/d77/d2a/dfd/ff6 359484 0 2024-04-26T20:18:58.810 INFO:tasks.workunit.client.0.smithi016.stdout:3/612: symlink d3/df/d25/d32/lc4 0 2024-04-26T20:18:58.815 INFO:tasks.workunit.client.0.smithi016.stdout:0/657: dread d2/dc/d1e/d35/f63 [0,4194304] 0 2024-04-26T20:18:58.819 INFO:tasks.workunit.client.0.smithi016.stdout:7/679: dread d0/d51/f5a [0,4194304] 0 2024-04-26T20:18:58.844 INFO:tasks.workunit.client.0.smithi016.stdout:6/630: dread d1/d21/d26/d1c/d2e/f33 [0,4194304] 0 2024-04-26T20:18:58.854 INFO:tasks.workunit.client.0.smithi016.stdout:1/744: dwrite d3/d5/da/d66/d8c/f93 [0,4194304] 0 2024-04-26T20:18:58.854 INFO:tasks.workunit.client.0.smithi016.stdout:7/680: dread d0/d1/d46/f84 [0,4194304] 0 2024-04-26T20:18:58.855 INFO:tasks.workunit.client.0.smithi016.stdout:7/681: dread - d0/d1/d34/d25/fb8 zero size 2024-04-26T20:18:58.856 INFO:tasks.workunit.client.0.smithi016.stdout:0/658: creat d2/d20/fdc x:0 0 0 2024-04-26T20:18:58.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/585: dread d0/d1e/f73 [0,4194304] 0 2024-04-26T20:18:58.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/586: dread - d0/d1e/d4e/d52/d88/d43/d9c/fb9 zero size 2024-04-26T20:18:58.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/587: chown d0/d1e 28100 1 2024-04-26T20:18:58.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/588: stat d0/dd/d66/d6f/d7f 0 2024-04-26T20:18:58.860 INFO:tasks.workunit.client.0.smithi016.stdout:1/745: creat d3/d5/da/d66/d8c/d84/ff7 x:0 0 0 2024-04-26T20:18:58.860 INFO:tasks.workunit.client.0.smithi016.stdout:2/728: dwrite d1d/d20/d22/fc2 [0,4194304] 0 2024-04-26T20:18:58.860 INFO:tasks.workunit.client.0.smithi016.stdout:5/958: dread d1/fa0 [0,4194304] 0 2024-04-26T20:18:58.860 INFO:tasks.workunit.client.0.smithi016.stdout:9/780: getdents d1/d2/d79 0 2024-04-26T20:18:58.861 INFO:tasks.workunit.client.0.smithi016.stdout:9/781: read d1/d2e/f17 [192281,98728] 0 2024-04-26T20:18:58.865 INFO:tasks.workunit.client.0.smithi016.stdout:4/589: creat d0/d1e/d30/fbe x:0 0 0 2024-04-26T20:18:58.865 INFO:tasks.workunit.client.0.smithi016.stdout:4/590: write d0/dd/d19/d1f/f45 [5025501,38231] 0 2024-04-26T20:18:58.868 INFO:tasks.workunit.client.0.smithi016.stdout:1/746: mkdir d3/d5/d8d/df8 0 2024-04-26T20:18:58.869 INFO:tasks.workunit.client.0.smithi016.stdout:0/659: dread d2/d20/d41/d4c/d4e/f6d [0,4194304] 0 2024-04-26T20:18:58.870 INFO:tasks.workunit.client.0.smithi016.stdout:2/729: symlink d1d/d20/d7c/dbc/lee 0 2024-04-26T20:18:58.878 INFO:tasks.workunit.client.0.smithi016.stdout:4/591: write d0/d1e/d64/f85 [5424230,68010] 0 2024-04-26T20:18:58.878 INFO:tasks.workunit.client.0.smithi016.stdout:4/592: chown d0/dd/d1b/l72 59 1 2024-04-26T20:18:58.878 INFO:tasks.workunit.client.0.smithi016.stdout:4/593: chown d0/dd/d1b/f27 317 1 2024-04-26T20:18:58.878 INFO:tasks.workunit.client.0.smithi016.stdout:0/660: symlink d2/d20/d41/d4c/ldd 0 2024-04-26T20:18:58.879 INFO:tasks.workunit.client.0.smithi016.stdout:2/730: mkdir d1d/d27/d49/def 0 2024-04-26T20:18:58.881 INFO:tasks.workunit.client.0.smithi016.stdout:4/594: mkdir d0/d96/dbf 0 2024-04-26T20:18:58.881 INFO:tasks.workunit.client.0.smithi016.stdout:4/595: write d0/d1e/d4e/d52/d88/d43/f4a [1274929,20069] 0 2024-04-26T20:18:58.911 INFO:tasks.workunit.client.0.smithi016.stdout:1/747: dwrite d3/d5/d6/d50/d79/f85 [0,4194304] 0 2024-04-26T20:18:58.911 INFO:tasks.workunit.client.0.smithi016.stdout:1/748: dread - d3/d5/da/d66/d8c/d84/d86/fc3 zero size 2024-04-26T20:18:58.911 INFO:tasks.workunit.client.0.smithi016.stdout:1/749: readlink d3/d5/d6/d5a/dbf/de2/lf2 0 2024-04-26T20:18:58.913 INFO:tasks.workunit.client.0.smithi016.stdout:0/661: mknod d2/dc/d18/d5b/cde 0 2024-04-26T20:18:58.914 INFO:tasks.workunit.client.0.smithi016.stdout:2/731: symlink d1d/d27/d49/lf0 0 2024-04-26T20:18:58.931 INFO:tasks.workunit.client.0.smithi016.stdout:8/725: sync 2024-04-26T20:18:58.933 INFO:tasks.workunit.client.0.smithi016.stdout:0/662: mknod d2/d8/d37/cdf 0 2024-04-26T20:18:58.940 INFO:tasks.workunit.client.0.smithi016.stdout:2/732: truncate d1d/d20/d22/d88/da4/fa5 1354290 0 2024-04-26T20:18:58.940 INFO:tasks.workunit.client.0.smithi016.stdout:8/726: unlink d9/d19/d45/d3f/lb1 0 2024-04-26T20:18:58.941 INFO:tasks.workunit.client.0.smithi016.stdout:0/663: symlink d2/d20/d41/d72/le0 0 2024-04-26T20:18:58.941 INFO:tasks.workunit.client.0.smithi016.stdout:0/664: write d2/dc/f79 [479596,24671] 0 2024-04-26T20:18:58.946 INFO:tasks.workunit.client.0.smithi016.stdout:8/727: mkdir d9/d19/d45/d3f/d64/dfc 0 2024-04-26T20:18:58.946 INFO:tasks.workunit.client.0.smithi016.stdout:8/728: dread - d9/d66/d73/fd6 zero size 2024-04-26T20:18:58.958 INFO:tasks.workunit.client.0.smithi016.stdout:1/750: dwrite d3/d5/d6/d9/d2a/fe1 [0,4194304] 0 2024-04-26T20:18:58.962 INFO:tasks.workunit.client.0.smithi016.stdout:0/665: truncate d2/d8/d37/d70/f97 3380363 0 2024-04-26T20:18:58.962 INFO:tasks.workunit.client.0.smithi016.stdout:4/596: dwrite d0/dd/f12 [0,4194304] 0 2024-04-26T20:18:58.962 INFO:tasks.workunit.client.0.smithi016.stdout:4/597: write d0/f46 [4447846,80083] 0 2024-04-26T20:18:58.963 INFO:tasks.workunit.client.0.smithi016.stdout:1/751: link d3/d5/d6/d5a/c4d d3/d5/da/d66/d8c/d84/cf9 0 2024-04-26T20:18:58.965 INFO:tasks.workunit.client.0.smithi016.stdout:0/666: symlink d2/d20/d41/d87/le1 0 2024-04-26T20:18:58.965 INFO:tasks.workunit.client.0.smithi016.stdout:0/667: chown d2/d8/d3b/fd8 0 1 2024-04-26T20:18:58.971 INFO:tasks.workunit.client.0.smithi016.stdout:4/598: symlink d0/dd/d66/d6f/lc0 0 2024-04-26T20:18:58.976 INFO:tasks.workunit.client.0.smithi016.stdout:8/729: read d9/d19/d45/d3f/d64/f5a [438979,121588] 0 2024-04-26T20:18:58.998 INFO:tasks.workunit.client.0.smithi016.stdout:9/782: dread d1/d59/d52/f7c [0,4194304] 0 2024-04-26T20:18:59.000 INFO:tasks.workunit.client.0.smithi016.stdout:5/959: dwrite d1/d78/fd4 [0,4194304] 0 2024-04-26T20:18:59.001 INFO:tasks.workunit.client.0.smithi016.stdout:5/960: dread - d1/d78/f122 zero size 2024-04-26T20:18:59.037 INFO:tasks.workunit.client.0.smithi016.stdout:2/733: dwrite d1d/d20/d7c/dbc/fd1 [0,4194304] 0 2024-04-26T20:18:59.222 INFO:tasks.workunit.client.0.smithi016.stdout:1/752: truncate d3/d5/d6/d5a/fb0 705306 0 2024-04-26T20:18:59.222 INFO:tasks.workunit.client.0.smithi016.stdout:1/753: truncate d3/d5/d6/d5a/dbf/fcc 930164 0 2024-04-26T20:18:59.222 INFO:tasks.workunit.client.0.smithi016.stdout:4/599: creat d0/d1e/fc1 x:0 0 0 2024-04-26T20:18:59.223 INFO:tasks.workunit.client.0.smithi016.stdout:8/730: mkdir d9/d72/d74/d9f/dfd 0 2024-04-26T20:18:59.223 INFO:tasks.workunit.client.0.smithi016.stdout:9/783: write d1/d2/f5 [1114597,50303] 0 2024-04-26T20:18:59.226 INFO:tasks.workunit.client.0.smithi016.stdout:5/961: rename d1/f31 to d1/d9/d1c/d52/d74/d98/dcb/f134 0 2024-04-26T20:18:59.226 INFO:tasks.workunit.client.0.smithi016.stdout:5/962: stat d1/d78/d99/dde/d8f/db6/dcc/l11e 0 2024-04-26T20:18:59.227 INFO:tasks.workunit.client.0.smithi016.stdout:2/734: rmdir d1d/d2a/d3d/dd9 39 2024-04-26T20:18:59.229 INFO:tasks.workunit.client.0.smithi016.stdout:1/754: link d3/d5/d6/d9/lc7 d3/d5/da/d66/de7/lfa 0 2024-04-26T20:18:59.231 INFO:tasks.workunit.client.0.smithi016.stdout:8/731: creat d9/d19/d45/d9e/de5/ffe x:0 0 0 2024-04-26T20:18:59.232 INFO:tasks.workunit.client.0.smithi016.stdout:4/600: rename d0/d1e/c20 to d0/d1e/d4e/d52/d88/d43/d5a/cc2 0 2024-04-26T20:18:59.233 INFO:tasks.workunit.client.0.smithi016.stdout:5/963: mknod d1/d9/d25/c135 0 2024-04-26T20:18:59.233 INFO:tasks.workunit.client.0.smithi016.stdout:5/964: write d1/d78/d99/dde/f39 [4259370,47950] 0 2024-04-26T20:18:59.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/601: write d0/dd/f98 [461794,115364] 0 2024-04-26T20:18:59.234 INFO:tasks.workunit.client.0.smithi016.stdout:9/784: dread d1/d2e/dc6/fca [0,4194304] 0 2024-04-26T20:18:59.235 INFO:tasks.workunit.client.0.smithi016.stdout:8/732: creat d9/d19/d45/d3f/d4d/fff x:0 0 0 2024-04-26T20:18:59.235 INFO:tasks.workunit.client.0.smithi016.stdout:8/733: chown d9/l36 38754 1 2024-04-26T20:18:59.235 INFO:tasks.workunit.client.0.smithi016.stdout:1/755: dread d3/d57/f6e [0,4194304] 0 2024-04-26T20:18:59.236 INFO:tasks.workunit.client.0.smithi016.stdout:2/735: rename d1d/d27/d2d/f2f to d1d/d27/d2d/d5a/dc7/ff1 0 2024-04-26T20:18:59.243 INFO:tasks.workunit.client.0.smithi016.stdout:1/756: mknod d3/d5/da/d66/d8c/d84/d86/cfb 0 2024-04-26T20:18:59.243 INFO:tasks.workunit.client.0.smithi016.stdout:1/757: readlink d3/d5/d6/l81 0 2024-04-26T20:18:59.246 INFO:tasks.workunit.client.0.smithi016.stdout:5/965: rename d1/d78/d99/dde/cb0 to d1/d9/d1c/d52/c136 0 2024-04-26T20:18:59.248 INFO:tasks.workunit.client.0.smithi016.stdout:8/734: dread d9/d19/f41 [0,4194304] 0 2024-04-26T20:18:59.252 INFO:tasks.workunit.client.0.smithi016.stdout:2/736: mkdir d1d/d27/d49/df2 0 2024-04-26T20:18:59.255 INFO:tasks.workunit.client.0.smithi016.stdout:1/758: mkdir d3/d5/d6/d9/d2a/dfc 0 2024-04-26T20:18:59.260 INFO:tasks.workunit.client.0.smithi016.stdout:4/602: rename d0/d1e/d4e/d52/d88/d43/fa0 to d0/dd/d66/d6f/d7f/daf/fc3 0 2024-04-26T20:18:59.268 INFO:tasks.workunit.client.0.smithi016.stdout:8/735: creat d9/d19/d45/d3f/d64/dfc/f100 x:0 0 0 2024-04-26T20:18:59.273 INFO:tasks.workunit.client.0.smithi016.stdout:2/737: mknod d1d/d20/d7c/cf3 0 2024-04-26T20:18:59.277 INFO:tasks.workunit.client.0.smithi016.stdout:4/603: rename d0/d1e/f21 to d0/d96/dbf/fc4 0 2024-04-26T20:18:59.277 INFO:tasks.workunit.client.0.smithi016.stdout:4/604: chown d0/d1e/d4e/d52/d88/d43/d5a/caa 115017 1 2024-04-26T20:18:59.278 INFO:tasks.workunit.client.0.smithi016.stdout:5/966: truncate d1/d9/f38 451627 0 2024-04-26T20:18:59.279 INFO:tasks.workunit.client.0.smithi016.stdout:2/738: creat d1d/d2a/d3d/dd9/de5/ff4 x:0 0 0 2024-04-26T20:18:59.280 INFO:tasks.workunit.client.0.smithi016.stdout:4/605: mkdir d0/dd/d1b/dbc/dc5 0 2024-04-26T20:18:59.281 INFO:tasks.workunit.client.0.smithi016.stdout:2/739: creat d1d/d27/d2d/d5a/d9c/ff5 x:0 0 0 2024-04-26T20:18:59.282 INFO:tasks.workunit.client.0.smithi016.stdout:2/740: write d1d/d27/d2d/f96 [738701,73598] 0 2024-04-26T20:18:59.282 INFO:tasks.workunit.client.0.smithi016.stdout:2/741: write d1d/d27/f53 [2639216,55337] 0 2024-04-26T20:18:59.282 INFO:tasks.workunit.client.0.smithi016.stdout:4/606: creat d0/dd/fc6 x:0 0 0 2024-04-26T20:18:59.282 INFO:tasks.workunit.client.0.smithi016.stdout:4/607: stat d0/d1e/fc1 0 2024-04-26T20:18:59.284 INFO:tasks.workunit.client.0.smithi016.stdout:2/742: dread d1d/d20/d22/d29/faf [0,4194304] 0 2024-04-26T20:18:59.284 INFO:tasks.workunit.client.0.smithi016.stdout:2/743: chown d1d/d27/d2d/d5a/cb9 0 1 2024-04-26T20:18:59.288 INFO:tasks.workunit.client.0.smithi016.stdout:2/744: unlink d1d/cc4 0 2024-04-26T20:18:59.290 INFO:tasks.workunit.client.0.smithi016.stdout:2/745: mkdir d1d/d27/d2d/d5a/dc7/dce/df6 0 2024-04-26T20:18:59.290 INFO:tasks.workunit.client.0.smithi016.stdout:2/746: chown d1d/d27/d2d/f30 184554232 1 2024-04-26T20:18:59.290 INFO:tasks.workunit.client.0.smithi016.stdout:2/747: fsync d1d/d27/f50 0 2024-04-26T20:18:59.295 INFO:tasks.workunit.client.0.smithi016.stdout:2/748: rename d1d/d27/d2d/d6b/l8d to d1d/d2a/d3d/lf7 0 2024-04-26T20:18:59.295 INFO:tasks.workunit.client.0.smithi016.stdout:2/749: dread - d1d/d20/d22/d29/fc8 zero size 2024-04-26T20:18:59.295 INFO:tasks.workunit.client.0.smithi016.stdout:2/750: mknod d1d/d20/d22/d29/cf8 0 2024-04-26T20:18:59.305 INFO:tasks.workunit.client.0.smithi016.stdout:2/751: rename d1d/d27/d49/f9a to d1d/d2a/ff9 0 2024-04-26T20:18:59.312 INFO:tasks.workunit.client.0.smithi016.stdout:9/785: dwrite d1/f15 [0,4194304] 0 2024-04-26T20:18:59.314 INFO:tasks.workunit.client.0.smithi016.stdout:9/786: creat d1/d2/d20/dff/f10b x:0 0 0 2024-04-26T20:18:59.314 INFO:tasks.workunit.client.0.smithi016.stdout:9/787: readlink d1/d2/d20/d49/d77/l71 0 2024-04-26T20:18:59.316 INFO:tasks.workunit.client.0.smithi016.stdout:9/788: link d1/d2/d20/d49/d77/d2a/d33/c36 d1/d2/d20/d49/d77/d107/c10c 0 2024-04-26T20:18:59.316 INFO:tasks.workunit.client.0.smithi016.stdout:9/789: truncate d1/d1b/f104 247307 0 2024-04-26T20:18:59.324 INFO:tasks.workunit.client.0.smithi016.stdout:1/759: dwrite d3/d5/f8f [4194304,4194304] 0 2024-04-26T20:18:59.327 INFO:tasks.workunit.client.0.smithi016.stdout:1/760: rename d3/d5/d6/d50/c9b to d3/d5/da/d66/de7/cfd 0 2024-04-26T20:18:59.333 INFO:tasks.workunit.client.0.smithi016.stdout:1/761: creat d3/d5/d8d/dab/ffe x:0 0 0 2024-04-26T20:18:59.340 INFO:tasks.workunit.client.0.smithi016.stdout:1/762: rename d3/d5/d6/d9/d2a/dfc to d3/d57/dff 0 2024-04-26T20:18:59.349 INFO:tasks.workunit.client.0.smithi016.stdout:4/608: dwrite d0/d1e/d4e/f8f [0,4194304] 0 2024-04-26T20:18:59.352 INFO:tasks.workunit.client.0.smithi016.stdout:2/752: dwrite f1b [4194304,4194304] 0 2024-04-26T20:18:59.356 INFO:tasks.workunit.client.0.smithi016.stdout:4/609: link d0/dd/d19/d57/f89 d0/dd/d19/d1f/d7b/fc7 0 2024-04-26T20:18:59.359 INFO:tasks.workunit.client.0.smithi016.stdout:2/753: rename d1d/d20/d22/d29/f37 to d1d/d2a/ffa 0 2024-04-26T20:18:59.362 INFO:tasks.workunit.client.0.smithi016.stdout:4/610: creat d0/dd/fc8 x:0 0 0 2024-04-26T20:18:59.362 INFO:tasks.workunit.client.0.smithi016.stdout:4/611: truncate d0/dd/d19/f8a 1207862 0 2024-04-26T20:18:59.365 INFO:tasks.workunit.client.0.smithi016.stdout:2/754: unlink d1d/d27/d2d/f30 0 2024-04-26T20:18:59.366 INFO:tasks.workunit.client.0.smithi016.stdout:2/755: write d1d/d52/fc0 [1001424,99767] 0 2024-04-26T20:18:59.366 INFO:tasks.workunit.client.0.smithi016.stdout:2/756: chown d1d/d27/d49/l5d 1041602734 1 2024-04-26T20:18:59.366 INFO:tasks.workunit.client.0.smithi016.stdout:2/757: readlink d1d/d27/d49/lf0 0 2024-04-26T20:18:59.366 INFO:tasks.workunit.client.0.smithi016.stdout:2/758: readlink d1d/d2a/lcb 0 2024-04-26T20:18:59.380 INFO:tasks.workunit.client.0.smithi016.stdout:7/682: sync 2024-04-26T20:18:59.390 INFO:tasks.workunit.client.0.smithi016.stdout:2/759: write d1d/d27/d2d/d5a/dc7/dce/fd3 [3878289,112330] 0 2024-04-26T20:18:59.392 INFO:tasks.workunit.client.0.smithi016.stdout:2/760: rename d1d/d27/d2d/d6b/d7e/fad to d1d/d27/d2d/d6b/d7e/ffb 0 2024-04-26T20:18:59.392 INFO:tasks.workunit.client.0.smithi016.stdout:2/761: chown d1d/d20/fca 4401 1 2024-04-26T20:18:59.393 INFO:tasks.workunit.client.0.smithi016.stdout:2/762: mkdir d1d/d52/dfc 0 2024-04-26T20:18:59.393 INFO:tasks.workunit.client.0.smithi016.stdout:2/763: creat d1d/d27/d2d/d5a/dea/ffd x:0 0 0 2024-04-26T20:18:59.394 INFO:tasks.workunit.client.0.smithi016.stdout:2/764: mknod d1d/d27/d2d/d5a/dc7/cfe 0 2024-04-26T20:18:59.395 INFO:tasks.workunit.client.0.smithi016.stdout:2/765: rmdir d1d/d20/d7c 39 2024-04-26T20:18:59.395 INFO:tasks.workunit.client.0.smithi016.stdout:2/766: readlink d1d/d27/d2d/d6b/lb7 0 2024-04-26T20:18:59.426 INFO:tasks.workunit.client.0.smithi016.stdout:8/736: dwrite d9/d2f/fc8 [0,4194304] 0 2024-04-26T20:18:59.430 INFO:tasks.workunit.client.0.smithi016.stdout:8/737: mkdir d9/d72/d74/dcd/dd7/d101 0 2024-04-26T20:18:59.439 INFO:tasks.workunit.client.0.smithi016.stdout:8/738: dread d9/d19/d45/d9e/d50/dad/fc4 [0,4194304] 0 2024-04-26T20:18:59.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:18:59.453 INFO:tasks.workunit.client.0.smithi016.stdout:1/763: dread d3/d5/da/d66/d8c/fa0 [0,4194304] 0 2024-04-26T20:18:59.458 INFO:tasks.workunit.client.0.smithi016.stdout:6/631: sync 2024-04-26T20:18:59.458 INFO:tasks.workunit.client.0.smithi016.stdout:9/790: dwrite d1/d2/d20/fc0 [0,4194304] 0 2024-04-26T20:18:59.458 INFO:tasks.workunit.client.0.smithi016.stdout:4/612: dread d0/dd/f6d [0,4194304] 0 2024-04-26T20:18:59.460 INFO:tasks.workunit.client.0.smithi016.stdout:6/632: mkdir d1/d21/d26/d1c/dd9 0 2024-04-26T20:18:59.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/767: dwrite d1d/d20/fc9 [0,4194304] 0 2024-04-26T20:18:59.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/768: fdatasync d1d/d2a/fb3 0 2024-04-26T20:18:59.461 INFO:tasks.workunit.client.0.smithi016.stdout:9/791: creat d1/d2e/f10d x:0 0 0 2024-04-26T20:18:59.463 INFO:tasks.workunit.client.0.smithi016.stdout:6/633: mknod d1/d21/d26/d1c/d2e/d53/d7f/cda 0 2024-04-26T20:18:59.463 INFO:tasks.workunit.client.0.smithi016.stdout:3/613: sync 2024-04-26T20:18:59.466 INFO:tasks.workunit.client.0.smithi016.stdout:6/634: getdents d1/d12 0 2024-04-26T20:18:59.475 INFO:tasks.workunit.client.0.smithi016.stdout:8/739: read d9/d23/d26/d2c/f77 [2939815,1126] 0 2024-04-26T20:18:59.481 INFO:tasks.workunit.client.0.smithi016.stdout:4/613: write d0/d96/dbf/fc4 [1093439,20404] 0 2024-04-26T20:18:59.483 INFO:tasks.workunit.client.0.smithi016.stdout:2/769: write d1d/d2a/f51 [1159568,5358] 0 2024-04-26T20:18:59.491 INFO:tasks.workunit.client.0.smithi016.stdout:8/740: dread d9/d2f/fc8 [0,4194304] 0 2024-04-26T20:18:59.491 INFO:tasks.workunit.client.0.smithi016.stdout:8/741: write d9/d23/d26/fbf [4479299,68547] 0 2024-04-26T20:18:59.491 INFO:tasks.workunit.client.0.smithi016.stdout:8/742: dread - d9/d19/d45/d9e/f8e zero size 2024-04-26T20:18:59.495 INFO:tasks.workunit.client.0.smithi016.stdout:4/614: write d0/d1e/f75 [2524355,99567] 0 2024-04-26T20:18:59.495 INFO:tasks.workunit.client.0.smithi016.stdout:4/615: write d0/dd/d19/f38 [775562,60371] 0 2024-04-26T20:18:59.508 INFO:tasks.workunit.client.0.smithi016.stdout:2/770: dread d1d/d27/d2d/d5a/dc7/fcf [0,4194304] 0 2024-04-26T20:18:59.550 INFO:tasks.workunit.client.0.smithi016.stdout:4/616: write d0/d1e/d4e/f8f [59321,85185] 0 2024-04-26T20:18:59.558 INFO:tasks.workunit.client.0.smithi016.stdout:8/743: dwrite d9/d19/d45/d9e/f68 [0,4194304] 0 2024-04-26T20:18:59.563 INFO:tasks.workunit.client.0.smithi016.stdout:2/771: dwrite d1d/d27/d2d/f96 [0,4194304] 0 2024-04-26T20:18:59.577 INFO:tasks.workunit.client.0.smithi016.stdout:4/617: dread d0/d96/dbf/fc4 [0,4194304] 0 2024-04-26T20:18:59.577 INFO:tasks.workunit.client.0.smithi016.stdout:4/618: readlink d0/dd/d19/d1f/l5b 0 2024-04-26T20:18:59.637 INFO:tasks.workunit.client.0.smithi016.stdout:4/619: dwrite d0/dd/d19/f24 [0,4194304] 0 2024-04-26T20:18:59.638 INFO:tasks.workunit.client.0.smithi016.stdout:4/620: write d0/dd/fc6 [453315,17417] 0 2024-04-26T20:18:59.642 INFO:tasks.workunit.client.0.smithi016.stdout:4/621: dread d0/dd/f3b [0,4194304] 0 2024-04-26T20:18:59.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 Processor -- start 2024-04-26T20:18:59.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 -- start start 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f61a00c5b50 0x7f61a00c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61a00cf290 0x7f61a00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f61a0070ce0 con 0x7f61a00c5b50 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f61a0070fc0 con 0x7f61a00cf290 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.659+0000 7f61a6000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61a00ca6f0 con 0x7f61a00b1d90 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f61a00c5b50 0x7f61a00c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f61a00c5b50 0x7f61a00c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40356/0 (socket says 172.21.15.16:40356) 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 -- 172.21.15.16:0/79832817 learned_addr learned my addr 172.21.15.16:0/79832817 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a5600640 1 --2- 172.21.15.16:0/79832817 >> v2:172.21.15.192:3300/0 conn(0x7f61a00cf290 0x7f61a00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f619fe00640 1 --2- 172.21.15.16:0/79832817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 -- 172.21.15.16:0/79832817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 msgr2=0x7f61a015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:59.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 --2- 172.21.15.16:0/79832817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 -- 172.21.15.16:0/79832817 >> v2:172.21.15.192:3300/0 conn(0x7f61a00cf290 msgr2=0x7f61a00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:18:59.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 --2- 172.21.15.16:0/79832817 >> v2:172.21.15.192:3300/0 conn(0x7f61a00cf290 0x7f61a00cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 -- 172.21.15.16:0/79832817 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00ca9d0 con 0x7f61a00c5b50 2024-04-26T20:18:59.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f61a4c00640 1 --2- 172.21.15.16:0/79832817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a00c5f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61a0071400 tx=0x7f619401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c650c3bca85e17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:59.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.663+0000 7f619f400640 1 -- 172.21.15.16:0/79832817 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940b5070 con 0x7f61a00c5b50 2024-04-26T20:18:59.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f619f400640 1 -- 172.21.15.16:0/79832817 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61940a89d0 con 0x7f61a00c5b50 2024-04-26T20:18:59.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f619f400640 1 -- 172.21.15.16:0/79832817 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940a8da0 con 0x7f61a00c5b50 2024-04-26T20:18:59.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- 172.21.15.16:0/79832817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 msgr2=0x7f61a00c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:59.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 --2- 172.21.15.16:0/79832817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a00c5f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61a0071400 tx=0x7f619401ed10 comp rx=0 tx=0).stop 2024-04-26T20:18:59.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- 172.21.15.16:0/79832817 shutdown_connections 2024-04-26T20:18:59.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 --2- 172.21.15.16:0/79832817 >> v2:172.21.15.192:3300/0 conn(0x7f61a00cf290 0x7f61a00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 --2- 172.21.15.16:0/79832817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 --2- 172.21.15.16:0/79832817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a00c5f30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- 172.21.15.16:0/79832817 >> 172.21.15.16:0/79832817 conn(0x7f61a006c7b0 msgr2=0x7f61a0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- 172.21.15.16:0/79832817 shutdown_connections 2024-04-26T20:18:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- 172.21.15.16:0/79832817 wait complete. 2024-04-26T20:18:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 Processor -- start 2024-04-26T20:18:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- start start 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a00b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a01f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a00cf290 0x7f61a01f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61a015c380 con 0x7f61a00c5b50 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61a015c200 con 0x7f61a00cf290 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a6000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61a00caef0 con 0x7f61a00b1d90 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a4c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a00b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f619fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a01f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a5600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a00cf290 0x7f61a01f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:59.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a4c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a00b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:48794/0 (socket says 172.21.15.16:48794) 2024-04-26T20:18:59.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.667+0000 7f61a4c00640 1 -- 172.21.15.16:0/4031664749 learned_addr learned my addr 172.21.15.16:0/4031664749 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619fe00640 1 -- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 msgr2=0x7f61a00b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619fe00640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a00b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619fe00640 1 -- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a00cf290 msgr2=0x7f61a01f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619fe00640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a00cf290 0x7f61a01f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619fe00640 1 -- 172.21.15.16:0/4031664749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00cbfe0 con 0x7f61a00c5b50 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619fe00640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a01f1920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f618c00d620 tx=0x7f618c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619cc00640 1 -- 172.21.15.16:0/4031664749 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c018020 con 0x7f61a00c5b50 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619cc00640 1 -- 172.21.15.16:0/4031664749 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618c014620 con 0x7f61a00c5b50 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619cc00640 1 -- 172.21.15.16:0/4031664749 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c014a10 con 0x7f61a00c5b50 2024-04-26T20:18:59.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a01f4e30 con 0x7f61a00c5b50 2024-04-26T20:18:59.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a01f53f0 con 0x7f61a00c5b50 2024-04-26T20:18:59.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a00506d0 con 0x7f61a00c5b50 2024-04-26T20:18:59.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.671+0000 7f619cc00640 1 -- 172.21.15.16:0/4031664749 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f618c01b020 con 0x7f61a00c5b50 2024-04-26T20:18:59.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.675+0000 7f619cc00640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6180068380 0x7f618006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:59.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.675+0000 7f619cc00640 1 -- 172.21.15.16:0/4031664749 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f618c087260 con 0x7f61a00c5b50 2024-04-26T20:18:59.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.675+0000 7f61a4c00640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6180068380 0x7f618006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:59.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.675+0000 7f61a4c00640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6180068380 0x7f618006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f619401ed50 tx=0x7f6194009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:59.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.679+0000 7f619cc00640 1 -- 172.21.15.16:0/4031664749 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f618c022020 con 0x7f61a00c5b50 2024-04-26T20:18:59.693 INFO:tasks.workunit.client.0.smithi016.stdout:4/622: dwrite d0/dd/d19/d1f/d7b/fc7 [0,4194304] 0 2024-04-26T20:18:59.718 INFO:tasks.workunit.client.0.smithi016.stdout:9/792: mknod d1/d2/d43/c10e 0 2024-04-26T20:18:59.718 INFO:tasks.workunit.client.0.smithi016.stdout:6/635: mknod d1/d21/d26/d1c/d7b/cdb 0 2024-04-26T20:18:59.718 INFO:tasks.workunit.client.0.smithi016.stdout:8/744: symlink d9/d23/l102 0 2024-04-26T20:18:59.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/772: mkdir d1d/d20/d22/dff 0 2024-04-26T20:18:59.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/773: write d1d/d27/d2d/d5a/dea/ffd [748433,41147] 0 2024-04-26T20:18:59.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/774: truncate d1d/d27/d2d/d5a/d9c/ff5 274341 0 2024-04-26T20:18:59.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/775: chown d1d/d20/d7c/dbc/le6 3 1 2024-04-26T20:18:59.720 INFO:tasks.workunit.client.0.smithi016.stdout:2/776: write d1d/d27/d2d/d5a/dc7/dce/fd3 [908925,25920] 0 2024-04-26T20:18:59.723 INFO:tasks.workunit.client.0.smithi016.stdout:9/793: dread d1/d2e/d40/fd9 [0,4194304] 0 2024-04-26T20:18:59.723 INFO:tasks.workunit.client.0.smithi016.stdout:9/794: chown d1/d2/d20/d49/d77/d3e/l87 16167963 1 2024-04-26T20:18:59.724 INFO:tasks.workunit.client.0.smithi016.stdout:4/623: mkdir d0/dd/dc9 0 2024-04-26T20:18:59.725 INFO:tasks.workunit.client.0.smithi016.stdout:4/624: truncate d0/dd/d66/d6f/fa3 688476 0 2024-04-26T20:18:59.725 INFO:tasks.workunit.client.0.smithi016.stdout:6/636: creat d1/d3a/db9/fdc x:0 0 0 2024-04-26T20:18:59.727 INFO:tasks.workunit.client.0.smithi016.stdout:8/745: rename d9/d19/d45/l4c to d9/d19/de6/l103 0 2024-04-26T20:18:59.727 INFO:tasks.workunit.client.0.smithi016.stdout:8/746: write d9/d66/d73/fcf [4992919,80327] 0 2024-04-26T20:18:59.727 INFO:tasks.workunit.client.0.smithi016.stdout:2/777: mkdir d1d/d2a/d3d/dd9/de5/d100 0 2024-04-26T20:18:59.727 INFO:tasks.workunit.client.0.smithi016.stdout:2/778: fdatasync d1d/d20/d22/f2c 0 2024-04-26T20:18:59.728 INFO:tasks.workunit.client.0.smithi016.stdout:9/795: truncate d1/d59/d52/f30 441084 0 2024-04-26T20:18:59.728 INFO:tasks.workunit.client.0.smithi016.stdout:9/796: chown d1/f15 1685 1 2024-04-26T20:18:59.728 INFO:tasks.workunit.client.0.smithi016.stdout:4/625: rmdir d0/dd 39 2024-04-26T20:18:59.729 INFO:tasks.workunit.client.0.smithi016.stdout:6/637: creat d1/d8/d2c/d3d/fdd x:0 0 0 2024-04-26T20:18:59.729 INFO:tasks.workunit.client.0.smithi016.stdout:6/638: chown d1/d21/d26/d1c/f4d 3681 1 2024-04-26T20:18:59.729 INFO:tasks.workunit.client.0.smithi016.stdout:6/639: chown d1/c7a 18857869 1 2024-04-26T20:18:59.731 INFO:tasks.workunit.client.0.smithi016.stdout:2/779: rename d1d/d27/d49/df2 to d1d/d20/d7c/dbc/d101 0 2024-04-26T20:18:59.732 INFO:tasks.workunit.client.0.smithi016.stdout:6/640: creat d1/d8/d2c/d47/dd7/fde x:0 0 0 2024-04-26T20:18:59.734 INFO:tasks.workunit.client.0.smithi016.stdout:9/797: rename d1/d2/d20/fce to d1/d2/d20/d49/d77/d107/f10f 0 2024-04-26T20:18:59.735 INFO:tasks.workunit.client.0.smithi016.stdout:2/780: creat d1d/d2a/d3d/f102 x:0 0 0 2024-04-26T20:18:59.743 INFO:tasks.workunit.client.0.smithi016.stdout:0/668: sync 2024-04-26T20:18:59.743 INFO:tasks.workunit.client.0.smithi016.stdout:7/683: sync 2024-04-26T20:18:59.743 INFO:tasks.workunit.client.0.smithi016.stdout:5/967: sync 2024-04-26T20:18:59.743 INFO:tasks.workunit.client.0.smithi016.stdout:5/968: dread - d1/d9/d1c/d52/d74/d98/dcb/f110 zero size 2024-04-26T20:18:59.743 INFO:tasks.workunit.client.0.smithi016.stdout:7/684: write d0/d1/d34/d25/d3f/d6d/d87/f7c [752780,107060] 0 2024-04-26T20:18:59.743 INFO:tasks.workunit.client.0.smithi016.stdout:7/685: write d0/d67/fac [205263,50110] 0 2024-04-26T20:18:59.744 INFO:tasks.workunit.client.0.smithi016.stdout:9/798: link d1/d2/f5 d1/d2/d20/dde/f110 0 2024-04-26T20:18:59.745 INFO:tasks.workunit.client.0.smithi016.stdout:5/969: creat d1/d9/d1c/d52/d74/d98/dcb/f137 x:0 0 0 2024-04-26T20:18:59.751 INFO:tasks.workunit.client.0.smithi016.stdout:2/781: dread d1d/d27/d2d/d5a/f7a [0,4194304] 0 2024-04-26T20:18:59.752 INFO:tasks.workunit.client.0.smithi016.stdout:2/782: write d1d/d20/f9f [277447,67306] 0 2024-04-26T20:18:59.753 INFO:tasks.workunit.client.0.smithi016.stdout:7/686: creat d0/d51/fd1 x:0 0 0 2024-04-26T20:18:59.754 INFO:tasks.workunit.client.0.smithi016.stdout:2/783: mkdir d1d/d2a/d3d/dd9/d103 0 2024-04-26T20:18:59.757 INFO:tasks.workunit.client.0.smithi016.stdout:6/641: dread d1/f1f [0,4194304] 0 2024-04-26T20:18:59.758 INFO:tasks.workunit.client.0.smithi016.stdout:7/687: rename d0/d83/l5b to d0/d1/d34/d25/ld2 0 2024-04-26T20:18:59.760 INFO:tasks.workunit.client.0.smithi016.stdout:6/642: getdents d1/d3a 0 2024-04-26T20:18:59.760 INFO:tasks.workunit.client.0.smithi016.stdout:6/643: write d1/d12/fb5 [675873,114452] 0 2024-04-26T20:18:59.762 INFO:tasks.workunit.client.0.smithi016.stdout:2/784: rename d1d/d27/d2d/f96 to d1d/d27/d2d/d6b/f104 0 2024-04-26T20:18:59.763 INFO:tasks.workunit.client.0.smithi016.stdout:2/785: dread - d1d/d27/fc6 zero size 2024-04-26T20:18:59.763 INFO:tasks.workunit.client.0.smithi016.stdout:2/786: fdatasync d1d/d27/d2d/f94 0 2024-04-26T20:18:59.768 INFO:tasks.workunit.client.0.smithi016.stdout:3/614: dread d3/d9/f1a [0,4194304] 0 2024-04-26T20:18:59.769 INFO:tasks.workunit.client.0.smithi016.stdout:6/644: mknod d1/d8/d2c/d3d/cdf 0 2024-04-26T20:18:59.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/645: mkdir d1/d3a/db9/de0 0 2024-04-26T20:18:59.785 INFO:tasks.workunit.client.0.smithi016.stdout:5/970: dread d1/d78/fdc [0,4194304] 0 2024-04-26T20:18:59.785 INFO:tasks.workunit.client.0.smithi016.stdout:3/615: truncate d3/d9/d18/f1c 3412779 0 2024-04-26T20:18:59.791 INFO:tasks.workunit.client.0.smithi016.stdout:3/616: dread d3/df/d25/d32/d3f/f8c [0,4194304] 0 2024-04-26T20:18:59.791 INFO:tasks.workunit.client.0.smithi016.stdout:3/617: truncate d3/d9/d18/d5a/f6f 513470 0 2024-04-26T20:18:59.794 INFO:tasks.workunit.client.0.smithi016.stdout:5/971: rename d1/l17 to d1/db8/l138 0 2024-04-26T20:18:59.796 INFO:tasks.workunit.client.0.smithi016.stdout:3/618: getdents d3/d70 0 2024-04-26T20:18:59.808 INFO:tasks.workunit.client.0.smithi016.stdout:6/646: write d1/d21/f39 [3683615,13374] 0 2024-04-26T20:18:59.808 INFO:tasks.workunit.client.0.smithi016.stdout:6/647: dread - d1/fd0 zero size 2024-04-26T20:18:59.811 INFO:tasks.workunit.client.0.smithi016.stdout:3/619: write d3/f19 [7095716,31602] 0 2024-04-26T20:18:59.811 INFO:tasks.workunit.client.0.smithi016.stdout:6/648: creat d1/d3a/db9/de0/fe1 x:0 0 0 2024-04-26T20:18:59.812 INFO:tasks.workunit.client.0.smithi016.stdout:5/972: truncate d1/d9/fc 7598903 0 2024-04-26T20:18:59.812 INFO:tasks.workunit.client.0.smithi016.stdout:5/973: chown d1/d9/d11/daa/d10b/f133 9432675 1 2024-04-26T20:18:59.812 INFO:tasks.workunit.client.0.smithi016.stdout:5/974: write d1/d9/d1c/d52/f102 [596591,75201] 0 2024-04-26T20:18:59.812 INFO:tasks.workunit.client.0.smithi016.stdout:5/975: truncate d1/d9/d1c/d52/d74/d98/dcb/f137 690481 0 2024-04-26T20:18:59.812 INFO:tasks.workunit.client.0.smithi016.stdout:7/688: write d0/d1/d34/d25/d3f/d6d/f77 [3298010,13713] 0 2024-04-26T20:18:59.813 INFO:tasks.workunit.client.0.smithi016.stdout:3/620: mknod d3/cc5 0 2024-04-26T20:18:59.813 INFO:tasks.workunit.client.0.smithi016.stdout:3/621: fdatasync d3/d9/d18/f8f 0 2024-04-26T20:18:59.814 INFO:tasks.workunit.client.0.smithi016.stdout:6/649: mkdir d1/d21/d26/d1c/d5d/de2 0 2024-04-26T20:18:59.814 INFO:tasks.workunit.client.0.smithi016.stdout:6/650: write d1/d21/d26/fb0 [5022761,77535] 0 2024-04-26T20:18:59.815 INFO:tasks.workunit.client.0.smithi016.stdout:5/976: creat d1/d78/d99/f139 x:0 0 0 2024-04-26T20:18:59.816 INFO:tasks.workunit.client.0.smithi016.stdout:0/669: dwrite d2/dc/d18/f1a [4194304,4194304] 0 2024-04-26T20:18:59.816 INFO:tasks.workunit.client.0.smithi016.stdout:0/670: chown d2/d20/f2f 7446 1 2024-04-26T20:18:59.817 INFO:tasks.workunit.client.0.smithi016.stdout:6/651: mknod d1/d21/d26/d25/ce3 0 2024-04-26T20:18:59.819 INFO:tasks.workunit.client.0.smithi016.stdout:3/622: rmdir d3/d9/d18/d5a 39 2024-04-26T20:18:59.836 INFO:tasks.workunit.client.0.smithi016.stdout:4/626: getdents d0/dd 0 2024-04-26T20:18:59.847 INFO:tasks.workunit.client.0.smithi016.stdout:5/977: write d1/d9/d11/daa/fd8 [2838707,89579] 0 2024-04-26T20:18:59.847 INFO:tasks.workunit.client.0.smithi016.stdout:5/978: stat d1/d9/d1c/l5b 0 2024-04-26T20:18:59.849 INFO:tasks.workunit.client.0.smithi016.stdout:3/623: write d3/df/f26 [1272208,130713] 0 2024-04-26T20:18:59.869 INFO:tasks.workunit.client.0.smithi016.stdout:7/689: dwrite d0/d1/d34/d25/d50/fa8 [0,4194304] 0 2024-04-26T20:18:59.870 INFO:tasks.workunit.client.0.smithi016.stdout:7/690: chown d0/d1/d34/l8b 184118 1 2024-04-26T20:18:59.870 INFO:tasks.workunit.client.0.smithi016.stdout:7/691: stat d0/d1/d34/d25/d3f/d6d/d79/l81 0 2024-04-26T20:18:59.870 INFO:tasks.workunit.client.0.smithi016.stdout:6/652: dwrite d1/faa [0,4194304] 0 2024-04-26T20:18:59.901 INFO:tasks.workunit.client.0.smithi016.stdout:9/799: dwrite d1/d2/d20/d49/d77/d2a/d75/f83 [0,4194304] 0 2024-04-26T20:18:59.918 INFO:tasks.workunit.client.0.smithi016.stdout:9/800: dread d1/fa7 [0,4194304] 0 2024-04-26T20:18:59.918 INFO:tasks.workunit.client.0.smithi016.stdout:2/787: dwrite d1d/d27/d2d/d5a/f7a [4194304,4194304] 0 2024-04-26T20:18:59.918 INFO:tasks.workunit.client.0.smithi016.stdout:2/788: truncate d1d/d27/d2d/d6b/d7e/ddc/fe7 935677 0 2024-04-26T20:18:59.919 INFO:tasks.workunit.client.0.smithi016.stdout:9/801: dread d1/d59/d52/d8c/fa2 [0,4194304] 0 2024-04-26T20:18:59.928 INFO:tasks.workunit.client.0.smithi016.stdout:9/802: dread d1/d2/d20/d49/d77/d2a/f5d [0,4194304] 0 2024-04-26T20:18:59.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.943+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61a00c5370 con 0x7f61a00c5b50 2024-04-26T20:18:59.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f619cc00640 1 -- 172.21.15.16:0/4031664749 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6880 (secure 0 0 0) 0x7f618c056c40 con 0x7f61a00c5b50 2024-04-26T20:18:59.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:18:59.949 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5127,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:17:25.637554+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":4261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4261":{"gid":4261,"name":"b","rank":2,"incarnation":15,"state":"up:active","state_seq":53,"addr":"172.21.15.192:6838/2295577139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2295577139},{"type":"v1","addr":"172.21.15.192:6838","nonce":2295577139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276,4261]},"id":1}]} 2024-04-26T20:18:59.949 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 20 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6180068380 msgr2=0x7f618006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6180068380 0x7f618006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f619401ed50 tx=0x7f6194009040 comp rx=0 tx=0).stop 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 msgr2=0x7f61a01f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a01f1920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f618c00d620 tx=0x7f618c00dae0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 shutdown_connections 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6180068380 0x7f618006a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a00cf290 0x7f61a01f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61a00c5b50 0x7f61a01f1920 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 --2- 172.21.15.16:0/4031664749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a00b1d90 0x7f61a00b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:59.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 >> 172.21.15.16:0/4031664749 conn(0x7f61a006c7b0 msgr2=0x7f61a00cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:18:59.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 shutdown_connections 2024-04-26T20:18:59.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:18:59.947+0000 7f61a6000640 1 -- 172.21.15.16:0/4031664749 wait complete. 2024-04-26T20:18:59.971 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-26T20:19:00.086 INFO:tasks.workunit.client.0.smithi016.stdout:0/671: creat d2/d20/d41/d87/d9d/db8/fe2 x:0 0 0 2024-04-26T20:19:00.086 INFO:tasks.workunit.client.0.smithi016.stdout:4/627: mkdir d0/dd/d19/d1f/d7b/dca 0 2024-04-26T20:19:00.087 INFO:tasks.workunit.client.0.smithi016.stdout:5/979: symlink d1/l13a 0 2024-04-26T20:19:00.089 INFO:tasks.workunit.client.0.smithi016.stdout:7/692: symlink d0/d1/d88/db3/dc1/ld3 0 2024-04-26T20:19:00.089 INFO:tasks.workunit.client.0.smithi016.stdout:7/693: readlink d0/d1/d46/db4/lcc 0 2024-04-26T20:19:00.090 INFO:tasks.workunit.client.0.smithi016.stdout:6/653: mkdir d1/d21/d26/d1c/d5d/de2/de4 0 2024-04-26T20:19:00.092 INFO:tasks.workunit.client.0.smithi016.stdout:6/654: read d1/d8/dae/fc4 [1956469,44765] 0 2024-04-26T20:19:00.093 INFO:tasks.workunit.client.0.smithi016.stdout:9/803: symlink d1/d2/d20/d49/d77/l111 0 2024-04-26T20:19:00.093 INFO:tasks.workunit.client.0.smithi016.stdout:2/789: truncate d1d/d20/d22/f8f 224500 0 2024-04-26T20:19:00.095 INFO:tasks.workunit.client.0.smithi016.stdout:0/672: getdents d2/dc/d18/d24/d53 0 2024-04-26T20:19:00.097 INFO:tasks.workunit.client.0.smithi016.stdout:4/628: symlink d0/d1e/d4e/d52/d54/d87/lcb 0 2024-04-26T20:19:00.098 INFO:tasks.workunit.client.0.smithi016.stdout:4/629: fsync d0/dd/d66/d6f/d7f/daf/fc3 0 2024-04-26T20:19:00.098 INFO:tasks.workunit.client.0.smithi016.stdout:5/980: creat d1/d78/d99/dde/db4/f13b x:0 0 0 2024-04-26T20:19:00.104 INFO:tasks.workunit.client.0.smithi016.stdout:7/694: link d0/d1/d34/d25/fb8 d0/d1/d6/d73/fd4 0 2024-04-26T20:19:00.104 INFO:tasks.workunit.client.0.smithi016.stdout:7/695: chown d0/d1/d88/db3/dc1/ld3 1 1 2024-04-26T20:19:00.104 INFO:tasks.workunit.client.0.smithi016.stdout:7/696: write d0/d1/d34/f2c [4670960,68801] 0 2024-04-26T20:19:00.104 INFO:tasks.workunit.client.0.smithi016.stdout:9/804: creat d1/d2/d20/d49/d77/d2a/d75/d85/f112 x:0 0 0 2024-04-26T20:19:00.105 INFO:tasks.workunit.client.0.smithi016.stdout:2/790: creat d1d/d20/d22/d29/f105 x:0 0 0 2024-04-26T20:19:00.105 INFO:tasks.workunit.client.0.smithi016.stdout:2/791: dread - d1d/d20/d22/d89/fbd zero size 2024-04-26T20:19:00.105 INFO:tasks.workunit.client.0.smithi016.stdout:6/655: write d1/d21/d26/d1c/d7b/d82/fa9 [594409,103396] 0 2024-04-26T20:19:00.105 INFO:tasks.workunit.client.0.smithi016.stdout:6/656: write d1/d8/d2c/d3d/f58 [1053167,32811] 0 2024-04-26T20:19:00.110 INFO:tasks.workunit.client.0.smithi016.stdout:4/630: symlink d0/d1e/d4e/d52/d54/d87/lcc 0 2024-04-26T20:19:00.110 INFO:tasks.workunit.client.0.smithi016.stdout:5/981: rmdir d1/d9/d1c/d52/d74/d98/dcb 39 2024-04-26T20:19:00.110 INFO:tasks.workunit.client.0.smithi016.stdout:0/673: mkdir d2/dc/de3 0 2024-04-26T20:19:00.110 INFO:tasks.workunit.client.0.smithi016.stdout:3/624: read d3/d9/d18/f1c [132970,88998] 0 2024-04-26T20:19:00.127 INFO:tasks.workunit.client.0.smithi016.stdout:7/697: read d0/d51/f5a [536997,46729] 0 2024-04-26T20:19:00.129 INFO:tasks.workunit.client.0.smithi016.stdout:9/805: creat d1/d59/d52/d8c/dd1/f113 x:0 0 0 2024-04-26T20:19:00.129 INFO:tasks.workunit.client.0.smithi016.stdout:2/792: creat d1d/d52/f106 x:0 0 0 2024-04-26T20:19:00.131 INFO:tasks.workunit.client.0.smithi016.stdout:3/625: mkdir d3/d9/d18/d82/dc6 0 2024-04-26T20:19:00.131 INFO:tasks.workunit.client.0.smithi016.stdout:3/626: write d3/df/d25/f28 [3410448,29362] 0 2024-04-26T20:19:00.135 INFO:tasks.workunit.client.0.smithi016.stdout:9/806: rename d1/d66 to d1/d2e/d40/d114 0 2024-04-26T20:19:00.135 INFO:tasks.workunit.client.0.smithi016.stdout:9/807: write d1/d2e/f35 [6338670,55619] 0 2024-04-26T20:19:00.139 INFO:tasks.workunit.client.0.smithi016.stdout:2/793: link d1d/d20/d22/d39/d3e/f47 d1d/d2a/d3d/dd9/f107 0 2024-04-26T20:19:00.139 INFO:tasks.workunit.client.0.smithi016.stdout:2/794: chown d1d/d2a/d3d/fd6 49938244 1 2024-04-26T20:19:00.140 INFO:tasks.workunit.client.0.smithi016.stdout:3/627: mkdir d3/df/d25/d32/dc7 0 2024-04-26T20:19:00.140 INFO:tasks.workunit.client.0.smithi016.stdout:3/628: chown d3/c7f 9014 1 2024-04-26T20:19:00.142 INFO:tasks.workunit.client.0.smithi016.stdout:2/795: mkdir d1d/d27/d2d/d6b/d108 0 2024-04-26T20:19:00.144 INFO:tasks.workunit.client.0.smithi016.stdout:3/629: mkdir d3/df/d25/dc8 0 2024-04-26T20:19:00.144 INFO:tasks.workunit.client.0.smithi016.stdout:3/630: stat d3/df/d25/d2a/l9b 0 2024-04-26T20:19:00.147 INFO:tasks.workunit.client.0.smithi016.stdout:2/796: link d1d/d20/l4f d1d/d27/d2d/d5a/dc7/l109 0 2024-04-26T20:19:00.155 INFO:tasks.workunit.client.0.smithi016.stdout:3/631: creat d3/d9/d2d/fc9 x:0 0 0 2024-04-26T20:19:00.155 INFO:tasks.workunit.client.0.smithi016.stdout:2/797: symlink d1d/d20/d7c/dbc/d101/l10a 0 2024-04-26T20:19:00.157 INFO:tasks.workunit.client.0.smithi016.stdout:5/982: write d1/d78/d99/dde/d8f/db6/dcc/f128 [1408815,58828] 0 2024-04-26T20:19:00.160 INFO:tasks.workunit.client.0.smithi016.stdout:3/632: creat d3/df/d25/d2a/d4a/fca x:0 0 0 2024-04-26T20:19:00.164 INFO:tasks.workunit.client.0.smithi016.stdout:5/983: mkdir d1/d9/d114/d13c 0 2024-04-26T20:19:00.167 INFO:tasks.workunit.client.0.smithi016.stdout:6/657: read d1/d21/d48/fd5 [2685070,4929] 0 2024-04-26T20:19:00.177 INFO:tasks.workunit.client.0.smithi016.stdout:6/658: creat d1/d8/d46/fe5 x:0 0 0 2024-04-26T20:19:00.180 INFO:tasks.workunit.client.0.smithi016.stdout:9/808: dread d1/d59/d52/fba [0,4194304] 0 2024-04-26T20:19:00.180 INFO:tasks.workunit.client.0.smithi016.stdout:9/809: write d1/d2/d20/d49/f7b [2221622,11238] 0 2024-04-26T20:19:00.180 INFO:tasks.workunit.client.0.smithi016.stdout:9/810: chown d1/d2/d43/l6a 202699713 1 2024-04-26T20:19:00.182 INFO:tasks.workunit.client.0.smithi016.stdout:6/659: link d1/d21/d26/d1c/d7b/d82/d8f/fca d1/fe6 0 2024-04-26T20:19:00.183 INFO:tasks.workunit.client.0.smithi016.stdout:9/811: mknod d1/d2/d20/c115 0 2024-04-26T20:19:00.189 INFO:tasks.workunit.client.0.smithi016.stdout:6/660: creat d1/d21/fe7 x:0 0 0 2024-04-26T20:19:00.190 INFO:tasks.workunit.client.0.smithi016.stdout:9/812: symlink d1/d2/d79/l116 0 2024-04-26T20:19:00.191 INFO:tasks.workunit.client.0.smithi016.stdout:6/661: link d1/d21/d48/fad d1/d3a/fe8 0 2024-04-26T20:19:00.191 INFO:tasks.workunit.client.0.smithi016.stdout:6/662: chown d1/d8/d46/c57 231 1 2024-04-26T20:19:00.192 INFO:tasks.workunit.client.0.smithi016.stdout:9/813: mknod d1/d2/d43/c117 0 2024-04-26T20:19:00.193 INFO:tasks.workunit.client.0.smithi016.stdout:6/663: mkdir d1/d8/d76/de9 0 2024-04-26T20:19:00.194 INFO:tasks.workunit.client.0.smithi016.stdout:6/664: rmdir d1/d21 39 2024-04-26T20:19:00.195 INFO:tasks.workunit.client.0.smithi016.stdout:6/665: write d1/d8/d46/f6c [423599,119892] 0 2024-04-26T20:19:00.198 INFO:tasks.workunit.client.0.smithi016.stdout:7/698: rename d0/d1 to d0/dd5 0 2024-04-26T20:19:00.200 INFO:tasks.workunit.client.0.smithi016.stdout:7/699: link d0/dd5/d95/f9a d0/dd5/d34/d25/d3f/d6d/d79/fd6 0 2024-04-26T20:19:00.205 INFO:tasks.workunit.client.0.smithi016.stdout:3/633: getdents d3/d9/d18/d82 0 2024-04-26T20:19:00.205 INFO:tasks.workunit.client.0.smithi016.stdout:3/634: write d3/df/d20/d61/d74/fa6 [5532139,104529] 0 2024-04-26T20:19:00.205 INFO:tasks.workunit.client.0.smithi016.stdout:3/635: stat d3/d9/d18/d82/dc6 0 2024-04-26T20:19:00.208 INFO:tasks.workunit.client.0.smithi016.stdout:3/636: symlink d3/df/d25/d2a/lcb 0 2024-04-26T20:19:00.230 INFO:tasks.workunit.client.0.smithi016.stdout:8/747: dwrite d9/d19/d45/d3f/d4d/fbc [0,4194304] 0 2024-04-26T20:19:00.231 INFO:tasks.workunit.client.0.smithi016.stdout:8/748: chown d9/d72/d74/dcd/fe7 14489 1 2024-04-26T20:19:00.236 INFO:tasks.workunit.client.0.smithi016.stdout:4/631: dwrite d0/f8d [0,4194304] 0 2024-04-26T20:19:00.236 INFO:tasks.workunit.client.0.smithi016.stdout:4/632: dread - d0/d1e/f78 zero size 2024-04-26T20:19:00.240 INFO:tasks.workunit.client.0.smithi016.stdout:9/814: write d1/d1b/f24 [4161085,69125] 0 2024-04-26T20:19:00.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/633: symlink d0/dd/d19/d1f/d7b/lcd 0 2024-04-26T20:19:00.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/634: stat d0/f10 0 2024-04-26T20:19:00.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/635: chown d0/dd/f98 10779578 1 2024-04-26T20:19:00.247 INFO:tasks.workunit.client.0.smithi016.stdout:4/636: dread - d0/dd/fc8 zero size 2024-04-26T20:19:00.249 INFO:tasks.workunit.client.0.smithi016.stdout:9/815: unlink d1/d2/d20/d49/d77/d2a/d75/d85/d9b/ldb 0 2024-04-26T20:19:00.250 INFO:tasks.workunit.client.0.smithi016.stdout:8/749: mkdir d9/d104 0 2024-04-26T20:19:00.254 INFO:tasks.workunit.client.0.smithi016.stdout:9/816: rename d1/d2e/d40/d114/db1 to d1/d59/da5/d118 0 2024-04-26T20:19:00.256 INFO:tasks.workunit.client.0.smithi016.stdout:8/750: unlink d9/d19/d45/d9e/d50/da9/dac/ff7 0 2024-04-26T20:19:00.258 INFO:tasks.workunit.client.0.smithi016.stdout:9/817: mknod d1/c119 0 2024-04-26T20:19:00.259 INFO:tasks.workunit.client.0.smithi016.stdout:8/751: truncate d9/d19/d45/d9e/d50/fec 3539840 0 2024-04-26T20:19:00.273 INFO:tasks.workunit.client.0.smithi016.stdout:3/637: fdatasync d3/df/d25/f28 0 2024-04-26T20:19:00.273 INFO:tasks.workunit.client.0.smithi016.stdout:3/638: readlink d3/l6 0 2024-04-26T20:19:00.274 INFO:tasks.workunit.client.0.smithi016.stdout:9/818: symlink d1/d2e/d40/d114/l11a 0 2024-04-26T20:19:00.275 INFO:tasks.workunit.client.0.smithi016.stdout:3/639: symlink d3/df/d25/d2a/d4a/lcc 0 2024-04-26T20:19:00.284 INFO:tasks.workunit.client.0.smithi016.stdout:6/666: dwrite d1/fe6 [0,4194304] 0 2024-04-26T20:19:00.284 INFO:tasks.workunit.client.0.smithi016.stdout:6/667: stat d1/d12/d90 0 2024-04-26T20:19:00.285 INFO:tasks.workunit.client.0.smithi016.stdout:7/700: dwrite d0/f42 [0,4194304] 0 2024-04-26T20:19:00.285 INFO:tasks.workunit.client.0.smithi016.stdout:6/668: write d1/d8/d2c/d47/f94 [1443449,56008] 0 2024-04-26T20:19:00.285 INFO:tasks.workunit.client.0.smithi016.stdout:7/701: fdatasync d0/dd5/d46/f98 0 2024-04-26T20:19:00.285 INFO:tasks.workunit.client.0.smithi016.stdout:5/984: write d1/d9/d25/f47 [3192124,55695] 0 2024-04-26T20:19:00.285 INFO:tasks.workunit.client.0.smithi016.stdout:2/798: dwrite d1d/d27/d2d/d6b/f104 [0,4194304] 0 2024-04-26T20:19:00.285 INFO:tasks.workunit.client.0.smithi016.stdout:2/799: chown d1d/d27/d2d/d6b/d7e/ddc 365196 1 2024-04-26T20:19:00.290 INFO:tasks.workunit.client.0.smithi016.stdout:5/985: dread d1/d9/d1c/d52/d74/fe9 [0,4194304] 0 2024-04-26T20:19:00.296 INFO:tasks.workunit.client.0.smithi016.stdout:7/702: mknod d0/dd5/d34/d25/cd7 0 2024-04-26T20:19:00.296 INFO:tasks.workunit.client.0.smithi016.stdout:7/703: chown d0/d83/l52 0 1 2024-04-26T20:19:00.301 INFO:tasks.workunit.client.0.smithi016.stdout:6/669: write d1/d12/fb5 [509899,118687] 0 2024-04-26T20:19:00.301 INFO:tasks.workunit.client.0.smithi016.stdout:6/670: truncate d1/d21/d48/d51/fb6 207913 0 2024-04-26T20:19:00.317 INFO:tasks.workunit.client.0.smithi016.stdout:6/671: dread d1/fa [0,4194304] 0 2024-04-26T20:19:00.321 INFO:tasks.workunit.client.0.smithi016.stdout:8/752: dwrite d9/d66/d73/fd6 [0,4194304] 0 2024-04-26T20:19:00.323 INFO:tasks.workunit.client.0.smithi016.stdout:1/764: sync 2024-04-26T20:19:00.323 INFO:tasks.workunit.client.0.smithi016.stdout:4/637: dwrite d0/d1e/fc1 [0,4194304] 0 2024-04-26T20:19:00.326 INFO:tasks.workunit.client.0.smithi016.stdout:9/819: symlink d1/d2/l11b 0 2024-04-26T20:19:00.326 INFO:tasks.workunit.client.0.smithi016.stdout:9/820: fdatasync d1/d59/d52/d8c/fa2 0 2024-04-26T20:19:00.326 INFO:tasks.workunit.client.0.smithi016.stdout:7/704: rmdir d0/dd5 39 2024-04-26T20:19:00.327 INFO:tasks.workunit.client.0.smithi016.stdout:6/672: symlink d1/d3a/db9/de0/lea 0 2024-04-26T20:19:00.329 INFO:tasks.workunit.client.0.smithi016.stdout:4/638: getdents d0/d1e/d4e/d52/d88 0 2024-04-26T20:19:00.330 INFO:tasks.workunit.client.0.smithi016.stdout:4/639: write d0/d1e/d64/f92 [798154,26686] 0 2024-04-26T20:19:00.330 INFO:tasks.workunit.client.0.smithi016.stdout:4/640: chown d0/dd/d19/d57 1592000 1 2024-04-26T20:19:00.330 INFO:tasks.workunit.client.0.smithi016.stdout:9/821: creat d1/d2/d20/d49/d77/d2a/d75/d85/f11c x:0 0 0 2024-04-26T20:19:00.331 INFO:tasks.workunit.client.0.smithi016.stdout:1/765: getdents d3/d5/d6/d9/d9e 0 2024-04-26T20:19:00.331 INFO:tasks.workunit.client.0.smithi016.stdout:1/766: fdatasync d3/d5/f4f 0 2024-04-26T20:19:00.332 INFO:tasks.workunit.client.0.smithi016.stdout:6/673: rename d1/d21/d48/fd5 to d1/d21/d26/d1c/feb 0 2024-04-26T20:19:00.333 INFO:tasks.workunit.client.0.smithi016.stdout:4/641: mkdir d0/dd/d66/d6f/d7f/dce 0 2024-04-26T20:19:00.334 INFO:tasks.workunit.client.0.smithi016.stdout:9/822: creat d1/d59/f11d x:0 0 0 2024-04-26T20:19:00.334 INFO:tasks.workunit.client.0.smithi016.stdout:9/823: truncate d1/d2e/d40/f62 4986147 0 2024-04-26T20:19:00.335 INFO:tasks.workunit.client.0.smithi016.stdout:1/767: creat d3/d5/d8d/f100 x:0 0 0 2024-04-26T20:19:00.339 INFO:tasks.workunit.client.0.smithi016.stdout:4/642: unlink d0/d1e/d4e/d52/d88/d43/d5a/c61 0 2024-04-26T20:19:00.339 INFO:tasks.workunit.client.0.smithi016.stdout:4/643: fsync d0/dd/d1b/f27 0 2024-04-26T20:19:00.340 INFO:tasks.workunit.client.0.smithi016.stdout:8/753: truncate d9/d66/d73/fd6 801910 0 2024-04-26T20:19:00.343 INFO:tasks.workunit.client.0.smithi016.stdout:1/768: rmdir d3/d5/d8d/df8 0 2024-04-26T20:19:00.343 INFO:tasks.workunit.client.0.smithi016.stdout:1/769: stat d3/d5/da/d66/d8c/f6a 0 2024-04-26T20:19:00.344 INFO:tasks.workunit.client.0.smithi016.stdout:8/754: creat d9/d66/f105 x:0 0 0 2024-04-26T20:19:00.376 INFO:tasks.workunit.client.0.smithi016.stdout:8/755: write d9/d23/d26/d2c/fc0 [710369,81399] 0 2024-04-26T20:19:00.377 INFO:tasks.workunit.client.0.smithi016.stdout:1/770: rmdir d3/d5/da/d66/d8c/d84/d86 39 2024-04-26T20:19:00.378 INFO:tasks.workunit.client.0.smithi016.stdout:8/756: mkdir d9/d19/d45/d106 0 2024-04-26T20:19:00.378 INFO:tasks.workunit.client.0.smithi016.stdout:8/757: truncate d9/d19/d45/d9e/d50/fec 3908031 0 2024-04-26T20:19:00.385 INFO:tasks.workunit.client.0.smithi016.stdout:5/986: dwrite d1/d9/d11/d4d/d72/dfb/d103/d112/f12a [0,4194304] 0 2024-04-26T20:19:00.385 INFO:tasks.workunit.client.0.smithi016.stdout:9/824: dread d1/d2/d43/fd8 [4194304,4194304] 0 2024-04-26T20:19:00.385 INFO:tasks.workunit.client.0.smithi016.stdout:9/825: getdents d1/d2/d79/d108 0 2024-04-26T20:19:00.385 INFO:tasks.workunit.client.0.smithi016.stdout:9/826: chown d1/d2/d20/d49/d77/d3e/d5e/fe0 1856693 1 2024-04-26T20:19:00.385 INFO:tasks.workunit.client.0.smithi016.stdout:9/827: chown d1/d2/d20/d49/f9f 129677209 1 2024-04-26T20:19:00.387 INFO:tasks.workunit.client.0.smithi016.stdout:1/771: link d3/d5/d6/d5a/f4a d3/d57/da4/f101 0 2024-04-26T20:19:00.387 INFO:tasks.workunit.client.0.smithi016.stdout:1/772: write d3/d5/d6/d9/fce [1547574,67398] 0 2024-04-26T20:19:00.389 INFO:tasks.workunit.client.0.smithi016.stdout:5/987: rmdir d1/db8 39 2024-04-26T20:19:00.389 INFO:tasks.workunit.client.0.smithi016.stdout:5/988: write d1/d9/d1c/d52/d74/fc7 [172543,64534] 0 2024-04-26T20:19:00.390 INFO:tasks.workunit.client.0.smithi016.stdout:9/828: mknod d1/d2/d20/d49/d77/d107/c11e 0 2024-04-26T20:19:00.438 INFO:tasks.workunit.client.0.smithi016.stdout:2/800: dwrite d1d/d27/d49/f56 [0,4194304] 0 2024-04-26T20:19:00.440 INFO:tasks.workunit.client.0.smithi016.stdout:1/773: mknod d3/d5/d6/d50/d79/c102 0 2024-04-26T20:19:00.441 INFO:tasks.workunit.client.0.smithi016.stdout:2/801: symlink d1d/d2a/d3d/dd9/de5/l10b 0 2024-04-26T20:19:00.443 INFO:tasks.workunit.client.0.smithi016.stdout:1/774: truncate d3/d5/d6/d50/d79/fa5 3162568 0 2024-04-26T20:19:00.443 INFO:tasks.workunit.client.0.smithi016.stdout:1/775: chown d3/d5/da/d66/d8c/f6b 238148 1 2024-04-26T20:19:00.443 INFO:tasks.workunit.client.0.smithi016.stdout:1/776: chown d3/d5/d6/d50/d79/da7/ld9 0 1 2024-04-26T20:19:00.444 INFO:tasks.workunit.client.0.smithi016.stdout:1/777: stat d3/d5/d6/d9/d2a/d3d/l8e 0 2024-04-26T20:19:00.444 INFO:tasks.workunit.client.0.smithi016.stdout:7/705: dread d0/dd5/d34/d25/d3f/d6d/d79/fd6 [0,4194304] 0 2024-04-26T20:19:00.447 INFO:tasks.workunit.client.0.smithi016.stdout:2/802: creat d1d/d27/d2d/d5a/dc7/dce/df6/f10c x:0 0 0 2024-04-26T20:19:00.454 INFO:tasks.workunit.client.0.smithi016.stdout:1/778: creat d3/d5/da/f103 x:0 0 0 2024-04-26T20:19:00.467 INFO:tasks.workunit.client.0.smithi016.stdout:4/644: dread d0/fa [0,4194304] 0 2024-04-26T20:19:00.467 INFO:tasks.workunit.client.0.smithi016.stdout:4/645: fsync d0/dd/fb2 0 2024-04-26T20:19:00.467 INFO:tasks.workunit.client.0.smithi016.stdout:4/646: chown d0/dd/d1b/c7d 53545 1 2024-04-26T20:19:00.467 INFO:tasks.workunit.client.0.smithi016.stdout:4/647: fsync d0/dd/d19/d1f/d7b/fc7 0 2024-04-26T20:19:00.467 INFO:tasks.workunit.client.0.smithi016.stdout:9/829: dwrite d1/ff3 [0,4194304] 0 2024-04-26T20:19:00.469 INFO:tasks.workunit.client.0.smithi016.stdout:2/803: creat d1d/d52/dfc/f10d x:0 0 0 2024-04-26T20:19:00.470 INFO:tasks.workunit.client.0.smithi016.stdout:4/648: creat d0/d1e/fcf x:0 0 0 2024-04-26T20:19:00.473 INFO:tasks.workunit.client.0.smithi016.stdout:2/804: unlink d1d/d27/d49/lc3 0 2024-04-26T20:19:00.477 INFO:tasks.workunit.client.0.smithi016.stdout:6/674: dwrite d1/d8/dae/f8e [0,4194304] 0 2024-04-26T20:19:00.477 INFO:tasks.workunit.client.0.smithi016.stdout:8/758: write d9/d19/f33 [1627686,89927] 0 2024-04-26T20:19:00.479 INFO:tasks.workunit.client.0.smithi016.stdout:6/675: write d1/d21/d48/d51/fb6 [578324,117863] 0 2024-04-26T20:19:00.481 INFO:tasks.workunit.client.0.smithi016.stdout:5/989: read d1/d9/fef [10584568,45907] 0 2024-04-26T20:19:00.486 INFO:tasks.workunit.client.0.smithi016.stdout:4/649: symlink d0/d1e/d4e/ld0 0 2024-04-26T20:19:00.487 INFO:tasks.workunit.client.0.smithi016.stdout:8/759: symlink d9/d72/l107 0 2024-04-26T20:19:00.488 INFO:tasks.workunit.client.0.smithi016.stdout:8/760: fdatasync d9/d19/d45/d9e/d50/f97 0 2024-04-26T20:19:00.491 INFO:tasks.workunit.client.0.smithi016.stdout:4/650: unlink d0/d1e/d4e/d52/d88/c3f 0 2024-04-26T20:19:00.491 INFO:tasks.workunit.client.0.smithi016.stdout:4/651: readlink d0/dd/d66/d6f/lc0 0 2024-04-26T20:19:00.493 INFO:tasks.workunit.client.0.smithi016.stdout:8/761: mknod d9/d66/d73/c108 0 2024-04-26T20:19:00.494 INFO:tasks.workunit.client.0.smithi016.stdout:4/652: rename d0/dd/d66/d6f/d7f to d0/d1e/d4e/d52/d88/d43/d5a/dd1 0 2024-04-26T20:19:00.516 INFO:tasks.workunit.client.0.smithi016.stdout:5/990: dread d1/d78/fdc [0,4194304] 0 2024-04-26T20:19:00.516 INFO:tasks.workunit.client.0.smithi016.stdout:5/991: chown d1/d9/d11/daa/cbd 3 1 2024-04-26T20:19:00.518 INFO:tasks.workunit.client.0.smithi016.stdout:4/653: dread d0/dd/d19/d57/f63 [0,4194304] 0 2024-04-26T20:19:00.518 INFO:tasks.workunit.client.0.smithi016.stdout:8/762: mkdir d9/d19/d45/d9e/d50/d109 0 2024-04-26T20:19:00.518 INFO:tasks.workunit.client.0.smithi016.stdout:8/763: chown d9/d23/cb8 15064964 1 2024-04-26T20:19:00.519 INFO:tasks.workunit.client.0.smithi016.stdout:5/992: mkdir d1/d9/d11/d13d 0 2024-04-26T20:19:00.520 INFO:tasks.workunit.client.0.smithi016.stdout:5/993: dread - d1/fdd zero size 2024-04-26T20:19:00.520 INFO:tasks.workunit.client.0.smithi016.stdout:5/994: truncate d1/d9/d25/f54 2434985 0 2024-04-26T20:19:00.520 INFO:tasks.workunit.client.0.smithi016.stdout:5/995: stat d1/d7d/l81 0 2024-04-26T20:19:00.520 INFO:tasks.workunit.client.0.smithi016.stdout:5/996: write d1/d7d/fdf [475851,108406] 0 2024-04-26T20:19:00.520 INFO:tasks.workunit.client.0.smithi016.stdout:5/997: write d1/d78/d99/ffc [72490,91986] 0 2024-04-26T20:19:00.520 INFO:tasks.workunit.client.0.smithi016.stdout:4/654: creat d0/d1e/d4e/fd2 x:0 0 0 2024-04-26T20:19:00.523 INFO:tasks.workunit.client.0.smithi016.stdout:8/764: unlink d9/d23/f3c 0 2024-04-26T20:19:00.523 INFO:tasks.workunit.client.0.smithi016.stdout:5/998: symlink d1/d9/d1c/d52/d74/d5f/l13e 0 2024-04-26T20:19:00.527 INFO:tasks.workunit.client.0.smithi016.stdout:4/655: getdents d0/dd/d19/d1f 0 2024-04-26T20:19:00.527 INFO:tasks.workunit.client.0.smithi016.stdout:4/656: stat d0/dd/d19/d57/f63 0 2024-04-26T20:19:00.527 INFO:tasks.workunit.client.0.smithi016.stdout:4/657: chown d0/dd/d19/d57/f63 684542 1 2024-04-26T20:19:00.529 INFO:tasks.workunit.client.0.smithi016.stdout:5/999: mknod d1/d9/d11/d13d/c13f 0 2024-04-26T20:19:00.534 INFO:tasks.workunit.client.0.smithi016.stdout:9/830: dwrite d1/d2/f5 [0,4194304] 0 2024-04-26T20:19:00.540 INFO:tasks.workunit.client.0.smithi016.stdout:8/765: dread d9/d19/d45/d9e/d50/fec [0,4194304] 0 2024-04-26T20:19:00.542 INFO:tasks.workunit.client.0.smithi016.stdout:4/658: mknod d0/dd/d1b/dbc/dc5/cd3 0 2024-04-26T20:19:00.542 INFO:tasks.workunit.client.0.smithi016.stdout:4/659: write d0/f1 [2964637,108230] 0 2024-04-26T20:19:00.542 INFO:tasks.workunit.client.0.smithi016.stdout:4/660: chown d0/d1e/d4e/d52/d88/f5f 5 1 2024-04-26T20:19:00.542 INFO:tasks.workunit.client.0.smithi016.stdout:4/661: fsync d0/d1e/d4e/d52/d88/d43/d5a/fa9 0 2024-04-26T20:19:00.542 INFO:tasks.workunit.client.0.smithi016.stdout:4/662: readlink d0/dd/d19/d1f/lba 0 2024-04-26T20:19:00.542 INFO:tasks.workunit.client.0.smithi016.stdout:4/663: chown d0/dd/d19/c2d 9061 1 2024-04-26T20:19:00.542 INFO:tasks.workunit.client.0.smithi016.stdout:8/766: mknod d9/d19/d45/d3f/d4d/c10a 0 2024-04-26T20:19:00.543 INFO:tasks.workunit.client.0.smithi016.stdout:2/805: dwrite d1d/d27/f53 [0,4194304] 0 2024-04-26T20:19:00.545 INFO:tasks.workunit.client.0.smithi016.stdout:4/664: creat d0/dd/d66/d6f/fd4 x:0 0 0 2024-04-26T20:19:00.546 INFO:tasks.workunit.client.0.smithi016.stdout:4/665: chown d0/d1e/f73 203494 1 2024-04-26T20:19:00.546 INFO:tasks.workunit.client.0.smithi016.stdout:4/666: chown d0/dd/d66 142049928 1 2024-04-26T20:19:00.546 INFO:tasks.workunit.client.0.smithi016.stdout:8/767: creat d9/d19/d45/d9e/d50/d109/f10b x:0 0 0 2024-04-26T20:19:00.546 INFO:tasks.workunit.client.0.smithi016.stdout:8/768: read d9/f18 [1610111,122877] 0 2024-04-26T20:19:00.546 INFO:tasks.workunit.client.0.smithi016.stdout:2/806: symlink d1d/d27/d2d/d5a/d9c/l10e 0 2024-04-26T20:19:00.547 INFO:tasks.workunit.client.0.smithi016.stdout:4/667: mknod d0/dd/d19/d1f/d7b/cd5 0 2024-04-26T20:19:00.547 INFO:tasks.workunit.client.0.smithi016.stdout:8/769: mkdir d9/d19/d45/d9e/d50/d109/d10c 0 2024-04-26T20:19:00.548 INFO:tasks.workunit.client.0.smithi016.stdout:2/807: creat d1d/d20/d22/d89/f10f x:0 0 0 2024-04-26T20:19:00.550 INFO:tasks.workunit.client.0.smithi016.stdout:4/668: link d0/d1e/d4e/d52/d88/f5f d0/dd/d1b/fd6 0 2024-04-26T20:19:00.550 INFO:tasks.workunit.client.0.smithi016.stdout:4/669: chown d0/dd/f98 15 1 2024-04-26T20:19:00.552 INFO:tasks.workunit.client.0.smithi016.stdout:2/808: rename d1d/d20/d7c/dbc/feb to d1d/d2a/d3d/dd9/de5/f110 0 2024-04-26T20:19:00.553 INFO:tasks.workunit.client.0.smithi016.stdout:4/670: mkdir d0/dd/d1b/dbc/dc5/dd7 0 2024-04-26T20:19:00.575 INFO:tasks.workunit.client.0.smithi016.stdout:2/809: rmdir d1d/d2a/d3d/dd9 39 2024-04-26T20:19:00.579 INFO:tasks.workunit.client.0.smithi016.stdout:2/810: mkdir d1d/d27/d2d/d6b/d111 0 2024-04-26T20:19:00.580 INFO:tasks.workunit.client.0.smithi016.stdout:2/811: chown d1d/d20/d22/d39/ddd 77155 1 2024-04-26T20:19:00.581 INFO:tasks.workunit.client.0.smithi016.stdout:8/770: dread d9/d19/d45/d9e/d50/f58 [0,4194304] 0 2024-04-26T20:19:00.585 INFO:tasks.workunit.client.0.smithi016.stdout:8/771: mknod d9/d72/d74/d9f/c10d 0 2024-04-26T20:19:00.585 INFO:tasks.workunit.client.0.smithi016.stdout:8/772: fsync d9/f90 0 2024-04-26T20:19:00.585 INFO:tasks.workunit.client.0.smithi016.stdout:7/706: dwrite d0/d67/f90 [0,4194304] 0 2024-04-26T20:19:00.585 INFO:tasks.workunit.client.0.smithi016.stdout:7/707: chown d0/dd5/d34/d25/dbc 75282 1 2024-04-26T20:19:00.588 INFO:tasks.workunit.client.0.smithi016.stdout:2/812: creat d1d/d27/d2d/d5a/dc7/dce/f112 x:0 0 0 2024-04-26T20:19:00.645 INFO:tasks.workunit.client.0.smithi016.stdout:1/779: dwrite d3/d5/d8d/dab/fca [0,4194304] 0 2024-04-26T20:19:00.645 INFO:tasks.workunit.client.0.smithi016.stdout:1/780: truncate d3/d57/f6e 1861256 0 2024-04-26T20:19:00.645 INFO:tasks.workunit.client.0.smithi016.stdout:1/781: fdatasync d3/d5/d6/d9/d9e/fde 0 2024-04-26T20:19:00.649 INFO:tasks.workunit.client.0.smithi016.stdout:2/813: creat d1d/d27/d2d/f113 x:0 0 0 2024-04-26T20:19:00.660 INFO:tasks.workunit.client.0.smithi016.stdout:9/831: dwrite d1/d2/f10a [0,4194304] 0 2024-04-26T20:19:00.663 INFO:tasks.workunit.client.0.smithi016.stdout:7/708: dread d0/dd5/d4b/f72 [0,4194304] 0 2024-04-26T20:19:00.664 INFO:tasks.workunit.client.0.smithi016.stdout:4/671: write d0/dd/f84 [1685696,53311] 0 2024-04-26T20:19:00.664 INFO:tasks.workunit.client.0.smithi016.stdout:7/709: write d0/dd5/d34/d25/d3f/d6d/d79/fc4 [751632,106931] 0 2024-04-26T20:19:00.664 INFO:tasks.workunit.client.0.smithi016.stdout:4/672: chown d0/d1e/f78 3 1 2024-04-26T20:19:00.664 INFO:tasks.workunit.client.0.smithi016.stdout:6/676: dwrite d1/d8/d2c/fc7 [0,4194304] 0 2024-04-26T20:19:00.664 INFO:tasks.workunit.client.0.smithi016.stdout:6/677: chown d1/d21/d26/d1c/d7b/d82/fa9 581627 1 2024-04-26T20:19:00.664 INFO:tasks.workunit.client.0.smithi016.stdout:6/678: readlink d1/d21/d48/l8c 0 2024-04-26T20:19:00.667 INFO:tasks.workunit.client.0.smithi016.stdout:1/782: dread d3/d5/da/d66/d8c/fd4 [0,4194304] 0 2024-04-26T20:19:00.677 INFO:tasks.workunit.client.0.smithi016.stdout:6/679: dread d1/fd [0,4194304] 0 2024-04-26T20:19:00.678 INFO:tasks.workunit.client.0.smithi016.stdout:7/710: unlink d0/d67/f6a 0 2024-04-26T20:19:00.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/680: write d1/d21/f3e [154771,55906] 0 2024-04-26T20:19:00.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/681: readlink d1/d21/d26/d1c/d2e/l65 0 2024-04-26T20:19:00.678 INFO:tasks.workunit.client.0.smithi016.stdout:6/682: readlink d1/d21/d26/lb3 0 2024-04-26T20:19:00.678 INFO:tasks.workunit.client.0.smithi016.stdout:7/711: write d0/dd5/d34/d25/d3f/f5f [335053,117967] 0 2024-04-26T20:19:00.679 INFO:tasks.workunit.client.0.smithi016.stdout:7/712: chown d0/dd5/d34/d25/d3f/la1 144 1 2024-04-26T20:19:00.679 INFO:tasks.workunit.client.0.smithi016.stdout:8/773: dwrite d9/d2f/fc8 [0,4194304] 0 2024-04-26T20:19:00.684 INFO:tasks.workunit.client.0.smithi016.stdout:6/683: mkdir d1/d3a/db9/dec 0 2024-04-26T20:19:00.687 INFO:tasks.workunit.client.0.smithi016.stdout:7/713: creat d0/dd5/d34/d25/d3f/d6d/d87/da3/fd8 x:0 0 0 2024-04-26T20:19:00.690 INFO:tasks.workunit.client.0.smithi016.stdout:6/684: creat d1/d3a/db9/dec/fed x:0 0 0 2024-04-26T20:19:00.694 INFO:tasks.workunit.client.0.smithi016.stdout:6/685: rmdir d1/d8/d46 39 2024-04-26T20:19:00.703 INFO:tasks.workunit.client.0.smithi016.stdout:2/814: rename d1d/d27/d2d/d5a to d1d/d27/d2d/d6b/d108/d114 0 2024-04-26T20:19:00.705 INFO:tasks.workunit.client.0.smithi016.stdout:7/714: link d0/dd5/d4b/l66 d0/ld9 0 2024-04-26T20:19:00.711 INFO:tasks.workunit.client.0.smithi016.stdout:4/673: dwrite d0/d1e/d4e/f8f [0,4194304] 0 2024-04-26T20:19:00.715 INFO:tasks.workunit.client.0.smithi016.stdout:2/815: mkdir d1d/d20/d22/d98/d115 0 2024-04-26T20:19:00.715 INFO:tasks.workunit.client.0.smithi016.stdout:9/832: write d1/d59/d52/f30 [1056063,39131] 0 2024-04-26T20:19:00.715 INFO:tasks.workunit.client.0.smithi016.stdout:8/774: truncate d9/d19/f33 1378083 0 2024-04-26T20:19:00.717 INFO:tasks.workunit.client.0.smithi016.stdout:4/674: creat d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/fd8 x:0 0 0 2024-04-26T20:19:00.718 INFO:tasks.workunit.client.0.smithi016.stdout:7/715: mknod d0/cda 0 2024-04-26T20:19:00.721 INFO:tasks.workunit.client.0.smithi016.stdout:1/783: dwrite d3/d5/d6/d9/d2a/d3d/fa9 [0,4194304] 0 2024-04-26T20:19:00.721 INFO:tasks.workunit.client.0.smithi016.stdout:2/816: symlink d1d/d2a/d3d/dd9/d103/l116 0 2024-04-26T20:19:00.721 INFO:tasks.workunit.client.0.smithi016.stdout:2/817: chown d1d/d20/d22/d88/ldb 1831828 1 2024-04-26T20:19:00.728 INFO:tasks.workunit.client.0.smithi016.stdout:8/775: mkdir d9/d19/d45/d3f/d10e 0 2024-04-26T20:19:00.728 INFO:tasks.workunit.client.0.smithi016.stdout:4/675: chown d0/dd/d19/d1f/f9b 0 1 2024-04-26T20:19:00.728 INFO:tasks.workunit.client.0.smithi016.stdout:7/716: creat d0/dd5/d6/d73/fdb x:0 0 0 2024-04-26T20:19:00.734 INFO:tasks.workunit.client.0.smithi016.stdout:9/833: rename d1/d2/c67 to d1/d2/d20/d49/d77/d2a/dfd/c11f 0 2024-04-26T20:19:00.735 INFO:tasks.workunit.client.0.smithi016.stdout:9/834: write d1/d2/d20/d49/d77/d2a/d75/d85/f11c [1033830,13122] 0 2024-04-26T20:19:00.735 INFO:tasks.workunit.client.0.smithi016.stdout:9/835: fsync d1/d2/d20/d49/d77/d2a/d75/f83 0 2024-04-26T20:19:00.738 INFO:tasks.workunit.client.0.smithi016.stdout:8/776: symlink d9/d72/l10f 0 2024-04-26T20:19:00.738 INFO:tasks.workunit.client.0.smithi016.stdout:4/676: mknod d0/dd/d19/d1f/d7b/dca/cd9 0 2024-04-26T20:19:00.738 INFO:tasks.workunit.client.0.smithi016.stdout:7/717: rmdir d0/dd5/d88/db3 39 2024-04-26T20:19:00.738 INFO:tasks.workunit.client.0.smithi016.stdout:7/718: fdatasync d0/dd5/d34/d25/fb8 0 2024-04-26T20:19:00.738 INFO:tasks.workunit.client.0.smithi016.stdout:7/719: truncate d0/dd5/d4b/f8e 4405434 0 2024-04-26T20:19:00.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/686: dwrite d1/d8/d2c/f41 [0,4194304] 0 2024-04-26T20:19:00.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/687: readlink d1/d8/d2c/d3d/l9e 0 2024-04-26T20:19:00.742 INFO:tasks.workunit.client.0.smithi016.stdout:0/674: sync 2024-04-26T20:19:00.743 INFO:tasks.workunit.client.0.smithi016.stdout:9/836: symlink d1/d2/d20/d49/l120 0 2024-04-26T20:19:00.744 INFO:tasks.workunit.client.0.smithi016.stdout:4/677: fdatasync d0/dd/f6d 0 2024-04-26T20:19:00.746 INFO:tasks.workunit.client.0.smithi016.stdout:1/784: dread d3/d5/da/f26 [4194304,4194304] 0 2024-04-26T20:19:00.746 INFO:tasks.workunit.client.0.smithi016.stdout:1/785: dread - d3/d5/d6/d9/d2a/fd8 zero size 2024-04-26T20:19:00.750 INFO:tasks.workunit.client.0.smithi016.stdout:8/777: dread d9/d23/d26/d2c/dea/ff8 [0,4194304] 0 2024-04-26T20:19:00.750 INFO:tasks.workunit.client.0.smithi016.stdout:8/778: chown d9/d72/d74/d9f/dfd 1 1 2024-04-26T20:19:00.750 INFO:tasks.workunit.client.0.smithi016.stdout:8/779: stat d9/d19/d45/d3f/d64/dfc 0 2024-04-26T20:19:00.757 INFO:tasks.workunit.client.0.smithi016.stdout:0/675: unlink d2/dc/d1e/cb2 0 2024-04-26T20:19:00.758 INFO:tasks.workunit.client.0.smithi016.stdout:0/676: dread - d2/d20/d41/f65 zero size 2024-04-26T20:19:00.759 INFO:tasks.workunit.client.0.smithi016.stdout:1/786: symlink d3/d5/l104 0 2024-04-26T20:19:00.760 INFO:tasks.workunit.client.0.smithi016.stdout:0/677: creat d2/fe4 x:0 0 0 2024-04-26T20:19:00.764 INFO:tasks.workunit.client.0.smithi016.stdout:1/787: creat d3/d5/da/d66/d8c/d84/d96/df5/f105 x:0 0 0 2024-04-26T20:19:00.764 INFO:tasks.workunit.client.0.smithi016.stdout:6/688: dread d1/fe6 [0,4194304] 0 2024-04-26T20:19:00.764 INFO:tasks.workunit.client.0.smithi016.stdout:0/678: truncate d2/dc/d1e/d25/f55 3541753 0 2024-04-26T20:19:00.766 INFO:tasks.workunit.client.0.smithi016.stdout:1/788: symlink d3/d5/d6/d50/d79/da7/l106 0 2024-04-26T20:19:00.770 INFO:tasks.workunit.client.0.smithi016.stdout:3/640: sync 2024-04-26T20:19:00.770 INFO:tasks.workunit.client.0.smithi016.stdout:3/641: getdents d3/df/d25/dc8 0 2024-04-26T20:19:00.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/689: creat d1/d21/d26/d1c/d5d/d88/fee x:0 0 0 2024-04-26T20:19:00.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/690: fdatasync d1/d21/f9b 0 2024-04-26T20:19:00.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/691: readlink d1/d8/d2c/d3d/ld3 0 2024-04-26T20:19:00.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/692: readlink d1/d21/d26/d1c/d8a/la3 0 2024-04-26T20:19:00.771 INFO:tasks.workunit.client.0.smithi016.stdout:3/642: link d3/d9/d2d/d4f/c52 d3/d9/d2d/db8/ccd 0 2024-04-26T20:19:00.771 INFO:tasks.workunit.client.0.smithi016.stdout:6/693: rename d1/d8 to d1/d21/d26/d1c/d5d/def 0 2024-04-26T20:19:00.771 INFO:tasks.workunit.client.0.smithi016.stdout:7/720: read d0/dd5/fbf [1694352,128249] 0 2024-04-26T20:19:00.772 INFO:tasks.workunit.client.0.smithi016.stdout:7/721: truncate d0/dd5/d6/d73/fd4 197182 0 2024-04-26T20:19:00.773 INFO:tasks.workunit.client.0.smithi016.stdout:2/818: dwrite d1d/d2a/fb3 [0,4194304] 0 2024-04-26T20:19:00.773 INFO:tasks.workunit.client.0.smithi016.stdout:3/643: unlink d3/df/d25/d32/c4c 0 2024-04-26T20:19:00.774 INFO:tasks.workunit.client.0.smithi016.stdout:7/722: symlink d0/dd5/d95/ldc 0 2024-04-26T20:19:00.774 INFO:tasks.workunit.client.0.smithi016.stdout:2/819: creat d1d/d20/d22/f117 x:0 0 0 2024-04-26T20:19:00.776 INFO:tasks.workunit.client.0.smithi016.stdout:7/723: link d0/dd5/d34/d25/cd7 d0/d51/dc7/cdd 0 2024-04-26T20:19:00.776 INFO:tasks.workunit.client.0.smithi016.stdout:2/820: read d1d/d27/d2d/d6b/d7e/ddc/fe7 [52247,36777] 0 2024-04-26T20:19:00.796 INFO:tasks.workunit.client.0.smithi016.stdout:6/694: dread d1/d21/d26/fb0 [0,4194304] 0 2024-04-26T20:19:00.799 INFO:tasks.workunit.client.0.smithi016.stdout:6/695: rename d1/d21/d26/d1c/d7b/d82/d8f/fa6 to d1/d21/d26/d1c/ff0 0 2024-04-26T20:19:00.800 INFO:tasks.workunit.client.0.smithi016.stdout:9/837: dwrite d1/d2/d20/d49/d77/d3e/d5e/d93/fcb [0,4194304] 0 2024-04-26T20:19:00.800 INFO:tasks.workunit.client.0.smithi016.stdout:9/838: readlink d1/d2e/l6c 0 2024-04-26T20:19:00.800 INFO:tasks.workunit.client.0.smithi016.stdout:9/839: chown d1/d2e/d40/f6b 73 1 2024-04-26T20:19:00.801 INFO:tasks.workunit.client.0.smithi016.stdout:9/840: stat d1/d2/f5 0 2024-04-26T20:19:00.801 INFO:tasks.workunit.client.0.smithi016.stdout:9/841: chown d1/d2/d20/d49/d77/c5b 3771 1 2024-04-26T20:19:00.801 INFO:tasks.workunit.client.0.smithi016.stdout:9/842: chown d1/d2/d20/d49/d77/d2a/d75/d85/d9b 30618370 1 2024-04-26T20:19:00.804 INFO:tasks.workunit.client.0.smithi016.stdout:9/843: rename d1/ff3 to d1/d59/d52/d8c/df1/f121 0 2024-04-26T20:19:00.807 INFO:tasks.workunit.client.0.smithi016.stdout:7/724: dread d0/dd5/d34/d25/d3f/d6d/d79/fd6 [0,4194304] 0 2024-04-26T20:19:00.828 INFO:tasks.workunit.client.0.smithi016.stdout:7/725: dread d0/dd5/fbf [0,4194304] 0 2024-04-26T20:19:00.829 INFO:tasks.workunit.client.0.smithi016.stdout:7/726: chown d0/dd5/d4b 0 1 2024-04-26T20:19:00.829 INFO:tasks.workunit.client.0.smithi016.stdout:7/727: write d0/dd5/d34/d25/d50/fc5 [849487,16618] 0 2024-04-26T20:19:00.830 INFO:tasks.workunit.client.0.smithi016.stdout:7/728: creat d0/dd5/d34/d25/d50/fde x:0 0 0 2024-04-26T20:19:00.836 INFO:tasks.workunit.client.0.smithi016.stdout:4/678: dwrite d0/dd/d19/d1f/f45 [4194304,4194304] 0 2024-04-26T20:19:00.838 INFO:tasks.workunit.client.0.smithi016.stdout:6/696: rmdir d1/d21/d26/d1c/d2e/d53/d93/dc1 0 2024-04-26T20:19:00.838 INFO:tasks.workunit.client.0.smithi016.stdout:6/697: stat d1/d21/d26/d1c/d5d/def/dae/f8e 0 2024-04-26T20:19:00.838 INFO:tasks.workunit.client.0.smithi016.stdout:6/698: write d1/d21/d26/d1c/d4e/f8b [1569995,113833] 0 2024-04-26T20:19:00.841 INFO:tasks.workunit.client.0.smithi016.stdout:4/679: link d0/d1e/d4e/d52/d88/f5f d0/d1e/d30/fda 0 2024-04-26T20:19:00.842 INFO:tasks.workunit.client.0.smithi016.stdout:6/699: creat d1/d21/d26/d1c/d5d/def/d2c/ff1 x:0 0 0 2024-04-26T20:19:00.873 INFO:tasks.workunit.client.0.smithi016.stdout:0/679: dread d2/dc/d1e/f1f [4194304,4194304] 0 2024-04-26T20:19:00.873 INFO:tasks.workunit.client.0.smithi016.stdout:8/780: dwrite f8 [0,4194304] 0 2024-04-26T20:19:00.879 INFO:tasks.workunit.client.0.smithi016.stdout:0/680: creat d2/dc/d18/fe5 x:0 0 0 2024-04-26T20:19:00.880 INFO:tasks.workunit.client.0.smithi016.stdout:4/680: rename d0/dd/f12 to d0/d1e/d30/fdb 0 2024-04-26T20:19:00.882 INFO:tasks.workunit.client.0.smithi016.stdout:0/681: link d2/dc/d18/f1a d2/dc/d45/fe6 0 2024-04-26T20:19:00.882 INFO:tasks.workunit.client.0.smithi016.stdout:0/682: read d2/dc/d1e/d35/f63 [3500506,125835] 0 2024-04-26T20:19:00.883 INFO:tasks.workunit.client.0.smithi016.stdout:6/700: rename d1/d21/d26/d1c/d5d/def/d2c/d3d/f58 to d1/d21/d78/ff2 0 2024-04-26T20:19:00.883 INFO:tasks.workunit.client.0.smithi016.stdout:6/701: chown d1/d21/d26/fb0 9278 1 2024-04-26T20:19:00.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/681: mkdir d0/d96/ddc 0 2024-04-26T20:19:00.887 INFO:tasks.workunit.client.0.smithi016.stdout:4/682: unlink d0/d1e/d4e/d52/d88/d43/f4a 0 2024-04-26T20:19:00.913 INFO:tasks.workunit.client.0.smithi016.stdout:8/781: dwrite d9/d19/f41 [0,4194304] 0 2024-04-26T20:19:00.926 INFO:tasks.workunit.client.0.smithi016.stdout:0/683: dwrite d2/d20/d41/f69 [0,4194304] 0 2024-04-26T20:19:00.927 INFO:tasks.workunit.client.0.smithi016.stdout:4/683: getdents d0/dd/d19/d1f/d7b 0 2024-04-26T20:19:00.928 INFO:tasks.workunit.client.0.smithi016.stdout:0/684: mknod d2/d20/d41/d72/ce7 0 2024-04-26T20:19:00.929 INFO:tasks.workunit.client.0.smithi016.stdout:4/684: mknod d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/cdd 0 2024-04-26T20:19:00.931 INFO:tasks.workunit.client.0.smithi016.stdout:0/685: rename d2/d20/d41/d87/d9d/ca0 to d2/d8/d37/ce8 0 2024-04-26T20:19:00.933 INFO:tasks.workunit.client.0.smithi016.stdout:4/685: mknod d0/d1e/d4e/d52/d88/d43/d9c/cde 0 2024-04-26T20:19:00.966 INFO:tasks.workunit.client.0.smithi016.stdout:0/686: symlink d2/d40/d61/d91/le9 0 2024-04-26T20:19:00.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/687: stat d2/dc/d18/d24/c52 0 2024-04-26T20:19:00.967 INFO:tasks.workunit.client.0.smithi016.stdout:0/688: readlink d2/d20/l23 0 2024-04-26T20:19:00.967 INFO:tasks.workunit.client.0.smithi016.stdout:3/644: dread d3/df/d25/f5c [4194304,4194304] 0 2024-04-26T20:19:00.967 INFO:tasks.workunit.client.0.smithi016.stdout:3/645: fsync d3/d9/d2d/fc9 0 2024-04-26T20:19:00.984 INFO:tasks.workunit.client.0.smithi016.stdout:1/789: dwrite d3/d5/d6/d50/fe4 [0,4194304] 0 2024-04-26T20:19:00.985 INFO:tasks.workunit.client.0.smithi016.stdout:9/844: dwrite d1/d2/d20/d49/d77/d2a/ffc [0,4194304] 0 2024-04-26T20:19:00.985 INFO:tasks.workunit.client.0.smithi016.stdout:8/782: write d9/d19/d45/d3f/f63 [7073160,115721] 0 2024-04-26T20:19:00.986 INFO:tasks.workunit.client.0.smithi016.stdout:4/686: dwrite d0/dd/d19/d1f/d7b/f7e [0,4194304] 0 2024-04-26T20:19:00.986 INFO:tasks.workunit.client.0.smithi016.stdout:9/845: write d1/d2/d20/d49/d77/d2a/d75/d85/f9e [1196248,94740] 0 2024-04-26T20:19:00.986 INFO:tasks.workunit.client.0.smithi016.stdout:9/846: stat d1/d2/d43/c72 0 2024-04-26T20:19:00.986 INFO:tasks.workunit.client.0.smithi016.stdout:9/847: dread - d1/d2/d20/d49/d77/d107/f10f zero size 2024-04-26T20:19:00.989 INFO:tasks.workunit.client.0.smithi016.stdout:6/702: dwrite d1/fa [4194304,4194304] 0 2024-04-26T20:19:00.989 INFO:tasks.workunit.client.0.smithi016.stdout:6/703: stat d1/d21/d26/d1c/d2e/d53 0 2024-04-26T20:19:00.989 INFO:tasks.workunit.client.0.smithi016.stdout:6/704: truncate d1/d21/f39 4542902 0 2024-04-26T20:19:00.989 INFO:tasks.workunit.client.0.smithi016.stdout:6/705: write d1/d12/fb7 [1453086,65963] 0 2024-04-26T20:19:00.989 INFO:tasks.workunit.client.0.smithi016.stdout:6/706: fdatasync d1/d21/d48/d51/fb6 0 2024-04-26T20:19:00.990 INFO:tasks.workunit.client.0.smithi016.stdout:8/783: symlink d9/d72/d74/l110 0 2024-04-26T20:19:01.001 INFO:tasks.workunit.client.0.smithi016.stdout:9/848: creat d1/d59/da5/d118/f122 x:0 0 0 2024-04-26T20:19:01.001 INFO:tasks.workunit.client.0.smithi016.stdout:3/646: symlink d3/df/d20/d41/lce 0 2024-04-26T20:19:01.005 INFO:tasks.workunit.client.0.smithi016.stdout:6/707: rmdir d1/d21/d26/d1c/d2e 39 2024-04-26T20:19:01.010 INFO:tasks.workunit.client.0.smithi016.stdout:9/849: getdents d1/d2e 0 2024-04-26T20:19:01.015 INFO:tasks.workunit.client.0.smithi016.stdout:3/647: dread d3/df/d25/d32/f7c [0,4194304] 0 2024-04-26T20:19:01.015 INFO:tasks.workunit.client.0.smithi016.stdout:3/648: read d3/df/d25/d32/f7c [3886906,84091] 0 2024-04-26T20:19:01.015 INFO:tasks.workunit.client.0.smithi016.stdout:3/649: fsync d3/df/d25/d2a/d4a/f91 0 2024-04-26T20:19:01.023 INFO:tasks.workunit.client.0.smithi016.stdout:9/850: dread d1/d2/d20/d49/f7b [0,4194304] 0 2024-04-26T20:19:01.025 INFO:tasks.workunit.client.0.smithi016.stdout:6/708: rename d1/d12/l4c to d1/d21/d26/d1c/d8a/lf3 0 2024-04-26T20:19:01.029 INFO:tasks.workunit.client.0.smithi016.stdout:9/851: mknod d1/d1b/c123 0 2024-04-26T20:19:01.029 INFO:tasks.workunit.client.0.smithi016.stdout:9/852: fdatasync d1/d2/d20/d49/d77/d2a/d75/d85/fb4 0 2024-04-26T20:19:01.030 INFO:tasks.workunit.client.0.smithi016.stdout:9/853: truncate d1/d2e/dc6/f53 263247 0 2024-04-26T20:19:01.032 INFO:tasks.workunit.client.0.smithi016.stdout:9/854: creat d1/d2/d20/de8/f124 x:0 0 0 2024-04-26T20:19:01.032 INFO:tasks.workunit.client.0.smithi016.stdout:9/855: fsync d1/d59/d52/fba 0 2024-04-26T20:19:01.067 INFO:tasks.workunit.client.0.smithi016.stdout:4/687: dwrite d0/dd/d19/f38 [0,4194304] 0 2024-04-26T20:19:01.068 INFO:tasks.workunit.client.0.smithi016.stdout:4/688: write d0/dd/d19/d1f/d7b/f7e [4329925,25409] 0 2024-04-26T20:19:01.068 INFO:tasks.workunit.client.0.smithi016.stdout:4/689: read d0/f1 [1364399,75267] 0 2024-04-26T20:19:01.068 INFO:tasks.workunit.client.0.smithi016.stdout:4/690: write d0/dd/d66/d6f/fd4 [103139,119529] 0 2024-04-26T20:19:01.069 INFO:tasks.workunit.client.0.smithi016.stdout:4/691: rmdir d0/d1e/d4e/d52 39 2024-04-26T20:19:01.071 INFO:tasks.workunit.client.0.smithi016.stdout:4/692: write d0/dd/f84 [3161924,10809] 0 2024-04-26T20:19:01.080 INFO:tasks.workunit.client.0.smithi016.stdout:8/784: dwrite d9/d19/d45/d9e/d50/f58 [0,4194304] 0 2024-04-26T20:19:01.086 INFO:tasks.workunit.client.0.smithi016.stdout:8/785: getdents d9/d72/d74 0 2024-04-26T20:19:01.089 INFO:tasks.workunit.client.0.smithi016.stdout:1/790: dwrite d3/d5/d6/d5a/dbf/fcc [0,4194304] 0 2024-04-26T20:19:01.089 INFO:tasks.workunit.client.0.smithi016.stdout:1/791: stat d3/d5/d6 0 2024-04-26T20:19:01.092 INFO:tasks.workunit.client.0.smithi016.stdout:1/792: creat d3/f107 x:0 0 0 2024-04-26T20:19:01.092 INFO:tasks.workunit.client.0.smithi016.stdout:0/689: dwrite d2/d20/d41/d87/d9d/fba [0,4194304] 0 2024-04-26T20:19:01.092 INFO:tasks.workunit.client.0.smithi016.stdout:0/690: fsync d2/d40/d61/fb1 0 2024-04-26T20:19:01.092 INFO:tasks.workunit.client.0.smithi016.stdout:1/793: getdents d3/d5/d6/d9/d9e 0 2024-04-26T20:19:01.092 INFO:tasks.workunit.client.0.smithi016.stdout:0/691: read - d2/d20/d41/d87/d9d/db8/fc0 zero size 2024-04-26T20:19:01.093 INFO:tasks.workunit.client.0.smithi016.stdout:1/794: creat d3/d5/d6/d9/f108 x:0 0 0 2024-04-26T20:19:01.095 INFO:tasks.workunit.client.0.smithi016.stdout:0/692: link d2/d8/d37/fc2 d2/d20/d41/d87/d9d/db8/fea 0 2024-04-26T20:19:01.095 INFO:tasks.workunit.client.0.smithi016.stdout:0/693: write d2/fb [599208,81194] 0 2024-04-26T20:19:01.096 INFO:tasks.workunit.client.0.smithi016.stdout:0/694: write d2/d20/d41/d87/fb9 [4320138,58807] 0 2024-04-26T20:19:01.096 INFO:tasks.workunit.client.0.smithi016.stdout:0/695: chown d2/dc/d1e/l68 67535601 1 2024-04-26T20:19:01.097 INFO:tasks.workunit.client.0.smithi016.stdout:0/696: mkdir d2/d20/d41/deb 0 2024-04-26T20:19:01.097 INFO:tasks.workunit.client.0.smithi016.stdout:0/697: dread - d2/dc/d18/d24/fb3 zero size 2024-04-26T20:19:01.106 INFO:tasks.workunit.client.0.smithi016.stdout:3/650: read d3/df/d25/d2a/f42 [3289762,76468] 0 2024-04-26T20:19:01.107 INFO:tasks.workunit.client.0.smithi016.stdout:0/698: dread d2/dc/f1d [0,4194304] 0 2024-04-26T20:19:01.107 INFO:tasks.workunit.client.0.smithi016.stdout:0/699: chown d2/d20/d41/f69 519433493 1 2024-04-26T20:19:01.109 INFO:tasks.workunit.client.0.smithi016.stdout:0/700: rmdir d2/dc/d1e/d35 39 2024-04-26T20:19:01.109 INFO:tasks.workunit.client.0.smithi016.stdout:0/701: stat d2/d20/fad 0 2024-04-26T20:19:01.109 INFO:tasks.workunit.client.0.smithi016.stdout:0/702: read d2/d8/d3b/fd8 [123877,96323] 0 2024-04-26T20:19:01.109 INFO:tasks.workunit.client.0.smithi016.stdout:0/703: write d2/d20/d41/f65 [1002803,26585] 0 2024-04-26T20:19:01.117 INFO:tasks.workunit.client.0.smithi016.stdout:0/704: read d2/d8/f36 [535971,105165] 0 2024-04-26T20:19:01.118 INFO:tasks.workunit.client.0.smithi016.stdout:8/786: write d9/d19/d45/d3f/f7f [3636423,80912] 0 2024-04-26T20:19:01.121 INFO:tasks.workunit.client.0.smithi016.stdout:4/693: dwrite d0/d1e/d4e/d52/d54/d87/fab [0,4194304] 0 2024-04-26T20:19:01.122 INFO:tasks.workunit.client.0.smithi016.stdout:0/705: mkdir d2/d20/d41/d87/d9d/dda/dec 0 2024-04-26T20:19:01.122 INFO:tasks.workunit.client.0.smithi016.stdout:0/706: stat d2/d20/d41/f69 0 2024-04-26T20:19:01.132 INFO:tasks.workunit.client.0.smithi016.stdout:9/856: dread d1/d2e/f63 [0,4194304] 0 2024-04-26T20:19:01.133 INFO:tasks.workunit.client.0.smithi016.stdout:9/857: write d1/d1b/f7d [1156334,116047] 0 2024-04-26T20:19:01.133 INFO:tasks.workunit.client.0.smithi016.stdout:9/858: fsync d1/d2/d20/d49/d77/d2a/d75/f83 0 2024-04-26T20:19:01.133 INFO:tasks.workunit.client.0.smithi016.stdout:6/709: dwrite d1/d21/d26/d1c/f81 [0,4194304] 0 2024-04-26T20:19:01.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/787: dread d9/d66/d73/fd6 [0,4194304] 0 2024-04-26T20:19:01.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/788: chown d9/d2f/l3b 166326024 1 2024-04-26T20:19:01.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/789: fdatasync d9/d19/d45/d9e/d50/dad/fc4 0 2024-04-26T20:19:01.134 INFO:tasks.workunit.client.0.smithi016.stdout:4/694: read d0/dd/f98 [218092,72762] 0 2024-04-26T20:19:01.135 INFO:tasks.workunit.client.0.smithi016.stdout:9/859: mkdir d1/d2/d20/d125 0 2024-04-26T20:19:01.136 INFO:tasks.workunit.client.0.smithi016.stdout:6/710: creat d1/d12/d90/ff4 x:0 0 0 2024-04-26T20:19:01.136 INFO:tasks.workunit.client.0.smithi016.stdout:6/711: truncate d1/d21/d48/fad 912251 0 2024-04-26T20:19:01.136 INFO:tasks.workunit.client.0.smithi016.stdout:3/651: write d3/df/d25/d2a/f7a [2588122,16137] 0 2024-04-26T20:19:01.136 INFO:tasks.workunit.client.0.smithi016.stdout:3/652: getdents d3/d9/d18/d82 0 2024-04-26T20:19:01.140 INFO:tasks.workunit.client.0.smithi016.stdout:8/790: rename d9/d72/lc5 to d9/d72/da3/l111 0 2024-04-26T20:19:01.140 INFO:tasks.workunit.client.0.smithi016.stdout:4/695: truncate d0/dd/f6d 1774375 0 2024-04-26T20:19:01.140 INFO:tasks.workunit.client.0.smithi016.stdout:9/860: creat d1/d2/d20/d49/d77/d2a/d75/d85/f126 x:0 0 0 2024-04-26T20:19:01.141 INFO:tasks.workunit.client.0.smithi016.stdout:6/712: mknod d1/d21/d26/d1c/d5d/d88/cf5 0 2024-04-26T20:19:01.141 INFO:tasks.workunit.client.0.smithi016.stdout:6/713: chown d1/d3a/db9/dec/fed 22192300 1 2024-04-26T20:19:01.142 INFO:tasks.workunit.client.0.smithi016.stdout:6/714: write d1/d21/d26/d1c/d5d/d88/fee [941241,107698] 0 2024-04-26T20:19:01.145 INFO:tasks.workunit.client.0.smithi016.stdout:4/696: mkdir d0/d1e/d4e/d52/d54/dad/ddf 0 2024-04-26T20:19:01.145 INFO:tasks.workunit.client.0.smithi016.stdout:4/697: chown d0/d1e/d4e/d52/d54/d87 5402671 1 2024-04-26T20:19:01.145 INFO:tasks.workunit.client.0.smithi016.stdout:9/861: mkdir d1/d2/d20/d127 0 2024-04-26T20:19:01.147 INFO:tasks.workunit.client.0.smithi016.stdout:1/795: write d3/d5/d6/d9/f4e [1882474,97127] 0 2024-04-26T20:19:01.148 INFO:tasks.workunit.client.0.smithi016.stdout:1/796: write d3/d57/f6d [367913,69405] 0 2024-04-26T20:19:01.148 INFO:tasks.workunit.client.0.smithi016.stdout:1/797: fsync d3/d5/da/f30 0 2024-04-26T20:19:01.156 INFO:tasks.workunit.client.0.smithi016.stdout:6/715: getdents d1/d21/d26/d1c/d5d/def/dae 0 2024-04-26T20:19:01.164 INFO:tasks.workunit.client.0.smithi016.stdout:4/698: write d0/dd/d19/d57/f60 [323204,125335] 0 2024-04-26T20:19:01.168 INFO:tasks.workunit.client.0.smithi016.stdout:0/707: dwrite d2/dc/d1e/f38 [0,4194304] 0 2024-04-26T20:19:01.168 INFO:tasks.workunit.client.0.smithi016.stdout:0/708: chown d2/dc/d1e/f3a 0 1 2024-04-26T20:19:01.168 INFO:tasks.workunit.client.0.smithi016.stdout:0/709: dread - d2/dc/d18/f48 zero size 2024-04-26T20:19:01.180 INFO:tasks.workunit.client.0.smithi016.stdout:1/798: creat d3/d5/da/d66/d8c/d84/d96/df5/f109 x:0 0 0 2024-04-26T20:19:01.180 INFO:tasks.workunit.client.0.smithi016.stdout:1/799: readlink d3/d5/d6/d5a/lda 0 2024-04-26T20:19:01.180 INFO:tasks.workunit.client.0.smithi016.stdout:3/653: dwrite d3/df/f99 [0,4194304] 0 2024-04-26T20:19:01.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/710: symlink d2/d8/led 0 2024-04-26T20:19:01.196 INFO:tasks.workunit.client.0.smithi016.stdout:9/862: dwrite d1/d59/d52/fbd [0,4194304] 0 2024-04-26T20:19:01.196 INFO:tasks.workunit.client.0.smithi016.stdout:9/863: chown d1/d2/d20/d49/d77/d2a/d33/f6f 1 1 2024-04-26T20:19:01.196 INFO:tasks.workunit.client.0.smithi016.stdout:6/716: dread d1/d21/d26/d1c/d5d/d88/fee [0,4194304] 0 2024-04-26T20:19:01.202 INFO:tasks.workunit.client.0.smithi016.stdout:4/699: truncate d0/dd/f2a 988386 0 2024-04-26T20:19:01.226 INFO:tasks.workunit.client.0.smithi016.stdout:1/800: write d3/d5/d6/d50/d58/fc1 [2023455,94099] 0 2024-04-26T20:19:01.227 INFO:tasks.workunit.client.0.smithi016.stdout:4/700: rename d0/dd/fb2 to d0/dd/d1b/dbc/dc5/fe0 0 2024-04-26T20:19:01.232 INFO:tasks.workunit.client.0.smithi016.stdout:8/791: dwrite d9/d72/d74/d9f/fde [0,4194304] 0 2024-04-26T20:19:01.233 INFO:tasks.workunit.client.0.smithi016.stdout:8/792: readlink d9/d19/d45/d3f/l43 0 2024-04-26T20:19:01.234 INFO:tasks.workunit.client.0.smithi016.stdout:3/654: dwrite d3/df/d25/d2a/d4a/fb4 [0,4194304] 0 2024-04-26T20:19:01.238 INFO:tasks.workunit.client.0.smithi016.stdout:6/717: dread d1/d21/d26/f54 [0,4194304] 0 2024-04-26T20:19:01.243 INFO:tasks.workunit.client.0.smithi016.stdout:8/793: creat d9/d19/de6/f112 x:0 0 0 2024-04-26T20:19:01.244 INFO:tasks.workunit.client.0.smithi016.stdout:8/794: write d9/d19/d45/d9e/f5b [5326261,69940] 0 2024-04-26T20:19:01.245 INFO:tasks.workunit.client.0.smithi016.stdout:3/655: creat d3/df/d20/d61/d76/fcf x:0 0 0 2024-04-26T20:19:01.247 INFO:tasks.workunit.client.0.smithi016.stdout:6/718: unlink d1/fa 0 2024-04-26T20:19:01.255 INFO:tasks.workunit.client.0.smithi016.stdout:4/701: write d0/dd/d19/d57/f89 [1049025,36520] 0 2024-04-26T20:19:01.255 INFO:tasks.workunit.client.0.smithi016.stdout:6/719: dread d1/d21/d26/d1c/d5d/def/d2c/d47/f94 [0,4194304] 0 2024-04-26T20:19:01.257 INFO:tasks.workunit.client.0.smithi016.stdout:8/795: mknod d9/d23/d26/d2c/dea/c113 0 2024-04-26T20:19:01.257 INFO:tasks.workunit.client.0.smithi016.stdout:8/796: write d9/d2f/f86 [872540,96477] 0 2024-04-26T20:19:01.258 INFO:tasks.workunit.client.0.smithi016.stdout:8/797: chown d9/d19/d45/d9e/fa4 175845 1 2024-04-26T20:19:01.258 INFO:tasks.workunit.client.0.smithi016.stdout:2/821: sync 2024-04-26T20:19:01.258 INFO:tasks.workunit.client.0.smithi016.stdout:2/822: write d1d/d20/d22/d39/d3e/f47 [1153592,29840] 0 2024-04-26T20:19:01.258 INFO:tasks.workunit.client.0.smithi016.stdout:2/823: write d1d/d20/d22/f117 [278817,18087] 0 2024-04-26T20:19:01.260 INFO:tasks.workunit.client.0.smithi016.stdout:9/864: dwrite d1/d2/d20/d49/d77/d2a/d75/d85/d9b/ff5 [0,4194304] 0 2024-04-26T20:19:01.260 INFO:tasks.workunit.client.0.smithi016.stdout:7/729: sync 2024-04-26T20:19:01.269 INFO:tasks.workunit.client.0.smithi016.stdout:6/720: link d1/d21/d26/d1c/d5d/def/fc d1/d21/d26/d1c/d2e/d53/d93/ff6 0 2024-04-26T20:19:01.270 INFO:tasks.workunit.client.0.smithi016.stdout:2/824: getdents d1d/d20/d7c/dbc 0 2024-04-26T20:19:01.278 INFO:tasks.workunit.client.0.smithi016.stdout:1/801: dwrite d3/d5/da/d66/d8c/f6b [0,4194304] 0 2024-04-26T20:19:01.281 INFO:tasks.workunit.client.0.smithi016.stdout:9/865: creat d1/d2/d20/d125/f128 x:0 0 0 2024-04-26T20:19:01.281 INFO:tasks.workunit.client.0.smithi016.stdout:9/866: chown d1/d2/d43/c117 14 1 2024-04-26T20:19:01.283 INFO:tasks.workunit.client.0.smithi016.stdout:2/825: creat d1d/d20/d22/d39/f118 x:0 0 0 2024-04-26T20:19:01.292 INFO:tasks.workunit.client.0.smithi016.stdout:1/802: symlink d3/d5/da/d66/l10a 0 2024-04-26T20:19:01.293 INFO:tasks.workunit.client.0.smithi016.stdout:2/826: rmdir d1d/d27/d49 39 2024-04-26T20:19:01.299 INFO:tasks.workunit.client.0.smithi016.stdout:3/656: dwrite d3/df/d25/d2a/d69/f92 [0,4194304] 0 2024-04-26T20:19:01.300 INFO:tasks.workunit.client.0.smithi016.stdout:1/803: truncate d3/d5/d6/d5a/f5d 320031 0 2024-04-26T20:19:01.304 INFO:tasks.workunit.client.0.smithi016.stdout:4/702: read d0/d1e/fc1 [213414,72520] 0 2024-04-26T20:19:01.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/657: creat d3/d9/d18/d82/dc6/fd0 x:0 0 0 2024-04-26T20:19:01.308 INFO:tasks.workunit.client.0.smithi016.stdout:3/658: dread - d3/df/d25/d2a/d4a/fca zero size 2024-04-26T20:19:01.310 INFO:tasks.workunit.client.0.smithi016.stdout:1/804: creat d3/d5/d6/d5a/dbf/de2/f10b x:0 0 0 2024-04-26T20:19:01.313 INFO:tasks.workunit.client.0.smithi016.stdout:6/721: dread d1/d21/d26/fb0 [0,4194304] 0 2024-04-26T20:19:01.313 INFO:tasks.workunit.client.0.smithi016.stdout:6/722: write d1/d12/d90/ff4 [377238,46677] 0 2024-04-26T20:19:01.315 INFO:tasks.workunit.client.0.smithi016.stdout:6/723: read d1/d21/f3e [18090,60055] 0 2024-04-26T20:19:01.316 INFO:tasks.workunit.client.0.smithi016.stdout:4/703: truncate d0/d1e/d64/f85 4454520 0 2024-04-26T20:19:01.321 INFO:tasks.workunit.client.0.smithi016.stdout:3/659: mkdir d3/df/d20/db0/dd1 0 2024-04-26T20:19:01.331 INFO:tasks.workunit.client.0.smithi016.stdout:9/867: dwrite d1/f8 [0,4194304] 0 2024-04-26T20:19:01.336 INFO:tasks.workunit.client.0.smithi016.stdout:4/704: mknod d0/dd/d66/d6f/ce1 0 2024-04-26T20:19:01.336 INFO:tasks.workunit.client.0.smithi016.stdout:4/705: truncate d0/d1e/d64/f92 1261676 0 2024-04-26T20:19:01.336 INFO:tasks.workunit.client.0.smithi016.stdout:4/706: fdatasync d0/dd/d66/d6f/fd4 0 2024-04-26T20:19:01.473 INFO:tasks.workunit.client.0.smithi016.stdout:6/724: dwrite d1/d21/d26/d1c/d2e/d53/f69 [0,4194304] 0 2024-04-26T20:19:01.474 INFO:tasks.workunit.client.0.smithi016.stdout:9/868: mknod d1/d2e/dd3/c129 0 2024-04-26T20:19:01.474 INFO:tasks.workunit.client.0.smithi016.stdout:9/869: chown d1/d2/d20/d49/d77/d2a/d75/d85/d9b/lbf 1 1 2024-04-26T20:19:01.474 INFO:tasks.workunit.client.0.smithi016.stdout:9/870: dread - d1/d2e/f10d zero size 2024-04-26T20:19:01.492 INFO:tasks.workunit.client.0.smithi016.stdout:4/707: dwrite d0/d1e/d4e/d52/d88/f5f [0,4194304] 0 2024-04-26T20:19:01.493 INFO:tasks.workunit.client.0.smithi016.stdout:6/725: mknod d1/d12/cf7 0 2024-04-26T20:19:01.493 INFO:tasks.workunit.client.0.smithi016.stdout:6/726: write d1/d21/d26/d1c/d5d/def/f2f [1481022,123542] 0 2024-04-26T20:19:01.493 INFO:tasks.workunit.client.0.smithi016.stdout:6/727: fsync d1/d21/d26/d1c/d7b/f89 0 2024-04-26T20:19:01.494 INFO:tasks.workunit.client.0.smithi016.stdout:9/871: unlink d1/d59/d52/d8c/cec 0 2024-04-26T20:19:01.503 INFO:tasks.workunit.client.0.smithi016.stdout:9/872: dread d1/d2e/f9 [0,4194304] 0 2024-04-26T20:19:01.513 INFO:tasks.workunit.client.0.smithi016.stdout:9/873: dread d1/d2e/f9 [0,4194304] 0 2024-04-26T20:19:01.514 INFO:tasks.workunit.client.0.smithi016.stdout:9/874: fsync d1/d2/d20/d49/d77/d2a/fa9 0 2024-04-26T20:19:01.527 INFO:tasks.workunit.client.0.smithi016.stdout:9/875: dread d1/d1b/f80 [0,4194304] 0 2024-04-26T20:19:01.527 INFO:tasks.workunit.client.0.smithi016.stdout:9/876: dread - d1/d2/d20/dde/ffa zero size 2024-04-26T20:19:01.529 INFO:tasks.workunit.client.0.smithi016.stdout:6/728: creat d1/d21/d26/d1c/d5d/de2/ff8 x:0 0 0 2024-04-26T20:19:01.530 INFO:tasks.workunit.client.0.smithi016.stdout:9/877: mkdir d1/d2e/d12a 0 2024-04-26T20:19:01.531 INFO:tasks.workunit.client.0.smithi016.stdout:9/878: rename d1 to d1/d1b/d12b 22 2024-04-26T20:19:01.531 INFO:tasks.workunit.client.0.smithi016.stdout:4/708: truncate d0/dd/f2a 1550468 0 2024-04-26T20:19:01.532 INFO:tasks.workunit.client.0.smithi016.stdout:4/709: readlink d0/dd/d1b/l7a 0 2024-04-26T20:19:01.532 INFO:tasks.workunit.client.0.smithi016.stdout:4/710: chown d0/dd/d66/d6f/ce1 98883815 1 2024-04-26T20:19:01.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/711: dwrite d0/f8d [0,4194304] 0 2024-04-26T20:19:01.618 INFO:tasks.workunit.client.0.smithi016.stdout:6/729: mknod d1/d21/d26/d1c/d5d/d88/cf9 0 2024-04-26T20:19:01.619 INFO:tasks.workunit.client.0.smithi016.stdout:9/879: mknod d1/d2/d20/de8/c12c 0 2024-04-26T20:19:01.619 INFO:tasks.workunit.client.0.smithi016.stdout:4/712: mknod d0/dd/d19/d1f/d7b/ce2 0 2024-04-26T20:19:01.621 INFO:tasks.workunit.client.0.smithi016.stdout:6/730: rename d1/d21/l28 to d1/d21/d26/d1c/d4e/lfa 0 2024-04-26T20:19:01.622 INFO:tasks.workunit.client.0.smithi016.stdout:9/880: truncate d1/d1b/f24 1338779 0 2024-04-26T20:19:01.623 INFO:tasks.workunit.client.0.smithi016.stdout:4/713: creat d0/d1e/d4e/d52/d54/fe3 x:0 0 0 2024-04-26T20:19:01.625 INFO:tasks.workunit.client.0.smithi016.stdout:6/731: rename d1/d21/f9b to d1/d21/d26/d1c/d5d/def/d2c/d47/dd7/ffb 0 2024-04-26T20:19:01.625 INFO:tasks.workunit.client.0.smithi016.stdout:6/732: dread - d1/d21/d78/fbb zero size 2024-04-26T20:19:01.627 INFO:tasks.workunit.client.0.smithi016.stdout:9/881: mkdir d1/d2/d20/d49/d77/d2a/d33/d12d 0 2024-04-26T20:19:01.627 INFO:tasks.workunit.client.0.smithi016.stdout:9/882: chown d1/d1b/fc7 310931 1 2024-04-26T20:19:01.628 INFO:tasks.workunit.client.0.smithi016.stdout:9/883: readlink d1/d2e/dd3/lf4 0 2024-04-26T20:19:01.628 INFO:tasks.workunit.client.0.smithi016.stdout:9/884: readlink d1/d59/d52/d8c/l101 0 2024-04-26T20:19:01.630 INFO:tasks.workunit.client.0.smithi016.stdout:6/733: rename d1/d21/d26/d1c/d8a/lf3 to d1/d21/d26/d1c/d5d/de2/lfc 0 2024-04-26T20:19:01.630 INFO:tasks.workunit.client.0.smithi016.stdout:6/734: read - d1/d21/d26/d1c/d5d/def/d2c/d47/dd7/fde zero size 2024-04-26T20:19:01.631 INFO:tasks.workunit.client.0.smithi016.stdout:9/885: symlink d1/d1b/l12e 0 2024-04-26T20:19:01.633 INFO:tasks.workunit.client.0.smithi016.stdout:4/714: mkdir d0/dd/dc9/de4 0 2024-04-26T20:19:01.633 INFO:tasks.workunit.client.0.smithi016.stdout:4/715: fdatasync d0/dd/d1b/f48 0 2024-04-26T20:19:01.635 INFO:tasks.workunit.client.0.smithi016.stdout:6/735: creat d1/d21/d26/d1c/d5d/d88/ffd x:0 0 0 2024-04-26T20:19:01.635 INFO:tasks.workunit.client.0.smithi016.stdout:6/736: chown d1/d21/d26/d1c/d8a 849189330 1 2024-04-26T20:19:01.637 INFO:tasks.workunit.client.0.smithi016.stdout:9/886: rmdir d1/d2/d20/d49/d77/d107 39 2024-04-26T20:19:01.639 INFO:tasks.workunit.client.0.smithi016.stdout:4/716: link d0/l37 d0/dd/dc9/le5 0 2024-04-26T20:19:01.643 INFO:tasks.workunit.client.0.smithi016.stdout:6/737: dread d1/d21/d26/d1c/d7b/d82/fa9 [0,4194304] 0 2024-04-26T20:19:01.645 INFO:tasks.workunit.client.0.smithi016.stdout:8/798: dwrite d9/d23/d26/d2c/fc0 [0,4194304] 0 2024-04-26T20:19:01.665 INFO:tasks.workunit.client.0.smithi016.stdout:8/799: write d9/f16 [929345,3904] 0 2024-04-26T20:19:01.699 INFO:tasks.workunit.client.0.smithi016.stdout:1/805: dread d3/d5/da/d66/d8c/f6a [0,4194304] 0 2024-04-26T20:19:01.699 INFO:tasks.workunit.client.0.smithi016.stdout:1/806: truncate d3/d5/d6/d5a/dbf/fd7 654988 0 2024-04-26T20:19:01.701 INFO:tasks.workunit.client.0.smithi016.stdout:2/827: dwrite f12 [0,4194304] 0 2024-04-26T20:19:01.706 INFO:tasks.workunit.client.0.smithi016.stdout:6/738: dwrite d1/d21/d26/d1c/d5d/def/d2c/d47/f94 [0,4194304] 0 2024-04-26T20:19:01.890 INFO:tasks.workunit.client.0.smithi016.stdout:9/887: creat d1/d2/d20/d49/d77/d2a/d33/f12f x:0 0 0 2024-04-26T20:19:01.890 INFO:tasks.workunit.client.0.smithi016.stdout:9/888: chown d1/d2/d20 508147 1 2024-04-26T20:19:01.890 INFO:tasks.workunit.client.0.smithi016.stdout:4/717: mkdir d0/d96/ddc/de6 0 2024-04-26T20:19:01.890 INFO:tasks.workunit.client.0.smithi016.stdout:9/889: fdatasync d1/d2e/d40/f6b 0 2024-04-26T20:19:01.893 INFO:tasks.workunit.client.0.smithi016.stdout:8/800: creat d9/d19/d45/d106/f114 x:0 0 0 2024-04-26T20:19:01.894 INFO:tasks.workunit.client.0.smithi016.stdout:8/801: dread - d9/d19/d45/d106/f114 zero size 2024-04-26T20:19:01.894 INFO:tasks.workunit.client.0.smithi016.stdout:8/802: fdatasync d9/d19/fb2 0 2024-04-26T20:19:01.894 INFO:tasks.workunit.client.0.smithi016.stdout:1/807: getdents d3/d5/d6 0 2024-04-26T20:19:01.897 INFO:tasks.workunit.client.0.smithi016.stdout:6/739: creat d1/d21/d26/d1c/d2e/d53/ffe x:0 0 0 2024-04-26T20:19:01.898 INFO:tasks.workunit.client.0.smithi016.stdout:4/718: symlink d0/d1e/d4e/le7 0 2024-04-26T20:19:01.899 INFO:tasks.workunit.client.0.smithi016.stdout:9/890: mknod d1/d2/d20/d49/d77/d107/c130 0 2024-04-26T20:19:01.900 INFO:tasks.workunit.client.0.smithi016.stdout:8/803: mkdir d9/d104/d115 0 2024-04-26T20:19:01.900 INFO:tasks.workunit.client.0.smithi016.stdout:8/804: dread - d9/d19/d45/d3f/d4d/dba/ffa zero size 2024-04-26T20:19:01.902 INFO:tasks.workunit.client.0.smithi016.stdout:1/808: creat d3/f10c x:0 0 0 2024-04-26T20:19:01.903 INFO:tasks.workunit.client.0.smithi016.stdout:4/719: mknod d0/dd/d19/d57/ce8 0 2024-04-26T20:19:01.903 INFO:tasks.workunit.client.0.smithi016.stdout:4/720: chown d0/dd/d19/d1f/d7b 0 1 2024-04-26T20:19:01.904 INFO:tasks.workunit.client.0.smithi016.stdout:9/891: rmdir d1/d2/d20/d49 39 2024-04-26T20:19:01.905 INFO:tasks.workunit.client.0.smithi016.stdout:8/805: rename d9/d66/f78 to d9/d19/d45/d9e/de5/f116 0 2024-04-26T20:19:01.906 INFO:tasks.workunit.client.0.smithi016.stdout:4/721: unlink d0/dd/dc9/le5 0 2024-04-26T20:19:01.907 INFO:tasks.workunit.client.0.smithi016.stdout:4/722: write d0/dd/d19/f4d [1742863,27565] 0 2024-04-26T20:19:01.907 INFO:tasks.workunit.client.0.smithi016.stdout:9/892: creat d1/f131 x:0 0 0 2024-04-26T20:19:01.908 INFO:tasks.workunit.client.0.smithi016.stdout:9/893: write d1/d59/d52/d8c/fa2 [1552494,34612] 0 2024-04-26T20:19:01.909 INFO:tasks.workunit.client.0.smithi016.stdout:1/809: rename c0 to d3/d5/d6/d9/d2a/c10d 0 2024-04-26T20:19:01.910 INFO:tasks.workunit.client.0.smithi016.stdout:8/806: unlink d9/d19/d45/d9e/d50/fec 0 2024-04-26T20:19:01.912 INFO:tasks.workunit.client.0.smithi016.stdout:4/723: mknod d0/dd/d19/d57/ce9 0 2024-04-26T20:19:01.913 INFO:tasks.workunit.client.0.smithi016.stdout:0/711: sync 2024-04-26T20:19:01.913 INFO:tasks.workunit.client.0.smithi016.stdout:3/660: sync 2024-04-26T20:19:01.913 INFO:tasks.workunit.client.0.smithi016.stdout:7/730: sync 2024-04-26T20:19:01.914 INFO:tasks.workunit.client.0.smithi016.stdout:9/894: creat d1/d2/d20/dff/f132 x:0 0 0 2024-04-26T20:19:01.917 INFO:tasks.workunit.client.0.smithi016.stdout:1/810: unlink d3/d5/d6/d50/d58/f69 0 2024-04-26T20:19:01.918 INFO:tasks.workunit.client.0.smithi016.stdout:8/807: rmdir d9/d19/d45/d9e/d50/d109 39 2024-04-26T20:19:01.918 INFO:tasks.workunit.client.0.smithi016.stdout:8/808: fdatasync d9/d23/d26/d2c/dea/ff8 0 2024-04-26T20:19:01.919 INFO:tasks.workunit.client.0.smithi016.stdout:4/724: getdents d0/d1e/d4e/d52/d54/dad 0 2024-04-26T20:19:01.921 INFO:tasks.workunit.client.0.smithi016.stdout:0/712: mkdir d2/dc/d1e/d35/dee 0 2024-04-26T20:19:01.921 INFO:tasks.workunit.client.0.smithi016.stdout:0/713: chown d2/f15 0 1 2024-04-26T20:19:01.922 INFO:tasks.workunit.client.0.smithi016.stdout:3/661: mkdir d3/d9/d2d/d4f/dd2 0 2024-04-26T20:19:01.924 INFO:tasks.workunit.client.0.smithi016.stdout:8/809: mknod d9/d23/d26/c117 0 2024-04-26T20:19:01.925 INFO:tasks.workunit.client.0.smithi016.stdout:4/725: mknod d0/dd/d19/d1f/d7b/cea 0 2024-04-26T20:19:01.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/726: chown d0/d1e/d30/l35 706 1 2024-04-26T20:19:01.926 INFO:tasks.workunit.client.0.smithi016.stdout:4/727: fsync d0/dd/d19/d1f/f9b 0 2024-04-26T20:19:01.926 INFO:tasks.workunit.client.0.smithi016.stdout:0/714: rmdir d2/d8 39 2024-04-26T20:19:01.927 INFO:tasks.workunit.client.0.smithi016.stdout:0/715: truncate d2/d20/d41/d87/d9d/fbd 753471 0 2024-04-26T20:19:01.928 INFO:tasks.workunit.client.0.smithi016.stdout:3/662: mknod d3/df/d25/d32/d3f/cd3 0 2024-04-26T20:19:01.930 INFO:tasks.workunit.client.0.smithi016.stdout:7/731: symlink d0/ldf 0 2024-04-26T20:19:01.930 INFO:tasks.workunit.client.0.smithi016.stdout:7/732: write d0/dd5/d34/d25/d50/fde [755521,73041] 0 2024-04-26T20:19:01.932 INFO:tasks.workunit.client.0.smithi016.stdout:8/810: getdents d9/d66/d73 0 2024-04-26T20:19:01.934 INFO:tasks.workunit.client.0.smithi016.stdout:4/728: creat d0/dd/d1b/dbc/dc5/dd7/feb x:0 0 0 2024-04-26T20:19:01.934 INFO:tasks.workunit.client.0.smithi016.stdout:4/729: chown d0/d1e/c7c 51712 1 2024-04-26T20:19:01.936 INFO:tasks.workunit.client.0.smithi016.stdout:3/663: rmdir d3/d9/d2d/d89 0 2024-04-26T20:19:01.936 INFO:tasks.workunit.client.0.smithi016.stdout:3/664: fdatasync d3/d9/d2d/d4f/fc3 0 2024-04-26T20:19:01.937 INFO:tasks.workunit.client.0.smithi016.stdout:4/730: creat d0/d96/ddc/fec x:0 0 0 2024-04-26T20:19:01.939 INFO:tasks.workunit.client.0.smithi016.stdout:3/665: truncate d3/d9/f1a 1084067 0 2024-04-26T20:19:01.941 INFO:tasks.workunit.client.0.smithi016.stdout:4/731: symlink d0/d1e/d4e/d52/led 0 2024-04-26T20:19:01.944 INFO:tasks.workunit.client.0.smithi016.stdout:4/732: rename d0/d1e/d30/c42 to d0/d1e/d64/cee 0 2024-04-26T20:19:01.972 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:01.973 INFO:tasks.workunit.client.0.smithi016.stdout:1/811: dwrite d3/d5/d6/d9/f108 [0,4194304] 0 2024-04-26T20:19:01.991 INFO:tasks.workunit.client.0.smithi016.stdout:6/740: dwrite d1/d21/d26/d1c/d5d/def/d2c/d47/fd1 [0,4194304] 0 2024-04-26T20:19:01.991 INFO:tasks.workunit.client.0.smithi016.stdout:9/895: dwrite d1/d59/d52/d8c/dd1/f113 [0,4194304] 0 2024-04-26T20:19:01.996 INFO:tasks.workunit.client.0.smithi016.stdout:4/733: dwrite d0/dd/d19/f8a [0,4194304] 0 2024-04-26T20:19:01.997 INFO:tasks.workunit.client.0.smithi016.stdout:6/741: unlink d1/d21/d26/d1c/d5d/d88/fbc 0 2024-04-26T20:19:01.997 INFO:tasks.workunit.client.0.smithi016.stdout:4/734: write d0/dd/d19/d57/f63 [998354,74477] 0 2024-04-26T20:19:01.999 INFO:tasks.workunit.client.0.smithi016.stdout:9/896: getdents d1/d2e/d40 0 2024-04-26T20:19:02.005 INFO:tasks.workunit.client.0.smithi016.stdout:9/897: creat d1/d2/d20/f133 x:0 0 0 2024-04-26T20:19:02.005 INFO:tasks.workunit.client.0.smithi016.stdout:7/733: dread d0/dd5/d34/d25/d3f/f5f [0,4194304] 0 2024-04-26T20:19:02.006 INFO:tasks.workunit.client.0.smithi016.stdout:9/898: rmdir d1/d2/d20/d49/d77/d2a/d75/d85/d9b 39 2024-04-26T20:19:02.009 INFO:tasks.workunit.client.0.smithi016.stdout:9/899: mkdir d1/d2/d20/d49/d77/d2a/d134 0 2024-04-26T20:19:02.009 INFO:tasks.workunit.client.0.smithi016.stdout:9/900: dread - d1/d2/d20/d49/d77/fd4 zero size 2024-04-26T20:19:02.010 INFO:tasks.workunit.client.0.smithi016.stdout:7/734: dread d0/dd5/d34/d25/d3f/d6d/d87/f7c [0,4194304] 0 2024-04-26T20:19:02.012 INFO:tasks.workunit.client.0.smithi016.stdout:7/735: mknod d0/dd5/d6/d6e/ce0 0 2024-04-26T20:19:02.013 INFO:tasks.workunit.client.0.smithi016.stdout:7/736: stat d0/la5 0 2024-04-26T20:19:02.022 INFO:tasks.workunit.client.0.smithi016.stdout:7/737: dread d0/dd5/d46/f98 [0,4194304] 0 2024-04-26T20:19:02.025 INFO:tasks.workunit.client.0.smithi016.stdout:7/738: unlink d0/dd5/d46/l43 0 2024-04-26T20:19:02.031 INFO:tasks.workunit.client.0.smithi016.stdout:7/739: dread d0/dd5/d34/db7/fbd [0,4194304] 0 2024-04-26T20:19:02.031 INFO:tasks.workunit.client.0.smithi016.stdout:7/740: fsync d0/dd5/d6/d73/fc6 0 2024-04-26T20:19:02.031 INFO:tasks.workunit.client.0.smithi016.stdout:7/741: stat d0/cda 0 2024-04-26T20:19:02.073 INFO:tasks.workunit.client.0.smithi016.stdout:1/812: dwrite d3/d5/d6/d50/fe4 [0,4194304] 0 2024-04-26T20:19:02.087 INFO:tasks.workunit.client.0.smithi016.stdout:6/742: dwrite d1/d21/d26/d1c/f4d [0,4194304] 0 2024-04-26T20:19:02.091 INFO:tasks.workunit.client.0.smithi016.stdout:0/716: dwrite d2/fb [0,4194304] 0 2024-04-26T20:19:02.093 INFO:tasks.workunit.client.0.smithi016.stdout:0/717: truncate d2/dc/d45/f89 4073762 0 2024-04-26T20:19:02.095 INFO:tasks.workunit.client.0.smithi016.stdout:0/718: link d2/d20/d41/d72/ce7 d2/dc/d1e/d35/cef 0 2024-04-26T20:19:02.095 INFO:tasks.workunit.client.0.smithi016.stdout:0/719: stat d2/d8/d3b/fd8 0 2024-04-26T20:19:02.101 INFO:tasks.workunit.client.0.smithi016.stdout:0/720: mknod d2/dc/d18/d24/cf0 0 2024-04-26T20:19:02.104 INFO:tasks.workunit.client.0.smithi016.stdout:0/721: creat d2/d8/d37/d5d/d60/ff1 x:0 0 0 2024-04-26T20:19:02.105 INFO:tasks.workunit.client.0.smithi016.stdout:1/813: dwrite d3/d5/da/d66/da2/fb9 [0,4194304] 0 2024-04-26T20:19:02.112 INFO:tasks.workunit.client.0.smithi016.stdout:1/814: symlink d3/d5/da/d66/d8c/l10e 0 2024-04-26T20:19:02.114 INFO:tasks.workunit.client.0.smithi016.stdout:2/828: sync 2024-04-26T20:19:02.117 INFO:tasks.workunit.client.0.smithi016.stdout:9/901: dwrite d1/d59/d52/d8c/df1/f100 [0,4194304] 0 2024-04-26T20:19:02.117 INFO:tasks.workunit.client.0.smithi016.stdout:1/815: read d3/d5/d6/d50/d79/f9f [287809,76629] 0 2024-04-26T20:19:02.117 INFO:tasks.workunit.client.0.smithi016.stdout:1/816: readlink d3/d5/da/d66/d8c/le3 0 2024-04-26T20:19:02.119 INFO:tasks.workunit.client.0.smithi016.stdout:9/902: creat d1/f135 x:0 0 0 2024-04-26T20:19:02.119 INFO:tasks.workunit.client.0.smithi016.stdout:1/817: getdents d3/d5/da/d66/d8c/d84/d96 0 2024-04-26T20:19:02.120 INFO:tasks.workunit.client.0.smithi016.stdout:9/903: rmdir d1/d2/d43 39 2024-04-26T20:19:02.122 INFO:tasks.workunit.client.0.smithi016.stdout:9/904: rename d1/d2e/c48 to d1/d2/c136 0 2024-04-26T20:19:02.122 INFO:tasks.workunit.client.0.smithi016.stdout:9/905: fsync d1/d2/d20/dff/f10b 0 2024-04-26T20:19:02.124 INFO:tasks.workunit.client.0.smithi016.stdout:9/906: unlink d1/d2/d43/c10e 0 2024-04-26T20:19:02.125 INFO:tasks.workunit.client.0.smithi016.stdout:6/743: dwrite d1/d21/d26/d1c/d5d/def/d76/f77 [0,4194304] 0 2024-04-26T20:19:02.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/907: rename d1/d2/d43/l102 to d1/d2/d79/l137 0 2024-04-26T20:19:02.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/908: fdatasync d1/d2/d20/d49/d77/d2a/f5d 0 2024-04-26T20:19:02.128 INFO:tasks.workunit.client.0.smithi016.stdout:9/909: readlink d1/d2/l11b 0 2024-04-26T20:19:02.131 INFO:tasks.workunit.client.0.smithi016.stdout:9/910: symlink d1/d2/d79/l138 0 2024-04-26T20:19:02.133 INFO:tasks.workunit.client.0.smithi016.stdout:9/911: rename d1/d2e/dd3/c129 to d1/d2/d20/d49/d77/d3e/d5e/c139 0 2024-04-26T20:19:02.133 INFO:tasks.workunit.client.0.smithi016.stdout:9/912: readlink d1/d2/d20/d49/d77/d2a/l34 0 2024-04-26T20:19:02.136 INFO:tasks.workunit.client.0.smithi016.stdout:9/913: mkdir d1/d2/d20/d49/d77/d2a/d33/d12d/d13a 0 2024-04-26T20:19:02.138 INFO:tasks.workunit.client.0.smithi016.stdout:2/829: dread d1d/d27/d2d/d6b/d108/d114/f7a [0,4194304] 0 2024-04-26T20:19:02.138 INFO:tasks.workunit.client.0.smithi016.stdout:9/914: truncate d1/d2e/dc6/fca 4037442 0 2024-04-26T20:19:02.141 INFO:tasks.workunit.client.0.smithi016.stdout:9/915: creat d1/d2/d20/d49/d77/d3e/f13b x:0 0 0 2024-04-26T20:19:02.141 INFO:tasks.workunit.client.0.smithi016.stdout:9/916: write d1/d59/d52/d8c/fa2 [2580042,9660] 0 2024-04-26T20:19:02.143 INFO:tasks.workunit.client.0.smithi016.stdout:2/830: creat d1d/d52/f119 x:0 0 0 2024-04-26T20:19:02.144 INFO:tasks.workunit.client.0.smithi016.stdout:1/818: write d3/d5/da/d66/d8c/fc9 [2731107,29731] 0 2024-04-26T20:19:02.145 INFO:tasks.workunit.client.0.smithi016.stdout:1/819: write d3/d5/d6/d5a/f90 [254963,66181] 0 2024-04-26T20:19:02.148 INFO:tasks.workunit.client.0.smithi016.stdout:1/820: link d3/d5/da/d66/d8c/f6b d3/d5/d8d/dab/f10f 0 2024-04-26T20:19:02.152 INFO:tasks.workunit.client.0.smithi016.stdout:1/821: mknod d3/c110 0 2024-04-26T20:19:02.152 INFO:tasks.workunit.client.0.smithi016.stdout:6/744: write d1/d21/d26/d1c/f3c [756790,26202] 0 2024-04-26T20:19:02.152 INFO:tasks.workunit.client.0.smithi016.stdout:2/831: dread f13 [0,4194304] 0 2024-04-26T20:19:02.152 INFO:tasks.workunit.client.0.smithi016.stdout:2/832: write f18 [3331947,68325] 0 2024-04-26T20:19:02.152 INFO:tasks.workunit.client.0.smithi016.stdout:2/833: dread - d1d/d20/d22/d39/f118 zero size 2024-04-26T20:19:02.153 INFO:tasks.workunit.client.0.smithi016.stdout:1/822: creat d3/d5/d6/d50/d79/da7/f111 x:0 0 0 2024-04-26T20:19:02.156 INFO:tasks.workunit.client.0.smithi016.stdout:6/745: mkdir d1/d21/d26/d1c/d7b/d82/d8f/dff 0 2024-04-26T20:19:02.163 INFO:tasks.workunit.client.0.smithi016.stdout:2/834: creat d1d/d52/f11a x:0 0 0 2024-04-26T20:19:02.169 INFO:tasks.workunit.client.0.smithi016.stdout:6/746: getdents d1/d21/d26/d1c/d5d 0 2024-04-26T20:19:02.170 INFO:tasks.workunit.client.0.smithi016.stdout:6/747: truncate d1/d3a/db9/fdc 15948 0 2024-04-26T20:19:02.171 INFO:tasks.workunit.client.0.smithi016.stdout:2/835: mknod d1d/d27/d2d/d6b/d111/c11b 0 2024-04-26T20:19:02.172 INFO:tasks.workunit.client.0.smithi016.stdout:2/836: creat d1d/d27/d2d/d6b/d108/d114/f11c x:0 0 0 2024-04-26T20:19:02.180 INFO:tasks.workunit.client.0.smithi016.stdout:6/748: dread d1/d12/fb7 [0,4194304] 0 2024-04-26T20:19:02.180 INFO:tasks.workunit.client.0.smithi016.stdout:6/749: chown d1/d21/d48/d51/fb6 16521 1 2024-04-26T20:19:02.180 INFO:tasks.workunit.client.0.smithi016.stdout:6/750: readlink d1/d21/d26/d1c/d5d/def/d2c/d3d/ld3 0 2024-04-26T20:19:02.180 INFO:tasks.workunit.client.0.smithi016.stdout:2/837: dread d1d/d52/fc0 [0,4194304] 0 2024-04-26T20:19:02.181 INFO:tasks.workunit.client.0.smithi016.stdout:6/751: truncate d1/d3a/f55 2939379 0 2024-04-26T20:19:02.184 INFO:tasks.workunit.client.0.smithi016.stdout:0/722: dwrite d2/dc/d45/f89 [0,4194304] 0 2024-04-26T20:19:02.186 INFO:tasks.workunit.client.0.smithi016.stdout:2/838: mkdir d1d/d20/d22/d98/d115/d11d 0 2024-04-26T20:19:02.188 INFO:tasks.workunit.client.0.smithi016.stdout:6/752: link d1/d21/d26/lb3 d1/d21/d48/d51/l100 0 2024-04-26T20:19:02.190 INFO:tasks.workunit.client.0.smithi016.stdout:0/723: symlink d2/d20/d57/lf2 0 2024-04-26T20:19:02.193 INFO:tasks.workunit.client.0.smithi016.stdout:2/839: rename d1d/d27/d2d/d6b/d108/d114/f9e to d1d/d27/f11e 0 2024-04-26T20:19:02.194 INFO:tasks.workunit.client.0.smithi016.stdout:6/753: creat d1/d21/d26/d1c/d2e/d53/f101 x:0 0 0 2024-04-26T20:19:02.194 INFO:tasks.workunit.client.0.smithi016.stdout:0/724: getdents d2/d20/d41/d87/d9d/db8 0 2024-04-26T20:19:02.194 INFO:tasks.workunit.client.0.smithi016.stdout:0/725: getdents d2/dc/d18/d24/d53 0 2024-04-26T20:19:02.196 INFO:tasks.workunit.client.0.smithi016.stdout:2/840: mknod d1d/d27/d2d/d6b/c11f 0 2024-04-26T20:19:02.196 INFO:tasks.workunit.client.0.smithi016.stdout:2/841: fsync d1d/d27/d2d/f94 0 2024-04-26T20:19:02.197 INFO:tasks.workunit.client.0.smithi016.stdout:1/823: dwrite d3/d57/f6e [0,4194304] 0 2024-04-26T20:19:02.197 INFO:tasks.workunit.client.0.smithi016.stdout:1/824: fdatasync d3/d5/d6/d50/d58/fc1 0 2024-04-26T20:19:02.197 INFO:tasks.workunit.client.0.smithi016.stdout:6/754: rename d1/d21/d26/lb3 to d1/d21/d78/l102 0 2024-04-26T20:19:02.198 INFO:tasks.workunit.client.0.smithi016.stdout:0/726: unlink d2/d20/d41/d72/f8d 0 2024-04-26T20:19:02.199 INFO:tasks.workunit.client.0.smithi016.stdout:2/842: truncate d1d/d27/d2d/f70 7735447 0 2024-04-26T20:19:02.199 INFO:tasks.workunit.client.0.smithi016.stdout:2/843: dread - d1d/d27/d2d/d6b/d108/d114/d9c/f99 zero size 2024-04-26T20:19:02.199 INFO:tasks.workunit.client.0.smithi016.stdout:2/844: read fa [5492195,102048] 0 2024-04-26T20:19:02.200 INFO:tasks.workunit.client.0.smithi016.stdout:2/845: readlink d1d/d2a/d3d/lf7 0 2024-04-26T20:19:02.200 INFO:tasks.workunit.client.0.smithi016.stdout:2/846: write d1d/d52/dfc/f10d [646071,64784] 0 2024-04-26T20:19:02.200 INFO:tasks.workunit.client.0.smithi016.stdout:1/825: creat d3/d57/dff/f112 x:0 0 0 2024-04-26T20:19:02.200 INFO:tasks.workunit.client.0.smithi016.stdout:1/826: stat d3/d5/da/d66/d8c/fa0 0 2024-04-26T20:19:02.208 INFO:tasks.workunit.client.0.smithi016.stdout:0/727: creat d2/dc/d18/d5b/ff3 x:0 0 0 2024-04-26T20:19:02.208 INFO:tasks.workunit.client.0.smithi016.stdout:0/728: write d2/d8/d3b/fd8 [783001,13604] 0 2024-04-26T20:19:02.208 INFO:tasks.workunit.client.0.smithi016.stdout:9/917: dwrite d1/d2/d20/d49/d77/d2a/d33/f5c [0,4194304] 0 2024-04-26T20:19:02.215 INFO:tasks.workunit.client.0.smithi016.stdout:6/755: write d1/d21/d26/d25/f35 [1351544,48649] 0 2024-04-26T20:19:02.215 INFO:tasks.workunit.client.0.smithi016.stdout:6/756: fdatasync d1/d21/f39 0 2024-04-26T20:19:02.215 INFO:tasks.workunit.client.0.smithi016.stdout:6/757: chown d1/d21/d26/d1c/d5d/def/l5b 1 1 2024-04-26T20:19:02.216 INFO:tasks.workunit.client.0.smithi016.stdout:2/847: creat d1d/d27/d2d/d6b/d108/d114/d9c/f120 x:0 0 0 2024-04-26T20:19:02.220 INFO:tasks.workunit.client.0.smithi016.stdout:6/758: link d1/d21/d26/d1c/d5d/d88/cf5 d1/d21/d26/d1c/d5d/def/d2c/d47/dd7/c103 0 2024-04-26T20:19:02.220 INFO:tasks.workunit.client.0.smithi016.stdout:6/759: truncate d1/d21/d26/f75 3307340 0 2024-04-26T20:19:02.225 INFO:tasks.workunit.client.0.smithi016.stdout:2/848: mkdir d1d/d2a/d121 0 2024-04-26T20:19:02.227 INFO:tasks.workunit.client.0.smithi016.stdout:6/760: rename d1/d21/d48/fad to d1/d21/d26/d1c/d5d/def/d2c/d47/f104 0 2024-04-26T20:19:02.227 INFO:tasks.workunit.client.0.smithi016.stdout:6/761: chown d1/d3a/db9 216 1 2024-04-26T20:19:02.229 INFO:tasks.workunit.client.0.smithi016.stdout:2/849: mkdir d1d/d27/d2d/d6b/d7e/dd8/d122 0 2024-04-26T20:19:02.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f4290000640 1 Processor -- start 2024-04-26T20:19:02.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f4290000640 1 -- start start 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f4290000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42880b1d80 0x7f428806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f4290000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42880cfb50 con 0x7f428815c7e0 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f4290000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42880cfe10 con 0x7f42880c6340 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f4290000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f42880cce10 con 0x7f42880b1d80 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f428d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42880b1d80 0x7f428806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f428cc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f42880c6340 0x7f428815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:60128/0 (socket says 172.21.15.16:60128) 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f428d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42880b1d80 0x7f428806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:33234/0 (socket says 172.21.15.16:33234) 2024-04-26T20:19:02.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.227+0000 7f428cc00640 1 -- 172.21.15.16:0/1553392603 learned_addr learned my addr 172.21.15.16:0/1553392603 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:02.233 INFO:tasks.workunit.client.0.smithi016.stdout:6/762: mknod d1/d21/d26/d1c/d5d/d88/c105 0 2024-04-26T20:19:02.233 INFO:tasks.workunit.client.0.smithi016.stdout:6/763: write d1/d21/d26/d1c/d5d/def/d2c/d47/dd7/ffb [105556,110125] 0 2024-04-26T20:19:02.233 INFO:tasks.workunit.client.0.smithi016.stdout:6/764: chown d1/d21/d26/d1c/d2e/d53/d7f 3492 1 2024-04-26T20:19:02.233 INFO:tasks.workunit.client.0.smithi016.stdout:6/765: fsync d1/d21/d78/fbb 0 2024-04-26T20:19:02.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.231+0000 7f428d600640 1 -- 172.21.15.16:0/1553392603 >> v1:172.21.15.192:6789/0 conn(0x7f42880c6340 legacy=0x7f428815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.231+0000 7f428d600640 1 -- 172.21.15.16:0/1553392603 >> v1:172.21.15.16:6789/0 conn(0x7f428815c7e0 legacy=0x7f4288166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.231+0000 7f428d600640 1 -- 172.21.15.16:0/1553392603 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428806d650 con 0x7f42880b1d80 2024-04-26T20:19:02.234 INFO:tasks.workunit.client.0.smithi016.stdout:2/850: symlink d1d/d20/d22/d89/l123 0 2024-04-26T20:19:02.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f428d600640 1 --2- 172.21.15.16:0/1553392603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880b1d80 0x7f428806feb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f427c0097c0 tx=0x7f427c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70d9689fdf66ac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:02.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4287e00640 1 -- 172.21.15.16:0/1553392603 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c0b5070 con 0x7f42880b1d80 2024-04-26T20:19:02.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4287e00640 1 -- 172.21.15.16:0/1553392603 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427c0a8990 con 0x7f42880b1d80 2024-04-26T20:19:02.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4287e00640 1 -- 172.21.15.16:0/1553392603 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c0a8d60 con 0x7f42880b1d80 2024-04-26T20:19:02.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 -- 172.21.15.16:0/1553392603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880b1d80 msgr2=0x7f428806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 --2- 172.21.15.16:0/1553392603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880b1d80 0x7f428806feb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f427c0097c0 tx=0x7f427c01ec90 comp rx=0 tx=0).stop 2024-04-26T20:19:02.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 -- 172.21.15.16:0/1553392603 shutdown_connections 2024-04-26T20:19:02.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 --2- 172.21.15.16:0/1553392603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880b1d80 0x7f428806feb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 -- 172.21.15.16:0/1553392603 >> 172.21.15.16:0/1553392603 conn(0x7f4288071160 msgr2=0x7f4288068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:02.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 -- 172.21.15.16:0/1553392603 shutdown_connections 2024-04-26T20:19:02.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 -- 172.21.15.16:0/1553392603 wait complete. 2024-04-26T20:19:02.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.235+0000 7f4290000640 1 Processor -- start 2024-04-26T20:19:02.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 -- start start 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42880b1d80 0x7f42881f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880c6340 0x7f42881f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f428815c7e0 0x7f4288152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42880b2160 con 0x7f42880b1d80 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f428806dc10 con 0x7f42880c6340 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4288071970 con 0x7f428815c7e0 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42880b1d80 0x7f42881f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42880b1d80 0x7f42881f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40374/0 (socket says 172.21.15.16:40374) 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 -- 172.21.15.16:0/3665157230 learned_addr learned my addr 172.21.15.16:0/3665157230 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428e000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f428815c7e0 0x7f4288152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428cc00640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880c6340 0x7f42881f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 -- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f428815c7e0 msgr2=0x7f4288152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f428815c7e0 0x7f4288152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 -- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880c6340 msgr2=0x7f42881f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880c6340 0x7f42881f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 -- 172.21.15.16:0/3665157230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880b2740 con 0x7f42880b1d80 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428e000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f428815c7e0 0x7f4288152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f428d600640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42880b1d80 0x7f42881f1820 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b3040 tx=0x7f427c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4285600640 1 -- 172.21.15.16:0/3665157230 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c0bf070 con 0x7f42880b1d80 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42880b2a20 con 0x7f42880b1d80 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42880b2fe0 con 0x7f42880b1d80 2024-04-26T20:19:02.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4285600640 1 -- 172.21.15.16:0/3665157230 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427c0a8950 con 0x7f42880b1d80 2024-04-26T20:19:02.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.239+0000 7f4285600640 1 -- 172.21.15.16:0/3665157230 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c0b5040 con 0x7f42880b1d80 2024-04-26T20:19:02.245 INFO:tasks.workunit.client.0.smithi016.stdout:9/918: write d1/f15 [3849883,108533] 0 2024-04-26T20:19:02.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.243+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42640052a0 con 0x7f42880b1d80 2024-04-26T20:19:02.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.243+0000 7f4285600640 1 -- 172.21.15.16:0/3665157230 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f427c0b0b40 con 0x7f42880b1d80 2024-04-26T20:19:02.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.243+0000 7f4285600640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f42680683b0 0x7f426806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.243+0000 7f4285600640 1 -- 172.21.15.16:0/3665157230 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f427c123920 con 0x7f42880b1d80 2024-04-26T20:19:02.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.243+0000 7f428cc00640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f42680683b0 0x7f426806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.243+0000 7f428cc00640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f42680683b0 0x7f426806a870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f42880b4ae0 tx=0x7f4274009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:02.250 INFO:tasks.workunit.client.0.smithi016.stdout:6/766: symlink d1/d21/d26/d25/l106 0 2024-04-26T20:19:02.251 INFO:tasks.workunit.client.0.smithi016.stdout:9/919: chown d1/d2/f6 12662 1 2024-04-26T20:19:02.253 INFO:tasks.workunit.client.0.smithi016.stdout:6/767: mknod d1/d3a/c107 0 2024-04-26T20:19:02.254 INFO:tasks.workunit.client.0.smithi016.stdout:6/768: write d1/d21/d78/fbb [840739,119975] 0 2024-04-26T20:19:02.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.247+0000 7f4285600640 1 -- 172.21.15.16:0/3665157230 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f427c0187f0 con 0x7f42880b1d80 2024-04-26T20:19:02.284 INFO:tasks.workunit.client.0.smithi016.stdout:1/827: dwrite d3/d5/d6/d5a/f4a [0,4194304] 0 2024-04-26T20:19:02.287 INFO:tasks.workunit.client.0.smithi016.stdout:9/920: link d1/d59/l22 d1/d59/da5/d118/l13c 0 2024-04-26T20:19:02.325 INFO:tasks.workunit.client.0.smithi016.stdout:1/828: rename d3/d5/d6/f7f to d3/d5/d6/d9/d9e/f113 0 2024-04-26T20:19:02.325 INFO:tasks.workunit.client.0.smithi016.stdout:0/729: dwrite d2/fdb [0,4194304] 0 2024-04-26T20:19:02.330 INFO:tasks.workunit.client.0.smithi016.stdout:6/769: dwrite d1/f1f [4194304,4194304] 0 2024-04-26T20:19:02.330 INFO:tasks.workunit.client.0.smithi016.stdout:6/770: chown d1/d21/d26/d1c/d5d/d88 29860 1 2024-04-26T20:19:02.337 INFO:tasks.workunit.client.0.smithi016.stdout:9/921: dread d1/d59/d52/fbd [0,4194304] 0 2024-04-26T20:19:02.342 INFO:tasks.workunit.client.0.smithi016.stdout:6/771: rename d1/d21/d26/d1c/f91 to d1/d12/d90/f108 0 2024-04-26T20:19:02.344 INFO:tasks.workunit.client.0.smithi016.stdout:9/922: unlink d1/d2e/dc6/fca 0 2024-04-26T20:19:02.345 INFO:tasks.workunit.client.0.smithi016.stdout:0/730: symlink d2/lf4 0 2024-04-26T20:19:02.368 INFO:tasks.workunit.client.0.smithi016.stdout:0/731: write d2/d8/d37/d5d/fd4 [4159261,34770] 0 2024-04-26T20:19:02.371 INFO:tasks.workunit.client.0.smithi016.stdout:9/923: link d1/d2/d20/d49/f7b d1/d59/f13d 0 2024-04-26T20:19:02.375 INFO:tasks.workunit.client.0.smithi016.stdout:2/851: dwrite d1d/d27/d49/f92 [0,4194304] 0 2024-04-26T20:19:02.379 INFO:tasks.workunit.client.0.smithi016.stdout:0/732: mkdir d2/dc/d18/dd7/df5 0 2024-04-26T20:19:02.379 INFO:tasks.workunit.client.0.smithi016.stdout:0/733: write d2/dc/d18/f48 [853328,51106] 0 2024-04-26T20:19:02.382 INFO:tasks.workunit.client.0.smithi016.stdout:9/924: dread d1/d59/d52/fbd [0,4194304] 0 2024-04-26T20:19:02.384 INFO:tasks.workunit.client.0.smithi016.stdout:0/734: creat d2/d40/d61/ff6 x:0 0 0 2024-04-26T20:19:02.387 INFO:tasks.workunit.client.0.smithi016.stdout:9/925: link d1/d2/d20/d49/l51 d1/d2/d20/de8/l13e 0 2024-04-26T20:19:02.387 INFO:tasks.workunit.client.0.smithi016.stdout:9/926: truncate d1/d1b/f104 340853 0 2024-04-26T20:19:02.387 INFO:tasks.workunit.client.0.smithi016.stdout:9/927: truncate d1/d2/d20/dde/ffa 1022268 0 2024-04-26T20:19:02.389 INFO:tasks.workunit.client.0.smithi016.stdout:6/772: dread d1/d21/d78/fbb [0,4194304] 0 2024-04-26T20:19:02.389 INFO:tasks.workunit.client.0.smithi016.stdout:6/773: write d1/d12/fb5 [1533173,460] 0 2024-04-26T20:19:02.389 INFO:tasks.workunit.client.0.smithi016.stdout:6/774: read - d1/d21/fe7 zero size 2024-04-26T20:19:02.391 INFO:tasks.workunit.client.0.smithi016.stdout:0/735: rename d2/dc/d18/d5b/ff3 to d2/dc/de3/ff7 0 2024-04-26T20:19:02.408 INFO:tasks.workunit.client.0.smithi016.stdout:1/829: dwrite d3/d5/d6/d50/fe4 [0,4194304] 0 2024-04-26T20:19:02.408 INFO:tasks.workunit.client.0.smithi016.stdout:1/830: stat d3/d5/d6/d9/d9e/fde 0 2024-04-26T20:19:02.408 INFO:tasks.workunit.client.0.smithi016.stdout:9/928: dread d1/d2/f10 [0,4194304] 0 2024-04-26T20:19:02.408 INFO:tasks.workunit.client.0.smithi016.stdout:9/929: write d1/d2/d20/d49/d77/d2a/d75/d85/f112 [87495,24463] 0 2024-04-26T20:19:02.411 INFO:tasks.workunit.client.0.smithi016.stdout:0/736: symlink d2/dc/d1e/lf8 0 2024-04-26T20:19:02.413 INFO:tasks.workunit.client.0.smithi016.stdout:1/831: creat d3/d57/da4/f114 x:0 0 0 2024-04-26T20:19:02.415 INFO:tasks.workunit.client.0.smithi016.stdout:2/852: dwrite d1d/d2a/d3d/fda [0,4194304] 0 2024-04-26T20:19:02.415 INFO:tasks.workunit.client.0.smithi016.stdout:2/853: fsync d1d/d20/d22/fe4 0 2024-04-26T20:19:02.417 INFO:tasks.workunit.client.0.smithi016.stdout:0/737: symlink d2/dc/d18/dd7/lf9 0 2024-04-26T20:19:02.417 INFO:tasks.workunit.client.0.smithi016.stdout:0/738: chown d2/d20/d41/d4c 928414 1 2024-04-26T20:19:02.417 INFO:tasks.workunit.client.0.smithi016.stdout:9/930: rename d1/f97 to d1/d1b/f13f 0 2024-04-26T20:19:02.418 INFO:tasks.workunit.client.0.smithi016.stdout:1/832: truncate d3/d5/d6/d9/f4e 5744118 0 2024-04-26T20:19:02.418 INFO:tasks.workunit.client.0.smithi016.stdout:1/833: fsync d3/d5/d6/f89 0 2024-04-26T20:19:02.418 INFO:tasks.workunit.client.0.smithi016.stdout:1/834: fdatasync d3/d57/f44 0 2024-04-26T20:19:02.420 INFO:tasks.workunit.client.0.smithi016.stdout:2/854: getdents d1d/d20/d22/d98/d115 0 2024-04-26T20:19:02.425 INFO:tasks.workunit.client.0.smithi016.stdout:6/775: dwrite d1/d21/d26/d1c/ff0 [0,4194304] 0 2024-04-26T20:19:02.425 INFO:tasks.workunit.client.0.smithi016.stdout:6/776: chown d1/d21/d26/d1c/d5d/de2/de4 14 1 2024-04-26T20:19:02.425 INFO:tasks.workunit.client.0.smithi016.stdout:6/777: write d1/d21/d26/d1c/d5d/def/f92 [779893,110648] 0 2024-04-26T20:19:02.430 INFO:tasks.workunit.client.0.smithi016.stdout:9/931: mkdir d1/d2/d43/d140 0 2024-04-26T20:19:02.430 INFO:tasks.workunit.client.0.smithi016.stdout:9/932: stat d1/d2/d20/d49/d77/l8d 0 2024-04-26T20:19:02.430 INFO:tasks.workunit.client.0.smithi016.stdout:9/933: readlink d1/d2/d20/d49/d77/l8b 0 2024-04-26T20:19:02.458 INFO:tasks.workunit.client.0.smithi016.stdout:8/811: sync 2024-04-26T20:19:02.458 INFO:tasks.workunit.client.0.smithi016.stdout:3/666: sync 2024-04-26T20:19:02.458 INFO:tasks.workunit.client.0.smithi016.stdout:3/667: read d3/df/d25/d2a/f42 [3226266,122335] 0 2024-04-26T20:19:02.459 INFO:tasks.workunit.client.0.smithi016.stdout:6/778: mkdir d1/d21/d78/d109 0 2024-04-26T20:19:02.460 INFO:tasks.workunit.client.0.smithi016.stdout:9/934: fdatasync d1/d2/fd 0 2024-04-26T20:19:02.468 INFO:tasks.workunit.client.0.smithi016.stdout:1/835: dread d3/d5/f33 [0,4194304] 0 2024-04-26T20:19:02.473 INFO:tasks.workunit.client.0.smithi016.stdout:3/668: dread d3/df/f58 [0,4194304] 0 2024-04-26T20:19:02.476 INFO:tasks.workunit.client.0.smithi016.stdout:8/812: mknod d9/d19/d45/d3f/d64/c118 0 2024-04-26T20:19:02.481 INFO:tasks.workunit.client.0.smithi016.stdout:0/739: dwrite d2/dc/d45/f89 [4194304,4194304] 0 2024-04-26T20:19:02.483 INFO:tasks.workunit.client.0.smithi016.stdout:6/779: creat d1/d3a/db9/de0/f10a x:0 0 0 2024-04-26T20:19:02.483 INFO:tasks.workunit.client.0.smithi016.stdout:6/780: truncate d1/d21/d26/d1c/d5d/d88/ffd 302479 0 2024-04-26T20:19:02.485 INFO:tasks.workunit.client.0.smithi016.stdout:3/669: rename d3/df/f2b to d3/d9/d18/d82/fd4 0 2024-04-26T20:19:02.487 INFO:tasks.workunit.client.0.smithi016.stdout:8/813: link d9/d19/d45/d3f/d4d/fb5 d9/d23/f119 0 2024-04-26T20:19:02.487 INFO:tasks.workunit.client.0.smithi016.stdout:8/814: stat d9/d19/d45/d9e/d50/dad/fd2 0 2024-04-26T20:19:02.489 INFO:tasks.workunit.client.0.smithi016.stdout:0/740: symlink d2/d20/d41/d87/d9d/dda/dec/lfa 0 2024-04-26T20:19:02.497 INFO:tasks.workunit.client.0.smithi016.stdout:8/815: dread d9/f42 [0,4194304] 0 2024-04-26T20:19:02.507 INFO:tasks.workunit.client.0.smithi016.stdout:2/855: dwrite d1d/d27/d2d/f94 [0,4194304] 0 2024-04-26T20:19:02.515 INFO:tasks.workunit.client.0.smithi016.stdout:0/741: write d2/d20/d41/d87/fb9 [2190588,30240] 0 2024-04-26T20:19:02.517 INFO:tasks.workunit.client.0.smithi016.stdout:3/670: truncate d3/df/d20/d5b/f6e 1546163 0 2024-04-26T20:19:02.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.555+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4264005590 con 0x7f42880b1d80 2024-04-26T20:19:02.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4285600640 1 -- 172.21.15.16:0/3665157230 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6046 (secure 0 0 0) 0x7f427c0f39a0 con 0x7f42880b1d80 2024-04-26T20:19:02.561 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:02.561 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:00.848149+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:19:02.561 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 21 2024-04-26T20:19:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f42680683b0 msgr2=0x7f426806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f42680683b0 0x7f426806a870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f42880b4ae0 tx=0x7f4274009040 comp rx=0 tx=0).stop 2024-04-26T20:19:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42880b1d80 msgr2=0x7f42881f1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42880b1d80 0x7f42881f1820 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b3040 tx=0x7f427c01ba30 comp rx=0 tx=0).stop 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 shutdown_connections 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f42680683b0 0x7f426806a870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f428815c7e0 0x7f4288152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42880c6340 0x7f42881f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 --2- 172.21.15.16:0/3665157230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42880b1d80 0x7f42881f1820 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 >> 172.21.15.16:0/3665157230 conn(0x7f4288071160 msgr2=0x7f428815b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 shutdown_connections 2024-04-26T20:19:02.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.559+0000 7f4290000640 1 -- 172.21.15.16:0/3665157230 wait complete. 2024-04-26T20:19:02.589 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b down, removed from mdsmap 2024-04-26T20:19:02.589 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-26T20:19:02.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:02.621 INFO:tasks.workunit.client.0.smithi016.stdout:9/935: dwrite d1/f131 [0,4194304] 0 2024-04-26T20:19:02.621 INFO:tasks.workunit.client.0.smithi016.stdout:9/936: truncate d1/d2/d20/fc0 5063650 0 2024-04-26T20:19:02.621 INFO:tasks.workunit.client.0.smithi016.stdout:9/937: fsync d1/d2/d20/f133 0 2024-04-26T20:19:02.621 INFO:tasks.workunit.client.0.smithi016.stdout:9/938: stat d1/d59/da5/d118/f122 0 2024-04-26T20:19:02.621 INFO:tasks.workunit.client.0.smithi016.stdout:9/939: chown d1/d1b/f24 1893 1 2024-04-26T20:19:02.621 INFO:tasks.workunit.client.0.smithi016.stdout:2/856: dwrite d1d/d20/d22/d39/d3e/f74 [0,4194304] 0 2024-04-26T20:19:02.623 INFO:tasks.workunit.client.0.smithi016.stdout:0/742: getdents d2/d8/d37/d5d 0 2024-04-26T20:19:02.623 INFO:tasks.workunit.client.0.smithi016.stdout:0/743: chown d2/d8/d3b/fa3 6458 1 2024-04-26T20:19:02.623 INFO:tasks.workunit.client.0.smithi016.stdout:3/671: mkdir d3/d9/d18/dd5 0 2024-04-26T20:19:02.624 INFO:tasks.workunit.client.0.smithi016.stdout:9/940: mknod d1/d2e/d40/c141 0 2024-04-26T20:19:02.624 INFO:tasks.workunit.client.0.smithi016.stdout:9/941: chown d1/d2/d20/d49/d77/d2a/d75/d85/f9e 1410 1 2024-04-26T20:19:02.641 INFO:tasks.workunit.client.0.smithi016.stdout:2/857: dread d1d/d27/d2d/f70 [0,4194304] 0 2024-04-26T20:19:02.641 INFO:tasks.workunit.client.0.smithi016.stdout:2/858: write d1d/d2a/d3d/f102 [1042112,97846] 0 2024-04-26T20:19:02.644 INFO:tasks.workunit.client.0.smithi016.stdout:9/942: creat d1/d2/d20/d49/d77/d2a/d75/f142 x:0 0 0 2024-04-26T20:19:02.645 INFO:tasks.workunit.client.0.smithi016.stdout:3/672: read d3/d9/d18/d82/fd4 [3093801,46586] 0 2024-04-26T20:19:02.645 INFO:tasks.workunit.client.0.smithi016.stdout:2/859: creat d1d/d27/d2d/d6b/d108/d114/d9c/f124 x:0 0 0 2024-04-26T20:19:02.646 INFO:tasks.workunit.client.0.smithi016.stdout:0/744: write d2/d20/d41/d87/d9d/fbd [1777557,24200] 0 2024-04-26T20:19:02.647 INFO:tasks.workunit.client.0.smithi016.stdout:9/943: dread - d1/d2/fe4 zero size 2024-04-26T20:19:02.661 INFO:tasks.workunit.client.0.smithi016.stdout:9/944: dread d1/d2/fd [0,4194304] 0 2024-04-26T20:19:02.662 INFO:tasks.workunit.client.0.smithi016.stdout:2/860: symlink d1d/d2a/d3d/dd9/de5/d100/l125 0 2024-04-26T20:19:02.663 INFO:tasks.workunit.client.0.smithi016.stdout:0/745: rename d2/d20/d41/f62 to d2/dc/d18/d24/d53/ffb 0 2024-04-26T20:19:02.663 INFO:tasks.workunit.client.0.smithi016.stdout:0/746: getdents d2/dc/d1e/d25 0 2024-04-26T20:19:02.664 INFO:tasks.workunit.client.0.smithi016.stdout:9/945: creat d1/d2/d20/d49/d77/d107/f143 x:0 0 0 2024-04-26T20:19:02.664 INFO:tasks.workunit.client.0.smithi016.stdout:9/946: fsync d1/d1b/f7d 0 2024-04-26T20:19:02.666 INFO:tasks.workunit.client.0.smithi016.stdout:2/861: creat d1d/d52/dfc/f126 x:0 0 0 2024-04-26T20:19:02.668 INFO:tasks.workunit.client.0.smithi016.stdout:1/836: dwrite d3/d57/f44 [0,4194304] 0 2024-04-26T20:19:02.668 INFO:tasks.workunit.client.0.smithi016.stdout:1/837: dread - d3/d5/d6/d5a/dbf/de2/f10b zero size 2024-04-26T20:19:02.669 INFO:tasks.workunit.client.0.smithi016.stdout:9/947: symlink d1/d59/d52/d8c/dd1/l144 0 2024-04-26T20:19:02.671 INFO:tasks.workunit.client.0.smithi016.stdout:2/862: creat d1d/d27/d2d/d6b/d7e/ddc/f127 x:0 0 0 2024-04-26T20:19:02.684 INFO:tasks.workunit.client.0.smithi016.stdout:1/838: rmdir d3/d5/d6/d9/d9e 39 2024-04-26T20:19:02.687 INFO:tasks.workunit.client.0.smithi016.stdout:9/948: truncate d1/d2/f5 803179 0 2024-04-26T20:19:02.687 INFO:tasks.workunit.client.0.smithi016.stdout:2/863: creat d1d/d20/d22/d29/f128 x:0 0 0 2024-04-26T20:19:02.690 INFO:tasks.workunit.client.0.smithi016.stdout:1/839: link d3/d5/da/d66/d8c/fc9 d3/d5/d6/d9/f115 0 2024-04-26T20:19:02.696 INFO:tasks.workunit.client.0.smithi016.stdout:7/742: sync 2024-04-26T20:19:02.696 INFO:tasks.workunit.client.0.smithi016.stdout:4/735: sync 2024-04-26T20:19:02.697 INFO:tasks.workunit.client.0.smithi016.stdout:4/736: fsync d0/d1e/d4e/f8f 0 2024-04-26T20:19:02.701 INFO:tasks.workunit.client.0.smithi016.stdout:9/949: creat d1/d2/d20/d49/d77/d2a/d33/d12d/f145 x:0 0 0 2024-04-26T20:19:02.703 INFO:tasks.workunit.client.0.smithi016.stdout:2/864: truncate d1d/d27/d49/f56 1254025 0 2024-04-26T20:19:02.704 INFO:tasks.workunit.client.0.smithi016.stdout:7/743: unlink d0/dd5/d34/d25/l44 0 2024-04-26T20:19:02.704 INFO:tasks.workunit.client.0.smithi016.stdout:7/744: chown d0/d83/f3c 0 1 2024-04-26T20:19:02.707 INFO:tasks.workunit.client.0.smithi016.stdout:4/737: mknod d0/dd/d19/d57/cef 0 2024-04-26T20:19:02.707 INFO:tasks.workunit.client.0.smithi016.stdout:9/950: symlink d1/d1b/l146 0 2024-04-26T20:19:02.708 INFO:tasks.workunit.client.0.smithi016.stdout:9/951: chown d1/d2/d20/d49/d77/d2a/d33/f12f 33 1 2024-04-26T20:19:02.709 INFO:tasks.workunit.client.0.smithi016.stdout:2/865: creat d1d/d20/d22/d98/f129 x:0 0 0 2024-04-26T20:19:02.710 INFO:tasks.workunit.client.0.smithi016.stdout:7/745: creat d0/d51/dc7/fe1 x:0 0 0 2024-04-26T20:19:02.713 INFO:tasks.workunit.client.0.smithi016.stdout:9/952: creat d1/d1b/f147 x:0 0 0 2024-04-26T20:19:02.714 INFO:tasks.workunit.client.0.smithi016.stdout:0/747: dwrite d2/dc/d1e/d35/f63 [0,4194304] 0 2024-04-26T20:19:02.716 INFO:tasks.workunit.client.0.smithi016.stdout:2/866: rmdir d1d/d27/d49/def 0 2024-04-26T20:19:02.716 INFO:tasks.workunit.client.0.smithi016.stdout:2/867: fdatasync d1d/d27/d2d/d6b/d7e/ffb 0 2024-04-26T20:19:02.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/746: creat d0/dd5/d34/d25/d3f/fe2 x:0 0 0 2024-04-26T20:19:02.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/747: read d0/dd5/d34/d25/d3f/d6d/d79/fd6 [1331799,93714] 0 2024-04-26T20:19:02.721 INFO:tasks.workunit.client.0.smithi016.stdout:7/748: readlink d0/d51/dc7/lca 0 2024-04-26T20:19:02.722 INFO:tasks.workunit.client.0.smithi016.stdout:7/749: chown d0/ld9 6937529 1 2024-04-26T20:19:02.722 INFO:tasks.workunit.client.0.smithi016.stdout:9/953: symlink d1/d2/d20/d49/d77/d2a/d33/d12d/l148 0 2024-04-26T20:19:02.723 INFO:tasks.workunit.client.0.smithi016.stdout:0/748: symlink d2/d20/d41/d4c/lfc 0 2024-04-26T20:19:02.725 INFO:tasks.workunit.client.0.smithi016.stdout:7/750: creat d0/dd5/d34/d25/d3f/d6d/dc2/fe3 x:0 0 0 2024-04-26T20:19:02.727 INFO:tasks.workunit.client.0.smithi016.stdout:0/749: rmdir d2/dc/de3 39 2024-04-26T20:19:02.728 INFO:tasks.workunit.client.0.smithi016.stdout:7/751: write d0/d51/f5a [4806417,68168] 0 2024-04-26T20:19:02.731 INFO:tasks.workunit.client.0.smithi016.stdout:0/750: truncate d2/d20/d41/d4c/d4e/fa1 887692 0 2024-04-26T20:19:02.748 INFO:tasks.workunit.client.0.smithi016.stdout:7/752: dread d0/dd5/d34/db7/fbd [0,4194304] 0 2024-04-26T20:19:02.750 INFO:tasks.workunit.client.0.smithi016.stdout:0/751: unlink d2/d8/c9b 0 2024-04-26T20:19:02.750 INFO:tasks.workunit.client.0.smithi016.stdout:2/868: truncate d1d/d27/d49/f56 50587 0 2024-04-26T20:19:02.754 INFO:tasks.workunit.client.0.smithi016.stdout:0/752: creat d2/dc/de3/ffd x:0 0 0 2024-04-26T20:19:02.754 INFO:tasks.workunit.client.0.smithi016.stdout:8/816: dread d9/d19/d45/d9e/d50/f58 [0,4194304] 0 2024-04-26T20:19:02.757 INFO:tasks.workunit.client.0.smithi016.stdout:2/869: mknod d1d/d2a/d3d/dd9/de5/c12a 0 2024-04-26T20:19:02.760 INFO:tasks.workunit.client.0.smithi016.stdout:7/753: symlink d0/dd5/d88/db3/le4 0 2024-04-26T20:19:02.760 INFO:tasks.workunit.client.0.smithi016.stdout:7/754: chown d0/d83/lb0 14660 1 2024-04-26T20:19:02.760 INFO:tasks.workunit.client.0.smithi016.stdout:7/755: write d0/fc [1361145,8900] 0 2024-04-26T20:19:02.760 INFO:tasks.workunit.client.0.smithi016.stdout:7/756: chown d0/d67/fac 334 1 2024-04-26T20:19:02.761 INFO:tasks.workunit.client.0.smithi016.stdout:8/817: unlink d9/d19/d45/d3f/d4d/fff 0 2024-04-26T20:19:02.770 INFO:tasks.workunit.client.0.smithi016.stdout:6/781: dwrite d1/d21/d26/d1c/d5d/de2/ff8 [0,4194304] 0 2024-04-26T20:19:02.775 INFO:tasks.workunit.client.0.smithi016.stdout:8/818: rename d9/d19/d45/d9e/d50/c81 to d9/d19/d45/d3f/c11a 0 2024-04-26T20:19:02.798 INFO:tasks.workunit.client.0.smithi016.stdout:9/954: write d1/d2/d43/f46 [3686170,32378] 0 2024-04-26T20:19:02.799 INFO:tasks.workunit.client.0.smithi016.stdout:8/819: dread d9/d19/d45/d9e/d50/da9/dac/fb7 [0,4194304] 0 2024-04-26T20:19:02.800 INFO:tasks.workunit.client.0.smithi016.stdout:8/820: chown d9/d2f/f86 1 1 2024-04-26T20:19:02.801 INFO:tasks.workunit.client.0.smithi016.stdout:6/782: rename d1/d21/d26/d1c/d5d/def/f92 to d1/d21/d26/d1c/d5d/def/d2c/f10b 0 2024-04-26T20:19:02.802 INFO:tasks.workunit.client.0.smithi016.stdout:9/955: rename d1/d2/d43/cb2 to d1/d2/d43/c149 0 2024-04-26T20:19:02.804 INFO:tasks.workunit.client.0.smithi016.stdout:8/821: mkdir d9/d23/d11b 0 2024-04-26T20:19:02.804 INFO:tasks.workunit.client.0.smithi016.stdout:8/822: write d9/d19/de6/f112 [113041,78130] 0 2024-04-26T20:19:02.806 INFO:tasks.workunit.client.0.smithi016.stdout:2/870: write d1d/d27/d2d/f44 [92109,24371] 0 2024-04-26T20:19:02.806 INFO:tasks.workunit.client.0.smithi016.stdout:2/871: chown d1d/d27/d2d/d6b/lb0 37 1 2024-04-26T20:19:02.806 INFO:tasks.workunit.client.0.smithi016.stdout:2/872: readlink d1d/d27/d49/l5d 0 2024-04-26T20:19:02.807 INFO:tasks.workunit.client.0.smithi016.stdout:0/753: dread d2/dc/f79 [0,4194304] 0 2024-04-26T20:19:02.807 INFO:tasks.workunit.client.0.smithi016.stdout:3/673: dwrite d3/df/d20/d61/d74/fb3 [0,4194304] 0 2024-04-26T20:19:02.807 INFO:tasks.workunit.client.0.smithi016.stdout:6/783: creat d1/d21/d26/d1c/d7b/d82/d8f/dff/f10c x:0 0 0 2024-04-26T20:19:02.807 INFO:tasks.workunit.client.0.smithi016.stdout:9/956: creat d1/d59/f14a x:0 0 0 2024-04-26T20:19:02.808 INFO:tasks.workunit.client.0.smithi016.stdout:8/823: unlink d9/d19/d45/d3f/l43 0 2024-04-26T20:19:02.808 INFO:tasks.workunit.client.0.smithi016.stdout:2/873: rmdir d1d/d20 39 2024-04-26T20:19:02.809 INFO:tasks.workunit.client.0.smithi016.stdout:2/874: fdatasync d1d/d20/fc9 0 2024-04-26T20:19:02.810 INFO:tasks.workunit.client.0.smithi016.stdout:3/674: mknod d3/df/d25/d32/dc7/cd6 0 2024-04-26T20:19:02.811 INFO:tasks.workunit.client.0.smithi016.stdout:9/957: mknod d1/d59/da5/c14b 0 2024-04-26T20:19:02.814 INFO:tasks.workunit.client.0.smithi016.stdout:6/784: creat d1/d21/d26/d1c/d2e/d53/f10d x:0 0 0 2024-04-26T20:19:02.814 INFO:tasks.workunit.client.0.smithi016.stdout:6/785: chown d1/d21/d48/lb8 13405359 1 2024-04-26T20:19:02.817 INFO:tasks.workunit.client.0.smithi016.stdout:7/757: dwrite d0/dd5/d6/d73/fc6 [0,4194304] 0 2024-04-26T20:19:02.820 INFO:tasks.workunit.client.0.smithi016.stdout:8/824: rmdir d9/d104/d115 0 2024-04-26T20:19:02.831 INFO:tasks.workunit.client.0.smithi016.stdout:9/958: dread d1/d2/d20/d49/d77/d3e/d5e/fbb [0,4194304] 0 2024-04-26T20:19:02.832 INFO:tasks.workunit.client.0.smithi016.stdout:3/675: rmdir d3/df/d25/d2a 39 2024-04-26T20:19:02.851 INFO:tasks.workunit.client.0.smithi016.stdout:9/959: creat d1/d2/d79/f14c x:0 0 0 2024-04-26T20:19:02.851 INFO:tasks.workunit.client.0.smithi016.stdout:9/960: truncate d1/d2/d20/d49/d77/d2a/d75/f142 291325 0 2024-04-26T20:19:02.851 INFO:tasks.workunit.client.0.smithi016.stdout:9/961: chown d1/d2/d20/d49/d77/l9c 35 1 2024-04-26T20:19:02.863 INFO:tasks.workunit.client.0.smithi016.stdout:9/962: unlink d1/d1b/fc7 0 2024-04-26T20:19:02.880 INFO:tasks.workunit.client.0.smithi016.stdout:9/963: write d1/d59/d52/fba [2824459,112160] 0 2024-04-26T20:19:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63b0800640 1 Processor -- start 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63b0800640 1 -- start start 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63b0800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f63a80c8a20 0x7f63a80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63b0800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a80c8350 con 0x7f63a80c7250 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63b0800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63a81698b0 con 0x7f63a80c68c0 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63b0800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f63a8072540 con 0x7f63a80c8a20 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63ade00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f63a80c68c0 0x7f63a816c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:60142/0 (socket says 172.21.15.16:60142) 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63ade00640 1 -- 172.21.15.16:0/1683371033 learned_addr learned my addr 172.21.15.16:0/1683371033 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63ae800640 1 --2- 172.21.15.16:0/1683371033 >> v2:172.21.15.192:3300/0 conn(0x7f63a80c8a20 0x7f63a80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.867+0000 7f63aca00640 1 -- 172.21.15.16:0/1683371033 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435067040 0 0) 0x7f63a81698b0 con 0x7f63a80c68c0 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.883+0000 7f63aca00640 1 -- 172.21.15.16:0/1683371033 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6390003980 con 0x7f63a80c68c0 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.883+0000 7f63aca00640 1 -- 172.21.15.16:0/1683371033 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752878087 0 0) 0x7f63a80c8350 con 0x7f63a80c7250 2024-04-26T20:19:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.883+0000 7f63aca00640 1 -- 172.21.15.16:0/1683371033 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63a81698b0 con 0x7f63a80c7250 2024-04-26T20:19:02.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.883+0000 7f63ae800640 1 -- 172.21.15.16:0/1683371033 >> v1:172.21.15.192:6789/0 conn(0x7f63a80c68c0 legacy=0x7f63a816c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.883+0000 7f63ae800640 1 -- 172.21.15.16:0/1683371033 >> v1:172.21.15.16:6789/0 conn(0x7f63a80c7250 legacy=0x7f63a8072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.883+0000 7f63ae800640 1 -- 172.21.15.16:0/1683371033 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a80c8070 con 0x7f63a80c8a20 2024-04-26T20:19:02.886 INFO:tasks.workunit.client.0.smithi016.stdout:6/786: dread d1/d21/d26/d1c/d5d/def/d76/f77 [0,4194304] 0 2024-04-26T20:19:02.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/825: dwrite d9/d66/d73/fd6 [0,4194304] 0 2024-04-26T20:19:02.889 INFO:tasks.workunit.client.0.smithi016.stdout:9/964: mknod d1/d59/da5/d118/c14d 0 2024-04-26T20:19:02.893 INFO:tasks.workunit.client.0.smithi016.stdout:6/787: stat d1/d21/d26/d1c/d5d/def/d2c/d3d/ld3 0 2024-04-26T20:19:02.893 INFO:tasks.workunit.client.0.smithi016.stdout:8/826: creat d9/d104/f11c x:0 0 0 2024-04-26T20:19:02.893 INFO:tasks.workunit.client.0.smithi016.stdout:8/827: fsync d9/d23/d26/faf 0 2024-04-26T20:19:02.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.891+0000 7f63ae800640 1 --2- 172.21.15.16:0/1683371033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a80c8e70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009d90 tx=0x7f63a40211d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae35fa4ffb1892 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:02.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.895+0000 7f63aca00640 1 -- 172.21.15.16:0/1683371033 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a40b6070 con 0x7f63a80c8a20 2024-04-26T20:19:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.895+0000 7f63aca00640 1 -- 172.21.15.16:0/1683371033 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a40b1400 con 0x7f63a80c8a20 2024-04-26T20:19:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.895+0000 7f63aca00640 1 -- 172.21.15.16:0/1683371033 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398001680 con 0x7f63a80c8a20 2024-04-26T20:19:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.895+0000 7f63b0800640 1 -- 172.21.15.16:0/1683371033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 msgr2=0x7f63a80c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.895+0000 7f63b0800640 1 --2- 172.21.15.16:0/1683371033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a80c8e70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009d90 tx=0x7f63a40211d0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.901 INFO:tasks.workunit.client.0.smithi016.stdout:9/965: creat d1/d2/d20/d49/d77/d2a/d33/d12d/f14e x:0 0 0 2024-04-26T20:19:02.902 INFO:tasks.workunit.client.0.smithi016.stdout:9/966: chown d1/d2e 35649306 1 2024-04-26T20:19:02.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.899+0000 7f63b0800640 1 -- 172.21.15.16:0/1683371033 shutdown_connections 2024-04-26T20:19:02.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.899+0000 7f63b0800640 1 --2- 172.21.15.16:0/1683371033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a80c8e70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.899+0000 7f63b0800640 1 -- 172.21.15.16:0/1683371033 >> 172.21.15.16:0/1683371033 conn(0x7f63a806c380 msgr2=0x7f63a806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:02.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.899+0000 7f63b0800640 1 -- 172.21.15.16:0/1683371033 shutdown_connections 2024-04-26T20:19:02.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.899+0000 7f63b0800640 1 -- 172.21.15.16:0/1683371033 wait complete. 2024-04-26T20:19:02.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 Processor -- start 2024-04-26T20:19:02.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 -- start start 2024-04-26T20:19:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80c68c0 0x7f63a816a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a80c7250 0x7f63a8157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a8157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f63a81690b0 con 0x7f63a80c68c0 2024-04-26T20:19:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f63a8168dd0 con 0x7f63a80c8a20 2024-04-26T20:19:02.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63b0800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f63a8169390 con 0x7f63a80c7250 2024-04-26T20:19:02.908 INFO:tasks.workunit.client.0.smithi016.stdout:8/828: mknod d9/d19/d45/d3f/d4d/dba/c11d 0 2024-04-26T20:19:02.908 INFO:tasks.workunit.client.0.smithi016.stdout:8/829: stat d9/d23/d26/d2c/f85 0 2024-04-26T20:19:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ae800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a8157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ae800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a8157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:33266/0 (socket says 172.21.15.16:33266) 2024-04-26T20:19:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ade00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80c68c0 0x7f63a816a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ae800640 1 -- 172.21.15.16:0/2068677478 learned_addr learned my addr 172.21.15.16:0/2068677478 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ae800640 1 -- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a80c7250 msgr2=0x7f63a8157980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T20:19:02.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ae800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a80c7250 0x7f63a8157980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ae800640 1 -- 172.21.15.16:0/2068677478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80c68c0 msgr2=0x7f63a816a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.903+0000 7f63ae800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80c68c0 0x7f63a816a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63ae800640 1 -- 172.21.15.16:0/2068677478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a8152a30 con 0x7f63a80c8a20 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63ae800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a8157ec0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f63a401f880 tx=0x7f63a401df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63a2000640 1 -- 172.21.15.16:0/2068677478 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a40b6040 con 0x7f63a80c8a20 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63a2000640 1 -- 172.21.15.16:0/2068677478 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a40c2070 con 0x7f63a80c8a20 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63a2000640 1 -- 172.21.15.16:0/2068677478 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c001600 con 0x7f63a80c8a20 2024-04-26T20:19:02.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a8153260 con 0x7f63a80c8a20 2024-04-26T20:19:02.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a8153820 con 0x7f63a80c8a20 2024-04-26T20:19:02.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.907+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a8077c20 con 0x7f63a80c8a20 2024-04-26T20:19:02.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.911+0000 7f63a2000640 1 -- 172.21.15.16:0/2068677478 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f63a40bc470 con 0x7f63a80c8a20 2024-04-26T20:19:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.911+0000 7f63a2000640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f638c0683b0 0x7f638c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.911+0000 7f63a2000640 1 -- 172.21.15.16:0/2068677478 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f63a4002020 con 0x7f63a80c8a20 2024-04-26T20:19:02.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.911+0000 7f63ade00640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f638c0683b0 0x7f638c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:02.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.911+0000 7f63ade00640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f638c0683b0 0x7f638c06a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f639c0011f0 tx=0x7f639c001b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:02.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:02.915+0000 7f63a2000640 1 -- 172.21.15.16:0/2068677478 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f63a401adf0 con 0x7f63a80c8a20 2024-04-26T20:19:02.919 INFO:tasks.workunit.client.0.smithi016.stdout:6/788: write d1/d21/d26/d1c/d5d/def/fc [7907110,50934] 0 2024-04-26T20:19:02.919 INFO:tasks.workunit.client.0.smithi016.stdout:0/754: dwrite d2/dc/d18/d24/fb3 [0,4194304] 0 2024-04-26T20:19:02.920 INFO:tasks.workunit.client.0.smithi016.stdout:2/875: write d1d/d27/d2d/d6b/f71 [1043806,56660] 0 2024-04-26T20:19:02.920 INFO:tasks.workunit.client.0.smithi016.stdout:2/876: truncate d1d/d2a/d3d/dd9/de5/f110 356463 0 2024-04-26T20:19:02.924 INFO:tasks.workunit.client.0.smithi016.stdout:8/830: dread d9/d66/d73/fcf [4194304,4194304] 0 2024-04-26T20:19:02.924 INFO:tasks.workunit.client.0.smithi016.stdout:6/789: write d1/d21/d26/d1c/d5d/def/dae/fc4 [581165,6416] 0 2024-04-26T20:19:02.925 INFO:tasks.workunit.client.0.smithi016.stdout:2/877: symlink d1d/d20/d22/d39/ddd/l12b 0 2024-04-26T20:19:02.926 INFO:tasks.workunit.client.0.smithi016.stdout:6/790: symlink d1/d21/d26/d1c/d7b/d82/l10e 0 2024-04-26T20:19:02.928 INFO:tasks.workunit.client.0.smithi016.stdout:9/967: dread d1/d2/d20/d49/d77/d2a/ffc [0,4194304] 0 2024-04-26T20:19:02.929 INFO:tasks.workunit.client.0.smithi016.stdout:0/755: rename d2/d20/d41/d4c/d4e/f86 to d2/dc/d45/ffe 0 2024-04-26T20:19:02.929 INFO:tasks.workunit.client.0.smithi016.stdout:2/878: symlink d1d/d20/l12c 0 2024-04-26T20:19:02.930 INFO:tasks.workunit.client.0.smithi016.stdout:6/791: getdents d1/d21/d26/d1c/d4e 0 2024-04-26T20:19:02.931 INFO:tasks.workunit.client.0.smithi016.stdout:9/968: mkdir d1/d2/d20/d14f 0 2024-04-26T20:19:02.933 INFO:tasks.workunit.client.0.smithi016.stdout:2/879: getdents d1d/d2a/d3d/dd9 0 2024-04-26T20:19:02.934 INFO:tasks.workunit.client.0.smithi016.stdout:6/792: stat d1/d21/d78/l102 0 2024-04-26T20:19:02.934 INFO:tasks.workunit.client.0.smithi016.stdout:3/676: dwrite d3/d9/fa2 [0,4194304] 0 2024-04-26T20:19:02.936 INFO:tasks.workunit.client.0.smithi016.stdout:0/756: write d2/d8/d3b/fd8 [640809,12056] 0 2024-04-26T20:19:02.937 INFO:tasks.workunit.client.0.smithi016.stdout:9/969: mknod d1/c150 0 2024-04-26T20:19:02.940 INFO:tasks.workunit.client.0.smithi016.stdout:2/880: creat d1d/d20/d22/d39/f12d x:0 0 0 2024-04-26T20:19:02.940 INFO:tasks.workunit.client.0.smithi016.stdout:2/881: write d1d/d20/d22/d39/f118 [653389,66574] 0 2024-04-26T20:19:02.941 INFO:tasks.workunit.client.0.smithi016.stdout:6/793: mknod d1/d21/d26/d25/c10f 0 2024-04-26T20:19:02.941 INFO:tasks.workunit.client.0.smithi016.stdout:6/794: write d1/f6 [3221098,34454] 0 2024-04-26T20:19:02.941 INFO:tasks.workunit.client.0.smithi016.stdout:6/795: chown d1/d21/fe7 78412651 1 2024-04-26T20:19:02.942 INFO:tasks.workunit.client.0.smithi016.stdout:0/757: creat d2/d20/d41/d72/fff x:0 0 0 2024-04-26T20:19:02.945 INFO:tasks.workunit.client.0.smithi016.stdout:9/970: chown d1/d2/l4e 1 1 2024-04-26T20:19:02.951 INFO:tasks.workunit.client.0.smithi016.stdout:2/882: truncate d1d/d2a/f4a 1698428 0 2024-04-26T20:19:02.954 INFO:tasks.workunit.client.0.smithi016.stdout:6/796: dread d1/d21/d26/d1c/d2e/d53/d93/f9d [0,4194304] 0 2024-04-26T20:19:02.954 INFO:tasks.workunit.client.0.smithi016.stdout:6/797: dread - d1/d21/fe7 zero size 2024-04-26T20:19:02.956 INFO:tasks.workunit.client.0.smithi016.stdout:9/971: creat d1/d2/d20/d49/d77/d107/f151 x:0 0 0 2024-04-26T20:19:02.956 INFO:tasks.workunit.client.0.smithi016.stdout:9/972: write d1/d2e/d40/fd9 [1095673,125018] 0 2024-04-26T20:19:02.961 INFO:tasks.workunit.client.0.smithi016.stdout:8/831: dwrite d9/d19/d45/d9e/d50/f97 [0,4194304] 0 2024-04-26T20:19:02.962 INFO:tasks.workunit.client.0.smithi016.stdout:2/883: dread d1d/d27/d2d/d6b/d108/d114/dea/ffd [0,4194304] 0 2024-04-26T20:19:02.963 INFO:tasks.workunit.client.0.smithi016.stdout:0/758: dread d2/d8/d37/d5d/f64 [0,4194304] 0 2024-04-26T20:19:02.963 INFO:tasks.workunit.client.0.smithi016.stdout:0/759: fdatasync d2/d8/f80 0 2024-04-26T20:19:02.963 INFO:tasks.workunit.client.0.smithi016.stdout:6/798: creat d1/d3a/db9/de0/f110 x:0 0 0 2024-04-26T20:19:02.966 INFO:tasks.workunit.client.0.smithi016.stdout:9/973: truncate d1/d2/d43/fd8 603635 0 2024-04-26T20:19:02.966 INFO:tasks.workunit.client.0.smithi016.stdout:8/832: link d9/d19/d45/d3f/d4d/cd1 d9/d19/d45/d9e/c11e 0 2024-04-26T20:19:02.977 INFO:tasks.workunit.client.0.smithi016.stdout:9/974: dread d1/d2e/d40/f6b [0,4194304] 0 2024-04-26T20:19:02.981 INFO:tasks.workunit.client.0.smithi016.stdout:2/884: dread d1d/d20/d7c/dbc/fd1 [0,4194304] 0 2024-04-26T20:19:02.985 INFO:tasks.workunit.client.0.smithi016.stdout:6/799: symlink d1/d3a/db9/de0/l111 0 2024-04-26T20:19:02.986 INFO:tasks.workunit.client.0.smithi016.stdout:8/833: dread d9/d19/d45/d3f/d4d/fbc [0,4194304] 0 2024-04-26T20:19:02.988 INFO:tasks.workunit.client.0.smithi016.stdout:8/834: write d9/d19/d45/d3f/d4d/fbc [4258053,30972] 0 2024-04-26T20:19:02.990 INFO:tasks.workunit.client.0.smithi016.stdout:2/885: creat d1d/d27/d2d/d6b/d7e/f12e x:0 0 0 2024-04-26T20:19:02.994 INFO:tasks.workunit.client.0.smithi016.stdout:0/760: unlink d2/dc/d1e/d25/l7d 0 2024-04-26T20:19:02.995 INFO:tasks.workunit.client.0.smithi016.stdout:0/761: chown d2/d20/d41/d72/l8e 26 1 2024-04-26T20:19:03.001 INFO:tasks.workunit.client.0.smithi016.stdout:9/975: unlink d1/d2/f61 0 2024-04-26T20:19:03.019 INFO:tasks.workunit.client.0.smithi016.stdout:8/835: write d9/d2f/f5e [8166979,100704] 0 2024-04-26T20:19:03.019 INFO:tasks.workunit.client.0.smithi016.stdout:8/836: chown d9/d23/lc7 1 1 2024-04-26T20:19:03.020 INFO:tasks.workunit.client.0.smithi016.stdout:2/886: creat d1d/d20/d22/d29/f12f x:0 0 0 2024-04-26T20:19:03.033 INFO:tasks.workunit.client.0.smithi016.stdout:3/677: dwrite d3/df/d20/d41/fb7 [0,4194304] 0 2024-04-26T20:19:03.035 INFO:tasks.workunit.client.0.smithi016.stdout:3/678: write d3/df/f2f [4210871,113421] 0 2024-04-26T20:19:03.040 INFO:tasks.workunit.client.0.smithi016.stdout:0/762: rename d2/d20/d41/d4c/d4e/cd3 to d2/d20/d41/d87/d9d/dda/c100 0 2024-04-26T20:19:03.041 INFO:tasks.workunit.client.0.smithi016.stdout:9/976: dwrite d1/d2/fe4 [0,4194304] 0 2024-04-26T20:19:03.042 INFO:tasks.workunit.client.0.smithi016.stdout:8/837: creat d9/d19/d45/d9e/d50/da9/dac/f11f x:0 0 0 2024-04-26T20:19:03.050 INFO:tasks.workunit.client.0.smithi016.stdout:6/800: dread d1/f7 [0,4194304] 0 2024-04-26T20:19:03.053 INFO:tasks.workunit.client.0.smithi016.stdout:0/763: write d2/d20/d41/f65 [602466,82774] 0 2024-04-26T20:19:03.057 INFO:tasks.workunit.client.0.smithi016.stdout:0/764: write d2/d20/d41/d87/d9d/db8/fce [661034,111094] 0 2024-04-26T20:19:03.057 INFO:tasks.workunit.client.0.smithi016.stdout:9/977: dread d1/f15 [0,4194304] 0 2024-04-26T20:19:03.062 INFO:tasks.workunit.client.0.smithi016.stdout:0/765: dread d2/dc/d18/f29 [4194304,4194304] 0 2024-04-26T20:19:03.062 INFO:tasks.workunit.client.0.smithi016.stdout:0/766: chown d2/dc/d1e 363561994 1 2024-04-26T20:19:03.066 INFO:tasks.workunit.client.0.smithi016.stdout:6/801: dread d1/d21/d26/d1c/d5d/def/f2f [4194304,4194304] 0 2024-04-26T20:19:03.066 INFO:tasks.workunit.client.0.smithi016.stdout:0/767: read d2/d40/d61/f81 [42035,73723] 0 2024-04-26T20:19:03.068 INFO:tasks.workunit.client.0.smithi016.stdout:3/679: dread d3/d9/d18/d82/fd4 [0,4194304] 0 2024-04-26T20:19:03.078 INFO:tasks.workunit.client.0.smithi016.stdout:8/838: write d9/fa2 [2544457,101176] 0 2024-04-26T20:19:03.078 INFO:tasks.workunit.client.0.smithi016.stdout:8/839: write d9/d19/d45/d3f/fdd [535118,72956] 0 2024-04-26T20:19:03.080 INFO:tasks.workunit.client.0.smithi016.stdout:9/978: truncate d1/d59/f13d 1125654 0 2024-04-26T20:19:03.080 INFO:tasks.workunit.client.0.smithi016.stdout:9/979: dread - d1/d2/d20/d49/d77/d2a/d75/d85/f126 zero size 2024-04-26T20:19:03.080 INFO:tasks.workunit.client.0.smithi016.stdout:9/980: fdatasync d1/d2/f10a 0 2024-04-26T20:19:03.080 INFO:tasks.workunit.client.0.smithi016.stdout:9/981: write d1/d2/d79/f14c [879027,12431] 0 2024-04-26T20:19:03.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/768: dread d2/f15 [0,4194304] 0 2024-04-26T20:19:03.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/769: readlink d2/d20/d57/l66 0 2024-04-26T20:19:03.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/770: chown d2/dc/d18/f96 129015364 1 2024-04-26T20:19:03.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/771: readlink d2/dc/d1e/lcb 0 2024-04-26T20:19:03.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/772: stat d2/dc/d18/f96 0 2024-04-26T20:19:03.087 INFO:tasks.workunit.client.0.smithi016.stdout:0/773: readlink d2/d20/d41/lc4 0 2024-04-26T20:19:03.088 INFO:tasks.workunit.client.0.smithi016.stdout:8/840: mknod d9/d19/d45/d9e/c120 0 2024-04-26T20:19:03.090 INFO:tasks.workunit.client.0.smithi016.stdout:9/982: creat d1/d2e/dc6/f152 x:0 0 0 2024-04-26T20:19:03.090 INFO:tasks.workunit.client.0.smithi016.stdout:9/983: chown d1/d2e/f7a 2174 1 2024-04-26T20:19:03.090 INFO:tasks.workunit.client.0.smithi016.stdout:3/680: read d3/df/d25/d2a/d69/db5/dac/fae [2396118,110127] 0 2024-04-26T20:19:03.091 INFO:tasks.workunit.client.0.smithi016.stdout:0/774: creat d2/dc/d1e/f101 x:0 0 0 2024-04-26T20:19:03.108 INFO:tasks.workunit.client.0.smithi016.stdout:6/802: dwrite d1/d3a/fb2 [0,4194304] 0 2024-04-26T20:19:03.108 INFO:tasks.workunit.client.0.smithi016.stdout:9/984: dread d1/d2/d20/d49/f7b [0,4194304] 0 2024-04-26T20:19:03.108 INFO:tasks.workunit.client.0.smithi016.stdout:6/803: chown d1/d21/d26/d1c/d2e/l65 10957 1 2024-04-26T20:19:03.108 INFO:tasks.workunit.client.0.smithi016.stdout:6/804: fsync d1/f4 0 2024-04-26T20:19:03.110 INFO:tasks.workunit.client.0.smithi016.stdout:8/841: rename d9/f16 to d9/d23/d26/d2c/f121 0 2024-04-26T20:19:03.115 INFO:tasks.workunit.client.0.smithi016.stdout:3/681: unlink d3/df/d25/d2a/d4a/c78 0 2024-04-26T20:19:03.115 INFO:tasks.workunit.client.0.smithi016.stdout:3/682: dread - d3/d9/d18/d82/fa7 zero size 2024-04-26T20:19:03.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/775: dwrite d2/d20/d41/f65 [0,4194304] 0 2024-04-26T20:19:03.141 INFO:tasks.workunit.client.0.smithi016.stdout:9/985: mknod d1/d2/d79/d108/c153 0 2024-04-26T20:19:03.143 INFO:tasks.workunit.client.0.smithi016.stdout:6/805: rename d1/d3a/db9/dec/fed to d1/d21/d26/d1c/d5d/de2/f112 0 2024-04-26T20:19:03.156 INFO:tasks.workunit.client.0.smithi016.stdout:9/986: stat d1/d2/l2b 0 2024-04-26T20:19:03.158 INFO:tasks.workunit.client.0.smithi016.stdout:6/806: unlink d1/d21/d26/d1c/d2e/d53/d93/f9d 0 2024-04-26T20:19:03.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/842: dwrite d9/f1b [0,4194304] 0 2024-04-26T20:19:03.175 INFO:tasks.workunit.client.0.smithi016.stdout:9/987: creat d1/d2/d20/dde/f154 x:0 0 0 2024-04-26T20:19:03.185 INFO:tasks.workunit.client.0.smithi016.stdout:3/683: dwrite d3/d9/d18/d82/fa7 [0,4194304] 0 2024-04-26T20:19:03.186 INFO:tasks.workunit.client.0.smithi016.stdout:6/807: truncate d1/d21/d26/d1c/d5d/def/d76/f77 2650602 0 2024-04-26T20:19:03.187 INFO:tasks.workunit.client.0.smithi016.stdout:6/808: readlink d1/d21/d48/d51/l100 0 2024-04-26T20:19:03.190 INFO:tasks.workunit.client.0.smithi016.stdout:3/684: rename d3/df/d25/d32/d3f/cd3 to d3/df/d20/d5b/cd7 0 2024-04-26T20:19:03.190 INFO:tasks.workunit.client.0.smithi016.stdout:3/685: chown d3/df/d20/d61/f9f 0 1 2024-04-26T20:19:03.191 INFO:tasks.workunit.client.0.smithi016.stdout:9/988: write d1/d2/d20/d49/d77/d2a/d75/d85/fb4 [1025961,83728] 0 2024-04-26T20:19:03.205 INFO:tasks.workunit.client.0.smithi016.stdout:3/686: dread d3/df/d25/d2a/d4a/fb4 [0,4194304] 0 2024-04-26T20:19:03.206 INFO:tasks.workunit.client.0.smithi016.stdout:9/989: creat d1/d59/d52/d8c/df1/f155 x:0 0 0 2024-04-26T20:19:03.207 INFO:tasks.workunit.client.0.smithi016.stdout:3/687: rmdir d3/df/d25/d2a 39 2024-04-26T20:19:03.208 INFO:tasks.workunit.client.0.smithi016.stdout:9/990: symlink d1/d59/l156 0 2024-04-26T20:19:03.208 INFO:tasks.workunit.client.0.smithi016.stdout:9/991: dread - d1/d2/d20/d49/f9f zero size 2024-04-26T20:19:03.209 INFO:tasks.workunit.client.0.smithi016.stdout:3/688: mknod d3/d9/d2d/d4f/cd8 0 2024-04-26T20:19:03.210 INFO:tasks.workunit.client.0.smithi016.stdout:9/992: creat d1/d2/d20/d49/d77/d2a/d75/d85/d9b/f157 x:0 0 0 2024-04-26T20:19:03.211 INFO:tasks.workunit.client.0.smithi016.stdout:3/689: creat d3/d9/fd9 x:0 0 0 2024-04-26T20:19:03.211 INFO:tasks.workunit.client.0.smithi016.stdout:3/690: dread - d3/df/d25/d2a/d4a/f77 zero size 2024-04-26T20:19:03.211 INFO:tasks.workunit.client.0.smithi016.stdout:9/993: creat d1/d2/d20/d49/d77/d2a/dfd/f158 x:0 0 0 2024-04-26T20:19:03.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.255+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63a80c8800 con 0x7f63a80c8a20 2024-04-26T20:19:03.259 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:03.259 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:00.848149+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:19:03.259 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 21 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.255+0000 7f63a2000640 1 -- 172.21.15.16:0/2068677478 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6046 (secure 0 0 0) 0x7f63a40f5ce0 con 0x7f63a80c8a20 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f638c0683b0 msgr2=0x7f638c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f638c0683b0 0x7f638c06a870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f639c0011f0 tx=0x7f639c001b20 comp rx=0 tx=0).stop 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 msgr2=0x7f63a8157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a8157ec0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f63a401f880 tx=0x7f63a401df70 comp rx=0 tx=0).stop 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 shutdown_connections 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f638c0683b0 0x7f638c06a870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a80c8a20 0x7f63a8157ec0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a80c7250 0x7f63a8157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:03.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 --2- 172.21.15.16:0/2068677478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80c68c0 0x7f63a816a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:03.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 >> 172.21.15.16:0/2068677478 conn(0x7f63a806c380 msgr2=0x7f63a806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:03.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 shutdown_connections 2024-04-26T20:19:03.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:03.259+0000 7f63b0800640 1 -- 172.21.15.16:0/2068677478 wait complete. 2024-04-26T20:19:03.265 INFO:tasks.workunit.client.0.smithi016.stdout:3/691: getdents d3/d9/d18/d59 0 2024-04-26T20:19:03.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/692: write d3/d9/f3d [1135259,70092] 0 2024-04-26T20:19:03.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/693: write d3/df/d25/f28 [263954,80860] 0 2024-04-26T20:19:03.266 INFO:tasks.workunit.client.0.smithi016.stdout:3/694: fsync d3/f60 0 2024-04-26T20:19:03.284 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 21, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 21, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4276": { "addr": "172.21.15.16:6836/1882507975", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6834", "nonce": 1882507975, "type": "v2" }, { "addr": "172.21.15.16:6836", "nonce": 1882507975, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4276, "incarnation": 9, "join_fscid": -1, "name": "c", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4279": { "addr": "172.21.15.16:6837/1962586875", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6835", "nonce": 1962586875, "type": "v2" }, { "addr": "172.21.15.16:6837", "nonce": 1962586875, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4279, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 5 }, "gid_5127": { "addr": "172.21.15.16:6833/1748916109", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6832", "nonce": 1748916109, "type": "v2" }, { "addr": "172.21.15.16:6833", "nonce": 1748916109, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5127, "incarnation": 21, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:19:00.848149+0000", "qdb_cluster": [ 4276, 4279 ], "qdb_leader": 4279, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4279, "mds_1": 4276, "mds_2": 5127 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:19:03.321 INFO:tasks.workunit.client.0.smithi016.stdout:3/695: rmdir d3/d9 39 2024-04-26T20:19:03.404 INFO:tasks.workunit.client.0.smithi016.stdout:1/840: sync 2024-04-26T20:19:03.529 INFO:tasks.workunit.client.0.smithi016.stdout:4/738: sync 2024-04-26T20:19:03.531 INFO:tasks.workunit.client.0.smithi016.stdout:4/739: mkdir d0/dd/dc9/de4/df0 0 2024-04-26T20:19:03.546 INFO:tasks.workunit.client.0.smithi016.stdout:4/740: dread d0/f46 [0,4194304] 0 2024-04-26T20:19:03.602 INFO:tasks.workunit.client.0.smithi016.stdout:1/841: dwrite d3/d5/f33 [0,4194304] 0 2024-04-26T20:19:03.679 INFO:tasks.workunit.client.0.smithi016.stdout:1/842: chown d3/d57/lb7 0 1 2024-04-26T20:19:03.680 INFO:tasks.workunit.client.0.smithi016.stdout:1/843: rename d3 to d3/d5/d6/d5a/dbf/de2/d116 22 2024-04-26T20:19:03.680 INFO:tasks.workunit.client.0.smithi016.stdout:1/844: truncate d3/d5/d6/d9/d2a/f76 4721554 0 2024-04-26T20:19:03.680 INFO:tasks.workunit.client.0.smithi016.stdout:1/845: rmdir d3/d5/da/d66/de7 39 2024-04-26T20:19:03.680 INFO:tasks.workunit.client.0.smithi016.stdout:1/846: read - d3/d5/da/d66/d8c/d84/d96/fba zero size 2024-04-26T20:19:03.681 INFO:tasks.workunit.client.0.smithi016.stdout:1/847: write d3/d5/d6/d9/f71 [13454242,21853] 0 2024-04-26T20:19:03.739 INFO:tasks.workunit.client.0.smithi016.stdout:1/848: creat d3/d5/da/d66/de7/f117 x:0 0 0 2024-04-26T20:19:03.739 INFO:tasks.workunit.client.0.smithi016.stdout:1/849: fsync d3/d5/d6/d5a/fb8 0 2024-04-26T20:19:03.739 INFO:tasks.workunit.client.0.smithi016.stdout:1/850: chown d3/d5/f43 1747171171 1 2024-04-26T20:19:03.742 INFO:tasks.workunit.client.0.smithi016.stdout:1/851: write d3/d5/da/d66/d8c/d84/d86/fc8 [82016,33766] 0 2024-04-26T20:19:03.743 INFO:tasks.workunit.client.0.smithi016.stdout:1/852: write d3/d57/f35 [432684,128225] 0 2024-04-26T20:19:03.743 INFO:tasks.workunit.client.0.smithi016.stdout:1/853: fdatasync d3/d5/da/f103 0 2024-04-26T20:19:03.743 INFO:tasks.workunit.client.0.smithi016.stdout:1/854: truncate d3/d5/da/d66/d8c/f6a 4607577 0 2024-04-26T20:19:03.743 INFO:tasks.workunit.client.0.smithi016.stdout:1/855: write d3/f107 [671321,106324] 0 2024-04-26T20:19:03.743 INFO:tasks.workunit.client.0.smithi016.stdout:1/856: chown d3/d5/d6/d5a/f90 22860 1 2024-04-26T20:19:03.743 INFO:tasks.workunit.client.0.smithi016.stdout:1/857: fdatasync d3/d5/f4f 0 2024-04-26T20:19:03.743 INFO:tasks.workunit.client.0.smithi016.stdout:1/858: chown d3/d5/cb4 16270543 1 2024-04-26T20:19:03.745 INFO:tasks.workunit.client.0.smithi016.stdout:1/859: unlink d3/d5/da/d66/d8c/l10e 0 2024-04-26T20:19:03.759 INFO:tasks.workunit.client.0.smithi016.stdout:1/860: dread d3/d5/d6/d9/f73 [0,4194304] 0 2024-04-26T20:19:03.765 INFO:tasks.workunit.client.0.smithi016.stdout:7/758: sync 2024-04-26T20:19:03.767 INFO:tasks.workunit.client.0.smithi016.stdout:7/759: unlink d0/dd5/d34/d25/f26 0 2024-04-26T20:19:03.767 INFO:tasks.workunit.client.0.smithi016.stdout:7/760: dread - d0/dd5/d34/d25/d3f/d6d/dc2/fe3 zero size 2024-04-26T20:19:03.767 INFO:tasks.workunit.client.0.smithi016.stdout:1/861: dread d3/d5/da/f21 [0,4194304] 0 2024-04-26T20:19:03.780 INFO:tasks.workunit.client.0.smithi016.stdout:7/761: dread d0/dd5/d34/d25/d50/fa8 [0,4194304] 0 2024-04-26T20:19:03.783 INFO:tasks.workunit.client.0.smithi016.stdout:7/762: rename d0/f31 to d0/dd5/d46/fe5 0 2024-04-26T20:19:03.783 INFO:tasks.workunit.client.0.smithi016.stdout:7/763: dread - d0/dd5/d34/d25/d3f/d6d/d87/da3/fd8 zero size 2024-04-26T20:19:03.784 INFO:tasks.workunit.client.0.smithi016.stdout:7/764: mkdir d0/d67/de6 0 2024-04-26T20:19:03.784 INFO:tasks.workunit.client.0.smithi016.stdout:7/765: chown d0/dd5/d34/d25/d50/f54 22023 1 2024-04-26T20:19:03.788 INFO:tasks.workunit.client.0.smithi016.stdout:7/766: write d0/dd5/d34/d25/d3f/d6d/d87/f7c [610095,4301] 0 2024-04-26T20:19:03.800 INFO:tasks.workunit.client.0.smithi016.stdout:1/862: dwrite d3/d5/d6/d5a/f4a [0,4194304] 0 2024-04-26T20:19:03.800 INFO:tasks.workunit.client.0.smithi016.stdout:1/863: write d3/d5/d8d/dab/ffe [513168,44914] 0 2024-04-26T20:19:03.800 INFO:tasks.workunit.client.0.smithi016.stdout:1/864: read - d3/d5/d6/d5a/f99 zero size 2024-04-26T20:19:03.800 INFO:tasks.workunit.client.0.smithi016.stdout:1/865: readlink d3/d5/da/d66/d8c/d84/d86/lea 0 2024-04-26T20:19:03.814 INFO:tasks.workunit.client.0.smithi016.stdout:1/866: write d3/d5/da/fdf [3997719,120246] 0 2024-04-26T20:19:03.815 INFO:tasks.workunit.client.0.smithi016.stdout:1/867: mknod d3/d5/d6/d50/d79/da7/c118 0 2024-04-26T20:19:03.819 INFO:tasks.workunit.client.0.smithi016.stdout:1/868: dread d3/d57/f6d [0,4194304] 0 2024-04-26T20:19:03.821 INFO:tasks.workunit.client.0.smithi016.stdout:1/869: mknod d3/d5/d6/d5a/dbf/de2/c119 0 2024-04-26T20:19:03.822 INFO:tasks.workunit.client.0.smithi016.stdout:1/870: creat d3/d5/d6/d5a/dbf/de2/f11a x:0 0 0 2024-04-26T20:19:03.823 INFO:tasks.workunit.client.0.smithi016.stdout:1/871: creat d3/d5/da/f11b x:0 0 0 2024-04-26T20:19:03.825 INFO:tasks.workunit.client.0.smithi016.stdout:1/872: mkdir d3/d5/d6/d9/d9e/de6/d11c 0 2024-04-26T20:19:03.826 INFO:tasks.workunit.client.0.smithi016.stdout:1/873: creat d3/d5/d6/d9/d2a/f11d x:0 0 0 2024-04-26T20:19:03.828 INFO:tasks.workunit.client.0.smithi016.stdout:1/874: mknod d3/d5/d6/c11e 0 2024-04-26T20:19:03.829 INFO:tasks.workunit.client.0.smithi016.stdout:1/875: creat d3/d5/da/d66/de7/f11f x:0 0 0 2024-04-26T20:19:03.834 INFO:tasks.workunit.client.0.smithi016.stdout:7/767: dwrite d0/d83/f60 [0,4194304] 0 2024-04-26T20:19:03.853 INFO:tasks.workunit.client.0.smithi016.stdout:4/741: sync 2024-04-26T20:19:03.853 INFO:tasks.workunit.client.0.smithi016.stdout:2/887: sync 2024-04-26T20:19:03.853 INFO:tasks.workunit.client.0.smithi016.stdout:0/776: sync 2024-04-26T20:19:03.853 INFO:tasks.workunit.client.0.smithi016.stdout:6/809: sync 2024-04-26T20:19:03.853 INFO:tasks.workunit.client.0.smithi016.stdout:8/843: sync 2024-04-26T20:19:03.853 INFO:tasks.workunit.client.0.smithi016.stdout:6/810: read d1/d21/d26/d25/f35 [450001,60003] 0 2024-04-26T20:19:03.853 INFO:tasks.workunit.client.0.smithi016.stdout:6/811: fsync d1/f4 0 2024-04-26T20:19:03.854 INFO:tasks.workunit.client.0.smithi016.stdout:9/994: sync 2024-04-26T20:19:03.854 INFO:tasks.workunit.client.0.smithi016.stdout:2/888: mknod d1d/d20/d22/d39/c130 0 2024-04-26T20:19:03.855 INFO:tasks.workunit.client.0.smithi016.stdout:2/889: chown d1d/d2a/lcb 5303330 1 2024-04-26T20:19:03.855 INFO:tasks.workunit.client.0.smithi016.stdout:2/890: fsync d1d/d2a/d3d/fda 0 2024-04-26T20:19:03.855 INFO:tasks.workunit.client.0.smithi016.stdout:0/777: getdents d2/dc/d45 0 2024-04-26T20:19:03.856 INFO:tasks.workunit.client.0.smithi016.stdout:3/696: sync 2024-04-26T20:19:03.856 INFO:tasks.workunit.client.0.smithi016.stdout:3/697: readlink d3/d9/lb2 0 2024-04-26T20:19:03.858 INFO:tasks.workunit.client.0.smithi016.stdout:6/812: link d1/f13 d1/d21/d26/d1c/d2e/d53/f113 0 2024-04-26T20:19:03.860 INFO:tasks.workunit.client.0.smithi016.stdout:9/995: link d1/d2/d20/dde/f154 d1/d2/d20/f159 0 2024-04-26T20:19:03.860 INFO:tasks.workunit.client.0.smithi016.stdout:2/891: symlink d1d/d27/d2d/d6b/d108/d114/dea/l131 0 2024-04-26T20:19:03.861 INFO:tasks.workunit.client.0.smithi016.stdout:0/778: rmdir d2/d40/d61 39 2024-04-26T20:19:03.862 INFO:tasks.workunit.client.0.smithi016.stdout:6/813: creat d1/d21/d26/d1c/d5d/def/d76/f114 x:0 0 0 2024-04-26T20:19:03.863 INFO:tasks.workunit.client.0.smithi016.stdout:0/779: creat d2/d8/f102 x:0 0 0 2024-04-26T20:19:03.864 INFO:tasks.workunit.client.0.smithi016.stdout:0/780: creat d2/dc/d18/dd7/df5/f103 x:0 0 0 2024-04-26T20:19:03.866 INFO:tasks.workunit.client.0.smithi016.stdout:0/781: unlink d2/cd5 0 2024-04-26T20:19:03.866 INFO:tasks.workunit.client.0.smithi016.stdout:0/782: chown d2/d20 2526313 1 2024-04-26T20:19:03.867 INFO:tasks.workunit.client.0.smithi016.stdout:0/783: mknod d2/d20/d41/d87/c104 0 2024-04-26T20:19:03.867 INFO:tasks.workunit.client.0.smithi016.stdout:0/784: stat d2/d20/f2f 0 2024-04-26T20:19:03.868 INFO:tasks.workunit.client.0.smithi016.stdout:9/996: dread d1/f41 [0,4194304] 0 2024-04-26T20:19:03.870 INFO:tasks.workunit.client.0.smithi016.stdout:9/997: mkdir d1/d59/d52/d8c/df1/d15a 0 2024-04-26T20:19:03.872 INFO:tasks.workunit.client.0.smithi016.stdout:0/785: symlink d2/d8/d3b/l105 0 2024-04-26T20:19:03.872 INFO:tasks.workunit.client.0.smithi016.stdout:0/786: write d2/d8/f36 [1362698,67015] 0 2024-04-26T20:19:03.872 INFO:tasks.workunit.client.0.smithi016.stdout:0/787: stat d2/d8/d37/d70/lb4 0 2024-04-26T20:19:03.872 INFO:tasks.workunit.client.0.smithi016.stdout:9/998: truncate d1/d2/d20/d49/d77/d2a/d75/d85/d9b/ff5 3152435 0 2024-04-26T20:19:03.874 INFO:tasks.workunit.client.0.smithi016.stdout:0/788: mknod d2/d20/d41/d87/d9d/c106 0 2024-04-26T20:19:03.874 INFO:tasks.workunit.client.0.smithi016.stdout:0/789: truncate d2/dc/d1e/f101 331736 0 2024-04-26T20:19:03.874 INFO:tasks.workunit.client.0.smithi016.stdout:2/892: read d1d/d27/d49/f56 [29897,7096] 0 2024-04-26T20:19:03.875 INFO:tasks.workunit.client.0.smithi016.stdout:4/742: dread d0/d1e/d4e/d52/d88/f5f [0,4194304] 0 2024-04-26T20:19:03.875 INFO:tasks.workunit.client.0.smithi016.stdout:0/790: chown d2/dc/l47 11274034 1 2024-04-26T20:19:03.878 INFO:tasks.workunit.client.0.smithi016.stdout:2/893: rename d1d/d20/f76 to d1d/d20/d22/d39/f132 0 2024-04-26T20:19:03.882 INFO:tasks.workunit.client.0.smithi016.stdout:4/743: rename d0/d1e/d30/c40 to d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/cf1 0 2024-04-26T20:19:03.911 INFO:tasks.workunit.client.0.smithi016.stdout:8/844: dwrite d9/d2f/fbb [0,4194304] 0 2024-04-26T20:19:03.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/768: write d0/d67/fb6 [1567018,69118] 0 2024-04-26T20:19:03.916 INFO:tasks.workunit.client.0.smithi016.stdout:7/769: dread - d0/dd5/d34/d25/d3f/d6d/dc2/fe3 zero size 2024-04-26T20:19:03.921 INFO:tasks.workunit.client.0.smithi016.stdout:7/770: creat d0/dd5/d34/d25/d3f/d6d/d79/fe7 x:0 0 0 2024-04-26T20:19:03.922 INFO:tasks.workunit.client.0.smithi016.stdout:7/771: fdatasync d0/dd5/d34/d25/d3f/d6d/d87/f71 0 2024-04-26T20:19:03.924 INFO:tasks.workunit.client.0.smithi016.stdout:7/772: chown d0/dd5/c1a 1348912219 1 2024-04-26T20:19:03.929 INFO:tasks.workunit.client.0.smithi016.stdout:9/999: dwrite d1/d2/d20/dde/ffa [0,4194304] 0 2024-04-26T20:19:03.943 INFO:tasks.workunit.client.0.smithi016.stdout:4/744: dwrite d0/dd/d66/d6f/fa5 [0,4194304] 0 2024-04-26T20:19:03.943 INFO:tasks.workunit.client.0.smithi016.stdout:4/745: dread - d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/fd8 zero size 2024-04-26T20:19:03.943 INFO:tasks.workunit.client.0.smithi016.stdout:4/746: chown d0/d96/dbf 50705 1 2024-04-26T20:19:03.947 INFO:tasks.workunit.client.0.smithi016.stdout:4/747: unlink d0/dd/d19/d1f/d7b/fc7 0 2024-04-26T20:19:03.950 INFO:tasks.workunit.client.0.smithi016.stdout:2/894: dwrite d1d/d2a/f4a [0,4194304] 0 2024-04-26T20:19:03.955 INFO:tasks.workunit.client.0.smithi016.stdout:2/895: creat d1d/d20/d22/d98/d115/d11d/f133 x:0 0 0 2024-04-26T20:19:03.956 INFO:tasks.workunit.client.0.smithi016.stdout:2/896: creat d1d/d27/d2d/d6b/d7e/dd8/d122/f134 x:0 0 0 2024-04-26T20:19:03.959 INFO:tasks.workunit.client.0.smithi016.stdout:2/897: mknod d1d/d20/d22/d39/ddd/c135 0 2024-04-26T20:19:03.963 INFO:tasks.workunit.client.0.smithi016.stdout:2/898: symlink d1d/d2a/l136 0 2024-04-26T20:19:03.965 INFO:tasks.workunit.client.0.smithi016.stdout:2/899: link d1d/d27/d2d/d6b/d7e/ddc/f127 d1d/d27/f137 0 2024-04-26T20:19:03.965 INFO:tasks.workunit.client.0.smithi016.stdout:2/900: dread - d1d/d20/d22/d89/f10f zero size 2024-04-26T20:19:03.972 INFO:tasks.workunit.client.0.smithi016.stdout:3/698: dwrite d3/d9/d2d/fa5 [0,4194304] 0 2024-04-26T20:19:03.972 INFO:tasks.workunit.client.0.smithi016.stdout:3/699: chown d3/d9/d18/d82/dc6 13 1 2024-04-26T20:19:03.972 INFO:tasks.workunit.client.0.smithi016.stdout:2/901: symlink d1d/d2a/d3d/dd9/l138 0 2024-04-26T20:19:03.972 INFO:tasks.workunit.client.0.smithi016.stdout:2/902: fsync d1d/d2a/f4a 0 2024-04-26T20:19:03.972 INFO:tasks.workunit.client.0.smithi016.stdout:2/903: rename d1d/d27/d2d/d6b/d108/d114/dc7/dce/fd3 to d1d/d2a/d3d/dd9/d103/f139 0 2024-04-26T20:19:03.972 INFO:tasks.workunit.client.0.smithi016.stdout:4/748: write d0/dd/d19/f8a [3743034,40369] 0 2024-04-26T20:19:03.973 INFO:tasks.workunit.client.0.smithi016.stdout:2/904: write d1d/d20/d22/f117 [636584,82470] 0 2024-04-26T20:19:03.976 INFO:tasks.workunit.client.0.smithi016.stdout:4/749: rename d0/d1e/d30/l32 to d0/d1e/d4e/d52/d88/d43/d5a/lf2 0 2024-04-26T20:19:03.976 INFO:tasks.workunit.client.0.smithi016.stdout:2/905: dread d1d/d27/d2d/d6b/d108/d114/dea/ffd [0,4194304] 0 2024-04-26T20:19:03.991 INFO:tasks.workunit.client.0.smithi016.stdout:4/750: dread d0/dd/d19/f38 [0,4194304] 0 2024-04-26T20:19:03.994 INFO:tasks.workunit.client.0.smithi016.stdout:4/751: dread d0/dd/d66/d6f/fa3 [0,4194304] 0 2024-04-26T20:19:03.994 INFO:tasks.workunit.client.0.smithi016.stdout:4/752: write d0/d96/ddc/fec [974905,75893] 0 2024-04-26T20:19:03.995 INFO:tasks.workunit.client.0.smithi016.stdout:4/753: creat d0/d1e/d4e/ff3 x:0 0 0 2024-04-26T20:19:03.996 INFO:tasks.workunit.client.0.smithi016.stdout:4/754: getdents d0/d1e/d4e/d52/d88/d43/d9c 0 2024-04-26T20:19:03.997 INFO:tasks.workunit.client.0.smithi016.stdout:4/755: write d0/d1e/fcf [78157,61469] 0 2024-04-26T20:19:03.997 INFO:tasks.workunit.client.0.smithi016.stdout:4/756: getdents d0/dd/d1b/dbc 0 2024-04-26T20:19:03.997 INFO:tasks.workunit.client.0.smithi016.stdout:4/757: write d0/dd/d1b/dbc/dc5/dd7/feb [152387,96763] 0 2024-04-26T20:19:03.999 INFO:tasks.workunit.client.0.smithi016.stdout:4/758: unlink d0/d1e/d4e/d52/d88/l70 0 2024-04-26T20:19:04.001 INFO:tasks.workunit.client.0.smithi016.stdout:4/759: link d0/d96/dbf/fc4 d0/dd/dc9/de4/df0/ff4 0 2024-04-26T20:19:04.010 INFO:tasks.workunit.client.0.smithi016.stdout:4/760: rename d0/dd/f6d to d0/d1e/d4e/d52/d54/dad/ff5 0 2024-04-26T20:19:04.012 INFO:tasks.workunit.client.0.smithi016.stdout:4/761: link d0/d1e/d4e/d52/d54/d87/fab d0/dd/dc9/ff6 0 2024-04-26T20:19:04.013 INFO:tasks.workunit.client.0.smithi016.stdout:2/906: dwrite d1d/d20/d22/fe4 [0,4194304] 0 2024-04-26T20:19:04.014 INFO:tasks.workunit.client.0.smithi016.stdout:0/791: dwrite d2/d20/fad [4194304,4194304] 0 2024-04-26T20:19:04.014 INFO:tasks.workunit.client.0.smithi016.stdout:6/814: dwrite d1/d21/d26/d1c/d5d/def/d76/f9a [0,4194304] 0 2024-04-26T20:19:04.015 INFO:tasks.workunit.client.0.smithi016.stdout:7/773: dwrite d0/d51/fd1 [0,4194304] 0 2024-04-26T20:19:04.049 INFO:tasks.workunit.client.0.smithi016.stdout:7/774: creat d0/fe8 x:0 0 0 2024-04-26T20:19:04.050 INFO:tasks.workunit.client.0.smithi016.stdout:2/907: dwrite d1d/d20/d22/f8f [0,4194304] 0 2024-04-26T20:19:04.050 INFO:tasks.workunit.client.0.smithi016.stdout:2/908: write d1d/d20/d22/d29/f128 [1017812,96749] 0 2024-04-26T20:19:04.059 INFO:tasks.workunit.client.0.smithi016.stdout:3/700: dwrite d3/df/d20/d41/f4e [4194304,4194304] 0 2024-04-26T20:19:04.072 INFO:tasks.workunit.client.0.smithi016.stdout:0/792: dwrite d2/dc/f44 [0,4194304] 0 2024-04-26T20:19:04.302 INFO:tasks.workunit.client.0.smithi016.stdout:2/909: creat d1d/d20/d22/d39/d3e/f13a x:0 0 0 2024-04-26T20:19:04.302 INFO:tasks.workunit.client.0.smithi016.stdout:2/910: fdatasync d1d/d27/f50 0 2024-04-26T20:19:04.303 INFO:tasks.workunit.client.0.smithi016.stdout:3/701: link d3/d9/f65 d3/d70/d8b/fda 0 2024-04-26T20:19:04.304 INFO:tasks.workunit.client.0.smithi016.stdout:3/702: readlink d3/l49 0 2024-04-26T20:19:04.304 INFO:tasks.workunit.client.0.smithi016.stdout:0/793: mkdir d2/dc/d1e/d107 0 2024-04-26T20:19:04.306 INFO:tasks.workunit.client.0.smithi016.stdout:0/794: dread d2/dc/d1e/f101 [0,4194304] 0 2024-04-26T20:19:04.308 INFO:tasks.workunit.client.0.smithi016.stdout:7/775: truncate d0/dd5/d4b/f4d 2772634 0 2024-04-26T20:19:04.309 INFO:tasks.workunit.client.0.smithi016.stdout:2/911: unlink d1d/d20/d22/fc2 0 2024-04-26T20:19:04.309 INFO:tasks.workunit.client.0.smithi016.stdout:2/912: fsync d1d/d2a/d3d/fd0 0 2024-04-26T20:19:04.310 INFO:tasks.workunit.client.0.smithi016.stdout:3/703: creat d3/d70/d8b/fdb x:0 0 0 2024-04-26T20:19:04.311 INFO:tasks.workunit.client.0.smithi016.stdout:0/795: getdents d2/dc/d1e/dc5 0 2024-04-26T20:19:04.312 INFO:tasks.workunit.client.0.smithi016.stdout:2/913: mknod d1d/d27/d2d/d6b/d108/d114/c13b 0 2024-04-26T20:19:04.313 INFO:tasks.workunit.client.0.smithi016.stdout:3/704: truncate d3/df/d25/d2a/d69/f92 582280 0 2024-04-26T20:19:04.317 INFO:tasks.workunit.client.0.smithi016.stdout:7/776: dread d0/d67/fb6 [0,4194304] 0 2024-04-26T20:19:04.318 INFO:tasks.workunit.client.0.smithi016.stdout:2/914: rename d1d/d27/d2d/d6b/d108/d114/f11c to d1d/d27/d2d/d6b/d7e/dd8/f13c 0 2024-04-26T20:19:04.318 INFO:tasks.workunit.client.0.smithi016.stdout:8/845: sync 2024-04-26T20:19:04.318 INFO:tasks.workunit.client.0.smithi016.stdout:1/876: sync 2024-04-26T20:19:04.321 INFO:tasks.workunit.client.0.smithi016.stdout:3/705: mkdir d3/d70/d8b/ddc 0 2024-04-26T20:19:04.321 INFO:tasks.workunit.client.0.smithi016.stdout:0/796: mknod d2/dc/de3/c108 0 2024-04-26T20:19:04.324 INFO:tasks.workunit.client.0.smithi016.stdout:2/915: truncate d1d/d2a/d3d/fd6 1922494 0 2024-04-26T20:19:04.325 INFO:tasks.workunit.client.0.smithi016.stdout:3/706: read d3/df/f13 [411060,81541] 0 2024-04-26T20:19:04.326 INFO:tasks.workunit.client.0.smithi016.stdout:1/877: unlink d3/d5/d6/d50/d79/lec 0 2024-04-26T20:19:04.330 INFO:tasks.workunit.client.0.smithi016.stdout:8/846: rename d9/d23/d26/c47 to d9/d19/d45/d9e/d50/d109/d10c/c122 0 2024-04-26T20:19:04.332 INFO:tasks.workunit.client.0.smithi016.stdout:6/815: sync 2024-04-26T20:19:04.332 INFO:tasks.workunit.client.0.smithi016.stdout:4/762: sync 2024-04-26T20:19:04.332 INFO:tasks.workunit.client.0.smithi016.stdout:0/797: link d2/d40/d61/fb1 d2/d8/d37/d70/f109 0 2024-04-26T20:19:04.333 INFO:tasks.workunit.client.0.smithi016.stdout:2/916: link d1d/d27/d2d/d6b/d7e/lb6 d1d/d27/d2d/d6b/d108/d114/dc7/l13d 0 2024-04-26T20:19:04.334 INFO:tasks.workunit.client.0.smithi016.stdout:0/798: dread d2/dc/d1e/f3a [0,4194304] 0 2024-04-26T20:19:04.336 INFO:tasks.workunit.client.0.smithi016.stdout:3/707: unlink d3/df/d20/d41/fb7 0 2024-04-26T20:19:04.336 INFO:tasks.workunit.client.0.smithi016.stdout:3/708: write d3/df/d25/f53 [544299,102411] 0 2024-04-26T20:19:04.336 INFO:tasks.workunit.client.0.smithi016.stdout:1/878: symlink d3/d5/da/d66/d8c/d84/d86/l120 0 2024-04-26T20:19:04.336 INFO:tasks.workunit.client.0.smithi016.stdout:6/816: getdents d1/d21/d26/d1c/d5d/d88 0 2024-04-26T20:19:04.337 INFO:tasks.workunit.client.0.smithi016.stdout:2/917: truncate d1d/d20/d22/f8f 2915726 0 2024-04-26T20:19:04.348 INFO:tasks.workunit.client.0.smithi016.stdout:0/799: getdents d2/dc 0 2024-04-26T20:19:04.348 INFO:tasks.workunit.client.0.smithi016.stdout:1/879: getdents d3/d5/da/d66 0 2024-04-26T20:19:04.348 INFO:tasks.workunit.client.0.smithi016.stdout:3/709: link d3/df/d25/f28 d3/fdd 0 2024-04-26T20:19:04.348 INFO:tasks.workunit.client.0.smithi016.stdout:3/710: truncate d3/df/d25/d2a/d4a/fca 489441 0 2024-04-26T20:19:04.348 INFO:tasks.workunit.client.0.smithi016.stdout:3/711: dread - d3/df/d20/d61/d76/fcf zero size 2024-04-26T20:19:04.348 INFO:tasks.workunit.client.0.smithi016.stdout:3/712: fdatasync d3/df/d25/d32/f95 0 2024-04-26T20:19:04.348 INFO:tasks.workunit.client.0.smithi016.stdout:2/918: creat d1d/d27/d2d/d6b/d108/f13e x:0 0 0 2024-04-26T20:19:04.349 INFO:tasks.workunit.client.0.smithi016.stdout:1/880: symlink d3/d5/d6/d50/l121 0 2024-04-26T20:19:04.349 INFO:tasks.workunit.client.0.smithi016.stdout:1/881: chown d3/d5/d6/d5a/dbf/de2/c119 53410252 1 2024-04-26T20:19:04.349 INFO:tasks.workunit.client.0.smithi016.stdout:1/882: dread - d3/d5/d6/d9/d2a/fd8 zero size 2024-04-26T20:19:04.349 INFO:tasks.workunit.client.0.smithi016.stdout:3/713: creat d3/df/d20/d61/d76/fde x:0 0 0 2024-04-26T20:19:04.349 INFO:tasks.workunit.client.0.smithi016.stdout:1/883: mknod d3/d5/d6/d9/c122 0 2024-04-26T20:19:04.349 INFO:tasks.workunit.client.0.smithi016.stdout:3/714: creat d3/df/d25/fdf x:0 0 0 2024-04-26T20:19:04.349 INFO:tasks.workunit.client.0.smithi016.stdout:3/715: readlink d3/df/d25/d2a/d69/l6a 0 2024-04-26T20:19:04.350 INFO:tasks.workunit.client.0.smithi016.stdout:7/777: read d0/d67/f90 [1493417,46949] 0 2024-04-26T20:19:04.350 INFO:tasks.workunit.client.0.smithi016.stdout:7/778: dread - d0/dd5/d34/f9f zero size 2024-04-26T20:19:04.350 INFO:tasks.workunit.client.0.smithi016.stdout:3/716: creat d3/df/d25/dc8/fe0 x:0 0 0 2024-04-26T20:19:04.360 INFO:tasks.workunit.client.0.smithi016.stdout:4/763: dread d0/d1e/d4e/d52/d88/d43/f56 [0,4194304] 0 2024-04-26T20:19:04.360 INFO:tasks.workunit.client.0.smithi016.stdout:3/717: mkdir d3/df/d25/dc8/de1 0 2024-04-26T20:19:04.360 INFO:tasks.workunit.client.0.smithi016.stdout:7/779: truncate d0/dd5/d95/fc9 1936772 0 2024-04-26T20:19:04.364 INFO:tasks.workunit.client.0.smithi016.stdout:4/764: creat d0/dd/d66/ff7 x:0 0 0 2024-04-26T20:19:04.368 INFO:tasks.workunit.client.0.smithi016.stdout:3/718: mkdir d3/df/d20/db0/dc2/de2 0 2024-04-26T20:19:04.373 INFO:tasks.workunit.client.0.smithi016.stdout:7/780: mknod d0/d51/dba/ce9 0 2024-04-26T20:19:04.376 INFO:tasks.workunit.client.0.smithi016.stdout:4/765: creat d0/d1e/d4e/d52/d88/d43/d5a/dd1/ff8 x:0 0 0 2024-04-26T20:19:04.387 INFO:tasks.workunit.client.0.smithi016.stdout:7/781: write d0/dd5/d34/d25/d3f/d6d/d79/fc4 [645656,43630] 0 2024-04-26T20:19:04.387 INFO:tasks.workunit.client.0.smithi016.stdout:7/782: chown d0/dd5/d34/d25/ld2 1550 1 2024-04-26T20:19:04.390 INFO:tasks.workunit.client.0.smithi016.stdout:7/783: link d0/dd5/d34/d25/d3f/f5f d0/dd5/d34/d25/d3f/d6d/d87/da3/fea 0 2024-04-26T20:19:04.390 INFO:tasks.workunit.client.0.smithi016.stdout:7/784: chown d0/dd5/d34/d25/d3f/d6d/f77 52704 1 2024-04-26T20:19:04.391 INFO:tasks.workunit.client.0.smithi016.stdout:7/785: mknod d0/dd5/d34/d25/d3f/d6d/d87/da3/ceb 0 2024-04-26T20:19:04.391 INFO:tasks.workunit.client.0.smithi016.stdout:7/786: write d0/f14 [9049530,83203] 0 2024-04-26T20:19:04.392 INFO:tasks.workunit.client.0.smithi016.stdout:7/787: write d0/dd5/d88/db3/fd0 [583594,61777] 0 2024-04-26T20:19:04.393 INFO:tasks.workunit.client.0.smithi016.stdout:7/788: rename d0/dd5/d6/d73 to d0/dd5/d34/dec 0 2024-04-26T20:19:04.397 INFO:tasks.workunit.client.0.smithi016.stdout:0/800: dwrite d2/d8/f36 [0,4194304] 0 2024-04-26T20:19:04.397 INFO:tasks.workunit.client.0.smithi016.stdout:0/801: readlink d2/l19 0 2024-04-26T20:19:04.397 INFO:tasks.workunit.client.0.smithi016.stdout:0/802: fdatasync d2/dc/d18/d24/fb3 0 2024-04-26T20:19:04.398 INFO:tasks.workunit.client.0.smithi016.stdout:3/719: dread d3/df/d25/d32/d3f/f8c [0,4194304] 0 2024-04-26T20:19:04.398 INFO:tasks.workunit.client.0.smithi016.stdout:3/720: stat d3/d70/d8b/fda 0 2024-04-26T20:19:04.407 INFO:tasks.workunit.client.0.smithi016.stdout:4/766: write d0/dd/d66/d6f/fa5 [1737114,130185] 0 2024-04-26T20:19:04.408 INFO:tasks.workunit.client.0.smithi016.stdout:0/803: rename d2/d20/d41/d87/d9d/dda/dec to d2/d8/d10a 0 2024-04-26T20:19:04.409 INFO:tasks.workunit.client.0.smithi016.stdout:3/721: creat d3/d9/d2d/fe3 x:0 0 0 2024-04-26T20:19:04.418 INFO:tasks.workunit.client.0.smithi016.stdout:4/767: mkdir d0/d1e/d4e/d52/d88/df9 0 2024-04-26T20:19:04.424 INFO:tasks.workunit.client.0.smithi016.stdout:0/804: rename d2/d8/d37/cdf to d2/d8/c10b 0 2024-04-26T20:19:04.424 INFO:tasks.workunit.client.0.smithi016.stdout:0/805: fsync d2/dc/d1e/f3a 0 2024-04-26T20:19:04.427 INFO:tasks.workunit.client.0.smithi016.stdout:4/768: rename d0/dd/d66 to d0/dd/d1b/dbc/dfa 0 2024-04-26T20:19:04.427 INFO:tasks.workunit.client.0.smithi016.stdout:4/769: write d0/d1e/d4e/d52/d54/fe3 [91522,42327] 0 2024-04-26T20:19:04.430 INFO:tasks.workunit.client.0.smithi016.stdout:4/770: creat d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/ffb x:0 0 0 2024-04-26T20:19:04.445 INFO:tasks.workunit.client.0.smithi016.stdout:4/771: dread d0/dd/d1b/f27 [0,4194304] 0 2024-04-26T20:19:04.449 INFO:tasks.workunit.client.0.smithi016.stdout:4/772: link d0/d1e/d4e/d52/d88/d43/d5a/c83 d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/cfc 0 2024-04-26T20:19:04.454 INFO:tasks.workunit.client.0.smithi016.stdout:7/789: dwrite d0/f42 [4194304,4194304] 0 2024-04-26T20:19:04.456 INFO:tasks.workunit.client.0.smithi016.stdout:7/790: creat d0/dd5/d34/d25/d3f/d6d/fed x:0 0 0 2024-04-26T20:19:04.456 INFO:tasks.workunit.client.0.smithi016.stdout:7/791: stat d0/dd5/d88/db3/fc3 0 2024-04-26T20:19:04.461 INFO:tasks.workunit.client.0.smithi016.stdout:6/817: dwrite d1/d21/d26/d1c/d2e/d53/ffe [0,4194304] 0 2024-04-26T20:19:04.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/919: dwrite d1d/d20/d22/d29/f128 [0,4194304] 0 2024-04-26T20:19:04.461 INFO:tasks.workunit.client.0.smithi016.stdout:2/920: truncate d1d/d20/d22/d39/d3e/f47 2234618 0 2024-04-26T20:19:04.461 INFO:tasks.workunit.client.0.smithi016.stdout:6/818: chown d1/d21/d26/d1c/d5d/def/d2c/c32 2795 1 2024-04-26T20:19:04.461 INFO:tasks.workunit.client.0.smithi016.stdout:7/792: mkdir d0/d67/de6/dee 0 2024-04-26T20:19:04.464 INFO:tasks.workunit.client.0.smithi016.stdout:6/819: mkdir d1/d21/d26/d1c/d5d/d88/d115 0 2024-04-26T20:19:04.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/884: dwrite d3/d5/d6/f89 [0,4194304] 0 2024-04-26T20:19:04.470 INFO:tasks.workunit.client.0.smithi016.stdout:1/885: mkdir d3/d5/d8d/dab/d123 0 2024-04-26T20:19:04.484 INFO:tasks.workunit.client.0.smithi016.stdout:3/722: dwrite d3/df/d20/d61/d76/fde [0,4194304] 0 2024-04-26T20:19:04.491 INFO:tasks.workunit.client.0.smithi016.stdout:3/723: mkdir d3/df/d25/d2a/d4a/de4 0 2024-04-26T20:19:04.492 INFO:tasks.workunit.client.0.smithi016.stdout:3/724: mknod d3/df/d20/db0/dc2/de2/ce5 0 2024-04-26T20:19:04.492 INFO:tasks.workunit.client.0.smithi016.stdout:3/725: mknod d3/df/d20/db0/ce6 0 2024-04-26T20:19:04.494 INFO:tasks.workunit.client.0.smithi016.stdout:3/726: truncate d3/df/d20/d41/f4e 481356 0 2024-04-26T20:19:04.494 INFO:tasks.workunit.client.0.smithi016.stdout:3/727: read d3/f1b [1044259,53250] 0 2024-04-26T20:19:04.494 INFO:tasks.workunit.client.0.smithi016.stdout:3/728: fsync d3/df/d25/d32/f3b 0 2024-04-26T20:19:04.495 INFO:tasks.workunit.client.0.smithi016.stdout:3/729: mknod d3/d9/d18/d82/dc6/ce7 0 2024-04-26T20:19:04.510 INFO:tasks.workunit.client.0.smithi016.stdout:3/730: dread d3/df/d25/d2a/f42 [0,4194304] 0 2024-04-26T20:19:04.510 INFO:tasks.workunit.client.0.smithi016.stdout:3/731: stat d3/d9/d18/d82/c87 0 2024-04-26T20:19:04.511 INFO:tasks.workunit.client.0.smithi016.stdout:3/732: mkdir d3/df/d25/d2a/d4a/de4/de8 0 2024-04-26T20:19:04.513 INFO:tasks.workunit.client.0.smithi016.stdout:3/733: rename d3/d9/l88 to d3/df/d20/db0/le9 0 2024-04-26T20:19:04.526 INFO:tasks.workunit.client.0.smithi016.stdout:3/734: dread d3/fdd [0,4194304] 0 2024-04-26T20:19:04.527 INFO:tasks.workunit.client.0.smithi016.stdout:3/735: unlink d3/df/d20/la3 0 2024-04-26T20:19:04.538 INFO:tasks.workunit.client.0.smithi016.stdout:7/793: dwrite d0/dd5/d34/dec/fdb [0,4194304] 0 2024-04-26T20:19:04.543 INFO:tasks.workunit.client.0.smithi016.stdout:8/847: dwrite d9/d23/d26/f76 [0,4194304] 0 2024-04-26T20:19:04.543 INFO:tasks.workunit.client.0.smithi016.stdout:6/820: dwrite d1/d21/d26/d1c/d5d/def/d2c/f10b [0,4194304] 0 2024-04-26T20:19:04.556 INFO:tasks.workunit.client.0.smithi016.stdout:3/736: dread d3/df/d20/d61/d74/f8d [0,4194304] 0 2024-04-26T20:19:04.556 INFO:tasks.workunit.client.0.smithi016.stdout:3/737: stat d3/df/d20/f4b 0 2024-04-26T20:19:04.564 INFO:tasks.workunit.client.0.smithi016.stdout:2/921: dwrite d1d/d2a/d3d/f102 [0,4194304] 0 2024-04-26T20:19:04.574 INFO:tasks.workunit.client.0.smithi016.stdout:8/848: mkdir d9/d19/d45/d9e/d50/d123 0 2024-04-26T20:19:04.576 INFO:tasks.workunit.client.0.smithi016.stdout:6/821: truncate d1/fd 1114555 0 2024-04-26T20:19:04.582 INFO:tasks.workunit.client.0.smithi016.stdout:8/849: mkdir d9/d19/d45/d9e/d50/d124 0 2024-04-26T20:19:04.614 INFO:tasks.workunit.client.0.smithi016.stdout:3/738: dwrite d3/df/d25/d32/d9e/fad [0,4194304] 0 2024-04-26T20:19:04.614 INFO:tasks.workunit.client.0.smithi016.stdout:3/739: write d3/df/d25/d2a/d69/db5/f97 [1927806,72188] 0 2024-04-26T20:19:04.614 INFO:tasks.workunit.client.0.smithi016.stdout:3/740: chown d3/df/d20/c24 171777 1 2024-04-26T20:19:04.615 INFO:tasks.workunit.client.0.smithi016.stdout:3/741: write d3/df/d25/d2a/f7a [1892434,25862] 0 2024-04-26T20:19:04.615 INFO:tasks.workunit.client.0.smithi016.stdout:3/742: dread - d3/df/d25/fdf zero size 2024-04-26T20:19:04.624 INFO:tasks.workunit.client.0.smithi016.stdout:3/743: dread d3/fdd [0,4194304] 0 2024-04-26T20:19:04.625 INFO:tasks.workunit.client.0.smithi016.stdout:3/744: dread - d3/df/d25/fbb zero size 2024-04-26T20:19:04.627 INFO:tasks.workunit.client.0.smithi016.stdout:3/745: creat d3/df/d25/d32/dc7/fea x:0 0 0 2024-04-26T20:19:04.629 INFO:tasks.workunit.client.0.smithi016.stdout:3/746: mkdir d3/d70/d8b/ddc/deb 0 2024-04-26T20:19:04.642 INFO:tasks.workunit.client.0.smithi016.stdout:6/822: mkdir d1/d21/d48/d116 0 2024-04-26T20:19:04.665 INFO:tasks.workunit.client.0.smithi016.stdout:2/922: rmdir d1d/d27/d2d/d6b/d108/d114/dea 39 2024-04-26T20:19:04.666 INFO:tasks.workunit.client.0.smithi016.stdout:2/923: creat d1d/d27/d2d/d6b/d7e/dd8/d122/f13f x:0 0 0 2024-04-26T20:19:04.666 INFO:tasks.workunit.client.0.smithi016.stdout:2/924: write d1d/d27/f50 [86335,22021] 0 2024-04-26T20:19:04.669 INFO:tasks.workunit.client.0.smithi016.stdout:6/823: creat d1/d21/f117 x:0 0 0 2024-04-26T20:19:04.680 INFO:tasks.workunit.client.0.smithi016.stdout:8/850: dwrite d9/d23/d26/f76 [0,4194304] 0 2024-04-26T20:19:04.680 INFO:tasks.workunit.client.0.smithi016.stdout:8/851: write d9/d19/d45/d9e/f8c [5754979,7742] 0 2024-04-26T20:19:04.680 INFO:tasks.workunit.client.0.smithi016.stdout:8/852: readlink d9/d23/d26/d2c/l8b 0 2024-04-26T20:19:04.681 INFO:tasks.workunit.client.0.smithi016.stdout:8/853: truncate d9/d19/fa8 1013831 0 2024-04-26T20:19:04.682 INFO:tasks.workunit.client.0.smithi016.stdout:8/854: creat d9/d66/d73/f125 x:0 0 0 2024-04-26T20:19:04.695 INFO:tasks.workunit.client.0.smithi016.stdout:6/824: dwrite d1/d21/d26/f75 [0,4194304] 0 2024-04-26T20:19:04.727 INFO:tasks.workunit.client.0.smithi016.stdout:6/825: dwrite d1/d21/d26/d1c/d2e/d53/f69 [0,4194304] 0 2024-04-26T20:19:04.727 INFO:tasks.workunit.client.0.smithi016.stdout:6/826: readlink d1/d21/d26/d1c/d2e/d53/d7f/lc9 0 2024-04-26T20:19:04.727 INFO:tasks.workunit.client.0.smithi016.stdout:6/827: write d1/d21/d26/d1c/d5d/d88/ffd [878659,62140] 0 2024-04-26T20:19:04.739 INFO:tasks.workunit.client.0.smithi016.stdout:6/828: write d1/d21/d26/d1c/d5d/def/fc [1042477,101343] 0 2024-04-26T20:19:04.740 INFO:tasks.workunit.client.0.smithi016.stdout:6/829: rename d1/d21/d26/d1c/d5d/def/dae/fc4 to d1/d21/d26/d1c/d5d/def/d2c/d3d/f118 0 2024-04-26T20:19:04.742 INFO:tasks.workunit.client.0.smithi016.stdout:6/830: dread d1/d21/d26/d1c/d4e/fa0 [0,4194304] 0 2024-04-26T20:19:05.250 INFO:tasks.workunit.client.0.smithi016.stdout:3/747: truncate d3/df/d20/d41/f4e 79186 0 2024-04-26T20:19:05.261 INFO:tasks.workunit.client.0.smithi016.stdout:7/794: sync 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:0/806: sync 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:2/925: sync 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:8/855: sync 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:4/773: sync 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:6/831: sync 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:1/886: sync 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:8/856: dread - d9/d19/d45/d9e/de5/f116 zero size 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:1/887: dread - d3/d5/da/f11b zero size 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:6/832: write d1/d21/d26/d1c/d5d/def/d2c/f41 [2496060,61850] 0 2024-04-26T20:19:05.262 INFO:tasks.workunit.client.0.smithi016.stdout:8/857: write d9/d19/d45/d9e/de5/ffe [818025,40591] 0 2024-04-26T20:19:05.263 INFO:tasks.workunit.client.0.smithi016.stdout:3/748: unlink d3/df/d20/db0/dc2/de2/ce5 0 2024-04-26T20:19:05.263 INFO:tasks.workunit.client.0.smithi016.stdout:7/795: mknod d0/dd5/d6/cef 0 2024-04-26T20:19:05.264 INFO:tasks.workunit.client.0.smithi016.stdout:0/807: mknod d2/dc/d1e/dc5/c10c 0 2024-04-26T20:19:05.264 INFO:tasks.workunit.client.0.smithi016.stdout:0/808: truncate d2/dc/de3/ff7 242461 0 2024-04-26T20:19:05.264 INFO:tasks.workunit.client.0.smithi016.stdout:0/809: fdatasync d2/fb 0 2024-04-26T20:19:05.264 INFO:tasks.workunit.client.0.smithi016.stdout:4/774: creat d0/dd/dc9/ffd x:0 0 0 2024-04-26T20:19:05.265 INFO:tasks.workunit.client.0.smithi016.stdout:1/888: creat d3/d5/d6/d9/d2a/f124 x:0 0 0 2024-04-26T20:19:05.266 INFO:tasks.workunit.client.0.smithi016.stdout:8/858: symlink d9/d19/d45/d9e/d50/d124/l126 0 2024-04-26T20:19:05.266 INFO:tasks.workunit.client.0.smithi016.stdout:8/859: stat d9/d19/d45 0 2024-04-26T20:19:05.267 INFO:tasks.workunit.client.0.smithi016.stdout:6/833: truncate d1/d21/d26/d1c/d5d/def/dae/f8e 2533688 0 2024-04-26T20:19:05.267 INFO:tasks.workunit.client.0.smithi016.stdout:6/834: write d1/d21/d26/d1c/d5d/def/d76/f114 [481419,124338] 0 2024-04-26T20:19:05.268 INFO:tasks.workunit.client.0.smithi016.stdout:7/796: fsync d0/dd5/f93 0 2024-04-26T20:19:05.273 INFO:tasks.workunit.client.0.smithi016.stdout:0/810: rename d2/dc/f79 to d2/d20/d41/d87/d9d/dda/f10d 0 2024-04-26T20:19:05.273 INFO:tasks.workunit.client.0.smithi016.stdout:7/797: truncate d0/d51/fd1 3287292 0 2024-04-26T20:19:05.278 INFO:tasks.workunit.client.0.smithi016.stdout:0/811: dread d2/dc/f1d [0,4194304] 0 2024-04-26T20:19:05.281 INFO:tasks.workunit.client.0.smithi016.stdout:6/835: rename d1/d12/l29 to d1/d21/d26/d1c/d8a/l119 0 2024-04-26T20:19:05.285 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:05.290 INFO:tasks.workunit.client.0.smithi016.stdout:0/812: mknod d2/dc/c10e 0 2024-04-26T20:19:05.290 INFO:tasks.workunit.client.0.smithi016.stdout:0/813: readlink d2/d20/d57/lf2 0 2024-04-26T20:19:05.290 INFO:tasks.workunit.client.0.smithi016.stdout:2/926: dread d1d/d52/f5f [0,4194304] 0 2024-04-26T20:19:05.293 INFO:tasks.workunit.client.0.smithi016.stdout:0/814: symlink d2/d20/d41/d87/l10f 0 2024-04-26T20:19:05.294 INFO:tasks.workunit.client.0.smithi016.stdout:6/836: dread d1/f7 [0,4194304] 0 2024-04-26T20:19:05.294 INFO:tasks.workunit.client.0.smithi016.stdout:6/837: fdatasync d1/d21/d26/d1c/d5d/def/d2c/fc7 0 2024-04-26T20:19:05.294 INFO:tasks.workunit.client.0.smithi016.stdout:0/815: write d2/dc/d1e/d25/f55 [4915376,16213] 0 2024-04-26T20:19:05.294 INFO:tasks.workunit.client.0.smithi016.stdout:6/838: write d1/d21/d26/d1c/d5d/def/d2c/d3d/f118 [1899675,37328] 0 2024-04-26T20:19:05.294 INFO:tasks.workunit.client.0.smithi016.stdout:6/839: truncate d1/d21/d26/f75 4223090 0 2024-04-26T20:19:05.297 INFO:tasks.workunit.client.0.smithi016.stdout:8/860: write d9/d19/d45/d3f/d4d/fbc [3781466,21712] 0 2024-04-26T20:19:05.297 INFO:tasks.workunit.client.0.smithi016.stdout:2/927: mkdir d1d/d20/d7c/dbc/d140 0 2024-04-26T20:19:05.298 INFO:tasks.workunit.client.0.smithi016.stdout:0/816: mkdir d2/d8/d37/d5d/d110 0 2024-04-26T20:19:05.298 INFO:tasks.workunit.client.0.smithi016.stdout:0/817: fsync d2/dc/d1e/fcf 0 2024-04-26T20:19:05.304 INFO:tasks.workunit.client.0.smithi016.stdout:8/861: mkdir d9/d23/d26/d2c/d127 0 2024-04-26T20:19:05.304 INFO:tasks.workunit.client.0.smithi016.stdout:8/862: dread - d9/d23/d26/d2c/dea/ff4 zero size 2024-04-26T20:19:05.304 INFO:tasks.workunit.client.0.smithi016.stdout:8/863: chown d9/d2f/f86 25178369 1 2024-04-26T20:19:05.304 INFO:tasks.workunit.client.0.smithi016.stdout:3/749: dread d3/d9/d18/f8f [0,4194304] 0 2024-04-26T20:19:05.304 INFO:tasks.workunit.client.0.smithi016.stdout:3/750: readlink d3/df/d20/d41/l55 0 2024-04-26T20:19:05.305 INFO:tasks.workunit.client.0.smithi016.stdout:7/798: dread d0/f29 [0,4194304] 0 2024-04-26T20:19:05.305 INFO:tasks.workunit.client.0.smithi016.stdout:7/799: chown d0/dd5/d95/c9d 46 1 2024-04-26T20:19:05.305 INFO:tasks.workunit.client.0.smithi016.stdout:7/800: fsync d0/d51/f5a 0 2024-04-26T20:19:05.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/818: creat d2/d20/d41/f111 x:0 0 0 2024-04-26T20:19:05.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/819: dread - d2/d8/d37/d70/f109 zero size 2024-04-26T20:19:05.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/820: write d2/d20/f67 [2174830,96773] 0 2024-04-26T20:19:05.308 INFO:tasks.workunit.client.0.smithi016.stdout:7/801: symlink d0/dd5/d46/lf0 0 2024-04-26T20:19:05.313 INFO:tasks.workunit.client.0.smithi016.stdout:0/821: getdents d2/d8 0 2024-04-26T20:19:05.320 INFO:tasks.workunit.client.0.smithi016.stdout:8/864: read d9/f14 [2749690,49410] 0 2024-04-26T20:19:05.329 INFO:tasks.workunit.client.0.smithi016.stdout:6/840: write d1/d21/d26/d1c/d5d/def/d2c/f42 [2535102,83409] 0 2024-04-26T20:19:05.329 INFO:tasks.workunit.client.0.smithi016.stdout:6/841: fsync d1/d21/d26/d1c/d5d/def/d76/fd8 0 2024-04-26T20:19:05.329 INFO:tasks.workunit.client.0.smithi016.stdout:6/842: dread - d1/d21/fe7 zero size 2024-04-26T20:19:05.329 INFO:tasks.workunit.client.0.smithi016.stdout:6/843: fdatasync d1/d21/d26/d1c/d7b/f89 0 2024-04-26T20:19:05.329 INFO:tasks.workunit.client.0.smithi016.stdout:8/865: stat d9/d19/d45/d9e/c11e 0 2024-04-26T20:19:05.421 INFO:tasks.workunit.client.0.smithi016.stdout:7/802: dwrite d0/dd5/fbf [0,4194304] 0 2024-04-26T20:19:05.434 INFO:tasks.workunit.client.0.smithi016.stdout:6/844: mkdir d1/d21/d26/d1c/d7b/d82/d8f/dff/d11a 0 2024-04-26T20:19:05.434 INFO:tasks.workunit.client.0.smithi016.stdout:6/845: chown d1/d21/d26/d1c/d2e/d53/f10d 13060 1 2024-04-26T20:19:05.437 INFO:tasks.workunit.client.0.smithi016.stdout:8/866: dwrite d9/d19/d45/d9e/d50/f97 [0,4194304] 0 2024-04-26T20:19:05.439 INFO:tasks.workunit.client.0.smithi016.stdout:6/846: truncate d1/d21/d26/d1c/d5d/def/f2f 3726505 0 2024-04-26T20:19:05.439 INFO:tasks.workunit.client.0.smithi016.stdout:6/847: write d1/d21/d26/d1c/d5d/def/fc [1573910,127416] 0 2024-04-26T20:19:05.460 INFO:tasks.workunit.client.0.smithi016.stdout:6/848: write d1/d21/d26/f75 [3743906,78870] 0 2024-04-26T20:19:05.460 INFO:tasks.workunit.client.0.smithi016.stdout:6/849: truncate d1/d3a/fe8 1894709 0 2024-04-26T20:19:05.461 INFO:tasks.workunit.client.0.smithi016.stdout:8/867: link d9/d104/f11c d9/d19/d45/f128 0 2024-04-26T20:19:05.466 INFO:tasks.workunit.client.0.smithi016.stdout:8/868: rename d9/d23/d26/d2c/dea/c113 to d9/d104/c129 0 2024-04-26T20:19:05.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b51200640 1 Processor -- start 2024-04-26T20:19:05.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b51200640 1 -- start start 2024-04-26T20:19:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b51200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c155b00 0x7f5b4c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b51200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b4c0cb3e0 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b51200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b4c0cbc60 con 0x7f5b4c155ee0 2024-04-26T20:19:05.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b51200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4c0cb6a0 con 0x7f5b4c155b00 2024-04-26T20:19:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b4be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5b4c0ccb10 0x7f5b4c166400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48708/0 (socket says 172.21.15.16:48708) 2024-04-26T20:19:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b4be00640 1 -- 172.21.15.16:0/176051572 learned_addr learned my addr 172.21.15.16:0/176051572 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b4b400640 1 --2- 172.21.15.16:0/176051572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c155b00 0x7f5b4c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249004063 0 0) 0x7f5b4c0cb3e0 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b30003530 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.487+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827461316 0 0) 0x7f5b4c0cbc60 con 0x7f5b4c155ee0 2024-04-26T20:19:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.491+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b4c0cb3e0 con 0x7f5b4c155ee0 2024-04-26T20:19:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.491+0000 7f5b4b400640 1 -- 172.21.15.16:0/176051572 >> v1:172.21.15.192:6789/0 conn(0x7f5b4c155ee0 legacy=0x7f5b4c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.491+0000 7f5b4b400640 1 -- 172.21.15.16:0/176051572 >> v1:172.21.15.16:6789/0 conn(0x7f5b4c0ccb10 legacy=0x7f5b4c166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.491+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1906019269 0 0) 0x7f5b30003530 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.491+0000 7f5b4b400640 1 -- 172.21.15.16:0/176051572 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4c0cb980 con 0x7f5b4c155b00 2024-04-26T20:19:05.497 INFO:tasks.workunit.client.0.smithi016.stdout:6/850: dwrite d1/f6 [0,4194304] 0 2024-04-26T20:19:05.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b4b400640 1 --2- 172.21.15.16:0/176051572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c155b00 0x7f5b4c15c690 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b380097f0 tx=0x7f5b3801ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c6dbd67bfb56e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:05.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380b5070 con 0x7f5b4c155b00 2024-04-26T20:19:05.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b380a8670 con 0x7f5b4c155b00 2024-04-26T20:19:05.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b4a000640 1 -- 172.21.15.16:0/176051572 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b44001a00 con 0x7f5b4c155b00 2024-04-26T20:19:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b51200640 1 -- 172.21.15.16:0/176051572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c155b00 msgr2=0x7f5b4c15c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b51200640 1 --2- 172.21.15.16:0/176051572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c155b00 0x7f5b4c15c690 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5b380097f0 tx=0x7f5b3801ebf0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b51200640 1 -- 172.21.15.16:0/176051572 shutdown_connections 2024-04-26T20:19:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b51200640 1 --2- 172.21.15.16:0/176051572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c155b00 0x7f5b4c15c690 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.495+0000 7f5b51200640 1 -- 172.21.15.16:0/176051572 >> 172.21.15.16:0/176051572 conn(0x7f5b4c068140 msgr2=0x7f5b4c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:05.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.499+0000 7f5b51200640 1 -- 172.21.15.16:0/176051572 shutdown_connections 2024-04-26T20:19:05.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.499+0000 7f5b51200640 1 -- 172.21.15.16:0/176051572 wait complete. 2024-04-26T20:19:05.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.499+0000 7f5b51200640 1 Processor -- start 2024-04-26T20:19:05.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b51200640 1 -- start start 2024-04-26T20:19:05.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b51200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0ccb10 0x7f5b4c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b51200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c155b00 0x7f5b4c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b51200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c155ee0 0x7f5b4c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.507 INFO:tasks.workunit.client.0.smithi016.stdout:8/869: dwrite d9/d19/f33 [0,4194304] 0 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b51200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c15c170 con 0x7f5b4c155ee0 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b51200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c15be90 con 0x7f5b4c155b00 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b51200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4c0cb060 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0ccb10 0x7f5b4c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0ccb10 0x7f5b4c0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:48184/0 (socket says 172.21.15.16:48184) 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 -- 172.21.15.16:0/765426051 learned_addr learned my addr 172.21.15.16:0/765426051 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4aa00640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c155b00 0x7f5b4c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4be00640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c155ee0 0x7f5b4c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 -- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c155b00 msgr2=0x7f5b4c150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c155b00 0x7f5b4c150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 -- 172.21.15.16:0/765426051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c155ee0 msgr2=0x7f5b4c151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c155ee0 0x7f5b4c151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4b400640 1 -- 172.21.15.16:0/765426051 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4c0d02f0 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.503+0000 7f5b4be00640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c155ee0 0x7f5b4c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:19:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.507+0000 7f5b4b400640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0ccb10 0x7f5b4c0ce500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b380b3040 tx=0x7f5b3801b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.507+0000 7f5b43400640 1 -- 172.21.15.16:0/765426051 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380b5040 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.507+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4c0cfd70 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.507+0000 7f5b43400640 1 -- 172.21.15.16:0/765426051 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b380be070 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.507+0000 7f5b43400640 1 -- 172.21.15.16:0/765426051 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380a8c20 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.507+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4c15a4b0 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.507+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b4c0506d0 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.511+0000 7f5b43400640 1 -- 172.21.15.16:0/765426051 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5b38003620 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.511+0000 7f5b43400640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5b2c068380 0x7f5b2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.511+0000 7f5b43400640 1 -- 172.21.15.16:0/765426051 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f5b38124bf0 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.511+0000 7f5b4aa00640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5b2c068380 0x7f5b2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:05.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.511+0000 7f5b4aa00640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5b2c068380 0x7f5b2c06a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0c6380 tx=0x7f5b3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:05.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.531+0000 7f5b43400640 1 -- 172.21.15.16:0/765426051 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5b38018750 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.547 INFO:tasks.workunit.client.0.smithi016.stdout:6/851: dwrite d1/d21/d26/d1c/d5d/def/d46/f71 [0,4194304] 0 2024-04-26T20:19:05.549 INFO:tasks.workunit.client.0.smithi016.stdout:6/852: dread d1/d21/d26/d1c/d4e/fa0 [0,4194304] 0 2024-04-26T20:19:05.549 INFO:tasks.workunit.client.0.smithi016.stdout:6/853: write d1/d21/d26/d1c/f7c [766515,71193] 0 2024-04-26T20:19:05.549 INFO:tasks.workunit.client.0.smithi016.stdout:6/854: fsync d1/d21/d26/d1c/d5d/de2/f112 0 2024-04-26T20:19:05.559 INFO:tasks.workunit.client.0.smithi016.stdout:8/870: symlink d9/d72/d74/d9f/dfd/l12a 0 2024-04-26T20:19:05.561 INFO:tasks.workunit.client.0.smithi016.stdout:6/855: dread d1/d21/d26/d1c/d5d/def/d2c/d47/fd1 [0,4194304] 0 2024-04-26T20:19:05.562 INFO:tasks.workunit.client.0.smithi016.stdout:8/871: getdents d9/d2f 0 2024-04-26T20:19:05.562 INFO:tasks.workunit.client.0.smithi016.stdout:8/872: chown d9/f14 2 1 2024-04-26T20:19:05.563 INFO:tasks.workunit.client.0.smithi016.stdout:8/873: fdatasync f5 0 2024-04-26T20:19:05.563 INFO:tasks.workunit.client.0.smithi016.stdout:6/856: mknod d1/d21/d26/c11b 0 2024-04-26T20:19:05.581 INFO:tasks.workunit.client.0.smithi016.stdout:1/889: sync 2024-04-26T20:19:05.582 INFO:tasks.workunit.client.0.smithi016.stdout:4/775: sync 2024-04-26T20:19:05.582 INFO:tasks.workunit.client.0.smithi016.stdout:8/874: mkdir d9/d19/d45/d106/d12b 0 2024-04-26T20:19:05.584 INFO:tasks.workunit.client.0.smithi016.stdout:1/890: link d3/d5/da/d66/d8c/d84/c9a d3/d5/da/c125 0 2024-04-26T20:19:05.588 INFO:tasks.workunit.client.0.smithi016.stdout:8/875: write d9/d19/d45/d3f/fdd [15019,93719] 0 2024-04-26T20:19:05.589 INFO:tasks.workunit.client.0.smithi016.stdout:4/776: symlink d0/d96/ddc/de6/lfe 0 2024-04-26T20:19:05.596 INFO:tasks.workunit.client.0.smithi016.stdout:1/891: write d3/d5/d6/d50/d79/f85 [2354373,27359] 0 2024-04-26T20:19:05.598 INFO:tasks.workunit.client.0.smithi016.stdout:8/876: mknod d9/d19/d45/d9e/d50/dad/c12c 0 2024-04-26T20:19:05.686 INFO:tasks.workunit.client.0.smithi016.stdout:1/892: dwrite d3/d5/da/d66/d8c/d84/d96/df5/f105 [0,4194304] 0 2024-04-26T20:19:05.701 INFO:tasks.workunit.client.0.smithi016.stdout:8/877: read d9/d2f/fc8 [2904888,120977] 0 2024-04-26T20:19:05.702 INFO:tasks.workunit.client.0.smithi016.stdout:8/878: write d9/d66/d73/fcf [5716434,96870] 0 2024-04-26T20:19:05.716 INFO:tasks.workunit.client.0.smithi016.stdout:1/893: write d3/d5/da/d66/d8c/fa0 [1328149,175] 0 2024-04-26T20:19:05.717 INFO:tasks.workunit.client.0.smithi016.stdout:8/879: creat d9/d23/d11b/f12d x:0 0 0 2024-04-26T20:19:05.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/894: truncate d3/d5/d6/d5a/dbf/fd7 1392990 0 2024-04-26T20:19:05.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/895: readlink d3/d5/da/d66/d8c/d84/lbd 0 2024-04-26T20:19:05.718 INFO:tasks.workunit.client.0.smithi016.stdout:1/896: fsync d3/d5/d6/d50/d79/f9f 0 2024-04-26T20:19:05.719 INFO:tasks.workunit.client.0.smithi016.stdout:8/880: getdents d9/d19/d45/d3f/d64 0 2024-04-26T20:19:05.748 INFO:tasks.workunit.client.0.smithi016.stdout:1/897: rename d3/d5/d6/d50/d79/da7/fc6 to d3/f126 0 2024-04-26T20:19:05.749 INFO:tasks.workunit.client.0.smithi016.stdout:8/881: truncate d9/d2f/f86 54338 0 2024-04-26T20:19:05.761 INFO:tasks.workunit.client.0.smithi016.stdout:1/898: dread d3/d5/d6/d50/d79/f85 [0,4194304] 0 2024-04-26T20:19:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.771+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b4c068690 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.775+0000 7f5b43400640 1 -- 172.21.15.16:0/765426051 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6046 (secure 0 0 0) 0x7f5b380f4d00 con 0x7f5b4c0ccb10 2024-04-26T20:19:05.778 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:05.778 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:00.848149+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:19:05.778 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 21 2024-04-26T20:19:05.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5b2c068380 msgr2=0x7f5b2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5b2c068380 0x7f5b2c06a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0c6380 tx=0x7f5b3c009040 comp rx=0 tx=0).stop 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0ccb10 msgr2=0x7f5b4c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0ccb10 0x7f5b4c0ce500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b380b3040 tx=0x7f5b3801b990 comp rx=0 tx=0).stop 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 shutdown_connections 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5b2c068380 0x7f5b2c06a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b4c155ee0 0x7f5b4c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c155b00 0x7f5b4c150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 --2- 172.21.15.16:0/765426051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0ccb10 0x7f5b4c0ce500 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 >> 172.21.15.16:0/765426051 conn(0x7f5b4c068140 msgr2=0x7f5b4c159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 shutdown_connections 2024-04-26T20:19:05.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:05.779+0000 7f5b51200640 1 -- 172.21.15.16:0/765426051 wait complete. 2024-04-26T20:19:05.808 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:19:05.826 INFO:tasks.workunit.client.0.smithi016.stdout:1/899: dwrite d3/f107 [0,4194304] 0 2024-04-26T20:19:05.826 INFO:tasks.workunit.client.0.smithi016.stdout:1/900: chown d3/d5/d6/d9/d2a/d3d/fa9 10017362 1 2024-04-26T20:19:05.827 INFO:tasks.workunit.client.0.smithi016.stdout:8/882: dwrite d9/d19/d45/d3f/f63 [0,4194304] 0 2024-04-26T20:19:05.828 INFO:tasks.workunit.client.0.smithi016.stdout:8/883: dread d9/d19/d45/f7c [0,4194304] 0 2024-04-26T20:19:05.830 INFO:tasks.workunit.client.0.smithi016.stdout:1/901: truncate d3/d5/da/d66/d8c/f93 6587679 0 2024-04-26T20:19:05.830 INFO:tasks.workunit.client.0.smithi016.stdout:1/902: chown d3/f77 0 1 2024-04-26T20:19:05.831 INFO:tasks.workunit.client.0.smithi016.stdout:8/884: creat d9/d23/d26/d2c/d127/f12e x:0 0 0 2024-04-26T20:19:05.846 INFO:tasks.workunit.client.0.smithi016.stdout:2/928: sync 2024-04-26T20:19:05.848 INFO:tasks.workunit.client.0.smithi016.stdout:1/903: truncate d3/d5/d6/d9/fce 125000 0 2024-04-26T20:19:05.848 INFO:tasks.workunit.client.0.smithi016.stdout:1/904: stat d3/d5/f4f 0 2024-04-26T20:19:05.849 INFO:tasks.workunit.client.0.smithi016.stdout:2/929: chown d1d/d20/d22/d98/f9b 722515422 1 2024-04-26T20:19:05.873 INFO:tasks.workunit.client.0.smithi016.stdout:8/885: dwrite d9/d2f/f5e [0,4194304] 0 2024-04-26T20:19:05.879 INFO:tasks.workunit.client.0.smithi016.stdout:2/930: dwrite d1d/d52/dfc/f126 [0,4194304] 0 2024-04-26T20:19:05.879 INFO:tasks.workunit.client.0.smithi016.stdout:2/931: write d1d/d2a/d3d/fd0 [406585,39289] 0 2024-04-26T20:19:05.880 INFO:tasks.workunit.client.0.smithi016.stdout:2/932: write d1d/d27/d2d/d6b/d7e/dd8/d122/f13f [366174,70717] 0 2024-04-26T20:19:05.880 INFO:tasks.workunit.client.0.smithi016.stdout:2/933: chown d1d/d20 2 1 2024-04-26T20:19:05.880 INFO:tasks.workunit.client.0.smithi016.stdout:2/934: truncate d1d/d27/d2d/d6b/d108/d114/fd5 537445 0 2024-04-26T20:19:06.130 INFO:tasks.workunit.client.0.smithi016.stdout:1/905: link d3/d5/da/f30 d3/d5/d8d/dab/f127 0 2024-04-26T20:19:06.130 INFO:tasks.workunit.client.0.smithi016.stdout:8/886: mknod d9/d19/d45/d106/c12f 0 2024-04-26T20:19:06.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/935: link d1d/d20/l12c d1d/d20/d7c/l141 0 2024-04-26T20:19:06.130 INFO:tasks.workunit.client.0.smithi016.stdout:2/936: fdatasync d1d/d27/d49/f6d 0 2024-04-26T20:19:06.137 INFO:tasks.workunit.client.0.smithi016.stdout:1/906: rename d3/d5/d8d/fdd to d3/d5/d6/d50/d79/da7/f128 0 2024-04-26T20:19:06.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/751: sync 2024-04-26T20:19:06.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/822: sync 2024-04-26T20:19:06.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/823: fdatasync d2/dc/d1e/fcf 0 2024-04-26T20:19:06.139 INFO:tasks.workunit.client.0.smithi016.stdout:0/824: fsync d2/d20/d41/d87/d9d/db8/fe2 0 2024-04-26T20:19:06.139 INFO:tasks.workunit.client.0.smithi016.stdout:0/825: chown d2/d20/d41/d87/d9d/db8/fc0 39867050 1 2024-04-26T20:19:06.140 INFO:tasks.workunit.client.0.smithi016.stdout:8/887: creat d9/d66/d73/f130 x:0 0 0 2024-04-26T20:19:06.141 INFO:tasks.workunit.client.0.smithi016.stdout:0/826: creat d2/d20/d41/d4c/f112 x:0 0 0 2024-04-26T20:19:06.142 INFO:tasks.workunit.client.0.smithi016.stdout:8/888: unlink d9/d19/d45/d3f/l82 0 2024-04-26T20:19:06.157 INFO:tasks.workunit.client.0.smithi016.stdout:0/827: write d2/dc/d18/d5b/fb6 [918503,10757] 0 2024-04-26T20:19:06.158 INFO:tasks.workunit.client.0.smithi016.stdout:3/752: dread d3/df/d20/d61/d74/fb3 [0,4194304] 0 2024-04-26T20:19:06.158 INFO:tasks.workunit.client.0.smithi016.stdout:3/753: dread - d3/d9/d2d/fe3 zero size 2024-04-26T20:19:06.159 INFO:tasks.workunit.client.0.smithi016.stdout:0/828: mknod d2/d20/d41/d87/c113 0 2024-04-26T20:19:06.162 INFO:tasks.workunit.client.0.smithi016.stdout:3/754: link d3/d9/d2d/db8/ccd d3/df/d20/d5b/cec 0 2024-04-26T20:19:06.162 INFO:tasks.workunit.client.0.smithi016.stdout:3/755: fsync d3/f29 0 2024-04-26T20:19:06.163 INFO:tasks.workunit.client.0.smithi016.stdout:1/907: write d3/d5/d6/d5a/f4a [2838026,99967] 0 2024-04-26T20:19:06.163 INFO:tasks.workunit.client.0.smithi016.stdout:3/756: symlink d3/d9/d2d/led 0 2024-04-26T20:19:06.170 INFO:tasks.workunit.client.0.smithi016.stdout:1/908: mknod d3/d5/da/d66/d8c/d84/c129 0 2024-04-26T20:19:06.170 INFO:tasks.workunit.client.0.smithi016.stdout:1/909: dread - d3/d5/d6/d5a/fb8 zero size 2024-04-26T20:19:06.170 INFO:tasks.workunit.client.0.smithi016.stdout:1/910: write d3/d5/d6/d50/d79/da7/f111 [54443,79325] 0 2024-04-26T20:19:06.170 INFO:tasks.workunit.client.0.smithi016.stdout:1/911: stat d3/d5/f43 0 2024-04-26T20:19:06.173 INFO:tasks.workunit.client.0.smithi016.stdout:4/777: sync 2024-04-26T20:19:06.173 INFO:tasks.workunit.client.0.smithi016.stdout:6/857: sync 2024-04-26T20:19:06.174 INFO:tasks.workunit.client.0.smithi016.stdout:7/803: sync 2024-04-26T20:19:06.175 INFO:tasks.workunit.client.0.smithi016.stdout:6/858: mkdir d1/d21/d26/d1c/d2e/d53/d93/d11c 0 2024-04-26T20:19:06.177 INFO:tasks.workunit.client.0.smithi016.stdout:4/778: symlink d0/d1e/d4e/d52/d54/dad/ddf/lff 0 2024-04-26T20:19:06.179 INFO:tasks.workunit.client.0.smithi016.stdout:7/804: mknod d0/dd5/d34/d25/d3f/d6d/d87/da3/cf1 0 2024-04-26T20:19:06.182 INFO:tasks.workunit.client.0.smithi016.stdout:6/859: symlink d1/d21/d26/d1c/d7b/d82/d8f/l11d 0 2024-04-26T20:19:06.184 INFO:tasks.workunit.client.0.smithi016.stdout:7/805: rmdir d0/d83 39 2024-04-26T20:19:06.186 INFO:tasks.workunit.client.0.smithi016.stdout:6/860: creat d1/d21/d26/d1c/dd9/f11e x:0 0 0 2024-04-26T20:19:06.186 INFO:tasks.workunit.client.0.smithi016.stdout:6/861: truncate d1/d3a/db9/de0/fe1 835671 0 2024-04-26T20:19:06.186 INFO:tasks.workunit.client.0.smithi016.stdout:6/862: write d1/d21/d26/d1c/d7b/f89 [4660153,118446] 0 2024-04-26T20:19:06.189 INFO:tasks.workunit.client.0.smithi016.stdout:6/863: mknod d1/d21/d48/dcf/c11f 0 2024-04-26T20:19:06.189 INFO:tasks.workunit.client.0.smithi016.stdout:7/806: write d0/dd5/d4b/f72 [42505,63640] 0 2024-04-26T20:19:06.189 INFO:tasks.workunit.client.0.smithi016.stdout:7/807: chown d0/dd5/d34/d25/d3f/d6d/dc2/fe3 12 1 2024-04-26T20:19:06.189 INFO:tasks.workunit.client.0.smithi016.stdout:6/864: rmdir d1/d21/d26/d25 39 2024-04-26T20:19:06.194 INFO:tasks.workunit.client.0.smithi016.stdout:3/757: write d3/df/d25/d2a/f73 [1682805,38005] 0 2024-04-26T20:19:06.195 INFO:tasks.workunit.client.0.smithi016.stdout:7/808: mkdir d0/dd5/d34/d25/d3f/df2 0 2024-04-26T20:19:06.203 INFO:tasks.workunit.client.0.smithi016.stdout:7/809: mknod d0/d67/de6/cf3 0 2024-04-26T20:19:06.203 INFO:tasks.workunit.client.0.smithi016.stdout:7/810: fsync d0/dd5/d34/dec/fdb 0 2024-04-26T20:19:06.220 INFO:tasks.workunit.client.0.smithi016.stdout:1/912: dwrite d3/d5/d6/d9/d2a/fe1 [0,4194304] 0 2024-04-26T20:19:06.222 INFO:tasks.workunit.client.0.smithi016.stdout:1/913: creat d3/d5/d6/d9/f12a x:0 0 0 2024-04-26T20:19:06.228 INFO:tasks.workunit.client.0.smithi016.stdout:0/829: dwrite d2/dc/d18/d5b/f5e [0,4194304] 0 2024-04-26T20:19:06.249 INFO:tasks.workunit.client.0.smithi016.stdout:3/758: dread d3/df/f2f [0,4194304] 0 2024-04-26T20:19:06.252 INFO:tasks.workunit.client.0.smithi016.stdout:3/759: rename d3/df/d20/l72 to d3/d9/lee 0 2024-04-26T20:19:06.253 INFO:tasks.workunit.client.0.smithi016.stdout:3/760: creat d3/df/d25/d32/d3f/fef x:0 0 0 2024-04-26T20:19:06.254 INFO:tasks.workunit.client.0.smithi016.stdout:1/914: dwrite d3/d5/f18 [4194304,4194304] 0 2024-04-26T20:19:06.303 INFO:tasks.workunit.client.0.smithi016.stdout:3/761: write d3/df/d25/d2a/d4a/fb4 [1941081,121023] 0 2024-04-26T20:19:06.304 INFO:tasks.workunit.client.0.smithi016.stdout:3/762: rmdir d3/df/d25/d2a/d69/db5 39 2024-04-26T20:19:06.306 INFO:tasks.workunit.client.0.smithi016.stdout:3/763: rename d3/l49 to d3/df/d20/d61/d76/lf0 0 2024-04-26T20:19:06.310 INFO:tasks.workunit.client.0.smithi016.stdout:7/811: write d0/dd5/d4b/f8e [1714515,11623] 0 2024-04-26T20:19:06.310 INFO:tasks.workunit.client.0.smithi016.stdout:7/812: chown d0/dd5/d34/d25/l9b 1859 1 2024-04-26T20:19:06.387 INFO:tasks.workunit.client.0.smithi016.stdout:7/813: dread d0/dd5/d4b/f72 [0,4194304] 0 2024-04-26T20:19:06.389 INFO:tasks.workunit.client.0.smithi016.stdout:7/814: creat d0/dd5/d34/db7/ff4 x:0 0 0 2024-04-26T20:19:06.400 INFO:tasks.workunit.client.0.smithi016.stdout:4/779: dwrite d0/dd/d19/d1f/d7b/f7e [0,4194304] 0 2024-04-26T20:19:06.400 INFO:tasks.workunit.client.0.smithi016.stdout:4/780: stat d0/dd/d1b/dbc/dfa/d6f/lb6 0 2024-04-26T20:19:06.402 INFO:tasks.workunit.client.0.smithi016.stdout:4/781: unlink d0/f46 0 2024-04-26T20:19:06.402 INFO:tasks.workunit.client.0.smithi016.stdout:4/782: write d0/dd/d19/f8a [694480,53255] 0 2024-04-26T20:19:06.404 INFO:tasks.workunit.client.0.smithi016.stdout:1/915: dwrite d3/f126 [0,4194304] 0 2024-04-26T20:19:06.409 INFO:tasks.workunit.client.0.smithi016.stdout:7/815: read d0/dd5/d34/d25/d50/f54 [2408033,41568] 0 2024-04-26T20:19:06.412 INFO:tasks.workunit.client.0.smithi016.stdout:7/816: rename d0/ld9 to d0/dd5/d46/lf5 0 2024-04-26T20:19:06.423 INFO:tasks.workunit.client.0.smithi016.stdout:7/817: dread d0/dd5/d34/d25/d3f/d6d/d87/f7c [0,4194304] 0 2024-04-26T20:19:06.424 INFO:tasks.workunit.client.0.smithi016.stdout:3/764: dwrite d3/df/d25/d2a/d4a/fb4 [0,4194304] 0 2024-04-26T20:19:06.425 INFO:tasks.workunit.client.0.smithi016.stdout:7/818: link d0/dd5/d34/d25/d3f/d6d/d87/da3/ceb d0/dd5/d34/db7/cf6 0 2024-04-26T20:19:06.442 INFO:tasks.workunit.client.0.smithi016.stdout:7/819: dread d0/dd5/d34/d25/d50/fa8 [0,4194304] 0 2024-04-26T20:19:06.443 INFO:tasks.workunit.client.0.smithi016.stdout:7/820: symlink d0/d83/lf7 0 2024-04-26T20:19:06.443 INFO:tasks.workunit.client.0.smithi016.stdout:7/821: chown d0/dd5/d34/db7/fbd 2 1 2024-04-26T20:19:06.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/916: dwrite d3/d5/d6/d9/d2a/f124 [0,4194304] 0 2024-04-26T20:19:06.466 INFO:tasks.workunit.client.0.smithi016.stdout:3/765: dread d3/df/d25/d32/f95 [0,4194304] 0 2024-04-26T20:19:06.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/917: chown d3/d5/da/d66/d8c/d84/d96/ccf 2077679 1 2024-04-26T20:19:06.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/918: readlink d3/d5/d6/l39 0 2024-04-26T20:19:06.466 INFO:tasks.workunit.client.0.smithi016.stdout:1/919: truncate d3/d5/da/d66/d8c/d84/d86/fa3 1035346 0 2024-04-26T20:19:06.466 INFO:tasks.workunit.client.0.smithi016.stdout:7/822: dread d0/f94 [0,4194304] 0 2024-04-26T20:19:06.466 INFO:tasks.workunit.client.0.smithi016.stdout:7/823: truncate d0/dd5/d34/d25/d3f/d6d/d79/fe7 169238 0 2024-04-26T20:19:06.468 INFO:tasks.workunit.client.0.smithi016.stdout:3/766: rename d3/df/d20/d5b/cbd to d3/d70/d8b/cf1 0 2024-04-26T20:19:06.470 INFO:tasks.workunit.client.0.smithi016.stdout:3/767: creat d3/df/d20/db0/dc2/de2/ff2 x:0 0 0 2024-04-26T20:19:06.470 INFO:tasks.workunit.client.0.smithi016.stdout:3/768: dread - d3/df/d25/d2a/fbf zero size 2024-04-26T20:19:06.470 INFO:tasks.workunit.client.0.smithi016.stdout:3/769: write d3/df/f13 [255992,67714] 0 2024-04-26T20:19:06.510 INFO:tasks.workunit.client.0.smithi016.stdout:1/920: dwrite d3/d57/f6e [0,4194304] 0 2024-04-26T20:19:06.516 INFO:tasks.workunit.client.0.smithi016.stdout:1/921: write d3/d5/d6/d5a/fb0 [139569,64245] 0 2024-04-26T20:19:06.517 INFO:tasks.workunit.client.0.smithi016.stdout:1/922: mknod d3/d57/da4/c12b 0 2024-04-26T20:19:06.518 INFO:tasks.workunit.client.0.smithi016.stdout:1/923: creat d3/d57/da4/f12c x:0 0 0 2024-04-26T20:19:06.519 INFO:tasks.workunit.client.0.smithi016.stdout:1/924: truncate d3/d5/d6/f89 3058047 0 2024-04-26T20:19:06.525 INFO:tasks.workunit.client.0.smithi016.stdout:1/925: rename d3/d5/d6 to d3/d5/da/d66/d8c/d84/d86/d12d 0 2024-04-26T20:19:06.525 INFO:tasks.workunit.client.0.smithi016.stdout:1/926: fsync d3/d57/f44 0 2024-04-26T20:19:06.525 INFO:tasks.workunit.client.0.smithi016.stdout:1/927: dread - d3/d5/d8d/f100 zero size 2024-04-26T20:19:06.528 INFO:tasks.workunit.client.0.smithi016.stdout:4/783: dwrite d0/f36 [0,4194304] 0 2024-04-26T20:19:06.534 INFO:tasks.workunit.client.0.smithi016.stdout:4/784: creat d0/d1e/f100 x:0 0 0 2024-04-26T20:19:06.535 INFO:tasks.workunit.client.0.smithi016.stdout:1/928: dread d3/d5/da/f21 [0,4194304] 0 2024-04-26T20:19:06.536 INFO:tasks.workunit.client.0.smithi016.stdout:4/785: link d0/d1e/d4e/d52/d88/l68 d0/dd/d19/d57/l101 0 2024-04-26T20:19:06.538 INFO:tasks.workunit.client.0.smithi016.stdout:1/929: rename d3/d5/da/d66/d8c/d84/d86/d12d/d50/d58/fc1 to d3/d5/da/d66/d8c/d84/d96/df5/f12e 0 2024-04-26T20:19:06.538 INFO:tasks.workunit.client.0.smithi016.stdout:1/930: write d3/d5/fb5 [4608460,55214] 0 2024-04-26T20:19:06.540 INFO:tasks.workunit.client.0.smithi016.stdout:4/786: creat d0/dd/dc9/de4/df0/f102 x:0 0 0 2024-04-26T20:19:06.540 INFO:tasks.workunit.client.0.smithi016.stdout:4/787: write d0/dd/f84 [3901666,83929] 0 2024-04-26T20:19:06.543 INFO:tasks.workunit.client.0.smithi016.stdout:2/937: sync 2024-04-26T20:19:06.545 INFO:tasks.workunit.client.0.smithi016.stdout:2/938: creat d1d/d27/d2d/d6b/d108/d114/dc7/dce/f142 x:0 0 0 2024-04-26T20:19:06.589 INFO:tasks.workunit.client.0.smithi016.stdout:2/939: dwrite d1d/d20/d22/d98/d115/d11d/f133 [0,4194304] 0 2024-04-26T20:19:06.591 INFO:tasks.workunit.client.0.smithi016.stdout:2/940: dread d1d/d27/d2d/d6b/d7e/fb4 [0,4194304] 0 2024-04-26T20:19:06.593 INFO:tasks.workunit.client.0.smithi016.stdout:2/941: creat d1d/d2a/d3d/f143 x:0 0 0 2024-04-26T20:19:06.593 INFO:tasks.workunit.client.0.smithi016.stdout:2/942: fsync d1d/d20/d22/d88/da4/fa5 0 2024-04-26T20:19:06.594 INFO:tasks.workunit.client.0.smithi016.stdout:2/943: mkdir d1d/d20/d22/d39/ddd/d144 0 2024-04-26T20:19:06.596 INFO:tasks.workunit.client.0.smithi016.stdout:2/944: rename d1d/d20/d7c to d1d/d20/d22/d29/d145 0 2024-04-26T20:19:06.597 INFO:tasks.workunit.client.0.smithi016.stdout:2/945: readlink d1d/d27/d2d/d6b/d108/d114/dc7/l109 0 2024-04-26T20:19:06.597 INFO:tasks.workunit.client.0.smithi016.stdout:2/946: symlink d1d/d2a/d121/l146 0 2024-04-26T20:19:06.600 INFO:tasks.workunit.client.0.smithi016.stdout:1/931: dwrite d3/d5/da/d66/d8c/d84/d96/df5/f12e [0,4194304] 0 2024-04-26T20:19:06.634 INFO:tasks.workunit.client.0.smithi016.stdout:2/947: dwrite d1d/d20/d22/d88/f95 [0,4194304] 0 2024-04-26T20:19:06.649 INFO:tasks.workunit.client.0.smithi016.stdout:1/932: dwrite d3/d57/f6e [4194304,4194304] 0 2024-04-26T20:19:06.660 INFO:tasks.workunit.client.0.smithi016.stdout:2/948: read d1d/d20/d22/d39/f5e [2681839,38839] 0 2024-04-26T20:19:06.661 INFO:tasks.workunit.client.0.smithi016.stdout:2/949: chown d1d/d27/d49/f6d 11762632 1 2024-04-26T20:19:06.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/933: getdents d3/d5/da/d66/d8c/d84/d86/d12d/d5a/dbf 0 2024-04-26T20:19:06.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/934: dread - d3/d5/da/d66/d8c/d84/d86/fd2 zero size 2024-04-26T20:19:06.662 INFO:tasks.workunit.client.0.smithi016.stdout:1/935: truncate d3/d5/da/d66/d8c/d84/d86/fd2 984565 0 2024-04-26T20:19:06.663 INFO:tasks.workunit.client.0.smithi016.stdout:2/950: symlink d1d/d20/d22/d29/d145/dbc/d101/l147 0 2024-04-26T20:19:06.663 INFO:tasks.workunit.client.0.smithi016.stdout:2/951: readlink d1d/d20/l4f 0 2024-04-26T20:19:06.664 INFO:tasks.workunit.client.0.smithi016.stdout:1/936: creat d3/d5/da/f12f x:0 0 0 2024-04-26T20:19:06.666 INFO:tasks.workunit.client.0.smithi016.stdout:2/952: unlink d1d/d20/d22/d39/c130 0 2024-04-26T20:19:06.669 INFO:tasks.workunit.client.0.smithi016.stdout:1/937: mkdir d3/d5/da/d66/d8c/d84/d86/d12d/d9/d9e/de6/d130 0 2024-04-26T20:19:06.670 INFO:tasks.workunit.client.0.smithi016.stdout:1/938: fdatasync d3/d5/da/d66/d8c/f6b 0 2024-04-26T20:19:06.670 INFO:tasks.workunit.client.0.smithi016.stdout:2/953: creat d1d/d20/d22/d39/ddd/f148 x:0 0 0 2024-04-26T20:19:06.682 INFO:tasks.workunit.client.0.smithi016.stdout:1/939: symlink d3/l131 0 2024-04-26T20:19:06.682 INFO:tasks.workunit.client.0.smithi016.stdout:1/940: stat d3/d57/dff 0 2024-04-26T20:19:06.690 INFO:tasks.workunit.client.0.smithi016.stdout:2/954: write d1d/d20/d22/fd7 [612296,63910] 0 2024-04-26T20:19:06.691 INFO:tasks.workunit.client.0.smithi016.stdout:2/955: dread - d1d/d27/f137 zero size 2024-04-26T20:19:06.938 INFO:tasks.workunit.client.0.smithi016.stdout:1/941: rename d3/d5/da/d66/d8c/d84/d86/d12d/d9/d2a/d3b/leb to d3/d5/da/d66/d8c/d84/d86/d12d/d50/d79/da7/l132 0 2024-04-26T20:19:06.938 INFO:tasks.workunit.client.0.smithi016.stdout:2/956: mkdir d1d/d20/d22/d29/d145/dbc/d149 0 2024-04-26T20:19:06.941 INFO:tasks.workunit.client.0.smithi016.stdout:1/942: dread d3/d5/da/d66/d8c/d84/d86/fa3 [0,4194304] 0 2024-04-26T20:19:06.941 INFO:tasks.workunit.client.0.smithi016.stdout:1/943: fdatasync d3/d5/da/d66/d8c/d84/d86/d12d/d9/f108 0 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:8/889: sync 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:7/824: sync 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:6/865: sync 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:7/825: stat d0/dd5/f93 0 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:3/770: sync 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:4/788: sync 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:4/789: chown d0/dd/d19/d1f/l39 1 1 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:3/771: truncate d3/d9/d18/d82/dc6/fd0 952853 0 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:4/790: write d0/d1e/d4e/d52/d54/dad/ff5 [2288459,60225] 0 2024-04-26T20:19:06.946 INFO:tasks.workunit.client.0.smithi016.stdout:0/830: sync 2024-04-26T20:19:06.947 INFO:tasks.workunit.client.0.smithi016.stdout:0/831: dread - d2/d8/d37/d70/f75 zero size 2024-04-26T20:19:06.947 INFO:tasks.workunit.client.0.smithi016.stdout:0/832: dread - d2/d20/d41/d72/fff zero size 2024-04-26T20:19:06.947 INFO:tasks.workunit.client.0.smithi016.stdout:2/957: symlink d1d/d20/d22/d39/l14a 0 2024-04-26T20:19:06.949 INFO:tasks.workunit.client.0.smithi016.stdout:8/890: link d9/d19/d45/d9e/l4e d9/d19/d45/d3f/d10e/l131 0 2024-04-26T20:19:06.949 INFO:tasks.workunit.client.0.smithi016.stdout:8/891: dread - d9/d19/d45/d3f/d4d/dba/ffa zero size 2024-04-26T20:19:06.950 INFO:tasks.workunit.client.0.smithi016.stdout:6/866: creat d1/d21/d26/d1c/d2e/d53/f120 x:0 0 0 2024-04-26T20:19:06.951 INFO:tasks.workunit.client.0.smithi016.stdout:3/772: rmdir d3/d9/d18 39 2024-04-26T20:19:06.953 INFO:tasks.workunit.client.0.smithi016.stdout:4/791: unlink d0/d1e/d4e/d52/d88/d43/d9c/l9f 0 2024-04-26T20:19:06.956 INFO:tasks.workunit.client.0.smithi016.stdout:0/833: creat d2/d40/d61/f114 x:0 0 0 2024-04-26T20:19:06.956 INFO:tasks.workunit.client.0.smithi016.stdout:0/834: dread - d2/d20/d57/f7f zero size 2024-04-26T20:19:06.959 INFO:tasks.workunit.client.0.smithi016.stdout:8/892: rename d9/d19/d45/d3f/f63 to d9/d19/d45/d3f/d4d/dba/f132 0 2024-04-26T20:19:06.959 INFO:tasks.workunit.client.0.smithi016.stdout:8/893: truncate d9/d19/d45/d9e/f8e 939599 0 2024-04-26T20:19:06.959 INFO:tasks.workunit.client.0.smithi016.stdout:8/894: readlink d9/d19/d45/d9e/l75 0 2024-04-26T20:19:06.959 INFO:tasks.workunit.client.0.smithi016.stdout:7/826: dread d0/fc [0,4194304] 0 2024-04-26T20:19:06.960 INFO:tasks.workunit.client.0.smithi016.stdout:6/867: creat d1/d21/d26/d1c/d7b/d82/d8f/f121 x:0 0 0 2024-04-26T20:19:06.962 INFO:tasks.workunit.client.0.smithi016.stdout:3/773: link d3/df/d25/d2a/c2c d3/cf3 0 2024-04-26T20:19:06.962 INFO:tasks.workunit.client.0.smithi016.stdout:3/774: dread - d3/d9/fd9 zero size 2024-04-26T20:19:06.963 INFO:tasks.workunit.client.0.smithi016.stdout:4/792: truncate d0/d1e/d30/fda 1016596 0 2024-04-26T20:19:06.963 INFO:tasks.workunit.client.0.smithi016.stdout:4/793: chown d0/dd/d19/d57/c9a 0 1 2024-04-26T20:19:06.963 INFO:tasks.workunit.client.0.smithi016.stdout:0/835: creat d2/dc/d1e/d35/dee/f115 x:0 0 0 2024-04-26T20:19:06.967 INFO:tasks.workunit.client.0.smithi016.stdout:8/895: creat d9/ddb/f133 x:0 0 0 2024-04-26T20:19:06.967 INFO:tasks.workunit.client.0.smithi016.stdout:8/896: write d9/d19/d45/f128 [1002356,72645] 0 2024-04-26T20:19:06.968 INFO:tasks.workunit.client.0.smithi016.stdout:6/868: unlink d1/d21/d26/d1c/d8a/la3 0 2024-04-26T20:19:06.969 INFO:tasks.workunit.client.0.smithi016.stdout:3/775: creat d3/d9/d18/d82/ff4 x:0 0 0 2024-04-26T20:19:06.969 INFO:tasks.workunit.client.0.smithi016.stdout:3/776: chown d3/df/d25/d2a/d4a/l56 87 1 2024-04-26T20:19:06.971 INFO:tasks.workunit.client.0.smithi016.stdout:4/794: creat d0/dd/d1b/dbc/dfa/d6f/f103 x:0 0 0 2024-04-26T20:19:06.978 INFO:tasks.workunit.client.0.smithi016.stdout:6/869: creat d1/d21/d26/d1c/d5d/def/d2c/d47/f122 x:0 0 0 2024-04-26T20:19:06.978 INFO:tasks.workunit.client.0.smithi016.stdout:6/870: write d1/d21/d26/d1c/d2e/d53/f101 [243101,126141] 0 2024-04-26T20:19:06.979 INFO:tasks.workunit.client.0.smithi016.stdout:3/777: mknod d3/d9/d2d/db8/cf5 0 2024-04-26T20:19:06.979 INFO:tasks.workunit.client.0.smithi016.stdout:3/778: chown d3/d9/lee 432 1 2024-04-26T20:19:06.979 INFO:tasks.workunit.client.0.smithi016.stdout:7/827: dread d0/dd5/d46/f84 [0,4194304] 0 2024-04-26T20:19:06.980 INFO:tasks.workunit.client.0.smithi016.stdout:4/795: creat d0/dd/d19/d1f/d7b/f104 x:0 0 0 2024-04-26T20:19:06.980 INFO:tasks.workunit.client.0.smithi016.stdout:4/796: fdatasync d0/dd/d1b/f48 0 2024-04-26T20:19:06.981 INFO:tasks.workunit.client.0.smithi016.stdout:4/797: truncate d0/dd/d1b/dbc/dc5/dd7/feb 681078 0 2024-04-26T20:19:06.981 INFO:tasks.workunit.client.0.smithi016.stdout:8/897: dread d9/d19/fa8 [0,4194304] 0 2024-04-26T20:19:06.983 INFO:tasks.workunit.client.0.smithi016.stdout:6/871: creat d1/d21/d26/d1c/d7b/d82/f123 x:0 0 0 2024-04-26T20:19:06.984 INFO:tasks.workunit.client.0.smithi016.stdout:3/779: mknod d3/d9/d2d/db8/cf6 0 2024-04-26T20:19:06.985 INFO:tasks.workunit.client.0.smithi016.stdout:3/780: read d3/df/d25/d2a/f7a [1747489,117695] 0 2024-04-26T20:19:06.985 INFO:tasks.workunit.client.0.smithi016.stdout:3/781: write d3/df/d25/fdf [925827,121618] 0 2024-04-26T20:19:06.986 INFO:tasks.workunit.client.0.smithi016.stdout:7/828: getdents d0/d67 0 2024-04-26T20:19:06.993 INFO:tasks.workunit.client.0.smithi016.stdout:8/898: truncate d9/d19/d45/d3f/d64/f65 625115 0 2024-04-26T20:19:06.993 INFO:tasks.workunit.client.0.smithi016.stdout:6/872: creat d1/d21/d78/d109/f124 x:0 0 0 2024-04-26T20:19:06.993 INFO:tasks.workunit.client.0.smithi016.stdout:3/782: mkdir d3/d70/df7 0 2024-04-26T20:19:06.996 INFO:tasks.workunit.client.0.smithi016.stdout:7/829: creat d0/d83/ff8 x:0 0 0 2024-04-26T20:19:06.997 INFO:tasks.workunit.client.0.smithi016.stdout:7/830: write d0/fe8 [250782,122906] 0 2024-04-26T20:19:06.997 INFO:tasks.workunit.client.0.smithi016.stdout:8/899: creat d9/d23/d26/d2c/d127/f134 x:0 0 0 2024-04-26T20:19:06.997 INFO:tasks.workunit.client.0.smithi016.stdout:8/900: write d9/d19/d45/d9e/d50/fe9 [642507,23718] 0 2024-04-26T20:19:06.999 INFO:tasks.workunit.client.0.smithi016.stdout:6/873: mkdir d1/d21/d78/d125 0 2024-04-26T20:19:06.999 INFO:tasks.workunit.client.0.smithi016.stdout:6/874: fsync d1/d3a/fb2 0 2024-04-26T20:19:07.001 INFO:tasks.workunit.client.0.smithi016.stdout:7/831: symlink d0/dd5/d34/d25/d3f/df2/lf9 0 2024-04-26T20:19:07.003 INFO:tasks.workunit.client.0.smithi016.stdout:8/901: getdents d9 0 2024-04-26T20:19:07.003 INFO:tasks.workunit.client.0.smithi016.stdout:8/902: dread - d9/fa7 zero size 2024-04-26T20:19:07.003 INFO:tasks.workunit.client.0.smithi016.stdout:6/875: getdents d1 0 2024-04-26T20:19:07.005 INFO:tasks.workunit.client.0.smithi016.stdout:7/832: symlink d0/dd5/d88/db3/dc1/lfa 0 2024-04-26T20:19:07.008 INFO:tasks.workunit.client.0.smithi016.stdout:8/903: unlink d9/d19/d45/d9e/l4e 0 2024-04-26T20:19:07.008 INFO:tasks.workunit.client.0.smithi016.stdout:6/876: creat d1/d21/d26/d1c/d5d/de2/de4/f126 x:0 0 0 2024-04-26T20:19:07.009 INFO:tasks.workunit.client.0.smithi016.stdout:1/944: dwrite d3/d5/f4f [4194304,4194304] 0 2024-04-26T20:19:07.009 INFO:tasks.workunit.client.0.smithi016.stdout:6/877: write d1/d21/d26/d1c/f7c [784703,31159] 0 2024-04-26T20:19:07.010 INFO:tasks.workunit.client.0.smithi016.stdout:3/783: write d3/df/f58 [2465304,40412] 0 2024-04-26T20:19:07.011 INFO:tasks.workunit.client.0.smithi016.stdout:8/904: read d9/d19/d45/d9e/d50/da9/dac/fb7 [182418,30676] 0 2024-04-26T20:19:07.011 INFO:tasks.workunit.client.0.smithi016.stdout:8/905: readlink d9/d23/d26/d2c/l6e 0 2024-04-26T20:19:07.013 INFO:tasks.workunit.client.0.smithi016.stdout:7/833: mkdir d0/dd5/d34/d25/d3f/dfb 0 2024-04-26T20:19:07.020 INFO:tasks.workunit.client.0.smithi016.stdout:1/945: unlink d3/d5/da/l7a 0 2024-04-26T20:19:07.025 INFO:tasks.workunit.client.0.smithi016.stdout:8/906: rmdir d9/d104 39 2024-04-26T20:19:07.027 INFO:tasks.workunit.client.0.smithi016.stdout:7/834: dread d0/dd5/d6/f3d [0,4194304] 0 2024-04-26T20:19:07.029 INFO:tasks.workunit.client.0.smithi016.stdout:1/946: creat d3/d5/da/d66/d8c/f133 x:0 0 0 2024-04-26T20:19:07.029 INFO:tasks.workunit.client.0.smithi016.stdout:1/947: chown d3/d5/d8d/l9d 0 1 2024-04-26T20:19:07.035 INFO:tasks.workunit.client.0.smithi016.stdout:0/836: dwrite d2/d8/d3b/fd8 [0,4194304] 0 2024-04-26T20:19:07.035 INFO:tasks.workunit.client.0.smithi016.stdout:0/837: read - d2/dc/d18/d24/d53/fd0 zero size 2024-04-26T20:19:07.035 INFO:tasks.workunit.client.0.smithi016.stdout:7/835: mkdir d0/d51/dc7/dfc 0 2024-04-26T20:19:07.044 INFO:tasks.workunit.client.0.smithi016.stdout:0/838: link d2/dc/d1e/d25/c5f d2/dc/d1e/d35/dee/c116 0 2024-04-26T20:19:07.045 INFO:tasks.workunit.client.0.smithi016.stdout:7/836: creat d0/d51/ffd x:0 0 0 2024-04-26T20:19:07.062 INFO:tasks.workunit.client.0.smithi016.stdout:0/839: write d2/dc/d18/f48 [686194,28714] 0 2024-04-26T20:19:07.062 INFO:tasks.workunit.client.0.smithi016.stdout:0/840: dread - d2/d8/d37/d70/f109 zero size 2024-04-26T20:19:07.064 INFO:tasks.workunit.client.0.smithi016.stdout:7/837: truncate d0/f42 3467869 0 2024-04-26T20:19:07.068 INFO:tasks.workunit.client.0.smithi016.stdout:6/878: write d1/d12/fb5 [1198598,73840] 0 2024-04-26T20:19:07.079 INFO:tasks.workunit.client.0.smithi016.stdout:0/841: symlink d2/dc/d1e/d107/l117 0 2024-04-26T20:19:07.088 INFO:tasks.workunit.client.0.smithi016.stdout:4/798: dwrite d0/f15 [0,4194304] 0 2024-04-26T20:19:07.088 INFO:tasks.workunit.client.0.smithi016.stdout:8/907: dwrite d9/d19/d45/d9e/d50/ff5 [0,4194304] 0 2024-04-26T20:19:07.090 INFO:tasks.workunit.client.0.smithi016.stdout:6/879: truncate d1/d21/d26/d1c/d5d/def/fc 2999362 0 2024-04-26T20:19:07.094 INFO:tasks.workunit.client.0.smithi016.stdout:1/948: dwrite d3/d5/da/d66/d8c/d84/d86/d12d/d5a/f3f [0,4194304] 0 2024-04-26T20:19:07.112 INFO:tasks.workunit.client.0.smithi016.stdout:6/880: dread d1/d12/d90/ff4 [0,4194304] 0 2024-04-26T20:19:07.112 INFO:tasks.workunit.client.0.smithi016.stdout:6/881: dread - d1/d21/d26/d1c/d5d/def/d76/fd8 zero size 2024-04-26T20:19:07.115 INFO:tasks.workunit.client.0.smithi016.stdout:7/838: dwrite d0/dd5/d34/d25/d50/fa8 [0,4194304] 0 2024-04-26T20:19:07.115 INFO:tasks.workunit.client.0.smithi016.stdout:7/839: readlink d0/dd5/d6/l16 0 2024-04-26T20:19:07.120 INFO:tasks.workunit.client.0.smithi016.stdout:3/784: dwrite f0 [8388608,4194304] 0 2024-04-26T20:19:07.122 INFO:tasks.workunit.client.0.smithi016.stdout:6/882: creat d1/d21/d26/d1c/d5d/def/d2c/d3d/f127 x:0 0 0 2024-04-26T20:19:07.122 INFO:tasks.workunit.client.0.smithi016.stdout:3/785: mkdir d3/d9/d2d/d4f/df8 0 2024-04-26T20:19:07.123 INFO:tasks.workunit.client.0.smithi016.stdout:6/883: symlink d1/d21/d78/d125/l128 0 2024-04-26T20:19:07.123 INFO:tasks.workunit.client.0.smithi016.stdout:6/884: write d1/d21/d26/d1c/d5d/def/d2c/d3d/f118 [557524,34766] 0 2024-04-26T20:19:07.124 INFO:tasks.workunit.client.0.smithi016.stdout:6/885: write d1/d21/fe7 [270898,128920] 0 2024-04-26T20:19:07.124 INFO:tasks.workunit.client.0.smithi016.stdout:3/786: rmdir d3/df/d25 39 2024-04-26T20:19:07.124 INFO:tasks.workunit.client.0.smithi016.stdout:3/787: dread - d3/d9/d18/d5a/fbc zero size 2024-04-26T20:19:07.125 INFO:tasks.workunit.client.0.smithi016.stdout:6/886: mknod d1/d21/d26/d1c/d4e/c129 0 2024-04-26T20:19:07.127 INFO:tasks.workunit.client.0.smithi016.stdout:3/788: mkdir d3/d70/d8b/d98/df9 0 2024-04-26T20:19:07.127 INFO:tasks.workunit.client.0.smithi016.stdout:3/789: readlink d3/l6 0 2024-04-26T20:19:07.128 INFO:tasks.workunit.client.0.smithi016.stdout:6/887: truncate d1/d21/d26/d1c/ff0 3405963 0 2024-04-26T20:19:07.128 INFO:tasks.workunit.client.0.smithi016.stdout:6/888: write d1/d21/d26/d1c/d5d/def/d2c/d47/dd7/ffb [308532,78639] 0 2024-04-26T20:19:07.128 INFO:tasks.workunit.client.0.smithi016.stdout:6/889: dread - d1/d21/f117 zero size 2024-04-26T20:19:07.130 INFO:tasks.workunit.client.0.smithi016.stdout:8/908: dread d9/d23/d26/f2e [0,4194304] 0 2024-04-26T20:19:07.130 INFO:tasks.workunit.client.0.smithi016.stdout:8/909: fsync d9/d19/d45/d9e/f8e 0 2024-04-26T20:19:07.130 INFO:tasks.workunit.client.0.smithi016.stdout:3/790: mkdir d3/d9/d18/dfa 0 2024-04-26T20:19:07.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/910: mkdir d9/d19/d45/d3f/d64/dfc/d135 0 2024-04-26T20:19:07.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/911: write d9/d23/d26/d2c/d127/f134 [512561,129608] 0 2024-04-26T20:19:07.133 INFO:tasks.workunit.client.0.smithi016.stdout:8/912: stat d9/d23/d26/d2c/l8b 0 2024-04-26T20:19:07.135 INFO:tasks.workunit.client.0.smithi016.stdout:3/791: rename d3/df/d25/d2a/d69 to d3/d9/d18/dfa/dfb 0 2024-04-26T20:19:07.143 INFO:tasks.workunit.client.0.smithi016.stdout:3/792: stat d3/d9/d2d/fa5 0 2024-04-26T20:19:07.143 INFO:tasks.workunit.client.0.smithi016.stdout:1/949: write d3/d5/da/d66/d8c/d84/d86/d12d/d9/f38 [821493,112524] 0 2024-04-26T20:19:07.143 INFO:tasks.workunit.client.0.smithi016.stdout:1/950: chown d3/d57/f44 2140005045 1 2024-04-26T20:19:07.143 INFO:tasks.workunit.client.0.smithi016.stdout:1/951: readlink d3/l131 0 2024-04-26T20:19:07.143 INFO:tasks.workunit.client.0.smithi016.stdout:6/890: mkdir d1/d21/d26/d1c/d5d/def/d12a 0 2024-04-26T20:19:07.145 INFO:tasks.workunit.client.0.smithi016.stdout:7/840: dread d0/dd5/d34/dec/fc6 [0,4194304] 0 2024-04-26T20:19:07.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/913: truncate d9/d19/f33 687418 0 2024-04-26T20:19:07.145 INFO:tasks.workunit.client.0.smithi016.stdout:8/914: truncate d9/d19/f91 32448 0 2024-04-26T20:19:07.149 INFO:tasks.workunit.client.0.smithi016.stdout:6/891: truncate d1/d21/d26/d1c/d5d/def/d46/f6c 44253 0 2024-04-26T20:19:07.150 INFO:tasks.workunit.client.0.smithi016.stdout:8/915: mknod d9/d72/d74/dcd/dd7/d101/c136 0 2024-04-26T20:19:07.151 INFO:tasks.workunit.client.0.smithi016.stdout:0/842: dwrite d2/dc/d45/f84 [0,4194304] 0 2024-04-26T20:19:07.154 INFO:tasks.workunit.client.0.smithi016.stdout:7/841: rmdir d0/dd5/d34/dec 39 2024-04-26T20:19:07.157 INFO:tasks.workunit.client.0.smithi016.stdout:6/892: creat d1/d12/d90/f12b x:0 0 0 2024-04-26T20:19:07.157 INFO:tasks.workunit.client.0.smithi016.stdout:6/893: dread - d1/d3a/db9/fd2 zero size 2024-04-26T20:19:07.158 INFO:tasks.workunit.client.0.smithi016.stdout:6/894: dread - d1/d21/f117 zero size 2024-04-26T20:19:07.163 INFO:tasks.workunit.client.0.smithi016.stdout:8/916: rename d9/d23/lc7 to d9/d19/d45/d9e/d50/dad/l137 0 2024-04-26T20:19:07.163 INFO:tasks.workunit.client.0.smithi016.stdout:8/917: truncate d9/d19/fb2 485407 0 2024-04-26T20:19:07.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/918: write d9/d72/d74/f95 [216927,109726] 0 2024-04-26T20:19:07.164 INFO:tasks.workunit.client.0.smithi016.stdout:8/919: truncate d9/f14 3607425 0 2024-04-26T20:19:07.169 INFO:tasks.workunit.client.0.smithi016.stdout:8/920: getdents d9/d19/d45/d9e/d50/d124 0 2024-04-26T20:19:07.179 INFO:tasks.workunit.client.0.smithi016.stdout:3/793: read d3/df/d25/d2a/d4a/fb4 [2599140,49341] 0 2024-04-26T20:19:07.184 INFO:tasks.workunit.client.0.smithi016.stdout:8/921: mkdir d9/d19/d45/d3f/d64/db6/d138 0 2024-04-26T20:19:07.187 INFO:tasks.workunit.client.0.smithi016.stdout:8/922: creat d9/d19/d45/d3f/d64/db6/f139 x:0 0 0 2024-04-26T20:19:07.189 INFO:tasks.workunit.client.0.smithi016.stdout:7/842: dread d0/d83/f3c [0,4194304] 0 2024-04-26T20:19:07.192 INFO:tasks.workunit.client.0.smithi016.stdout:7/843: write d0/d83/ff8 [301085,64038] 0 2024-04-26T20:19:07.196 INFO:tasks.workunit.client.0.smithi016.stdout:4/799: dwrite d0/dd/d1b/fd6 [0,4194304] 0 2024-04-26T20:19:07.201 INFO:tasks.workunit.client.0.smithi016.stdout:8/923: dread d9/f90 [0,4194304] 0 2024-04-26T20:19:07.202 INFO:tasks.workunit.client.0.smithi016.stdout:6/895: write d1/f4 [2013193,8698] 0 2024-04-26T20:19:07.209 INFO:tasks.workunit.client.0.smithi016.stdout:3/794: dread d3/df/d25/d32/d3f/fb6 [0,4194304] 0 2024-04-26T20:19:07.209 INFO:tasks.workunit.client.0.smithi016.stdout:3/795: chown d3/l6 17043629 1 2024-04-26T20:19:07.209 INFO:tasks.workunit.client.0.smithi016.stdout:3/796: stat d3/df/d25/d32/d3f/l90 0 2024-04-26T20:19:07.211 INFO:tasks.workunit.client.0.smithi016.stdout:8/924: rename d9/d19/d45/d3f/d64/l83 to d9/d23/l13a 0 2024-04-26T20:19:07.216 INFO:tasks.workunit.client.0.smithi016.stdout:6/896: symlink d1/d21/d26/d1c/d5d/d88/l12c 0 2024-04-26T20:19:07.220 INFO:tasks.workunit.client.0.smithi016.stdout:2/958: sync 2024-04-26T20:19:07.221 INFO:tasks.workunit.client.0.smithi016.stdout:8/925: rmdir d9/d19/d45/d3f/d64 39 2024-04-26T20:19:07.240 INFO:tasks.workunit.client.0.smithi016.stdout:7/844: dwrite d0/d83/f3c [0,4194304] 0 2024-04-26T20:19:07.243 INFO:tasks.workunit.client.0.smithi016.stdout:2/959: link d1d/d27/d2d/d6b/d7e/ddc/fe7 d1d/d2a/d3d/dd9/d103/f14b 0 2024-04-26T20:19:07.243 INFO:tasks.workunit.client.0.smithi016.stdout:2/960: chown d1d/c21 19686 1 2024-04-26T20:19:07.245 INFO:tasks.workunit.client.0.smithi016.stdout:7/845: getdents d0/dd5/d34/d25/d3f 0 2024-04-26T20:19:07.245 INFO:tasks.workunit.client.0.smithi016.stdout:7/846: fdatasync d0/dd5/d34/d25/d3f/d6d/d87/da3/fea 0 2024-04-26T20:19:07.245 INFO:tasks.workunit.client.0.smithi016.stdout:2/961: truncate d1d/d20/d22/d39/d3e/f74 3191077 0 2024-04-26T20:19:07.246 INFO:tasks.workunit.client.0.smithi016.stdout:7/847: mknod d0/d83/cfe 0 2024-04-26T20:19:07.261 INFO:tasks.workunit.client.0.smithi016.stdout:7/848: dread d0/f29 [0,4194304] 0 2024-04-26T20:19:07.261 INFO:tasks.workunit.client.0.smithi016.stdout:4/800: dwrite d0/dd/f2a [0,4194304] 0 2024-04-26T20:19:07.261 INFO:tasks.workunit.client.0.smithi016.stdout:4/801: read d0/dd/f84 [348007,4989] 0 2024-04-26T20:19:07.261 INFO:tasks.workunit.client.0.smithi016.stdout:4/802: write d0/f11 [3790710,82973] 0 2024-04-26T20:19:07.261 INFO:tasks.workunit.client.0.smithi016.stdout:4/803: chown d0/f1 546 1 2024-04-26T20:19:07.266 INFO:tasks.workunit.client.0.smithi016.stdout:2/962: getdents d1d/d20/d22/d39 0 2024-04-26T20:19:07.266 INFO:tasks.workunit.client.0.smithi016.stdout:2/963: readlink d1d/d27/d2d/d6b/d7e/lb6 0 2024-04-26T20:19:07.281 INFO:tasks.workunit.client.0.smithi016.stdout:4/804: read d0/d1e/d4e/d52/d88/d43/f56 [3519665,45531] 0 2024-04-26T20:19:07.281 INFO:tasks.workunit.client.0.smithi016.stdout:4/805: readlink d0/d96/ddc/de6/lfe 0 2024-04-26T20:19:07.285 INFO:tasks.workunit.client.0.smithi016.stdout:2/964: rmdir d1d/d52 39 2024-04-26T20:19:07.285 INFO:tasks.workunit.client.0.smithi016.stdout:2/965: readlink d1d/d27/d2d/d6b/lb0 0 2024-04-26T20:19:07.286 INFO:tasks.workunit.client.0.smithi016.stdout:2/966: truncate d1d/d27/d2d/d6b/d108/f13e 628063 0 2024-04-26T20:19:07.286 INFO:tasks.workunit.client.0.smithi016.stdout:2/967: dread - d1d/d27/d2d/d6b/d7e/ddc/f127 zero size 2024-04-26T20:19:07.287 INFO:tasks.workunit.client.0.smithi016.stdout:4/806: creat d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/f105 x:0 0 0 2024-04-26T20:19:07.287 INFO:tasks.workunit.client.0.smithi016.stdout:2/968: creat d1d/d20/d22/d39/f14c x:0 0 0 2024-04-26T20:19:07.332 INFO:tasks.workunit.client.0.smithi016.stdout:7/849: dwrite d0/dd5/d34/db7/fbd [0,4194304] 0 2024-04-26T20:19:07.356 INFO:tasks.workunit.client.0.smithi016.stdout:2/969: dwrite d1d/d20/d22/d98/f129 [0,4194304] 0 2024-04-26T20:19:07.357 INFO:tasks.workunit.client.0.smithi016.stdout:6/897: dwrite d1/d21/d26/d1c/d2e/f33 [0,4194304] 0 2024-04-26T20:19:07.359 INFO:tasks.workunit.client.0.smithi016.stdout:7/850: rename d0/d51/dba to d0/dd5/d34/dec/dff 0 2024-04-26T20:19:07.360 INFO:tasks.workunit.client.0.smithi016.stdout:2/970: creat d1d/d20/d22/d39/d3e/f14d x:0 0 0 2024-04-26T20:19:07.361 INFO:tasks.workunit.client.0.smithi016.stdout:6/898: creat d1/d21/d48/f12d x:0 0 0 2024-04-26T20:19:07.361 INFO:tasks.workunit.client.0.smithi016.stdout:6/899: readlink d1/d3a/db9/de0/l111 0 2024-04-26T20:19:07.361 INFO:tasks.workunit.client.0.smithi016.stdout:7/851: mkdir d0/d51/dc7/dfc/d100 0 2024-04-26T20:19:07.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/971: mkdir d1d/d27/d2d/d6b/d108/d114/dc7/dce/d14e 0 2024-04-26T20:19:07.362 INFO:tasks.workunit.client.0.smithi016.stdout:2/972: dread - d1d/d20/d22/d39/f14c zero size 2024-04-26T20:19:07.364 INFO:tasks.workunit.client.0.smithi016.stdout:2/973: dread d1d/d2a/d3d/dd9/de5/f110 [0,4194304] 0 2024-04-26T20:19:07.364 INFO:tasks.workunit.client.0.smithi016.stdout:2/974: truncate d1d/d20/d22/d39/d3e/f14d 724524 0 2024-04-26T20:19:07.364 INFO:tasks.workunit.client.0.smithi016.stdout:2/975: write d1d/d27/d2d/d6b/d7e/dd8/f13c [487078,20486] 0 2024-04-26T20:19:07.364 INFO:tasks.workunit.client.0.smithi016.stdout:2/976: stat d1d/d20/d22/d29/d145/dbc/d101/l10a 0 2024-04-26T20:19:07.366 INFO:tasks.workunit.client.0.smithi016.stdout:6/900: creat d1/d21/d78/d109/f12e x:0 0 0 2024-04-26T20:19:07.367 INFO:tasks.workunit.client.0.smithi016.stdout:2/977: mkdir d1d/d2a/d121/d14f 0 2024-04-26T20:19:07.369 INFO:tasks.workunit.client.0.smithi016.stdout:8/926: dwrite d9/d23/d26/d2c/fc0 [0,4194304] 0 2024-04-26T20:19:07.370 INFO:tasks.workunit.client.0.smithi016.stdout:6/901: rename d1/d21/d26/d1c/c99 to d1/d21/d26/d1c/d4e/c12f 0 2024-04-26T20:19:07.370 INFO:tasks.workunit.client.0.smithi016.stdout:6/902: write d1/d21/d26/d1c/d2e/d53/f101 [536414,6422] 0 2024-04-26T20:19:07.372 INFO:tasks.workunit.client.0.smithi016.stdout:2/978: unlink d1d/d20/d22/d39/ddd/led 0 2024-04-26T20:19:07.377 INFO:tasks.workunit.client.0.smithi016.stdout:7/852: dread d0/d67/fb6 [0,4194304] 0 2024-04-26T20:19:07.388 INFO:tasks.workunit.client.0.smithi016.stdout:4/807: dwrite d0/dd/d19/f24 [0,4194304] 0 2024-04-26T20:19:07.389 INFO:tasks.workunit.client.0.smithi016.stdout:8/927: truncate d9/d19/d45/f67 3981165 0 2024-04-26T20:19:07.391 INFO:tasks.workunit.client.0.smithi016.stdout:4/808: creat d0/dd/dc9/de4/df0/f106 x:0 0 0 2024-04-26T20:19:07.396 INFO:tasks.workunit.client.0.smithi016.stdout:6/903: dread d1/d21/d26/d1c/d7b/d82/d8f/fca [0,4194304] 0 2024-04-26T20:19:07.430 INFO:tasks.workunit.client.0.smithi016.stdout:7/853: dwrite d0/dd5/d6/d6e/f86 [0,4194304] 0 2024-04-26T20:19:07.450 INFO:tasks.workunit.client.0.smithi016.stdout:2/979: dwrite d1d/d27/d2d/d6b/d7e/ffb [0,4194304] 0 2024-04-26T20:19:07.452 INFO:tasks.workunit.client.0.smithi016.stdout:6/904: symlink d1/d3a/db9/de0/l130 0 2024-04-26T20:19:07.452 INFO:tasks.workunit.client.0.smithi016.stdout:8/928: dwrite d9/d19/f33 [0,4194304] 0 2024-04-26T20:19:07.453 INFO:tasks.workunit.client.0.smithi016.stdout:7/854: read d0/dd5/d46/fe5 [997208,15562] 0 2024-04-26T20:19:07.454 INFO:tasks.workunit.client.0.smithi016.stdout:2/980: link d1d/d20/d22/f117 d1d/d2a/d121/d14f/f150 0 2024-04-26T20:19:07.455 INFO:tasks.workunit.client.0.smithi016.stdout:4/809: dwrite d0/dd/d19/d1f/d7b/f104 [0,4194304] 0 2024-04-26T20:19:07.455 INFO:tasks.workunit.client.0.smithi016.stdout:4/810: chown d0/fa 73 1 2024-04-26T20:19:07.457 INFO:tasks.workunit.client.0.smithi016.stdout:8/929: creat d9/d72/d74/dcd/dd7/d101/f13b x:0 0 0 2024-04-26T20:19:07.457 INFO:tasks.workunit.client.0.smithi016.stdout:8/930: chown d9/d72 478052652 1 2024-04-26T20:19:07.457 INFO:tasks.workunit.client.0.smithi016.stdout:8/931: chown d9/f90 27326 1 2024-04-26T20:19:07.457 INFO:tasks.workunit.client.0.smithi016.stdout:8/932: chown d9/d23/d26/d2c/c7b 7942 1 2024-04-26T20:19:07.457 INFO:tasks.workunit.client.0.smithi016.stdout:6/905: unlink d1/d21/d26/d1c/d2e/f33 0 2024-04-26T20:19:07.458 INFO:tasks.workunit.client.0.smithi016.stdout:8/933: write d9/d2f/f86 [951804,75068] 0 2024-04-26T20:19:07.458 INFO:tasks.workunit.client.0.smithi016.stdout:6/906: write d1/d21/d26/d1c/d5d/d88/ffd [1384869,80622] 0 2024-04-26T20:19:07.458 INFO:tasks.workunit.client.0.smithi016.stdout:7/855: creat d0/dd5/d34/d25/d3f/d6d/d87/da3/f101 x:0 0 0 2024-04-26T20:19:07.459 INFO:tasks.workunit.client.0.smithi016.stdout:2/981: creat d1d/d20/d22/d39/d3e/f151 x:0 0 0 2024-04-26T20:19:07.459 INFO:tasks.workunit.client.0.smithi016.stdout:2/982: write d1d/d27/d49/f56 [370459,129634] 0 2024-04-26T20:19:07.462 INFO:tasks.workunit.client.0.smithi016.stdout:8/934: truncate d9/d19/f34 2447195 0 2024-04-26T20:19:07.463 INFO:tasks.workunit.client.0.smithi016.stdout:2/983: creat d1d/f152 x:0 0 0 2024-04-26T20:19:07.464 INFO:tasks.workunit.client.0.smithi016.stdout:2/984: fdatasync d1d/f43 0 2024-04-26T20:19:07.464 INFO:tasks.workunit.client.0.smithi016.stdout:2/985: chown d1d/d20/d22/d89/f10f 175 1 2024-04-26T20:19:07.464 INFO:tasks.workunit.client.0.smithi016.stdout:8/935: symlink d9/d72/d74/d9f/dfd/l13c 0 2024-04-26T20:19:07.466 INFO:tasks.workunit.client.0.smithi016.stdout:2/986: rename d1d/d20/l12c to d1d/d27/d2d/d6b/d7e/l153 0 2024-04-26T20:19:07.467 INFO:tasks.workunit.client.0.smithi016.stdout:8/936: symlink d9/ddb/l13d 0 2024-04-26T20:19:07.467 INFO:tasks.workunit.client.0.smithi016.stdout:8/937: stat d9/d23/d26/d2c/l8b 0 2024-04-26T20:19:07.473 INFO:tasks.workunit.client.0.smithi016.stdout:6/907: read d1/d12/fb7 [254931,5722] 0 2024-04-26T20:19:07.473 INFO:tasks.workunit.client.0.smithi016.stdout:6/908: truncate d1/d21/d26/d1c/d2e/d53/f5f 780380 0 2024-04-26T20:19:07.474 INFO:tasks.workunit.client.0.smithi016.stdout:2/987: rmdir d1d/d20/d22/d88/da4 39 2024-04-26T20:19:07.474 INFO:tasks.workunit.client.0.smithi016.stdout:2/988: fdatasync d1d/d27/f50 0 2024-04-26T20:19:07.480 INFO:tasks.workunit.client.0.smithi016.stdout:8/938: dread d9/f14 [0,4194304] 0 2024-04-26T20:19:07.487 INFO:tasks.workunit.client.0.smithi016.stdout:8/939: mkdir d9/d19/d45/d9e/d50/da9/d13e 0 2024-04-26T20:19:07.487 INFO:tasks.workunit.client.0.smithi016.stdout:8/940: getdents d9/d19/d45/d106/d12b 0 2024-04-26T20:19:07.492 INFO:tasks.workunit.client.0.smithi016.stdout:0/843: sync 2024-04-26T20:19:07.492 INFO:tasks.workunit.client.0.smithi016.stdout:1/952: sync 2024-04-26T20:19:07.495 INFO:tasks.workunit.client.0.smithi016.stdout:8/941: unlink d9/d23/d26/cdc 0 2024-04-26T20:19:07.496 INFO:tasks.workunit.client.0.smithi016.stdout:0/844: creat d2/d20/d41/d87/d9d/db8/f118 x:0 0 0 2024-04-26T20:19:07.498 INFO:tasks.workunit.client.0.smithi016.stdout:8/942: symlink d9/d72/d74/dcd/l13f 0 2024-04-26T20:19:07.500 INFO:tasks.workunit.client.0.smithi016.stdout:0/845: stat d2/d20/d41/d72/l8e 0 2024-04-26T20:19:07.521 INFO:tasks.workunit.client.0.smithi016.stdout:2/989: write d1d/d27/d2d/f70 [5862284,57527] 0 2024-04-26T20:19:07.524 INFO:tasks.workunit.client.0.smithi016.stdout:8/943: rename d9/d19/d45/d9e/f68 to d9/d19/d45/d3f/f140 0 2024-04-26T20:19:07.525 INFO:tasks.workunit.client.0.smithi016.stdout:7/856: dread d0/d67/fb6 [0,4194304] 0 2024-04-26T20:19:07.525 INFO:tasks.workunit.client.0.smithi016.stdout:4/811: dwrite d0/f8d [4194304,4194304] 0 2024-04-26T20:19:07.529 INFO:tasks.workunit.client.0.smithi016.stdout:8/944: rename d9/d19/d45/d9e/d50/d109/d10c/c122 to d9/d19/d45/d3f/c141 0 2024-04-26T20:19:07.535 INFO:tasks.workunit.client.0.smithi016.stdout:7/857: link d0/dd5/d46/fe5 d0/dd5/d34/dec/dff/f102 0 2024-04-26T20:19:07.535 INFO:tasks.workunit.client.0.smithi016.stdout:0/846: dwrite d2/dc/d18/f29 [0,4194304] 0 2024-04-26T20:19:07.536 INFO:tasks.workunit.client.0.smithi016.stdout:2/990: truncate d1d/d2a/d3d/fd6 1222358 0 2024-04-26T20:19:07.537 INFO:tasks.workunit.client.0.smithi016.stdout:6/909: dwrite d1/d21/d48/f4f [0,4194304] 0 2024-04-26T20:19:07.538 INFO:tasks.workunit.client.0.smithi016.stdout:7/858: creat d0/dd5/f103 x:0 0 0 2024-04-26T20:19:07.539 INFO:tasks.workunit.client.0.smithi016.stdout:0/847: mkdir d2/d8/d119 0 2024-04-26T20:19:07.540 INFO:tasks.workunit.client.0.smithi016.stdout:2/991: rmdir d1d/d20/d22/d39 39 2024-04-26T20:19:07.544 INFO:tasks.workunit.client.0.smithi016.stdout:8/945: dread d9/d23/d26/d2c/d127/f134 [0,4194304] 0 2024-04-26T20:19:07.544 INFO:tasks.workunit.client.0.smithi016.stdout:8/946: chown d9/d19/d45/d3f/d4d/cd8 0 1 2024-04-26T20:19:07.545 INFO:tasks.workunit.client.0.smithi016.stdout:1/953: dwrite d3/d5/da/d66/d8c/d84/d86/d12d/d9/f108 [4194304,4194304] 0 2024-04-26T20:19:07.546 INFO:tasks.workunit.client.0.smithi016.stdout:4/812: write d0/dd/f3b [494446,130506] 0 2024-04-26T20:19:07.546 INFO:tasks.workunit.client.0.smithi016.stdout:4/813: truncate d0/d1e/d30/fdb 4243481 0 2024-04-26T20:19:07.550 INFO:tasks.workunit.client.0.smithi016.stdout:6/910: symlink d1/d3a/db9/dec/l131 0 2024-04-26T20:19:07.550 INFO:tasks.workunit.client.0.smithi016.stdout:3/797: sync 2024-04-26T20:19:07.550 INFO:tasks.workunit.client.0.smithi016.stdout:3/798: fsync d3/df/d25/d2a/f73 0 2024-04-26T20:19:07.551 INFO:tasks.workunit.client.0.smithi016.stdout:7/859: symlink d0/d51/dc7/l104 0 2024-04-26T20:19:07.553 INFO:tasks.workunit.client.0.smithi016.stdout:8/947: unlink d9/d19/f8f 0 2024-04-26T20:19:07.553 INFO:tasks.workunit.client.0.smithi016.stdout:8/948: chown d9/d19/l6a 938 1 2024-04-26T20:19:07.553 INFO:tasks.workunit.client.0.smithi016.stdout:1/954: mknod d3/d5/da/d66/da2/c134 0 2024-04-26T20:19:07.555 INFO:tasks.workunit.client.0.smithi016.stdout:6/911: creat d1/d21/d48/d116/f132 x:0 0 0 2024-04-26T20:19:07.555 INFO:tasks.workunit.client.0.smithi016.stdout:0/848: dread d2/d20/d41/f65 [0,4194304] 0 2024-04-26T20:19:07.556 INFO:tasks.workunit.client.0.smithi016.stdout:4/814: mkdir d0/d1e/d4e/d52/d88/d107 0 2024-04-26T20:19:07.556 INFO:tasks.workunit.client.0.smithi016.stdout:4/815: write d0/d1e/fc1 [1157159,126792] 0 2024-04-26T20:19:07.556 INFO:tasks.workunit.client.0.smithi016.stdout:4/816: chown d0/d1e/d4e/ca6 2 1 2024-04-26T20:19:07.557 INFO:tasks.workunit.client.0.smithi016.stdout:3/799: link d3/cf3 d3/d70/d8b/d98/cfc 0 2024-04-26T20:19:07.558 INFO:tasks.workunit.client.0.smithi016.stdout:7/860: creat d0/dd5/d34/d25/f105 x:0 0 0 2024-04-26T20:19:07.559 INFO:tasks.workunit.client.0.smithi016.stdout:8/949: rename d9/d19/d45/d3f/d4d/lb4 to d9/d19/d45/d9e/l142 0 2024-04-26T20:19:07.560 INFO:tasks.workunit.client.0.smithi016.stdout:1/955: getdents d3/d5/da/d66/d8c/d84/d86/d12d 0 2024-04-26T20:19:07.562 INFO:tasks.workunit.client.0.smithi016.stdout:0/849: mknod d2/d40/d61/d91/c11a 0 2024-04-26T20:19:07.564 INFO:tasks.workunit.client.0.smithi016.stdout:4/817: creat d0/d1e/d4e/f108 x:0 0 0 2024-04-26T20:19:07.569 INFO:tasks.workunit.client.0.smithi016.stdout:3/800: mknod d3/d9/d18/d82/cfd 0 2024-04-26T20:19:07.570 INFO:tasks.workunit.client.0.smithi016.stdout:7/861: rename d0/dd5/d95 to d0/dd5/d46/db4/d106 0 2024-04-26T20:19:07.570 INFO:tasks.workunit.client.0.smithi016.stdout:7/862: write d0/dd5/d34/d25/d50/fde [1062553,65592] 0 2024-04-26T20:19:07.571 INFO:tasks.workunit.client.0.smithi016.stdout:8/950: creat d9/d72/d74/f143 x:0 0 0 2024-04-26T20:19:07.572 INFO:tasks.workunit.client.0.smithi016.stdout:1/956: unlink d3/d5/da/d66/d8c/d84/d86/d12d/d50/d58/l6c 0 2024-04-26T20:19:07.572 INFO:tasks.workunit.client.0.smithi016.stdout:1/957: chown d3/d5/da/d66/d8c/d84/d86/d12d/d9/f115 3392489 1 2024-04-26T20:19:07.572 INFO:tasks.workunit.client.0.smithi016.stdout:1/958: chown d3/d5/da/d66/d8c/d84/d86/d12d/d9/c95 991152 1 2024-04-26T20:19:07.574 INFO:tasks.workunit.client.0.smithi016.stdout:3/801: mknod d3/df/d20/db0/dc2/cfe 0 2024-04-26T20:19:07.574 INFO:tasks.workunit.client.0.smithi016.stdout:3/802: fdatasync d3/d9/d18/d5a/fbc 0 2024-04-26T20:19:07.574 INFO:tasks.workunit.client.0.smithi016.stdout:7/863: mknod d0/dd5/d34/d25/d3f/d6d/dc2/c107 0 2024-04-26T20:19:07.574 INFO:tasks.workunit.client.0.smithi016.stdout:6/912: dread d1/d21/d26/d1c/d5d/def/d76/f9a [0,4194304] 0 2024-04-26T20:19:07.574 INFO:tasks.workunit.client.0.smithi016.stdout:6/913: chown d1/d21/d26/d1c/d5d/def/d76 6842166 1 2024-04-26T20:19:07.574 INFO:tasks.workunit.client.0.smithi016.stdout:6/914: fdatasync d1/d21/d26/d1c/d5d/def/d2c/d3d/fdd 0 2024-04-26T20:19:07.575 INFO:tasks.workunit.client.0.smithi016.stdout:8/951: symlink d9/d72/d74/dcd/l144 0 2024-04-26T20:19:07.577 INFO:tasks.workunit.client.0.smithi016.stdout:3/803: rename d3/df/d25/d2a/f94 to d3/df/d25/d2a/d4a/de4/de8/fff 0 2024-04-26T20:19:07.580 INFO:tasks.workunit.client.0.smithi016.stdout:3/804: truncate d3/d9/f65 6988052 0 2024-04-26T20:19:07.580 INFO:tasks.workunit.client.0.smithi016.stdout:3/805: fdatasync d3/d9/d2d/f9a 0 2024-04-26T20:19:07.590 INFO:tasks.workunit.client.0.smithi016.stdout:6/915: dread d1/d21/d26/d1c/d7b/d82/fa9 [0,4194304] 0 2024-04-26T20:19:07.592 INFO:tasks.workunit.client.0.smithi016.stdout:3/806: creat d3/d70/df7/f100 x:0 0 0 2024-04-26T20:19:07.603 INFO:tasks.workunit.client.0.smithi016.stdout:2/992: dwrite d1d/d20/d22/d88/da4/fa5 [0,4194304] 0 2024-04-26T20:19:07.603 INFO:tasks.workunit.client.0.smithi016.stdout:2/993: chown d1d/d20/d22/d39/d3e/f86 1573716883 1 2024-04-26T20:19:07.603 INFO:tasks.workunit.client.0.smithi016.stdout:2/994: write d1d/d20/f9f [400073,108210] 0 2024-04-26T20:19:07.603 INFO:tasks.workunit.client.0.smithi016.stdout:3/807: dread d3/d9/d18/dfa/dfb/db5/f6c [0,4194304] 0 2024-04-26T20:19:07.605 INFO:tasks.workunit.client.0.smithi016.stdout:6/916: link d1/d21/d26/d1c/d5d/def/d2c/d47/c5e d1/d21/d26/d1c/d5d/def/d2c/c133 0 2024-04-26T20:19:07.605 INFO:tasks.workunit.client.0.smithi016.stdout:6/917: readlink d1/d21/d26/d25/l63 0 2024-04-26T20:19:07.605 INFO:tasks.workunit.client.0.smithi016.stdout:6/918: chown d1/d21/d26/d1c/d2e/d53/d7f 168 1 2024-04-26T20:19:07.606 INFO:tasks.workunit.client.0.smithi016.stdout:2/995: creat d1d/d27/d49/f154 x:0 0 0 2024-04-26T20:19:07.610 INFO:tasks.workunit.client.0.smithi016.stdout:6/919: rename d1/d21/d26/d1c/d5d/def/d2c/d3d to d1/d21/d26/d1c/d5d/def/d46/d134 0 2024-04-26T20:19:07.629 INFO:tasks.workunit.client.0.smithi016.stdout:1/959: dwrite d3/d5/da/d66/d8c/d84/d96/df5/f12e [4194304,4194304] 0 2024-04-26T20:19:07.629 INFO:tasks.workunit.client.0.smithi016.stdout:1/960: truncate d3/d5/da/d66/d8c/d84/d86/d12d/d50/d79/da7/f111 485087 0 2024-04-26T20:19:07.633 INFO:tasks.workunit.client.0.smithi016.stdout:4/818: write d0/fa [900747,53997] 0 2024-04-26T20:19:07.643 INFO:tasks.workunit.client.0.smithi016.stdout:2/996: creat d1d/d27/d2d/d6b/d108/d114/dc7/dce/f155 x:0 0 0 2024-04-26T20:19:07.643 INFO:tasks.workunit.client.0.smithi016.stdout:2/997: chown d1d/d2a/d3d/fd6 638 1 2024-04-26T20:19:07.643 INFO:tasks.workunit.client.0.smithi016.stdout:2/998: readlink d1d/d20/d22/d39/lab 0 2024-04-26T20:19:07.645 INFO:tasks.workunit.client.0.smithi016.stdout:0/850: dwrite d2/d20/f2f [0,4194304] 0 2024-04-26T20:19:07.659 INFO:tasks.workunit.client.0.smithi016.stdout:7/864: write d0/dd5/d34/dec/fc6 [886713,80962] 0 2024-04-26T20:19:07.664 INFO:tasks.workunit.client.0.smithi016.stdout:0/851: creat d2/dc/d1e/d107/f11b x:0 0 0 2024-04-26T20:19:07.664 INFO:tasks.workunit.client.0.smithi016.stdout:8/952: dwrite d9/d19/f91 [0,4194304] 0 2024-04-26T20:19:07.677 INFO:tasks.workunit.client.0.smithi016.stdout:2/999: write d1d/d20/f2b [998974,15598] 0 2024-04-26T20:19:07.677 INFO:tasks.workunit.client.0.smithi016.stdout:1/961: dwrite d3/d5/da/d66/d8c/d84/d86/d12d/d9/d2a/d3b/faa [0,4194304] 0 2024-04-26T20:19:07.680 INFO:tasks.workunit.client.0.smithi016.stdout:4/819: dwrite d0/dd/d1b/dbc/dc5/dd7/feb [0,4194304] 0 2024-04-26T20:19:07.682 INFO:tasks.workunit.client.0.smithi016.stdout:3/808: dwrite d3/d9/d2d/d4f/f50 [0,4194304] 0 2024-04-26T20:19:07.688 INFO:tasks.workunit.client.0.smithi016.stdout:1/962: mknod d3/d5/da/d66/d8c/d84/d86/d12d/d9/d2a/d3b/c135 0 2024-04-26T20:19:07.688 INFO:tasks.workunit.client.0.smithi016.stdout:7/865: dread d0/dd5/f5e [0,4194304] 0 2024-04-26T20:19:07.688 INFO:tasks.workunit.client.0.smithi016.stdout:1/963: readlink d3/d5/da/d66/l80 0 2024-04-26T20:19:07.688 INFO:tasks.workunit.client.0.smithi016.stdout:1/964: dread - d3/d5/d8d/f100 zero size 2024-04-26T20:19:07.688 INFO:tasks.workunit.client.0.smithi016.stdout:1/965: fsync d3/d5/fb5 0 2024-04-26T20:19:07.691 INFO:tasks.workunit.client.0.smithi016.stdout:4/820: mknod d0/dd/d1b/dbc/dc5/c109 0 2024-04-26T20:19:07.694 INFO:tasks.workunit.client.0.smithi016.stdout:3/809: mkdir d3/df/d25/dc8/d101 0 2024-04-26T20:19:07.696 INFO:tasks.workunit.client.0.smithi016.stdout:1/966: creat d3/f136 x:0 0 0 2024-04-26T20:19:07.697 INFO:tasks.workunit.client.0.smithi016.stdout:4/821: symlink d0/d1e/d4e/d52/d88/l10a 0 2024-04-26T20:19:07.698 INFO:tasks.workunit.client.0.smithi016.stdout:3/810: symlink d3/df/d20/db0/dd1/l102 0 2024-04-26T20:19:07.702 INFO:tasks.workunit.client.0.smithi016.stdout:1/967: rename d3/d5/d8d/dab/la8 to d3/l137 0 2024-04-26T20:19:07.702 INFO:tasks.workunit.client.0.smithi016.stdout:4/822: symlink d0/l10b 0 2024-04-26T20:19:07.702 INFO:tasks.workunit.client.0.smithi016.stdout:4/823: chown d0/d1e/d4e/d52/d88/d43/d5a/fa9 192111227 1 2024-04-26T20:19:07.702 INFO:tasks.workunit.client.0.smithi016.stdout:3/811: unlink d3/df/d25/d2a/d4a/lcc 0 2024-04-26T20:19:07.703 INFO:tasks.workunit.client.0.smithi016.stdout:1/968: rename d3/d5/da/d66/d8c/d84/d86/d12d/l1f to d3/d57/da4/l138 0 2024-04-26T20:19:07.708 INFO:tasks.workunit.client.0.smithi016.stdout:4/824: creat d0/f10c x:0 0 0 2024-04-26T20:19:07.728 INFO:tasks.workunit.client.0.smithi016.stdout:4/825: dread d0/dd/d19/f24 [0,4194304] 0 2024-04-26T20:19:07.728 INFO:tasks.workunit.client.0.smithi016.stdout:3/812: write d3/d70/d8b/fda [4181143,89563] 0 2024-04-26T20:19:07.728 INFO:tasks.workunit.client.0.smithi016.stdout:4/826: chown d0/dd/d19/d1f/d7b/cd5 0 1 2024-04-26T20:19:07.728 INFO:tasks.workunit.client.0.smithi016.stdout:3/813: write d3/df/d25/d2a/d4a/f91 [416445,48753] 0 2024-04-26T20:19:07.728 INFO:tasks.workunit.client.0.smithi016.stdout:3/814: stat d3/df/d25/d2a/lcb 0 2024-04-26T20:19:07.729 INFO:tasks.workunit.client.0.smithi016.stdout:8/953: dwrite d9/d19/fb2 [0,4194304] 0 2024-04-26T20:19:07.731 INFO:tasks.workunit.client.0.smithi016.stdout:3/815: unlink d3/d9/cbe 0 2024-04-26T20:19:07.739 INFO:tasks.workunit.client.0.smithi016.stdout:8/954: unlink d9/d19/d45/d3f/d64/f65 0 2024-04-26T20:19:07.743 INFO:tasks.workunit.client.0.smithi016.stdout:3/816: dread d3/df/d25/d2a/d4a/fb4 [0,4194304] 0 2024-04-26T20:19:07.761 INFO:tasks.workunit.client.0.smithi016.stdout:3/817: dread d3/df/d25/f5c [0,4194304] 0 2024-04-26T20:19:07.763 INFO:tasks.workunit.client.0.smithi016.stdout:7/866: dwrite d0/d51/dc7/fe1 [0,4194304] 0 2024-04-26T20:19:07.763 INFO:tasks.workunit.client.0.smithi016.stdout:7/867: chown d0/dd5/d34/d25/d50/l82 59830032 1 2024-04-26T20:19:07.763 INFO:tasks.workunit.client.0.smithi016.stdout:7/868: truncate d0/dd5/d34/d25/d3f/d6d/d87/da3/fd8 847058 0 2024-04-26T20:19:07.764 INFO:tasks.workunit.client.0.smithi016.stdout:8/955: mkdir d9/d19/de6/d145 0 2024-04-26T20:19:07.778 INFO:tasks.workunit.client.0.smithi016.stdout:1/969: dwrite d3/d5/da/d66/d8c/d84/d86/d12d/d50/d79/da7/f128 [0,4194304] 0 2024-04-26T20:19:07.778 INFO:tasks.workunit.client.0.smithi016.stdout:1/970: write d3/d57/da4/f101 [2681716,14568] 0 2024-04-26T20:19:07.779 INFO:tasks.workunit.client.0.smithi016.stdout:7/869: rename d0/d83/ff8 to d0/dd5/d34/d25/d3f/dfb/f108 0 2024-04-26T20:19:07.779 INFO:tasks.workunit.client.0.smithi016.stdout:7/870: stat d0/d83/lf7 0 2024-04-26T20:19:07.790 INFO:tasks.workunit.client.0.smithi016.stdout:1/971: mknod d3/d5/d8d/dab/c139 0 2024-04-26T20:19:07.790 INFO:tasks.workunit.client.0.smithi016.stdout:1/972: write d3/d5/da/d66/d8c/d84/d86/d12d/d50/fe4 [5032877,6133] 0 2024-04-26T20:19:07.790 INFO:tasks.workunit.client.0.smithi016.stdout:1/973: truncate d3/d5/da/d66/d8c/d84/d86/d12d/d5a/f5d 819744 0 2024-04-26T20:19:07.792 INFO:tasks.workunit.client.0.smithi016.stdout:7/871: truncate d0/dd5/d46/db4/d106/f9a 759751 0 2024-04-26T20:19:07.795 INFO:tasks.workunit.client.0.smithi016.stdout:1/974: mknod d3/d5/da/d66/d8c/d84/c13a 0 2024-04-26T20:19:07.796 INFO:tasks.workunit.client.0.smithi016.stdout:7/872: creat d0/dd5/d46/f109 x:0 0 0 2024-04-26T20:19:07.803 INFO:tasks.workunit.client.0.smithi016.stdout:1/975: symlink d3/d5/da/d66/d8c/d84/d96/df5/l13b 0 2024-04-26T20:19:07.805 INFO:tasks.workunit.client.0.smithi016.stdout:7/873: mknod d0/dd5/d4b/c10a 0 2024-04-26T20:19:07.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:07.812 INFO:tasks.workunit.client.0.smithi016.stdout:8/956: dwrite d9/f53 [0,4194304] 0 2024-04-26T20:19:07.814 INFO:tasks.workunit.client.0.smithi016.stdout:1/976: creat d3/d57/dff/f13c x:0 0 0 2024-04-26T20:19:07.814 INFO:tasks.workunit.client.0.smithi016.stdout:1/977: dread - d3/d5/da/d66/d8c/d84/d96/df5/f109 zero size 2024-04-26T20:19:07.815 INFO:tasks.workunit.client.0.smithi016.stdout:8/957: symlink d9/d19/de6/l146 0 2024-04-26T20:19:07.851 INFO:tasks.workunit.client.0.smithi016.stdout:8/958: dwrite d9/f90 [0,4194304] 0 2024-04-26T20:19:07.853 INFO:tasks.workunit.client.0.smithi016.stdout:1/978: symlink d3/d5/da/d66/d8c/d84/d86/d12d/d9/d2a/d3b/l13d 0 2024-04-26T20:19:07.853 INFO:tasks.workunit.client.0.smithi016.stdout:1/979: fsync d3/d5/da/f11b 0 2024-04-26T20:19:07.853 INFO:tasks.workunit.client.0.smithi016.stdout:1/980: chown d3/d5/da/d66/d8c/d84/d86/d12d/d50/d79/c102 2108999835 1 2024-04-26T20:19:07.858 INFO:tasks.workunit.client.0.smithi016.stdout:1/981: dread d3/d5/d8d/dab/f127 [0,4194304] 0 2024-04-26T20:19:07.858 INFO:tasks.workunit.client.0.smithi016.stdout:1/982: chown d3/d57/f44 542064975 1 2024-04-26T20:19:07.859 INFO:tasks.workunit.client.0.smithi016.stdout:8/959: rename d9/d19/d45/d9e/d50/fe9 to d9/d19/d45/d9e/d50/dad/f147 0 2024-04-26T20:19:07.876 INFO:tasks.workunit.client.0.smithi016.stdout:8/960: dread d9/d23/d26/d2c/f85 [0,4194304] 0 2024-04-26T20:19:07.877 INFO:tasks.workunit.client.0.smithi016.stdout:1/983: creat d3/d5/da/d66/d8c/d84/d86/d12d/d5a/dbf/de2/f13e x:0 0 0 2024-04-26T20:19:07.879 INFO:tasks.workunit.client.0.smithi016.stdout:8/961: unlink d9/d72/d74/d9f/dfd/l12a 0 2024-04-26T20:19:07.879 INFO:tasks.workunit.client.0.smithi016.stdout:8/962: chown d9/d19/d45/d9e/d50/da9/dac/fb7 268655240 1 2024-04-26T20:19:07.881 INFO:tasks.workunit.client.0.smithi016.stdout:1/984: link d3/d57/dff/f13c d3/d5/da/d66/da2/f13f 0 2024-04-26T20:19:07.883 INFO:tasks.workunit.client.0.smithi016.stdout:8/963: unlink d9/d19/l6a 0 2024-04-26T20:19:07.883 INFO:tasks.workunit.client.0.smithi016.stdout:8/964: write d9/ddb/f133 [697302,5431] 0 2024-04-26T20:19:07.884 INFO:tasks.workunit.client.0.smithi016.stdout:3/818: dwrite d3/df/f26 [0,4194304] 0 2024-04-26T20:19:07.884 INFO:tasks.workunit.client.0.smithi016.stdout:3/819: readlink d3/d9/lb2 0 2024-04-26T20:19:07.885 INFO:tasks.workunit.client.0.smithi016.stdout:1/985: rename d3/d5/da/d66/d8c/c72 to d3/d5/da/d66/d8c/d84/d86/d12d/d50/d79/c140 0 2024-04-26T20:19:07.888 INFO:tasks.workunit.client.0.smithi016.stdout:3/820: creat d3/df/d25/dc8/de1/f103 x:0 0 0 2024-04-26T20:19:07.889 INFO:tasks.workunit.client.0.smithi016.stdout:8/965: truncate d9/d19/d45/f67 2280840 0 2024-04-26T20:19:07.890 INFO:tasks.workunit.client.0.smithi016.stdout:3/821: mkdir d3/d9/d18/d59/d104 0 2024-04-26T20:19:07.892 INFO:tasks.workunit.client.0.smithi016.stdout:8/966: rmdir d9/d19/d45/d3f/d10e 39 2024-04-26T20:19:07.892 INFO:tasks.workunit.client.0.smithi016.stdout:8/967: write d9/d72/d74/dcd/dd7/d101/f13b [933933,115719] 0 2024-04-26T20:19:07.894 INFO:tasks.workunit.client.0.smithi016.stdout:3/822: mkdir d3/df/d25/d32/d3f/d105 0 2024-04-26T20:19:07.895 INFO:tasks.workunit.client.0.smithi016.stdout:8/968: symlink d9/d23/d26/l148 0 2024-04-26T20:19:07.897 INFO:tasks.workunit.client.0.smithi016.stdout:3/823: creat d3/d70/d8b/ddc/deb/f106 x:0 0 0 2024-04-26T20:19:07.900 INFO:tasks.workunit.client.0.smithi016.stdout:1/986: dread d3/d5/da/d66/d8c/d84/d86/d12d/d9/d2a/d3d/fa9 [0,4194304] 0 2024-04-26T20:19:07.912 INFO:tasks.workunit.client.0.smithi016.stdout:1/987: write d3/d5/da/d66/d8c/d84/d86/d12d/d9/f73 [491838,103016] 0 2024-04-26T20:19:07.949 INFO:tasks.workunit.client.0.smithi016.stdout:1/988: dwrite d3/d5/da/d66/d8c/d84/d86/d12d/d50/d79/f85 [0,4194304] 0 2024-04-26T20:19:07.952 INFO:tasks.workunit.client.0.smithi016.stdout:8/969: truncate d9/f1b 3511161 0 2024-04-26T20:19:07.971 INFO:tasks.workunit.client.0.smithi016.stdout:3/824: dwrite d3/f7 [0,4194304] 0 2024-04-26T20:19:07.973 INFO:tasks.workunit.client.0.smithi016.stdout:3/825: read d3/df/d25/d2a/d4a/fca [201781,67897] 0 2024-04-26T20:19:07.974 INFO:tasks.workunit.client.0.smithi016.stdout:8/970: creat d9/d23/d26/d2c/dea/f149 x:0 0 0 2024-04-26T20:19:07.976 INFO:tasks.workunit.client.0.smithi016.stdout:3/826: link d3/df/d25/d2a/d4a/f7e d3/df/d25/d2a/d4a/de4/de8/f107 0 2024-04-26T20:19:07.977 INFO:tasks.workunit.client.0.smithi016.stdout:8/971: mknod d9/d72/c14a 0 2024-04-26T20:19:07.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e7e200640 1 Processor -- start 2024-04-26T20:19:07.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e7e200640 1 -- start start 2024-04-26T20:19:07.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e7e200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4e78155db0 0x7f4e780c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:07.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e7e200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e780ca470 con 0x7f4e78156190 2024-04-26T20:19:07.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e7e200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7806d020 con 0x7f4e780cae40 2024-04-26T20:19:07.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e7e200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7806d2e0 con 0x7f4e78155db0 2024-04-26T20:19:07.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e77400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4e78155db0 0x7f4e780c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:07.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e77e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4e78156190 0x7f4e780707c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48720/0 (socket says 172.21.15.16:48720) 2024-04-26T20:19:07.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e77e00640 1 -- 172.21.15.16:0/1947693839 learned_addr learned my addr 172.21.15.16:0/1947693839 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:07.995 INFO:tasks.workunit.client.0.smithi016.stdout:1/989: dwrite d3/d5/da/d66/d8c/d84/d86/d12d/d9/fe8 [0,4194304] 0 2024-04-26T20:19:07.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e77400640 1 -- 172.21.15.16:0/1947693839 >> v1:172.21.15.192:6789/0 conn(0x7f4e780cae40 legacy=0x7f4e780c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e77400640 1 -- 172.21.15.16:0/1947693839 >> v1:172.21.15.16:6789/0 conn(0x7f4e78156190 legacy=0x7f4e780707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:07.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.991+0000 7f4e77400640 1 -- 172.21.15.16:0/1947693839 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780ce4f0 con 0x7f4e78155db0 2024-04-26T20:19:07.996 INFO:tasks.workunit.client.0.smithi016.stdout:3/827: dread d3/d70/d8b/fda [0,4194304] 0 2024-04-26T20:19:07.996 INFO:tasks.workunit.client.0.smithi016.stdout:3/828: write d3/df/d25/d2a/d4a/f7e [815675,103988] 0 2024-04-26T20:19:07.998 INFO:tasks.workunit.client.0.smithi016.stdout:8/972: getdents d9/d19/d45/d9e/d50/d109/d10c 0 2024-04-26T20:19:07.998 INFO:tasks.workunit.client.0.smithi016.stdout:8/973: stat d9/d19/d45/d3f/d64/db6/ld5 0 2024-04-26T20:19:07.998 INFO:tasks.workunit.client.0.smithi016.stdout:8/974: write d9/fa7 [343787,13494] 0 2024-04-26T20:19:07.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.995+0000 7f4e77400640 1 --2- 172.21.15.16:0/1947693839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e78155db0 0x7f4e780c8590 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097c0 tx=0x7f4e6801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ec96c8d18ee7de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:08.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e76000640 1 -- 172.21.15.16:0/1947693839 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680b0070 con 0x7f4e78155db0 2024-04-26T20:19:08.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e76000640 1 -- 172.21.15.16:0/1947693839 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e680ab600 con 0x7f4e78155db0 2024-04-26T20:19:08.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e76000640 1 -- 172.21.15.16:0/1947693839 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680ab9d0 con 0x7f4e78155db0 2024-04-26T20:19:08.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e7e200640 1 -- 172.21.15.16:0/1947693839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e78155db0 msgr2=0x7f4e780c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:08.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e7e200640 1 --2- 172.21.15.16:0/1947693839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e78155db0 0x7f4e780c8590 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097c0 tx=0x7f4e6801c330 comp rx=0 tx=0).stop 2024-04-26T20:19:08.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e7e200640 1 -- 172.21.15.16:0/1947693839 shutdown_connections 2024-04-26T20:19:08.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e7e200640 1 --2- 172.21.15.16:0/1947693839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e78155db0 0x7f4e780c8590 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097c0 tx=0x7f4e6801c330 comp rx=0 tx=0).stop 2024-04-26T20:19:08.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:07.999+0000 7f4e7e200640 1 -- 172.21.15.16:0/1947693839 >> 172.21.15.16:0/1947693839 conn(0x7f4e7806f160 msgr2=0x7f4e7806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:08.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.003+0000 7f4e7e200640 1 -- 172.21.15.16:0/1947693839 shutdown_connections 2024-04-26T20:19:08.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.003+0000 7f4e7e200640 1 -- 172.21.15.16:0/1947693839 wait complete. 2024-04-26T20:19:08.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.003+0000 7f4e7e200640 1 Processor -- start 2024-04-26T20:19:08.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.003+0000 7f4e7e200640 1 -- start start 2024-04-26T20:19:08.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e780cae40 0x7f4e7815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:08.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e78156190 0x7f4e7815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:08.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e7815db60 0x7f4e7815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:08.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780ced90 con 0x7f4e780cae40 2024-04-26T20:19:08.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780ceab0 con 0x7f4e7815db60 2024-04-26T20:19:08.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780c9840 con 0x7f4e78156190 2024-04-26T20:19:08.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e76a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e78156190 0x7f4e7815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:08.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e780cae40 0x7f4e7815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:08.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e76a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e78156190 0x7f4e7815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:48196/0 (socket says 172.21.15.16:48196) 2024-04-26T20:19:08.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e76a00640 1 -- 172.21.15.16:0/378819690 learned_addr learned my addr 172.21.15.16:0/378819690 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:08.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77e00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e7815db60 0x7f4e7815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:08.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77400640 1 -- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e78156190 msgr2=0x7f4e7815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:08.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77400640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e78156190 0x7f4e7815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:08.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77400640 1 -- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e7815db60 msgr2=0x7f4e7815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:08.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77400640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e7815db60 0x7f4e7815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:08.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77400640 1 -- 172.21.15.16:0/378819690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e781fed90 con 0x7f4e780cae40 2024-04-26T20:19:08.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e77400640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e780cae40 0x7f4e7815d620 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e7806fe60 tx=0x7f4e680190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:08.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e6f400640 1 -- 172.21.15.16:0/378819690 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680b0040 con 0x7f4e780cae40 2024-04-26T20:19:08.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e6f400640 1 -- 172.21.15.16:0/378819690 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e680b9070 con 0x7f4e780cae40 2024-04-26T20:19:08.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 -- 172.21.15.16:0/378819690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e781ff030 con 0x7f4e780cae40 2024-04-26T20:19:08.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e6f400640 1 -- 172.21.15.16:0/378819690 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680aac10 con 0x7f4e780cae40 2024-04-26T20:19:08.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.007+0000 7f4e7e200640 1 -- 172.21.15.16:0/378819690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e781ff2f0 con 0x7f4e780cae40 2024-04-26T20:19:08.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.011+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4c0052a0 con 0x7f4e780cae40 2024-04-26T20:19:08.015 INFO:tasks.workunit.client.0.smithi016.stdout:1/990: dread d3/d5/da/f29 [0,4194304] 0 2024-04-26T20:19:08.015 INFO:tasks.workunit.client.0.smithi016.stdout:1/991: getdents d3/d5/d8d/dab/d123 0 2024-04-26T20:19:08.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.015+0000 7f4e6f400640 1 -- 172.21.15.16:0/378819690 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e680be460 con 0x7f4e780cae40 2024-04-26T20:19:08.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.015+0000 7f4e6f400640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4e580683d0 0x7f4e5806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:08.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.015+0000 7f4e6f400640 1 -- 172.21.15.16:0/378819690 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f4e681218d0 con 0x7f4e780cae40 2024-04-26T20:19:08.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.015+0000 7f4e76a00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4e580683d0 0x7f4e5806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:08.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.019+0000 7f4e76a00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4e580683d0 0x7f4e5806a890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4e780cd850 tx=0x7f4e64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:08.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.023+0000 7f4e6f400640 1 -- 172.21.15.16:0/378819690 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e68015fb0 con 0x7f4e780cae40 2024-04-26T20:19:08.155 INFO:tasks.workunit.client.0.smithi016.stdout:1/992: read d3/d5/da/d66/d8c/d84/d86/fa3 [454474,125378] 0 2024-04-26T20:19:08.155 INFO:tasks.workunit.client.0.smithi016.stdout:1/993: read d3/d5/da/d66/d8c/d84/d86/d12d/d9/f73 [3422366,14149] 0 2024-04-26T20:19:08.155 INFO:tasks.workunit.client.0.smithi016.stdout:1/994: stat d3/d5/da/d66/d8c/d84/d86/d12d/d5a/f3f 0 2024-04-26T20:19:08.156 INFO:tasks.workunit.client.0.smithi016.stdout:1/995: dread d3/d5/da/d66/d8c/d84/d86/fa3 [0,4194304] 0 2024-04-26T20:19:08.174 INFO:tasks.workunit.client.0.smithi016.stdout:8/975: dwrite d9/d66/d73/f130 [0,4194304] 0 2024-04-26T20:19:08.174 INFO:tasks.workunit.client.0.smithi016.stdout:8/976: chown d9/d19/d45/d9e/d50/dad 168 1 2024-04-26T20:19:08.176 INFO:tasks.workunit.client.0.smithi016.stdout:1/996: truncate d3/d5/da/d66/d8c/d84/d86/d12d/d9/f71 7164609 0 2024-04-26T20:19:08.176 INFO:tasks.workunit.client.0.smithi016.stdout:1/997: dread - d3/d57/da4/f12c zero size 2024-04-26T20:19:08.180 INFO:tasks.workunit.client.0.smithi016.stdout:8/977: symlink d9/d72/l14b 0 2024-04-26T20:19:08.188 INFO:tasks.workunit.client.0.smithi016.stdout:8/978: dread d9/d19/d45/d9e/de5/ffe [0,4194304] 0 2024-04-26T20:19:08.209 INFO:tasks.workunit.client.0.smithi016.stdout:8/979: read d9/d23/d26/d2c/fa0 [2368549,60499] 0 2024-04-26T20:19:08.209 INFO:tasks.workunit.client.0.smithi016.stdout:8/980: chown d9/d19/d45/d9e/fc6 112 1 2024-04-26T20:19:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.251+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e4c005590 con 0x7f4e780cae40 2024-04-26T20:19:08.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6f400640 1 -- 172.21.15.16:0/378819690 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6048 (secure 0 0 0) 0x7f4e680f1370 con 0x7f4e780cae40 2024-04-26T20:19:08.256 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:08.256 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:05.862130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:resolve","state_seq":25,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:19:08.257 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 22 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4e580683d0 msgr2=0x7f4e5806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4e580683d0 0x7f4e5806a890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4e780cd850 tx=0x7f4e64009040 comp rx=0 tx=0).stop 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e780cae40 msgr2=0x7f4e7815d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e780cae40 0x7f4e7815d620 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e7806fe60 tx=0x7f4e680190d0 comp rx=0 tx=0).stop 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 shutdown_connections 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4e580683d0 0x7f4e5806a890 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e7815db60 0x7f4e7815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e78156190 0x7f4e7815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 --2- 172.21.15.16:0/378819690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e780cae40 0x7f4e7815d620 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 >> 172.21.15.16:0/378819690 conn(0x7f4e7806f160 msgr2=0x7f4e780cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:08.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 shutdown_connections 2024-04-26T20:19:08.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:08.255+0000 7f4e6cc00640 1 -- 172.21.15.16:0/378819690 wait complete. 2024-04-26T20:19:08.277 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:19:08.367 INFO:tasks.workunit.client.0.smithi016.stdout:1/998: rmdir d3/d5/da/d66/d8c/d84/d96/df5 39 2024-04-26T20:19:08.368 INFO:tasks.workunit.client.0.smithi016.stdout:6/920: sync 2024-04-26T20:19:08.368 INFO:tasks.workunit.client.0.smithi016.stdout:6/921: fdatasync d1/f1f 0 2024-04-26T20:19:08.369 INFO:tasks.workunit.client.0.smithi016.stdout:0/852: sync 2024-04-26T20:19:08.369 INFO:tasks.workunit.client.0.smithi016.stdout:4/827: sync 2024-04-26T20:19:08.369 INFO:tasks.workunit.client.0.smithi016.stdout:0/853: chown d2/d8/d119 2273959 1 2024-04-26T20:19:08.369 INFO:tasks.workunit.client.0.smithi016.stdout:6/922: symlink d1/d21/d26/d1c/d4e/l135 0 2024-04-26T20:19:08.370 INFO:tasks.workunit.client.0.smithi016.stdout:0/854: symlink d2/dc/d45/l11c 0 2024-04-26T20:19:08.370 INFO:tasks.workunit.client.0.smithi016.stdout:0/855: dread - d2/d20/d41/f50 zero size 2024-04-26T20:19:08.388 INFO:tasks.workunit.client.0.smithi016.stdout:1/999: write d3/d57/f44 [2537342,83373] 0 2024-04-26T20:19:08.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/828: write d0/dd/d19/d1f/d7b/f7e [3659727,84481] 0 2024-04-26T20:19:08.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/829: write d0/d1e/d4e/d52/d88/d43/fb0 [487833,74917] 0 2024-04-26T20:19:08.396 INFO:tasks.workunit.client.0.smithi016.stdout:4/830: dread - d0/d1e/d4e/f108 zero size 2024-04-26T20:19:08.413 INFO:tasks.workunit.client.0.smithi016.stdout:4/831: dread d0/f1 [0,4194304] 0 2024-04-26T20:19:08.414 INFO:tasks.workunit.client.0.smithi016.stdout:0/856: dwrite d2/d40/d61/fb1 [0,4194304] 0 2024-04-26T20:19:08.416 INFO:tasks.workunit.client.0.smithi016.stdout:0/857: stat d2/dc/d1e/d25/c5f 0 2024-04-26T20:19:08.418 INFO:tasks.workunit.client.0.smithi016.stdout:6/923: link d1/d21/d26/d1c/d5d/def/d2c/f41 d1/d21/d26/d1c/d5d/def/f136 0 2024-04-26T20:19:08.420 INFO:tasks.workunit.client.0.smithi016.stdout:4/832: dread d0/d1e/d64/f92 [0,4194304] 0 2024-04-26T20:19:08.420 INFO:tasks.workunit.client.0.smithi016.stdout:4/833: chown d0/d1e/d4e/d52/d88/d43/d5a/lb8 856280529 1 2024-04-26T20:19:08.420 INFO:tasks.workunit.client.0.smithi016.stdout:4/834: chown d0/dd 2 1 2024-04-26T20:19:08.420 INFO:tasks.workunit.client.0.smithi016.stdout:0/858: mknod d2/dc/d1e/dc5/c11d 0 2024-04-26T20:19:08.421 INFO:tasks.workunit.client.0.smithi016.stdout:6/924: mknod d1/d21/d26/d1c/d7b/d82/c137 0 2024-04-26T20:19:08.421 INFO:tasks.workunit.client.0.smithi016.stdout:6/925: chown d1/d21/d78/l7d 2232 1 2024-04-26T20:19:08.442 INFO:tasks.workunit.client.0.smithi016.stdout:0/859: dread d2/d40/d61/fb1 [0,4194304] 0 2024-04-26T20:19:08.449 INFO:tasks.workunit.client.0.smithi016.stdout:4/835: link d0/dd/d19/f4d d0/d1e/d4e/d52/d88/df9/f10d 0 2024-04-26T20:19:08.450 INFO:tasks.workunit.client.0.smithi016.stdout:0/860: truncate d2/dc/d18/d5b/f5e 2145871 0 2024-04-26T20:19:08.458 INFO:tasks.workunit.client.0.smithi016.stdout:4/836: rename d0/dd/d19/l3c to d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/l10e 0 2024-04-26T20:19:08.461 INFO:tasks.workunit.client.0.smithi016.stdout:0/861: rename d2/d20/d41/d87/d9d/db8/fc0 to d2/d20/d41/d4c/d4e/f11e 0 2024-04-26T20:19:08.461 INFO:tasks.workunit.client.0.smithi016.stdout:4/837: mknod d0/d1e/d4e/d52/d88/d43/d5a/dd1/c10f 0 2024-04-26T20:19:08.462 INFO:tasks.workunit.client.0.smithi016.stdout:0/862: link d2/d8/d37/d5d/d60/c6e d2/dc/de3/c11f 0 2024-04-26T20:19:08.479 INFO:tasks.workunit.client.0.smithi016.stdout:4/838: mknod d0/d1e/d4e/d52/d88/d107/c110 0 2024-04-26T20:19:08.479 INFO:tasks.workunit.client.0.smithi016.stdout:4/839: chown d0/d1e/d4e/d52/d88 24423 1 2024-04-26T20:19:08.492 INFO:tasks.workunit.client.0.smithi016.stdout:6/926: dwrite d1/d21/d26/d1c/d5d/def/d46/d134/f127 [0,4194304] 0 2024-04-26T20:19:08.493 INFO:tasks.workunit.client.0.smithi016.stdout:4/840: rename d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/cdd to d0/dd/d19/d1f/d7b/c111 0 2024-04-26T20:19:08.494 INFO:tasks.workunit.client.0.smithi016.stdout:6/927: rmdir d1/d21 39 2024-04-26T20:19:08.495 INFO:tasks.workunit.client.0.smithi016.stdout:4/841: symlink d0/d1e/d4e/d52/d88/d43/d5a/l112 0 2024-04-26T20:19:08.496 INFO:tasks.workunit.client.0.smithi016.stdout:4/842: read d0/d1e/fc1 [963680,22864] 0 2024-04-26T20:19:08.497 INFO:tasks.workunit.client.0.smithi016.stdout:6/928: creat d1/d21/d78/d109/f138 x:0 0 0 2024-04-26T20:19:08.497 INFO:tasks.workunit.client.0.smithi016.stdout:4/843: getdents d0/d1e 0 2024-04-26T20:19:08.507 INFO:tasks.workunit.client.0.smithi016.stdout:6/929: rename d1/d21/d26/d1c/d5d/d88/cf9 to d1/d21/c139 0 2024-04-26T20:19:08.507 INFO:tasks.workunit.client.0.smithi016.stdout:6/930: chown d1/d21/d26/d1c/d5d/def/l5b 75490040 1 2024-04-26T20:19:08.507 INFO:tasks.workunit.client.0.smithi016.stdout:6/931: chown d1/d21/d26/c1b 6 1 2024-04-26T20:19:08.507 INFO:tasks.workunit.client.0.smithi016.stdout:6/932: fdatasync d1/d21/d26/d1c/d5d/def/d76/fd8 0 2024-04-26T20:19:08.507 INFO:tasks.workunit.client.0.smithi016.stdout:6/933: write d1/d21/d26/d1c/d2e/d53/f69 [5144087,44539] 0 2024-04-26T20:19:08.507 INFO:tasks.workunit.client.0.smithi016.stdout:6/934: dread - d1/d21/d26/d1c/d5d/de2/de4/f126 zero size 2024-04-26T20:19:08.508 INFO:tasks.workunit.client.0.smithi016.stdout:4/844: dread d0/d1e/f75 [0,4194304] 0 2024-04-26T20:19:08.508 INFO:tasks.workunit.client.0.smithi016.stdout:4/845: chown d0/dd/d19/d1f/d7b/lcd 827561 1 2024-04-26T20:19:08.522 INFO:tasks.workunit.client.0.smithi016.stdout:4/846: dread d0/d1e/d4e/d52/d54/f55 [0,4194304] 0 2024-04-26T20:19:08.574 INFO:tasks.workunit.client.0.smithi016.stdout:6/935: dwrite d1/d21/d26/d1c/d5d/def/d2c/d47/f104 [0,4194304] 0 2024-04-26T20:19:08.582 INFO:tasks.workunit.client.0.smithi016.stdout:4/847: dwrite d0/d1e/d30/fda [4194304,4194304] 0 2024-04-26T20:19:08.585 INFO:tasks.workunit.client.0.smithi016.stdout:4/848: rename d0/d96/ddc to d0/dd/d19/d57/d113 0 2024-04-26T20:19:08.585 INFO:tasks.workunit.client.0.smithi016.stdout:4/849: chown d0/f10 0 1 2024-04-26T20:19:08.585 INFO:tasks.workunit.client.0.smithi016.stdout:4/850: fdatasync d0/d1e/d64/f85 0 2024-04-26T20:19:08.586 INFO:tasks.workunit.client.0.smithi016.stdout:4/851: symlink d0/d1e/d4e/d52/d54/dad/ddf/l114 0 2024-04-26T20:19:08.586 INFO:tasks.workunit.client.0.smithi016.stdout:4/852: write d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/ffb [449969,96971] 0 2024-04-26T20:19:08.588 INFO:tasks.workunit.client.0.smithi016.stdout:4/853: truncate d0/dd/d19/d1f/d7b/f7e 1550166 0 2024-04-26T20:19:08.588 INFO:tasks.workunit.client.0.smithi016.stdout:4/854: getdents d0/dd/dc9/de4/df0 0 2024-04-26T20:19:08.589 INFO:tasks.workunit.client.0.smithi016.stdout:4/855: rmdir d0/d1e/d4e/d52/d54/dad 39 2024-04-26T20:19:08.590 INFO:tasks.workunit.client.0.smithi016.stdout:4/856: rename d0/dd/d1b to d0/d1e/d4e/d52/d88/d115 0 2024-04-26T20:19:08.614 INFO:tasks.workunit.client.0.smithi016.stdout:4/857: dread d0/d1e/d4e/d52/d88/f5f [4194304,4194304] 0 2024-04-26T20:19:08.615 INFO:tasks.workunit.client.0.smithi016.stdout:4/858: creat d0/d96/dbf/f116 x:0 0 0 2024-04-26T20:19:08.616 INFO:tasks.workunit.client.0.smithi016.stdout:4/859: rmdir d0/d1e/d4e/d52/d88/d115 39 2024-04-26T20:19:08.616 INFO:tasks.workunit.client.0.smithi016.stdout:4/860: write d0/d1e/d4e/d52/d88/d43/fb0 [1253227,120649] 0 2024-04-26T20:19:08.616 INFO:tasks.workunit.client.0.smithi016.stdout:4/861: dread - d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/fd8 zero size 2024-04-26T20:19:08.619 INFO:tasks.workunit.client.0.smithi016.stdout:6/936: dwrite d1/d21/d26/d1c/feb [0,4194304] 0 2024-04-26T20:19:08.639 INFO:tasks.workunit.client.0.smithi016.stdout:6/937: dread d1/d21/d26/d1c/d5d/def/d46/d134/f127 [0,4194304] 0 2024-04-26T20:19:08.647 INFO:tasks.workunit.client.0.smithi016.stdout:7/874: sync 2024-04-26T20:19:08.650 INFO:tasks.workunit.client.0.smithi016.stdout:7/875: creat d0/dd5/d34/d25/d3f/d6d/d87/f10b x:0 0 0 2024-04-26T20:19:08.653 INFO:tasks.workunit.client.0.smithi016.stdout:7/876: rename d0/dd5/d34/d25/d3f/d6d/d79/fe7 to d0/dd5/d34/d25/d3f/d6d/d87/f10c 0 2024-04-26T20:19:08.657 INFO:tasks.workunit.client.0.smithi016.stdout:7/877: write d0/dd5/d88/db3/fd0 [277041,111250] 0 2024-04-26T20:19:08.700 INFO:tasks.workunit.client.0.smithi016.stdout:6/938: dwrite d1/d21/d26/d1c/d2e/d53/f69 [0,4194304] 0 2024-04-26T20:19:08.731 INFO:tasks.workunit.client.0.smithi016.stdout:6/939: dwrite d1/d21/d26/d1c/d5d/def/dae/faf [4194304,4194304] 0 2024-04-26T20:19:08.794 INFO:tasks.workunit.client.0.smithi016.stdout:6/940: dwrite d1/d21/d26/d1c/d5d/def/d2c/d47/fd1 [4194304,4194304] 0 2024-04-26T20:19:08.876 INFO:tasks.workunit.client.0.smithi016.stdout:8/981: sync 2024-04-26T20:19:08.876 INFO:tasks.workunit.client.0.smithi016.stdout:3/829: sync 2024-04-26T20:19:08.876 INFO:tasks.workunit.client.0.smithi016.stdout:8/982: write d9/d19/d45/d3f/d64/f57 [2417035,109853] 0 2024-04-26T20:19:08.879 INFO:tasks.workunit.client.0.smithi016.stdout:3/830: rename d3/d9/d2d/d4f/df8 to d3/df/d25/d32/d3f/d105/d108 0 2024-04-26T20:19:08.880 INFO:tasks.workunit.client.0.smithi016.stdout:8/983: getdents d9/d19/d45/d9e/d50 0 2024-04-26T20:19:08.880 INFO:tasks.workunit.client.0.smithi016.stdout:8/984: getdents d9 0 2024-04-26T20:19:08.881 INFO:tasks.workunit.client.0.smithi016.stdout:8/985: dread d9/d66/fb0 [0,4194304] 0 2024-04-26T20:19:08.882 INFO:tasks.workunit.client.0.smithi016.stdout:8/986: read d9/d19/d45/d9e/d50/da9/dac/fb7 [265886,86411] 0 2024-04-26T20:19:08.884 INFO:tasks.workunit.client.0.smithi016.stdout:8/987: link d9/d19/c55 d9/d19/d45/d3f/d4d/dba/c14c 0 2024-04-26T20:19:08.885 INFO:tasks.workunit.client.0.smithi016.stdout:8/988: symlink d9/d19/d45/d9e/d50/d109/l14d 0 2024-04-26T20:19:08.887 INFO:tasks.workunit.client.0.smithi016.stdout:8/989: mkdir d9/d19/d45/d9e/d50/d123/d14e 0 2024-04-26T20:19:08.887 INFO:tasks.workunit.client.0.smithi016.stdout:8/990: write d9/d19/d45/d9e/fc6 [6029203,116392] 0 2024-04-26T20:19:08.887 INFO:tasks.workunit.client.0.smithi016.stdout:8/991: chown d9/d19/d45/d9e/d50/da9/dac/cbe 1067263583 1 2024-04-26T20:19:08.888 INFO:tasks.workunit.client.0.smithi016.stdout:8/992: rename d9/f14 to d9/d19/d45/d3f/d4d/f14f 0 2024-04-26T20:19:08.890 INFO:tasks.workunit.client.0.smithi016.stdout:8/993: unlink d9/d19/c21 0 2024-04-26T20:19:08.890 INFO:tasks.workunit.client.0.smithi016.stdout:8/994: fdatasync d9/ddb/f133 0 2024-04-26T20:19:08.890 INFO:tasks.workunit.client.0.smithi016.stdout:8/995: chown d9/ddb/f133 29701 1 2024-04-26T20:19:08.891 INFO:tasks.workunit.client.0.smithi016.stdout:8/996: creat d9/d19/d45/d3f/d64/dfc/d135/f150 x:0 0 0 2024-04-26T20:19:08.891 INFO:tasks.workunit.client.0.smithi016.stdout:8/997: write d9/d23/f119 [1446653,93364] 0 2024-04-26T20:19:08.891 INFO:tasks.workunit.client.0.smithi016.stdout:8/998: stat d9/d72/d74/f143 0 2024-04-26T20:19:08.907 INFO:tasks.workunit.client.0.smithi016.stdout:8/999: read d9/fa7 [89791,9585] 0 2024-04-26T20:19:08.908 INFO:tasks.workunit.client.0.smithi016.stdout:6/941: dwrite d1/d21/d26/f75 [4194304,4194304] 0 2024-04-26T20:19:08.910 INFO:tasks.workunit.client.0.smithi016.stdout:6/942: symlink d1/d21/d26/d1c/d8a/l13a 0 2024-04-26T20:19:08.911 INFO:tasks.workunit.client.0.smithi016.stdout:6/943: mknod d1/d21/d48/dcf/c13b 0 2024-04-26T20:19:08.912 INFO:tasks.workunit.client.0.smithi016.stdout:6/944: mknod d1/d21/d26/d1c/d2e/c13c 0 2024-04-26T20:19:08.914 INFO:tasks.workunit.client.0.smithi016.stdout:6/945: mkdir d1/d21/d26/d1c/d5d/def/d46/d134/d13d 0 2024-04-26T20:19:08.914 INFO:tasks.workunit.client.0.smithi016.stdout:6/946: stat d1/d21/d26/d1c/c38 0 2024-04-26T20:19:08.914 INFO:tasks.workunit.client.0.smithi016.stdout:6/947: dread - d1/d21/d48/f12d zero size 2024-04-26T20:19:08.917 INFO:tasks.workunit.client.0.smithi016.stdout:6/948: link d1/d21/d26/d25/lbf d1/d21/d26/d1c/d2e/d53/d93/l13e 0 2024-04-26T20:19:08.917 INFO:tasks.workunit.client.0.smithi016.stdout:6/949: symlink d1/d21/d26/d1c/d5d/d88/l13f 0 2024-04-26T20:19:08.965 INFO:tasks.workunit.client.0.smithi016.stdout:6/950: dwrite d1/d21/f39 [0,4194304] 0 2024-04-26T20:19:08.966 INFO:tasks.workunit.client.0.smithi016.stdout:6/951: creat d1/f140 x:0 0 0 2024-04-26T20:19:08.967 INFO:tasks.workunit.client.0.smithi016.stdout:6/952: symlink d1/d21/d48/d116/l141 0 2024-04-26T20:19:08.967 INFO:tasks.workunit.client.0.smithi016.stdout:6/953: truncate d1/d12/d90/f12b 788236 0 2024-04-26T20:19:08.967 INFO:tasks.workunit.client.0.smithi016.stdout:6/954: chown d1/d3a/c6a 20542 1 2024-04-26T20:19:08.968 INFO:tasks.workunit.client.0.smithi016.stdout:6/955: mknod d1/d21/d48/c142 0 2024-04-26T20:19:08.968 INFO:tasks.workunit.client.0.smithi016.stdout:6/956: fdatasync d1/d21/d26/d1c/d5d/def/d76/fd8 0 2024-04-26T20:19:09.005 INFO:tasks.workunit.client.0.smithi016.stdout:6/957: dwrite d1/d21/d26/fb0 [0,4194304] 0 2024-04-26T20:19:09.006 INFO:tasks.workunit.client.0.smithi016.stdout:6/958: write d1/d21/d26/d1c/d4e/fa0 [1842143,128542] 0 2024-04-26T20:19:09.007 INFO:tasks.workunit.client.0.smithi016.stdout:6/959: creat d1/d21/d26/f143 x:0 0 0 2024-04-26T20:19:09.024 INFO:tasks.workunit.client.0.smithi016.stdout:6/960: dread d1/d21/d48/f4f [0,4194304] 0 2024-04-26T20:19:09.048 INFO:tasks.workunit.client.0.smithi016.stdout:0/863: sync 2024-04-26T20:19:09.076 INFO:tasks.workunit.client.0.smithi016.stdout:0/864: dwrite d2/d8/d37/d70/fb5 [0,4194304] 0 2024-04-26T20:19:09.077 INFO:tasks.workunit.client.0.smithi016.stdout:0/865: write d2/dc/d45/f78 [946078,98573] 0 2024-04-26T20:19:09.077 INFO:tasks.workunit.client.0.smithi016.stdout:0/866: chown d2/d40/d61 12 1 2024-04-26T20:19:09.077 INFO:tasks.workunit.client.0.smithi016.stdout:0/867: fdatasync d2/d20/f9e 0 2024-04-26T20:19:09.078 INFO:tasks.workunit.client.0.smithi016.stdout:0/868: mkdir d2/d8/d37/d5d/d110/d120 0 2024-04-26T20:19:09.080 INFO:tasks.workunit.client.0.smithi016.stdout:0/869: rename d2/c5 to d2/dc/d1e/c121 0 2024-04-26T20:19:09.081 INFO:tasks.workunit.client.0.smithi016.stdout:0/870: truncate d2/d20/f9e 452246 0 2024-04-26T20:19:09.081 INFO:tasks.workunit.client.0.smithi016.stdout:0/871: chown d2/d20/d41/d87/d9d/db8/f118 202952 1 2024-04-26T20:19:09.082 INFO:tasks.workunit.client.0.smithi016.stdout:0/872: creat d2/dc/d18/dd7/df5/f122 x:0 0 0 2024-04-26T20:19:09.083 INFO:tasks.workunit.client.0.smithi016.stdout:0/873: creat d2/d8/d37/f123 x:0 0 0 2024-04-26T20:19:09.084 INFO:tasks.workunit.client.0.smithi016.stdout:0/874: symlink d2/dc/d18/l124 0 2024-04-26T20:19:09.085 INFO:tasks.workunit.client.0.smithi016.stdout:0/875: getdents d2/dc/d1e/d35 0 2024-04-26T20:19:09.085 INFO:tasks.workunit.client.0.smithi016.stdout:0/876: dread - d2/d20/d57/f7f zero size 2024-04-26T20:19:09.085 INFO:tasks.workunit.client.0.smithi016.stdout:0/877: write d2/d20/fdc [959656,122152] 0 2024-04-26T20:19:09.086 INFO:tasks.workunit.client.0.smithi016.stdout:0/878: mkdir d2/d8/d37/d5d/d60/d125 0 2024-04-26T20:19:09.087 INFO:tasks.workunit.client.0.smithi016.stdout:6/961: dwrite d1/d21/d78/d109/f12e [0,4194304] 0 2024-04-26T20:19:09.098 INFO:tasks.workunit.client.0.smithi016.stdout:0/879: rename d2/d8/d37 to d2/d40/d61/d91/d126 0 2024-04-26T20:19:09.099 INFO:tasks.workunit.client.0.smithi016.stdout:0/880: stat d2/dc/d18/d24/cf0 0 2024-04-26T20:19:09.099 INFO:tasks.workunit.client.0.smithi016.stdout:0/881: stat d2/d20/d41/d4c/d4e/f88 0 2024-04-26T20:19:09.100 INFO:tasks.workunit.client.0.smithi016.stdout:6/962: rename d1/faa to d1/d21/d26/d1c/d7b/d82/d8f/f144 0 2024-04-26T20:19:09.100 INFO:tasks.workunit.client.0.smithi016.stdout:0/882: creat d2/d8/d119/f127 x:0 0 0 2024-04-26T20:19:09.120 INFO:tasks.workunit.client.0.smithi016.stdout:6/963: dread d1/d12/fb7 [0,4194304] 0 2024-04-26T20:19:09.121 INFO:tasks.workunit.client.0.smithi016.stdout:6/964: getdents d1/d21/d26/d1c/d2e/d53/d7f 0 2024-04-26T20:19:09.142 INFO:tasks.workunit.client.0.smithi016.stdout:0/883: dwrite d2/d8/f11 [0,4194304] 0 2024-04-26T20:19:09.142 INFO:tasks.workunit.client.0.smithi016.stdout:0/884: getdents d2/dc 0 2024-04-26T20:19:09.144 INFO:tasks.workunit.client.0.smithi016.stdout:0/885: rename d2/d40/d61 to d2/d20/d57/d128 0 2024-04-26T20:19:09.144 INFO:tasks.workunit.client.0.smithi016.stdout:0/886: dread - d2/dc/d1e/d35/dee/f115 zero size 2024-04-26T20:19:09.144 INFO:tasks.workunit.client.0.smithi016.stdout:0/887: readlink d2/dc/d1e/l77 0 2024-04-26T20:19:09.205 INFO:tasks.workunit.client.0.smithi016.stdout:6/965: dwrite d1/d21/d26/d1c/d2e/d53/f5f [0,4194304] 0 2024-04-26T20:19:09.207 INFO:tasks.workunit.client.0.smithi016.stdout:6/966: mkdir d1/d21/d78/d145 0 2024-04-26T20:19:09.207 INFO:tasks.workunit.client.0.smithi016.stdout:6/967: readlink d1/d21/d26/d1c/d2e/d53/lb1 0 2024-04-26T20:19:09.207 INFO:tasks.workunit.client.0.smithi016.stdout:6/968: fsync d1/d21/d26/d1c/d5d/def/d46/d134/fdd 0 2024-04-26T20:19:09.207 INFO:tasks.workunit.client.0.smithi016.stdout:6/969: chown d1/d21/d78/d145 48540750 1 2024-04-26T20:19:09.208 INFO:tasks.workunit.client.0.smithi016.stdout:6/970: truncate d1/d21/d26/d1c/d5d/def/fc 2030101 0 2024-04-26T20:19:09.208 INFO:tasks.workunit.client.0.smithi016.stdout:6/971: readlink d1/d21/d48/d116/l141 0 2024-04-26T20:19:09.210 INFO:tasks.workunit.client.0.smithi016.stdout:6/972: mkdir d1/d21/d26/d1c/d5d/d88/d146 0 2024-04-26T20:19:09.210 INFO:tasks.workunit.client.0.smithi016.stdout:6/973: stat d1/d21/d26/d1c/d5d/def/d2c/f10b 0 2024-04-26T20:19:09.212 INFO:tasks.workunit.client.0.smithi016.stdout:6/974: rename d1/d3a/db9/de0 to d1/d21/d26/d1c/d8a/d147 0 2024-04-26T20:19:09.214 INFO:tasks.workunit.client.0.smithi016.stdout:6/975: link d1/d21/d26/d25/l106 d1/d21/d26/d1c/d2e/d53/d7f/l148 0 2024-04-26T20:19:09.216 INFO:tasks.workunit.client.0.smithi016.stdout:6/976: truncate d1/d21/d26/d1c/d7b/f89 3232372 0 2024-04-26T20:19:09.216 INFO:tasks.workunit.client.0.smithi016.stdout:6/977: rmdir d1/d21/d26/d1c/d5d/def 39 2024-04-26T20:19:09.221 INFO:tasks.workunit.client.0.smithi016.stdout:0/888: dwrite d2/d20/d41/d87/d9d/fbd [0,4194304] 0 2024-04-26T20:19:09.221 INFO:tasks.workunit.client.0.smithi016.stdout:0/889: dread - d2/d20/d57/d128/d91/d126/f123 zero size 2024-04-26T20:19:09.221 INFO:tasks.workunit.client.0.smithi016.stdout:0/890: chown d2/dc/d18 1824558899 1 2024-04-26T20:19:09.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/862: sync 2024-04-26T20:19:09.234 INFO:tasks.workunit.client.0.smithi016.stdout:3/831: sync 2024-04-26T20:19:09.236 INFO:tasks.workunit.client.0.smithi016.stdout:7/878: sync 2024-04-26T20:19:09.237 INFO:tasks.workunit.client.0.smithi016.stdout:3/832: rename d3/df/d25/dc8/fe0 to d3/d9/d18/d59/f109 0 2024-04-26T20:19:09.237 INFO:tasks.workunit.client.0.smithi016.stdout:3/833: dread - d3/d9/d2d/d4f/fc3 zero size 2024-04-26T20:19:09.239 INFO:tasks.workunit.client.0.smithi016.stdout:7/879: dread d0/dd5/d34/d25/d3f/d6d/d74/fa9 [0,4194304] 0 2024-04-26T20:19:09.239 INFO:tasks.workunit.client.0.smithi016.stdout:7/880: write d0/f27 [2334642,42584] 0 2024-04-26T20:19:09.239 INFO:tasks.workunit.client.0.smithi016.stdout:7/881: truncate d0/dd5/d34/d25/d3f/f5f 759740 0 2024-04-26T20:19:09.239 INFO:tasks.workunit.client.0.smithi016.stdout:3/834: creat d3/df/d20/db0/dd1/f10a x:0 0 0 2024-04-26T20:19:09.241 INFO:tasks.workunit.client.0.smithi016.stdout:7/882: truncate d0/d83/f3c 3228846 0 2024-04-26T20:19:09.248 INFO:tasks.workunit.client.0.smithi016.stdout:7/883: fsync d0/dd5/d34/dec/dff/f102 0 2024-04-26T20:19:09.250 INFO:tasks.workunit.client.0.smithi016.stdout:7/884: truncate d0/dd5/d34/dec/fd4 150418 0 2024-04-26T20:19:09.250 INFO:tasks.workunit.client.0.smithi016.stdout:7/885: write d0/dd5/d88/fcb [4524085,52706] 0 2024-04-26T20:19:09.251 INFO:tasks.workunit.client.0.smithi016.stdout:7/886: creat d0/dd5/d46/f10d x:0 0 0 2024-04-26T20:19:09.253 INFO:tasks.workunit.client.0.smithi016.stdout:7/887: symlink d0/dd5/d88/db3/dc1/l10e 0 2024-04-26T20:19:09.261 INFO:tasks.workunit.client.0.smithi016.stdout:7/888: read d0/dd5/f93 [103934,94864] 0 2024-04-26T20:19:09.261 INFO:tasks.workunit.client.0.smithi016.stdout:7/889: stat d0/d51/ffd 0 2024-04-26T20:19:09.262 INFO:tasks.workunit.client.0.smithi016.stdout:7/890: readlink d0/dd5/l62 0 2024-04-26T20:19:09.262 INFO:tasks.workunit.client.0.smithi016.stdout:7/891: stat d0/f8c 0 2024-04-26T20:19:09.286 INFO:tasks.workunit.client.0.smithi016.stdout:0/891: dwrite d2/d20/d41/d4c/d4e/f11e [0,4194304] 0 2024-04-26T20:19:09.286 INFO:tasks.workunit.client.0.smithi016.stdout:0/892: stat d2/dc/d45/fe6 0 2024-04-26T20:19:09.304 INFO:tasks.workunit.client.0.smithi016.stdout:0/893: dread d2/d8/d3b/fa3 [0,4194304] 0 2024-04-26T20:19:09.304 INFO:tasks.workunit.client.0.smithi016.stdout:0/894: dread - d2/d20/d57/d128/f114 zero size 2024-04-26T20:19:09.304 INFO:tasks.workunit.client.0.smithi016.stdout:0/895: fdatasync d2/d20/d41/d87/d9d/db8/fce 0 2024-04-26T20:19:09.305 INFO:tasks.workunit.client.0.smithi016.stdout:0/896: getdents d2/d20/d41/d87/d9d/dda 0 2024-04-26T20:19:09.305 INFO:tasks.workunit.client.0.smithi016.stdout:7/892: dwrite d0/dd5/f5e [0,4194304] 0 2024-04-26T20:19:09.307 INFO:tasks.workunit.client.0.smithi016.stdout:0/897: rename d2/d20/d57/d128/d91/d126/d70 to d2/d20/d41/d87/d9d/db8/d129 0 2024-04-26T20:19:09.308 INFO:tasks.workunit.client.0.smithi016.stdout:0/898: creat d2/dc/d1e/d25/f12a x:0 0 0 2024-04-26T20:19:09.308 INFO:tasks.workunit.client.0.smithi016.stdout:0/899: chown d2/d20/d57/d128/d91 1651 1 2024-04-26T20:19:09.309 INFO:tasks.workunit.client.0.smithi016.stdout:0/900: chown d2/l3f 126 1 2024-04-26T20:19:09.389 INFO:tasks.workunit.client.0.smithi016.stdout:0/901: dwrite d2/dc/f44 [4194304,4194304] 0 2024-04-26T20:19:09.627 INFO:tasks.workunit.client.0.smithi016.stdout:4/863: sync 2024-04-26T20:19:09.627 INFO:tasks.workunit.client.0.smithi016.stdout:7/893: sync 2024-04-26T20:19:09.628 INFO:tasks.workunit.client.0.smithi016.stdout:3/835: sync 2024-04-26T20:19:09.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/894: chown d0/d51/dc7/fe1 14175957 1 2024-04-26T20:19:09.628 INFO:tasks.workunit.client.0.smithi016.stdout:4/864: readlink d0/d1e/d4e/d52/d88/d115/dbc/dfa/la7 0 2024-04-26T20:19:09.628 INFO:tasks.workunit.client.0.smithi016.stdout:3/836: chown d3/df/f99 9761073 1 2024-04-26T20:19:09.628 INFO:tasks.workunit.client.0.smithi016.stdout:6/978: sync 2024-04-26T20:19:09.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/895: mknod d0/dd5/d34/d25/d3f/d6d/c10f 0 2024-04-26T20:19:09.628 INFO:tasks.workunit.client.0.smithi016.stdout:7/896: fsync d0/dd5/d34/dec/fc6 0 2024-04-26T20:19:09.630 INFO:tasks.workunit.client.0.smithi016.stdout:7/897: symlink d0/dd5/d34/dec/dff/l110 0 2024-04-26T20:19:09.633 INFO:tasks.workunit.client.0.smithi016.stdout:6/979: dread d1/d21/d26/d1c/d2e/d53/f101 [0,4194304] 0 2024-04-26T20:19:09.634 INFO:tasks.workunit.client.0.smithi016.stdout:6/980: mknod d1/d21/d26/d1c/d7b/d82/d8f/dff/d11a/c149 0 2024-04-26T20:19:09.634 INFO:tasks.workunit.client.0.smithi016.stdout:6/981: truncate d1/d21/d26/d1c/d5d/def/d2c/d47/dd7/ffb 1028374 0 2024-04-26T20:19:09.665 INFO:tasks.workunit.client.0.smithi016.stdout:3/837: mkdir d3/df/d25/d2a/d4a/d10b 0 2024-04-26T20:19:09.667 INFO:tasks.workunit.client.0.smithi016.stdout:3/838: creat d3/df/d25/d32/f10c x:0 0 0 2024-04-26T20:19:09.667 INFO:tasks.workunit.client.0.smithi016.stdout:3/839: write d3/df/f64 [420880,62938] 0 2024-04-26T20:19:09.667 INFO:tasks.workunit.client.0.smithi016.stdout:3/840: chown d3/df/d25/d2a/c2c 3237057 1 2024-04-26T20:19:09.667 INFO:tasks.workunit.client.0.smithi016.stdout:3/841: fsync d3/d9/d18/dfa/dfb/db5/f6c 0 2024-04-26T20:19:09.667 INFO:tasks.workunit.client.0.smithi016.stdout:3/842: dread - d3/d9/d18/d59/f109 zero size 2024-04-26T20:19:09.667 INFO:tasks.workunit.client.0.smithi016.stdout:4/865: write d0/dd/d19/f24 [107958,13436] 0 2024-04-26T20:19:09.668 INFO:tasks.workunit.client.0.smithi016.stdout:4/866: mknod d0/d96/c117 0 2024-04-26T20:19:09.669 INFO:tasks.workunit.client.0.smithi016.stdout:4/867: getdents d0/dd/d19 0 2024-04-26T20:19:09.671 INFO:tasks.workunit.client.0.smithi016.stdout:4/868: symlink d0/dd/dc9/l118 0 2024-04-26T20:19:09.672 INFO:tasks.workunit.client.0.smithi016.stdout:4/869: getdents d0/d1e/d4e/d52/d54/d87 0 2024-04-26T20:19:09.672 INFO:tasks.workunit.client.0.smithi016.stdout:4/870: write d0/d1e/d4e/d52/d88/d43/d5a/fa9 [4718716,9800] 0 2024-04-26T20:19:09.672 INFO:tasks.workunit.client.0.smithi016.stdout:4/871: fsync d0/dd/d19/d57/f63 0 2024-04-26T20:19:09.672 INFO:tasks.workunit.client.0.smithi016.stdout:4/872: fsync d0/dd/dc9/ff6 0 2024-04-26T20:19:09.675 INFO:tasks.workunit.client.0.smithi016.stdout:4/873: link d0/f11 d0/dd/d19/d57/f119 0 2024-04-26T20:19:09.678 INFO:tasks.workunit.client.0.smithi016.stdout:4/874: mkdir d0/dd/d19/d57/d11a 0 2024-04-26T20:19:09.708 INFO:tasks.workunit.client.0.smithi016.stdout:6/982: dread d1/d21/d26/d1c/d5d/def/d2c/d47/f104 [0,4194304] 0 2024-04-26T20:19:09.708 INFO:tasks.workunit.client.0.smithi016.stdout:6/983: chown d1/d21/d26/d1c/d7b/d82/d8f/cc8 41 1 2024-04-26T20:19:09.708 INFO:tasks.workunit.client.0.smithi016.stdout:6/984: chown d1/d21/d26/d1c/d5d/def/d12a 0 1 2024-04-26T20:19:09.708 INFO:tasks.workunit.client.0.smithi016.stdout:6/985: truncate d1/d12/fb7 1598748 0 2024-04-26T20:19:09.710 INFO:tasks.workunit.client.0.smithi016.stdout:7/898: dwrite d0/d51/ffd [0,4194304] 0 2024-04-26T20:19:09.717 INFO:tasks.workunit.client.0.smithi016.stdout:7/899: truncate d0/dd5/fbf 1402665 0 2024-04-26T20:19:09.722 INFO:tasks.workunit.client.0.smithi016.stdout:7/900: getdents d0/dd5/d6/d6e 0 2024-04-26T20:19:09.725 INFO:tasks.workunit.client.0.smithi016.stdout:4/875: dwrite d0/d1e/d4e/f108 [0,4194304] 0 2024-04-26T20:19:09.725 INFO:tasks.workunit.client.0.smithi016.stdout:4/876: chown d0/d1e/d4e/d52/d88/f5f 117552318 1 2024-04-26T20:19:09.743 INFO:tasks.workunit.client.0.smithi016.stdout:6/986: dwrite d1/f140 [0,4194304] 0 2024-04-26T20:19:09.748 INFO:tasks.workunit.client.0.smithi016.stdout:0/902: sync 2024-04-26T20:19:09.754 INFO:tasks.workunit.client.0.smithi016.stdout:0/903: truncate d2/dc/d18/d24/fb3 2454945 0 2024-04-26T20:19:09.754 INFO:tasks.workunit.client.0.smithi016.stdout:0/904: write d2/dc/d1e/d25/f28 [5165091,41068] 0 2024-04-26T20:19:09.754 INFO:tasks.workunit.client.0.smithi016.stdout:6/987: dread d1/d21/d48/d51/fb6 [0,4194304] 0 2024-04-26T20:19:09.754 INFO:tasks.workunit.client.0.smithi016.stdout:6/988: rename d1/d21/d26/d1c/d7b to d1/d21/d26/d1c/d7b/d82/d8f/dff/d14a 22 2024-04-26T20:19:09.787 INFO:tasks.workunit.client.0.smithi016.stdout:4/877: dwrite d0/dd/d19/f4d [4194304,4194304] 0 2024-04-26T20:19:09.789 INFO:tasks.workunit.client.0.smithi016.stdout:6/989: symlink d1/d12/d90/l14b 0 2024-04-26T20:19:09.796 INFO:tasks.workunit.client.0.smithi016.stdout:4/878: dread d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/fa5 [0,4194304] 0 2024-04-26T20:19:09.808 INFO:tasks.workunit.client.0.smithi016.stdout:4/879: rmdir d0/d1e/d4e/d52/d54 39 2024-04-26T20:19:09.818 INFO:tasks.workunit.client.0.smithi016.stdout:4/880: creat d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/f11b x:0 0 0 2024-04-26T20:19:09.819 INFO:tasks.workunit.client.0.smithi016.stdout:3/843: dwrite d3/d9/d18/d82/fb9 [0,4194304] 0 2024-04-26T20:19:09.822 INFO:tasks.workunit.client.0.smithi016.stdout:4/881: creat d0/dd/d19/f11c x:0 0 0 2024-04-26T20:19:09.834 INFO:tasks.workunit.client.0.smithi016.stdout:4/882: read d0/d1e/d64/f95 [254344,71158] 0 2024-04-26T20:19:09.858 INFO:tasks.workunit.client.0.smithi016.stdout:3/844: dwrite d3/d9/d18/d82/ff4 [0,4194304] 0 2024-04-26T20:19:09.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/883: creat d0/d1e/d4e/d52/d88/f11d x:0 0 0 2024-04-26T20:19:09.860 INFO:tasks.workunit.client.0.smithi016.stdout:3/845: mknod d3/df/d25/d2a/d4a/de4/c10d 0 2024-04-26T20:19:09.863 INFO:tasks.workunit.client.0.smithi016.stdout:3/846: dread d3/df/d20/d41/f4e [0,4194304] 0 2024-04-26T20:19:09.883 INFO:tasks.workunit.client.0.smithi016.stdout:3/847: write d3/d9/d18/d82/ff4 [611664,88965] 0 2024-04-26T20:19:09.883 INFO:tasks.workunit.client.0.smithi016.stdout:3/848: read - d3/df/faa zero size 2024-04-26T20:19:09.884 INFO:tasks.workunit.client.0.smithi016.stdout:3/849: chown d3/df/f58 441802100 1 2024-04-26T20:19:09.884 INFO:tasks.workunit.client.0.smithi016.stdout:6/990: dwrite d1/d21/f3e [0,4194304] 0 2024-04-26T20:19:09.884 INFO:tasks.workunit.client.0.smithi016.stdout:4/884: getdents d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f 0 2024-04-26T20:19:09.885 INFO:tasks.workunit.client.0.smithi016.stdout:4/885: write d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/f11b [870157,7529] 0 2024-04-26T20:19:09.885 INFO:tasks.workunit.client.0.smithi016.stdout:3/850: symlink d3/d9/d18/d5a/l10e 0 2024-04-26T20:19:09.888 INFO:tasks.workunit.client.0.smithi016.stdout:6/991: rmdir d1/d21/d26/d1c/dd9 39 2024-04-26T20:19:09.897 INFO:tasks.workunit.client.0.smithi016.stdout:4/886: dread d0/dd/d19/d1f/d7b/f104 [0,4194304] 0 2024-04-26T20:19:09.898 INFO:tasks.workunit.client.0.smithi016.stdout:4/887: fdatasync d0/dd/d19/f11c 0 2024-04-26T20:19:09.898 INFO:tasks.workunit.client.0.smithi016.stdout:6/992: dread d1/d21/d26/d1c/d7b/d82/d8f/f144 [0,4194304] 0 2024-04-26T20:19:09.899 INFO:tasks.workunit.client.0.smithi016.stdout:6/993: chown d1/d21/d26/d1c/d5d/d88 46814 1 2024-04-26T20:19:09.899 INFO:tasks.workunit.client.0.smithi016.stdout:6/994: fdatasync f0 0 2024-04-26T20:19:09.899 INFO:tasks.workunit.client.0.smithi016.stdout:3/851: creat d3/df/d20/d61/d76/f10f x:0 0 0 2024-04-26T20:19:09.899 INFO:tasks.workunit.client.0.smithi016.stdout:3/852: truncate d3/df/faa 880685 0 2024-04-26T20:19:09.899 INFO:tasks.workunit.client.0.smithi016.stdout:4/888: link d0/d1e/d4e/d52/d88/f11d d0/d1e/d4e/d52/d88/d107/f11e 0 2024-04-26T20:19:09.938 INFO:tasks.workunit.client.0.smithi016.stdout:4/889: dwrite d0/dd/d19/f38 [0,4194304] 0 2024-04-26T20:19:09.939 INFO:tasks.workunit.client.0.smithi016.stdout:6/995: rmdir d1/d21/d78/d109 39 2024-04-26T20:19:09.940 INFO:tasks.workunit.client.0.smithi016.stdout:4/890: unlink d0/d1e/d64/f85 0 2024-04-26T20:19:09.952 INFO:tasks.workunit.client.0.smithi016.stdout:3/853: dwrite d3/df/d20/d61/d74/fb3 [0,4194304] 0 2024-04-26T20:19:09.952 INFO:tasks.workunit.client.0.smithi016.stdout:3/854: write d3/d9/d2d/d4f/f50 [4500610,34478] 0 2024-04-26T20:19:09.952 INFO:tasks.workunit.client.0.smithi016.stdout:3/855: chown d3/d9/d18 27090 1 2024-04-26T20:19:09.952 INFO:tasks.workunit.client.0.smithi016.stdout:3/856: dread - d3/d9/d2d/fc9 zero size 2024-04-26T20:19:09.953 INFO:tasks.workunit.client.0.smithi016.stdout:6/996: getdents d1/d21/d26/d1c/d5d/de2 0 2024-04-26T20:19:09.954 INFO:tasks.workunit.client.0.smithi016.stdout:3/857: mknod d3/df/d25/d2a/d4a/c110 0 2024-04-26T20:19:09.955 INFO:tasks.workunit.client.0.smithi016.stdout:6/997: creat d1/d21/d26/d1c/d5d/d88/f14c x:0 0 0 2024-04-26T20:19:09.955 INFO:tasks.workunit.client.0.smithi016.stdout:6/998: stat d1/d21/d26/d1c/d8a/d147/l130 0 2024-04-26T20:19:09.955 INFO:tasks.workunit.client.0.smithi016.stdout:6/999: chown d1/d21/d48/lb8 41 1 2024-04-26T20:19:09.979 INFO:tasks.workunit.client.0.smithi016.stdout:4/891: dwrite d0/d1e/d30/fbe [0,4194304] 0 2024-04-26T20:19:09.979 INFO:tasks.workunit.client.0.smithi016.stdout:4/892: fsync d0/dd/d19/d57/d113/fec 0 2024-04-26T20:19:09.980 INFO:tasks.workunit.client.0.smithi016.stdout:3/858: creat d3/d9/d18/dd5/f111 x:0 0 0 2024-04-26T20:19:09.983 INFO:tasks.workunit.client.0.smithi016.stdout:4/893: mkdir d0/d1e/d4e/d52/d11f 0 2024-04-26T20:19:09.997 INFO:tasks.workunit.client.0.smithi016.stdout:3/859: dread d3/d70/d8b/f93 [0,4194304] 0 2024-04-26T20:19:10.040 INFO:tasks.workunit.client.0.smithi016.stdout:3/860: dwrite d3/df/d25/d32/f3b [0,4194304] 0 2024-04-26T20:19:10.042 INFO:tasks.workunit.client.0.smithi016.stdout:4/894: mkdir d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/d120 0 2024-04-26T20:19:10.052 INFO:tasks.workunit.client.0.smithi016.stdout:0/905: sync 2024-04-26T20:19:10.052 INFO:tasks.workunit.client.0.smithi016.stdout:7/901: sync 2024-04-26T20:19:10.052 INFO:tasks.workunit.client.0.smithi016.stdout:7/902: chown d0/dd5/d4b/lcf 937452149 1 2024-04-26T20:19:10.053 INFO:tasks.workunit.client.0.smithi016.stdout:3/861: symlink d3/df/d20/d61/l112 0 2024-04-26T20:19:10.053 INFO:tasks.workunit.client.0.smithi016.stdout:3/862: fdatasync d3/df/d20/d61/d76/f10f 0 2024-04-26T20:19:10.055 INFO:tasks.workunit.client.0.smithi016.stdout:0/906: truncate d2/dc/d45/f84 2501012 0 2024-04-26T20:19:10.083 INFO:tasks.workunit.client.0.smithi016.stdout:4/895: dwrite d0/dd/d19/f11c [0,4194304] 0 2024-04-26T20:19:10.085 INFO:tasks.workunit.client.0.smithi016.stdout:0/907: creat d2/dc/d18/d5b/f12b x:0 0 0 2024-04-26T20:19:10.087 INFO:tasks.workunit.client.0.smithi016.stdout:4/896: mkdir d0/d1e/d4e/d52/d88/d43/d5a/dd1/d121 0 2024-04-26T20:19:10.088 INFO:tasks.workunit.client.0.smithi016.stdout:0/908: rmdir d2/d8/d10a 39 2024-04-26T20:19:10.089 INFO:tasks.workunit.client.0.smithi016.stdout:4/897: symlink d0/l122 0 2024-04-26T20:19:10.089 INFO:tasks.workunit.client.0.smithi016.stdout:4/898: write d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/f105 [309137,16763] 0 2024-04-26T20:19:10.090 INFO:tasks.workunit.client.0.smithi016.stdout:4/899: write d0/d1e/d64/f8e [931517,115904] 0 2024-04-26T20:19:10.090 INFO:tasks.workunit.client.0.smithi016.stdout:0/909: rmdir d2/d20/d57/d128/d91/d126/d5d/d60 39 2024-04-26T20:19:10.091 INFO:tasks.workunit.client.0.smithi016.stdout:4/900: rmdir d0/dd/d19/d57 39 2024-04-26T20:19:10.093 INFO:tasks.workunit.client.0.smithi016.stdout:0/910: truncate d2/dc/d18/f29 3899123 0 2024-04-26T20:19:10.140 INFO:tasks.workunit.client.0.smithi016.stdout:7/903: dwrite d0/dd5/d46/db4/d106/f9a [0,4194304] 0 2024-04-26T20:19:10.144 INFO:tasks.workunit.client.0.smithi016.stdout:4/901: dread d0/dd/d19/d57/f89 [0,4194304] 0 2024-04-26T20:19:10.144 INFO:tasks.workunit.client.0.smithi016.stdout:4/902: stat d0/dd/f98 0 2024-04-26T20:19:10.150 INFO:tasks.workunit.client.0.smithi016.stdout:0/911: dwrite d2/d40/f5c [0,4194304] 0 2024-04-26T20:19:10.152 INFO:tasks.workunit.client.0.smithi016.stdout:4/903: link d0/d1e/d4e/d52/d88/d115/dbc/dfa/la7 d0/d1e/d4e/d52/d88/d115/l123 0 2024-04-26T20:19:10.177 INFO:tasks.workunit.client.0.smithi016.stdout:7/904: dwrite d0/f8c [4194304,4194304] 0 2024-04-26T20:19:10.180 INFO:tasks.workunit.client.0.smithi016.stdout:7/905: fsync d0/dd5/d34/d25/d3f/d6d/d87/da3/fd8 0 2024-04-26T20:19:10.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/912: mknod d2/dc/d18/dd7/df5/c12c 0 2024-04-26T20:19:10.180 INFO:tasks.workunit.client.0.smithi016.stdout:0/913: dread - d2/dc/d1e/dc5/fd6 zero size 2024-04-26T20:19:10.182 INFO:tasks.workunit.client.0.smithi016.stdout:4/904: dread d0/d1e/d4e/d52/d88/d115/fd6 [0,4194304] 0 2024-04-26T20:19:10.194 INFO:tasks.workunit.client.0.smithi016.stdout:0/914: dread d2/dc/d45/f84 [0,4194304] 0 2024-04-26T20:19:10.196 INFO:tasks.workunit.client.0.smithi016.stdout:7/906: creat d0/dd5/d34/d25/d3f/d6d/dc2/f111 x:0 0 0 2024-04-26T20:19:10.197 INFO:tasks.workunit.client.0.smithi016.stdout:0/915: symlink d2/d20/d41/d4c/d4e/l12d 0 2024-04-26T20:19:10.197 INFO:tasks.workunit.client.0.smithi016.stdout:0/916: read - d2/dc/d18/d5b/fd9 zero size 2024-04-26T20:19:10.234 INFO:tasks.workunit.client.0.smithi016.stdout:4/905: dwrite d0/f8d [4194304,4194304] 0 2024-04-26T20:19:10.240 INFO:tasks.workunit.client.0.smithi016.stdout:0/917: dwrite d2/dc/d1e/f3a [0,4194304] 0 2024-04-26T20:19:10.242 INFO:tasks.workunit.client.0.smithi016.stdout:7/907: creat d0/dd5/d34/d25/d3f/d6d/d74/f112 x:0 0 0 2024-04-26T20:19:10.243 INFO:tasks.workunit.client.0.smithi016.stdout:4/906: dread d0/dd/f84 [0,4194304] 0 2024-04-26T20:19:10.243 INFO:tasks.workunit.client.0.smithi016.stdout:4/907: write d0/d1e/d30/fdb [2105578,29099] 0 2024-04-26T20:19:10.244 INFO:tasks.workunit.client.0.smithi016.stdout:0/918: link d2/dc/de3/c108 d2/dc/de3/c12e 0 2024-04-26T20:19:10.276 INFO:tasks.workunit.client.0.smithi016.stdout:4/908: dread d0/dd/d19/d1f/f9b [0,4194304] 0 2024-04-26T20:19:10.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:10.284 INFO:tasks.workunit.client.0.smithi016.stdout:7/908: dwrite d0/dd5/d46/db4/d106/f9a [0,4194304] 0 2024-04-26T20:19:10.284 INFO:tasks.workunit.client.0.smithi016.stdout:0/919: dwrite d2/dc/d1e/d107/f11b [0,4194304] 0 2024-04-26T20:19:10.287 INFO:tasks.workunit.client.0.smithi016.stdout:0/920: mkdir d2/dc/d1e/dc5/d12f 0 2024-04-26T20:19:10.288 INFO:tasks.workunit.client.0.smithi016.stdout:7/909: truncate d0/dd5/d34/d25/fb8 109856 0 2024-04-26T20:19:10.288 INFO:tasks.workunit.client.0.smithi016.stdout:7/910: stat d0/dd5/d34/d25/d3f/d6d/d87/da3/fea 0 2024-04-26T20:19:10.289 INFO:tasks.workunit.client.0.smithi016.stdout:0/921: rename d2/d20/d57/l66 to d2/d8/d10a/l130 0 2024-04-26T20:19:10.290 INFO:tasks.workunit.client.0.smithi016.stdout:0/922: dread - d2/dc/d18/dd7/df5/f103 zero size 2024-04-26T20:19:10.291 INFO:tasks.workunit.client.0.smithi016.stdout:7/911: mknod d0/dd5/d34/d25/d3f/df2/c113 0 2024-04-26T20:19:10.291 INFO:tasks.workunit.client.0.smithi016.stdout:7/912: chown d0/dd5/d6/d6e/c96 10625 1 2024-04-26T20:19:10.293 INFO:tasks.workunit.client.0.smithi016.stdout:0/923: truncate d2/d8/f80 964229 0 2024-04-26T20:19:10.293 INFO:tasks.workunit.client.0.smithi016.stdout:0/924: chown d2 82704 1 2024-04-26T20:19:10.294 INFO:tasks.workunit.client.0.smithi016.stdout:7/913: rename d0/dd5/d34/d25/ld2 to d0/dd5/d46/db4/l114 0 2024-04-26T20:19:10.294 INFO:tasks.workunit.client.0.smithi016.stdout:3/863: sync 2024-04-26T20:19:10.298 INFO:tasks.workunit.client.0.smithi016.stdout:0/925: dread d2/d20/d41/d87/d9d/db8/fce [0,4194304] 0 2024-04-26T20:19:10.307 INFO:tasks.workunit.client.0.smithi016.stdout:3/864: truncate d3/df/d25/d32/d9e/fad 2759284 0 2024-04-26T20:19:10.315 INFO:tasks.workunit.client.0.smithi016.stdout:7/914: write d0/dd5/d46/db4/d106/fc9 [1729420,64097] 0 2024-04-26T20:19:10.315 INFO:tasks.workunit.client.0.smithi016.stdout:7/915: chown d0/dd5/d88/db3/dc1/l10e 7969142 1 2024-04-26T20:19:10.317 INFO:tasks.workunit.client.0.smithi016.stdout:0/926: write d2/dc/d1e/f38 [2072871,54134] 0 2024-04-26T20:19:10.320 INFO:tasks.workunit.client.0.smithi016.stdout:3/865: write d3/f60 [3736675,46714] 0 2024-04-26T20:19:10.321 INFO:tasks.workunit.client.0.smithi016.stdout:0/927: symlink d2/d20/d57/d128/d91/d126/d5d/d60/d125/l131 0 2024-04-26T20:19:10.335 INFO:tasks.workunit.client.0.smithi016.stdout:3/866: rename d3/df/d20/d5b/cec to d3/df/d25/d32/d3f/d105/d108/c113 0 2024-04-26T20:19:10.335 INFO:tasks.workunit.client.0.smithi016.stdout:3/867: stat d3/d9/d18/d82/c87 0 2024-04-26T20:19:10.335 INFO:tasks.workunit.client.0.smithi016.stdout:7/916: write d0/d83/f60 [3228016,123518] 0 2024-04-26T20:19:10.409 INFO:tasks.workunit.client.0.smithi016.stdout:3/868: dwrite d3/d9/f3d [0,4194304] 0 2024-04-26T20:19:10.412 INFO:tasks.workunit.client.0.smithi016.stdout:7/917: dwrite d0/d51/fd1 [0,4194304] 0 2024-04-26T20:19:10.416 INFO:tasks.workunit.client.0.smithi016.stdout:7/918: symlink d0/dd5/d34/d25/d3f/d6d/d79/l115 0 2024-04-26T20:19:10.425 INFO:tasks.workunit.client.0.smithi016.stdout:3/869: read d3/df/d25/d32/f3b [1575662,18943] 0 2024-04-26T20:19:10.426 INFO:tasks.workunit.client.0.smithi016.stdout:3/870: truncate d3/df/d25/d32/f95 393554 0 2024-04-26T20:19:10.426 INFO:tasks.workunit.client.0.smithi016.stdout:3/871: chown d3/df/d25/d2a/d4a/de4/de8/fff 938 1 2024-04-26T20:19:10.427 INFO:tasks.workunit.client.0.smithi016.stdout:3/872: fdatasync d3/d9/d18/f8f 0 2024-04-26T20:19:10.428 INFO:tasks.workunit.client.0.smithi016.stdout:3/873: rename d3/df/d20/db0/le9 to d3/d9/d18/dfa/dfb/l114 0 2024-04-26T20:19:10.429 INFO:tasks.workunit.client.0.smithi016.stdout:3/874: dread - d3/df/d25/d2a/fbf zero size 2024-04-26T20:19:10.454 INFO:tasks.workunit.client.0.smithi016.stdout:3/875: write d3/d9/d18/f34 [91962,4238] 0 2024-04-26T20:19:10.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f5667200640 1 Processor -- start 2024-04-26T20:19:10.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f5667200640 1 -- start start 2024-04-26T20:19:10.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f5667200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 0x7f56600c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f5667200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56600c9d90 con 0x7f5660153af0 2024-04-26T20:19:10.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f5667200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56600ca070 con 0x7f56600c7b80 2024-04-26T20:19:10.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f5667200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f566015dec0 con 0x7f56600c9720 2024-04-26T20:19:10.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f565fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5660153af0 0x7f566015d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48734/0 (socket says 172.21.15.16:48734) 2024-04-26T20:19:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.463+0000 7f565fe00640 1 -- 172.21.15.16:0/808948479 learned_addr learned my addr 172.21.15.16:0/808948479 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:10.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f5665200640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 0x7f56600c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785890220 0 0) 0x7f56600c9d90 con 0x7f5660153af0 2024-04-26T20:19:10.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5644003530 con 0x7f5660153af0 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 910744336 0 0) 0x7f5644003530 con 0x7f5660153af0 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 msgr2=0x7f56600c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 0x7f56600c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 >> v1:172.21.15.192:6789/0 conn(0x7f56600c7b80 legacy=0x7f56600c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56600ca350 con 0x7f5660153af0 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f5650001680 con 0x7f5660153af0 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 >> v1:172.21.15.16:6789/0 conn(0x7f5660153af0 legacy=0x7f566015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56440039f0 0x7f5644003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 0x7f5644004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644004d50 0x7f56440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f566015dec0 con 0x7f5644004d50 2024-04-26T20:19:10.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f564400bb10 con 0x7f56440039f0 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f564400bd10 con 0x7f56600c9720 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565fe00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56440039f0 0x7f5644003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565f400640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 0x7f5644004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f5665200640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644004d50 0x7f56440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565fe00640 1 -- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 msgr2=0x7f5644004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565fe00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56600c9720 0x7f5644004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565fe00640 1 -- 172.21.15.16:0/808948479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644004d50 msgr2=0x7f56440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565fe00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644004d50 0x7f56440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.467+0000 7f565fe00640 1 -- 172.21.15.16:0/808948479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5644003530 con 0x7f56440039f0 2024-04-26T20:19:10.473 INFO:tasks.workunit.client.0.smithi016.stdout:7/919: dwrite d0/dd5/d34/dec/fdb [0,4194304] 0 2024-04-26T20:19:10.473 INFO:tasks.workunit.client.0.smithi016.stdout:3/876: write d3/df/f99 [643727,107822] 0 2024-04-26T20:19:10.474 INFO:tasks.workunit.client.0.smithi016.stdout:7/920: rename d0/d83/lb0 to d0/d67/de6/dee/l116 0 2024-04-26T20:19:10.474 INFO:tasks.workunit.client.0.smithi016.stdout:7/921: read - d0/dd5/d34/db7/ff4 zero size 2024-04-26T20:19:10.474 INFO:tasks.workunit.client.0.smithi016.stdout:7/922: read - d0/dd5/d88/db3/fc3 zero size 2024-04-26T20:19:10.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.471+0000 7f565fe00640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56440039f0 0x7f5644003e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5650001ec0 tx=0x7f565001cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0a453d6866ab811 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:10.475 INFO:tasks.workunit.client.0.smithi016.stdout:7/923: rmdir d0 39 2024-04-26T20:19:10.475 INFO:tasks.workunit.client.0.smithi016.stdout:7/924: write d0/dd5/d4b/f72 [1946670,93209] 0 2024-04-26T20:19:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.471+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650007d40 con 0x7f56440039f0 2024-04-26T20:19:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.471+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56500a9070 con 0x7f56440039f0 2024-04-26T20:19:10.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.471+0000 7f565ea00640 1 -- 172.21.15.16:0/808948479 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500a5dc0 con 0x7f56440039f0 2024-04-26T20:19:10.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 -- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56440039f0 msgr2=0x7f5644003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 --2- 172.21.15.16:0/808948479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56440039f0 0x7f5644003e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5650001ec0 tx=0x7f565001cc60 comp rx=0 tx=0).stop 2024-04-26T20:19:10.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5665200640 1 -- 172.21.15.16:0/808948479 reap_dead start 2024-04-26T20:19:10.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 -- 172.21.15.16:0/808948479 shutdown_connections 2024-04-26T20:19:10.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 -- 172.21.15.16:0/808948479 >> 172.21.15.16:0/808948479 conn(0x7f566006c380 msgr2=0x7f566006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:10.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 -- 172.21.15.16:0/808948479 shutdown_connections 2024-04-26T20:19:10.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 -- 172.21.15.16:0/808948479 wait complete. 2024-04-26T20:19:10.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 Processor -- start 2024-04-26T20:19:10.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.475+0000 7f5667200640 1 -- start start 2024-04-26T20:19:10.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56440039f0 0x7f56601f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f566015b640 0x7f56600c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f566015c990 0x7f566014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f566015d290 con 0x7f56440039f0 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56600ca630 con 0x7f566015c990 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5660153ed0 con 0x7f566015b640 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56440039f0 0x7f56601f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56440039f0 0x7f56601f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38410/0 (socket says 172.21.15.16:38410) 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 -- 172.21.15.16:0/1819264627 learned_addr learned my addr 172.21.15.16:0/1819264627 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565f400640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f566015b640 0x7f56600c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5665200640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f566015c990 0x7f566014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 -- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f566015b640 msgr2=0x7f56600c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f566015b640 0x7f56600c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 -- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f566015c990 msgr2=0x7f566014c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f566015c990 0x7f566014c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 -- 172.21.15.16:0/1819264627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566015c1b0 con 0x7f56440039f0 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f565fe00640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56440039f0 0x7f56601f5ef0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f565001d140 tx=0x7f5644005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5657e00640 1 -- 172.21.15.16:0/1819264627 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650007d20 con 0x7f56440039f0 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5657e00640 1 -- 172.21.15.16:0/1819264627 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56500047f0 con 0x7f56440039f0 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56601f9590 con 0x7f56440039f0 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5657e00640 1 -- 172.21.15.16:0/1819264627 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650004be0 con 0x7f56440039f0 2024-04-26T20:19:10.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566015bed0 con 0x7f56440039f0 2024-04-26T20:19:10.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.479+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5660077c20 con 0x7f56440039f0 2024-04-26T20:19:10.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.483+0000 7f5657e00640 1 -- 172.21.15.16:0/1819264627 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5650007090 con 0x7f56440039f0 2024-04-26T20:19:10.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.483+0000 7f5657e00640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5640068380 0x7f564006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:10.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.483+0000 7f5657e00640 1 -- 172.21.15.16:0/1819264627 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f5650120bd0 con 0x7f56440039f0 2024-04-26T20:19:10.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.483+0000 7f565f400640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5640068380 0x7f564006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:10.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.483+0000 7f565f400640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5640068380 0x7f564006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f564c00e440 tx=0x7f564c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:10.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.487+0000 7f5657e00640 1 -- 172.21.15.16:0/1819264627 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5650016970 con 0x7f56440039f0 2024-04-26T20:19:10.518 INFO:tasks.workunit.client.0.smithi016.stdout:3/877: dread d3/df/f26 [0,4194304] 0 2024-04-26T20:19:10.518 INFO:tasks.workunit.client.0.smithi016.stdout:3/878: write d3/df/d25/d2a/f7a [4144626,6880] 0 2024-04-26T20:19:10.527 INFO:tasks.workunit.client.0.smithi016.stdout:7/925: dwrite d0/dd5/d34/d25/d3f/d6d/d87/da3/f101 [0,4194304] 0 2024-04-26T20:19:10.531 INFO:tasks.workunit.client.0.smithi016.stdout:7/926: creat d0/dd5/d46/db4/f117 x:0 0 0 2024-04-26T20:19:10.531 INFO:tasks.workunit.client.0.smithi016.stdout:7/927: fdatasync d0/dd5/d34/d25/d3f/d6d/d79/fc4 0 2024-04-26T20:19:10.531 INFO:tasks.workunit.client.0.smithi016.stdout:7/928: write d0/dd5/d34/d25/d3f/d6d/dc2/f111 [449458,23711] 0 2024-04-26T20:19:10.532 INFO:tasks.workunit.client.0.smithi016.stdout:7/929: rmdir d0/dd5/d34/d25/dbc 0 2024-04-26T20:19:10.536 INFO:tasks.workunit.client.0.smithi016.stdout:4/909: sync 2024-04-26T20:19:10.536 INFO:tasks.workunit.client.0.smithi016.stdout:4/910: write d0/dd/d19/d1f/f9b [2176600,18310] 0 2024-04-26T20:19:10.537 INFO:tasks.workunit.client.0.smithi016.stdout:4/911: creat d0/dd/d19/d57/f124 x:0 0 0 2024-04-26T20:19:10.537 INFO:tasks.workunit.client.0.smithi016.stdout:4/912: fsync d0/d1e/d64/f95 0 2024-04-26T20:19:10.538 INFO:tasks.workunit.client.0.smithi016.stdout:4/913: stat d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/ffb 0 2024-04-26T20:19:10.538 INFO:tasks.workunit.client.0.smithi016.stdout:4/914: chown d0/d1e/d4e/d52/d88/d115/l123 18166 1 2024-04-26T20:19:10.538 INFO:tasks.workunit.client.0.smithi016.stdout:4/915: symlink d0/dd/d19/d57/d113/l125 0 2024-04-26T20:19:10.538 INFO:tasks.workunit.client.0.smithi016.stdout:3/879: dread d3/f7 [0,4194304] 0 2024-04-26T20:19:10.538 INFO:tasks.workunit.client.0.smithi016.stdout:3/880: fsync d3/df/d25/d32/d3f/fef 0 2024-04-26T20:19:10.539 INFO:tasks.workunit.client.0.smithi016.stdout:4/916: mkdir d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/d126 0 2024-04-26T20:19:10.542 INFO:tasks.workunit.client.0.smithi016.stdout:3/881: symlink d3/d70/d8b/ddc/deb/l115 0 2024-04-26T20:19:10.544 INFO:tasks.workunit.client.0.smithi016.stdout:3/882: creat d3/d9/d18/d82/f116 x:0 0 0 2024-04-26T20:19:10.546 INFO:tasks.workunit.client.0.smithi016.stdout:3/883: rmdir d3/df/d25/d2a 39 2024-04-26T20:19:10.546 INFO:tasks.workunit.client.0.smithi016.stdout:3/884: chown f0 192 1 2024-04-26T20:19:10.548 INFO:tasks.workunit.client.0.smithi016.stdout:3/885: link d3/df/d20/db0/dd1/l102 d3/df/d25/d32/dc7/l117 0 2024-04-26T20:19:10.551 INFO:tasks.workunit.client.0.smithi016.stdout:3/886: rename d3/df/d20/d61 to d3/d9/d18/dfa/dfb/db5/d118 0 2024-04-26T20:19:10.560 INFO:tasks.workunit.client.0.smithi016.stdout:3/887: dread d3/df/d25/d2a/d4a/de4/de8/f107 [0,4194304] 0 2024-04-26T20:19:10.563 INFO:tasks.workunit.client.0.smithi016.stdout:3/888: rename d3/d9/d18/d59/f8a to d3/d9/d2d/db8/f119 0 2024-04-26T20:19:10.563 INFO:tasks.workunit.client.0.smithi016.stdout:3/889: readlink d3/d9/d18/dfa/dfb/l6a 0 2024-04-26T20:19:10.564 INFO:tasks.workunit.client.0.smithi016.stdout:3/890: truncate d3/d9/f1a 3716142 0 2024-04-26T20:19:10.566 INFO:tasks.workunit.client.0.smithi016.stdout:3/891: link d3/d9/d18/d82/dc6/ce7 d3/d9/d18/dd5/c11a 0 2024-04-26T20:19:10.566 INFO:tasks.workunit.client.0.smithi016.stdout:7/930: write d0/f8c [3286005,33596] 0 2024-04-26T20:19:10.567 INFO:tasks.workunit.client.0.smithi016.stdout:3/892: mknod d3/df/d20/db0/dc2/de2/c11b 0 2024-04-26T20:19:10.567 INFO:tasks.workunit.client.0.smithi016.stdout:3/893: stat d3/l1d 0 2024-04-26T20:19:10.571 INFO:tasks.workunit.client.0.smithi016.stdout:7/931: creat d0/dd5/d34/d25/d3f/dfb/f118 x:0 0 0 2024-04-26T20:19:10.572 INFO:tasks.workunit.client.0.smithi016.stdout:3/894: creat d3/d70/d8b/ddc/f11c x:0 0 0 2024-04-26T20:19:10.574 INFO:tasks.workunit.client.0.smithi016.stdout:3/895: unlink d3/d9/d18/dfa/dfb/db5/d118/l85 0 2024-04-26T20:19:10.594 INFO:tasks.workunit.client.0.smithi016.stdout:3/896: rename d3/d9/d18/dfa/dfb to d3/df/d20/d5b/d11d 0 2024-04-26T20:19:10.625 INFO:tasks.workunit.client.0.smithi016.stdout:3/897: dwrite d3/df/d25/d2a/d4a/f91 [0,4194304] 0 2024-04-26T20:19:10.628 INFO:tasks.workunit.client.0.smithi016.stdout:3/898: unlink d3/d9/lb2 0 2024-04-26T20:19:10.629 INFO:tasks.workunit.client.0.smithi016.stdout:3/899: mkdir d3/df/d20/d5b/d11d/db5/dac/d11e 0 2024-04-26T20:19:10.630 INFO:tasks.workunit.client.0.smithi016.stdout:3/900: creat d3/d70/d8b/f11f x:0 0 0 2024-04-26T20:19:10.630 INFO:tasks.workunit.client.0.smithi016.stdout:3/901: read d3/df/d20/d5b/d11d/db5/dac/fae [2712641,55349] 0 2024-04-26T20:19:10.631 INFO:tasks.workunit.client.0.smithi016.stdout:3/902: link d3/d9/ce d3/d70/df7/c120 0 2024-04-26T20:19:10.632 INFO:tasks.workunit.client.0.smithi016.stdout:3/903: mkdir d3/df/d20/db0/dc2/d121 0 2024-04-26T20:19:10.633 INFO:tasks.workunit.client.0.smithi016.stdout:3/904: symlink d3/df/d20/d5b/d11d/db5/dac/d11e/l122 0 2024-04-26T20:19:10.653 INFO:tasks.workunit.client.0.smithi016.stdout:4/917: dwrite d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/f11b [0,4194304] 0 2024-04-26T20:19:10.653 INFO:tasks.workunit.client.0.smithi016.stdout:4/918: write d0/dd/d19/f4d [301657,93746] 0 2024-04-26T20:19:10.711 INFO:tasks.workunit.client.0.smithi016.stdout:4/919: dwrite d0/dd/d19/f8a [0,4194304] 0 2024-04-26T20:19:10.725 INFO:tasks.workunit.client.0.smithi016.stdout:4/920: write d0/dd/d19/f8a [3288863,22055] 0 2024-04-26T20:19:10.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.743+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56600c80f0 con 0x7f56440039f0 2024-04-26T20:19:10.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.743+0000 7f5657e00640 1 -- 172.21.15.16:0/1819264627 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6048 (secure 0 0 0) 0x7f56500f0cd0 con 0x7f56440039f0 2024-04-26T20:19:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:10.748 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:05.862130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:resolve","state_seq":25,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:19:10.748 INFO:tasks.workunit.client.0.smithi016.stdout:4/921: read d0/dd/d19/f4d [7101522,112222] 0 2024-04-26T20:19:10.749 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 22 2024-04-26T20:19:10.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5640068380 msgr2=0x7f564006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5640068380 0x7f564006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f564c00e440 tx=0x7f564c009040 comp rx=0 tx=0).stop 2024-04-26T20:19:10.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56440039f0 msgr2=0x7f56601f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56440039f0 0x7f56601f5ef0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f565001d140 tx=0x7f5644005840 comp rx=0 tx=0).stop 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 shutdown_connections 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5640068380 0x7f564006a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f566015c990 0x7f566014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f566015b640 0x7f56600c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 --2- 172.21.15.16:0/1819264627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56440039f0 0x7f56601f5ef0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 >> 172.21.15.16:0/1819264627 conn(0x7f566006c380 msgr2=0x7f566014f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 shutdown_connections 2024-04-26T20:19:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:10.747+0000 7f5667200640 1 -- 172.21.15.16:0/1819264627 wait complete. 2024-04-26T20:19:10.757 INFO:tasks.workunit.client.0.smithi016.stdout:3/905: read d3/df/f26 [1575221,27596] 0 2024-04-26T20:19:10.767 INFO:tasks.workunit.client.0.smithi016.stdout:7/932: dwrite d0/dd5/d34/d25/d50/fde [0,4194304] 0 2024-04-26T20:19:10.767 INFO:tasks.workunit.client.0.smithi016.stdout:7/933: getdents d0/dd5/d6/d6e 0 2024-04-26T20:19:10.771 INFO:tasks.workunit.client.0.smithi016.stdout:7/934: creat d0/dd5/d34/d25/d3f/d6d/dc2/f119 x:0 0 0 2024-04-26T20:19:10.773 INFO:tasks.workunit.client.0.smithi016.stdout:4/922: write d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/f11b [3215599,41725] 0 2024-04-26T20:19:10.773 INFO:tasks.workunit.client.0.smithi016.stdout:4/923: write d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/fa5 [2141330,41595] 0 2024-04-26T20:19:10.773 INFO:tasks.workunit.client.0.smithi016.stdout:4/924: stat d0/dd/d19/d1f/f3e 0 2024-04-26T20:19:10.773 INFO:tasks.workunit.client.0.smithi016.stdout:4/925: fsync d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/fc3 0 2024-04-26T20:19:10.774 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:19:10.777 INFO:tasks.workunit.client.0.smithi016.stdout:7/935: read d0/dd5/fbf [1294091,13317] 0 2024-04-26T20:19:10.777 INFO:tasks.workunit.client.0.smithi016.stdout:0/928: sync 2024-04-26T20:19:10.780 INFO:tasks.workunit.client.0.smithi016.stdout:7/936: rename d0/cda to d0/dd5/d34/d25/d3f/d6d/d87/da3/c11a 0 2024-04-26T20:19:10.780 INFO:tasks.workunit.client.0.smithi016.stdout:7/937: readlink d0/dd5/d46/db4/d106/ldc 0 2024-04-26T20:19:10.780 INFO:tasks.workunit.client.0.smithi016.stdout:0/929: symlink d2/d20/d57/d128/d91/l132 0 2024-04-26T20:19:10.781 INFO:tasks.workunit.client.0.smithi016.stdout:3/906: read d3/df/d20/d5b/d11d/db5/d118/d74/fb3 [2404359,100655] 0 2024-04-26T20:19:10.792 INFO:tasks.workunit.client.0.smithi016.stdout:0/930: creat d2/dc/d18/dd7/df5/f133 x:0 0 0 2024-04-26T20:19:10.793 INFO:tasks.workunit.client.0.smithi016.stdout:3/907: creat d3/d70/d8b/f123 x:0 0 0 2024-04-26T20:19:10.794 INFO:tasks.workunit.client.0.smithi016.stdout:3/908: rmdir d3/df/d25/d32/d3f 39 2024-04-26T20:19:10.796 INFO:tasks.workunit.client.0.smithi016.stdout:3/909: creat d3/d9/d18/d82/f124 x:0 0 0 2024-04-26T20:19:10.815 INFO:tasks.workunit.client.0.smithi016.stdout:0/931: dread d2/dc/d45/f89 [0,4194304] 0 2024-04-26T20:19:10.815 INFO:tasks.workunit.client.0.smithi016.stdout:0/932: readlink d2/d8/l33 0 2024-04-26T20:19:10.816 INFO:tasks.workunit.client.0.smithi016.stdout:0/933: mknod d2/d20/d57/d128/d91/d126/c134 0 2024-04-26T20:19:10.842 INFO:tasks.workunit.client.0.smithi016.stdout:3/910: dwrite d3/df/d25/d2a/f73 [0,4194304] 0 2024-04-26T20:19:10.842 INFO:tasks.workunit.client.0.smithi016.stdout:3/911: truncate d3/d9/d2d/f9a 4670979 0 2024-04-26T20:19:10.844 INFO:tasks.workunit.client.0.smithi016.stdout:3/912: truncate d3/d9/d18/d82/fb9 1771419 0 2024-04-26T20:19:10.851 INFO:tasks.workunit.client.0.smithi016.stdout:3/913: dread d3/df/d25/d2a/d4a/f7e [0,4194304] 0 2024-04-26T20:19:10.854 INFO:tasks.workunit.client.0.smithi016.stdout:0/934: dwrite d2/d20/d41/d87/d9d/db8/d129/fa6 [0,4194304] 0 2024-04-26T20:19:10.854 INFO:tasks.workunit.client.0.smithi016.stdout:0/935: readlink d2/d8/l33 0 2024-04-26T20:19:10.856 INFO:tasks.workunit.client.0.smithi016.stdout:3/914: dread d3/df/f64 [0,4194304] 0 2024-04-26T20:19:10.856 INFO:tasks.workunit.client.0.smithi016.stdout:3/915: chown d3/df/d25/d2a/d4a/fca 87550356 1 2024-04-26T20:19:10.856 INFO:tasks.workunit.client.0.smithi016.stdout:3/916: chown d3/df/d25/d2a/l9b 70 1 2024-04-26T20:19:10.872 INFO:tasks.workunit.client.0.smithi016.stdout:3/917: dread d3/df/d20/f4b [0,4194304] 0 2024-04-26T20:19:10.872 INFO:tasks.workunit.client.0.smithi016.stdout:3/918: chown d3/df/d20/d41/lce 209111384 1 2024-04-26T20:19:10.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/919: mkdir d3/d9/d18/d59/d125 0 2024-04-26T20:19:10.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/920: chown d3/cc5 1632980 1 2024-04-26T20:19:10.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/921: truncate d3/df/d25/d2a/d4a/fc1 71933 0 2024-04-26T20:19:10.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/922: chown d3/d9/d18/f1c 0 1 2024-04-26T20:19:10.873 INFO:tasks.workunit.client.0.smithi016.stdout:3/923: write d3/df/d25/d2a/d4a/de4/de8/f107 [1145696,47387] 0 2024-04-26T20:19:10.874 INFO:tasks.workunit.client.0.smithi016.stdout:3/924: stat d3/l15 0 2024-04-26T20:19:10.903 INFO:tasks.workunit.client.0.smithi016.stdout:3/925: dwrite d3/df/d25/d2a/d4a/fca [0,4194304] 0 2024-04-26T20:19:11.094 INFO:tasks.workunit.client.0.smithi016.stdout:7/938: dwrite d0/dd5/d34/d25/d3f/d6d/d87/da3/fd8 [0,4194304] 0 2024-04-26T20:19:11.094 INFO:tasks.workunit.client.0.smithi016.stdout:7/939: read d0/dd5/f93 [805273,49112] 0 2024-04-26T20:19:11.094 INFO:tasks.workunit.client.0.smithi016.stdout:7/940: read - d0/dd5/d34/d25/d3f/d6d/dc2/f119 zero size 2024-04-26T20:19:11.095 INFO:tasks.workunit.client.0.smithi016.stdout:7/941: mkdir d0/dd5/d4b/d11b 0 2024-04-26T20:19:11.096 INFO:tasks.workunit.client.0.smithi016.stdout:7/942: mknod d0/dd5/d34/d25/d3f/d6d/c11c 0 2024-04-26T20:19:11.096 INFO:tasks.workunit.client.0.smithi016.stdout:7/943: dread - d0/dd5/d34/d25/d3f/d6d/d74/f112 zero size 2024-04-26T20:19:11.096 INFO:tasks.workunit.client.0.smithi016.stdout:7/944: chown d0/dd5/f103 15649 1 2024-04-26T20:19:11.096 INFO:tasks.workunit.client.0.smithi016.stdout:7/945: chown d0/d83/lf7 0 1 2024-04-26T20:19:11.133 INFO:tasks.workunit.client.0.smithi016.stdout:4/926: dwrite d0/d1e/d4e/d52/d88/df9/f10d [4194304,4194304] 0 2024-04-26T20:19:11.134 INFO:tasks.workunit.client.0.smithi016.stdout:4/927: chown d0/d1e/d4e/d52/d88/d115/dbc/dc5/fe0 87317768 1 2024-04-26T20:19:11.157 INFO:tasks.workunit.client.0.smithi016.stdout:0/936: dwrite d2/dc/d18/d24/fb3 [0,4194304] 0 2024-04-26T20:19:11.159 INFO:tasks.workunit.client.0.smithi016.stdout:7/946: dwrite d0/fe8 [0,4194304] 0 2024-04-26T20:19:11.161 INFO:tasks.workunit.client.0.smithi016.stdout:7/947: creat d0/d83/f11d x:0 0 0 2024-04-26T20:19:11.161 INFO:tasks.workunit.client.0.smithi016.stdout:7/948: chown d0/dd5/d46/l7b 3591 1 2024-04-26T20:19:11.162 INFO:tasks.workunit.client.0.smithi016.stdout:7/949: rmdir d0/d51/dc7/dfc 39 2024-04-26T20:19:11.162 INFO:tasks.workunit.client.0.smithi016.stdout:7/950: read d0/dd5/d34/d25/d3f/f5f [339860,110108] 0 2024-04-26T20:19:11.163 INFO:tasks.workunit.client.0.smithi016.stdout:7/951: mkdir d0/dd5/d46/d11e 0 2024-04-26T20:19:11.165 INFO:tasks.workunit.client.0.smithi016.stdout:7/952: rename d0/d67/de6/dee/l116 to d0/d89/l11f 0 2024-04-26T20:19:11.167 INFO:tasks.workunit.client.0.smithi016.stdout:7/953: rename d0/dd5/d46/caf to d0/dd5/d34/d25/d3f/df2/c120 0 2024-04-26T20:19:11.168 INFO:tasks.workunit.client.0.smithi016.stdout:7/954: chown d0/dd5/l32 83013765 1 2024-04-26T20:19:11.168 INFO:tasks.workunit.client.0.smithi016.stdout:7/955: write d0/dd5/d46/f10d [783758,38723] 0 2024-04-26T20:19:11.168 INFO:tasks.workunit.client.0.smithi016.stdout:7/956: chown d0/d51/dc7/l104 119371 1 2024-04-26T20:19:11.170 INFO:tasks.workunit.client.0.smithi016.stdout:7/957: mknod d0/d51/dc7/dfc/d100/c121 0 2024-04-26T20:19:11.171 INFO:tasks.workunit.client.0.smithi016.stdout:7/958: readlink d0/dd5/lcd 0 2024-04-26T20:19:11.173 INFO:tasks.workunit.client.0.smithi016.stdout:7/959: rename d0/dd5/d88 to d0/d51/dc7/dfc/d100/d122 0 2024-04-26T20:19:11.173 INFO:tasks.workunit.client.0.smithi016.stdout:7/960: stat d0/dd5/d34/d25/d3f/fe2 0 2024-04-26T20:19:11.174 INFO:tasks.workunit.client.0.smithi016.stdout:4/928: dwrite d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/fd8 [0,4194304] 0 2024-04-26T20:19:11.175 INFO:tasks.workunit.client.0.smithi016.stdout:7/961: symlink d0/dd5/d6/d6e/l123 0 2024-04-26T20:19:11.179 INFO:tasks.workunit.client.0.smithi016.stdout:7/962: creat d0/d51/dc7/dfc/d100/f124 x:0 0 0 2024-04-26T20:19:11.179 INFO:tasks.workunit.client.0.smithi016.stdout:7/963: write d0/dd5/d34/d25/d3f/d6d/d87/da3/fea [1538174,128817] 0 2024-04-26T20:19:11.183 INFO:tasks.workunit.client.0.smithi016.stdout:7/964: creat d0/dd5/f125 x:0 0 0 2024-04-26T20:19:11.183 INFO:tasks.workunit.client.0.smithi016.stdout:7/965: readlink d0/dd5/d34/d25/d3f/d6d/d87/l61 0 2024-04-26T20:19:11.183 INFO:tasks.workunit.client.0.smithi016.stdout:7/966: chown d0/d51/ffd 224648 1 2024-04-26T20:19:11.183 INFO:tasks.workunit.client.0.smithi016.stdout:7/967: fdatasync d0/dd5/d46/db4/d106/f9a 0 2024-04-26T20:19:11.184 INFO:tasks.workunit.client.0.smithi016.stdout:7/968: rename d0/d51/f5a to d0/dd5/d34/db7/f126 0 2024-04-26T20:19:11.188 INFO:tasks.workunit.client.0.smithi016.stdout:7/969: read d0/dd5/d34/d25/fb8 [47045,68265] 0 2024-04-26T20:19:11.188 INFO:tasks.workunit.client.0.smithi016.stdout:7/970: write d0/dd5/d34/d25/d50/f54 [1029557,72964] 0 2024-04-26T20:19:11.189 INFO:tasks.workunit.client.0.smithi016.stdout:7/971: creat d0/dd5/d6/f127 x:0 0 0 2024-04-26T20:19:11.199 INFO:tasks.workunit.client.0.smithi016.stdout:7/972: truncate d0/dd5/d34/d25/d50/f54 1383656 0 2024-04-26T20:19:11.199 INFO:tasks.workunit.client.0.smithi016.stdout:7/973: write d0/dd5/d34/d25/d3f/d6d/d87/da3/fd8 [4944387,96321] 0 2024-04-26T20:19:11.200 INFO:tasks.workunit.client.0.smithi016.stdout:7/974: symlink d0/d51/dc7/dfc/d100/d122/l128 0 2024-04-26T20:19:11.202 INFO:tasks.workunit.client.0.smithi016.stdout:7/975: creat d0/dd5/d46/db4/d106/f129 x:0 0 0 2024-04-26T20:19:11.203 INFO:tasks.workunit.client.0.smithi016.stdout:7/976: creat d0/dd5/f12a x:0 0 0 2024-04-26T20:19:11.217 INFO:tasks.workunit.client.0.smithi016.stdout:7/977: dread d0/d51/fd1 [0,4194304] 0 2024-04-26T20:19:11.219 INFO:tasks.workunit.client.0.smithi016.stdout:0/937: dwrite d2/d20/d57/d128/d91/d126/d5d/fd4 [0,4194304] 0 2024-04-26T20:19:11.242 INFO:tasks.workunit.client.0.smithi016.stdout:4/929: dwrite d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/fa3 [0,4194304] 0 2024-04-26T20:19:11.245 INFO:tasks.workunit.client.0.smithi016.stdout:4/930: mknod d0/d96/dbf/c127 0 2024-04-26T20:19:11.248 INFO:tasks.workunit.client.0.smithi016.stdout:3/926: sync 2024-04-26T20:19:11.248 INFO:tasks.workunit.client.0.smithi016.stdout:3/927: write d3/d9/d18/dd5/f111 [345704,28712] 0 2024-04-26T20:19:11.248 INFO:tasks.workunit.client.0.smithi016.stdout:3/928: dread - d3/d9/d2d/fc9 zero size 2024-04-26T20:19:11.248 INFO:tasks.workunit.client.0.smithi016.stdout:3/929: dread - d3/df/d25/d2a/fbf zero size 2024-04-26T20:19:11.249 INFO:tasks.workunit.client.0.smithi016.stdout:3/930: truncate d3/df/f99 1998370 0 2024-04-26T20:19:11.249 INFO:tasks.workunit.client.0.smithi016.stdout:3/931: write d3/df/d25/d32/f7c [832411,38376] 0 2024-04-26T20:19:11.250 INFO:tasks.workunit.client.0.smithi016.stdout:3/932: symlink d3/df/d25/dc8/l126 0 2024-04-26T20:19:11.250 INFO:tasks.workunit.client.0.smithi016.stdout:3/933: fdatasync d3/df/d20/d5b/d11d/db5/d118/d76/fde 0 2024-04-26T20:19:11.256 INFO:tasks.workunit.client.0.smithi016.stdout:3/934: dread d3/d9/d18/f1c [0,4194304] 0 2024-04-26T20:19:11.257 INFO:tasks.workunit.client.0.smithi016.stdout:3/935: write d3/df/d20/db0/dd1/f10a [532699,3478] 0 2024-04-26T20:19:11.309 INFO:tasks.workunit.client.0.smithi016.stdout:0/938: dwrite d2/f15 [0,4194304] 0 2024-04-26T20:19:11.325 INFO:tasks.workunit.client.0.smithi016.stdout:0/939: write d2/d20/d57/d128/d91/d126/fc2 [3289462,90] 0 2024-04-26T20:19:11.330 INFO:tasks.workunit.client.0.smithi016.stdout:4/931: dwrite d0/d1e/d64/f95 [0,4194304] 0 2024-04-26T20:19:11.333 INFO:tasks.workunit.client.0.smithi016.stdout:4/932: creat d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/f128 x:0 0 0 2024-04-26T20:19:11.333 INFO:tasks.workunit.client.0.smithi016.stdout:4/933: chown d0/d1e/d4e/d52/d54/l69 280797290 1 2024-04-26T20:19:11.333 INFO:tasks.workunit.client.0.smithi016.stdout:4/934: chown d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/fb4 4033299 1 2024-04-26T20:19:11.334 INFO:tasks.workunit.client.0.smithi016.stdout:4/935: symlink d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/d120/l129 0 2024-04-26T20:19:11.335 INFO:tasks.workunit.client.0.smithi016.stdout:4/936: creat d0/d1e/d4e/d52/d88/d43/d5a/dd1/d121/f12a x:0 0 0 2024-04-26T20:19:11.336 INFO:tasks.workunit.client.0.smithi016.stdout:4/937: creat d0/dd/d19/d1f/d7b/dca/f12b x:0 0 0 2024-04-26T20:19:11.337 INFO:tasks.workunit.client.0.smithi016.stdout:3/936: dwrite d3/df/d20/d5b/d11d/db5/d118/d74/fb3 [0,4194304] 0 2024-04-26T20:19:11.338 INFO:tasks.workunit.client.0.smithi016.stdout:4/938: getdents d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce 0 2024-04-26T20:19:11.339 INFO:tasks.workunit.client.0.smithi016.stdout:3/937: rename d3/d9/d2d/fa5 to d3/d9/d2d/f127 0 2024-04-26T20:19:11.340 INFO:tasks.workunit.client.0.smithi016.stdout:4/939: mknod d0/dd/dc9/de4/df0/c12c 0 2024-04-26T20:19:11.357 INFO:tasks.workunit.client.0.smithi016.stdout:0/940: dwrite d2/dc/d18/d24/fb3 [4194304,4194304] 0 2024-04-26T20:19:11.360 INFO:tasks.workunit.client.0.smithi016.stdout:0/941: creat d2/dc/d18/dd7/f135 x:0 0 0 2024-04-26T20:19:11.360 INFO:tasks.workunit.client.0.smithi016.stdout:0/942: fsync d2/d8/f11 0 2024-04-26T20:19:11.360 INFO:tasks.workunit.client.0.smithi016.stdout:0/943: read d2/dc/d18/f48 [665258,50447] 0 2024-04-26T20:19:11.360 INFO:tasks.workunit.client.0.smithi016.stdout:0/944: chown d2/dc/d1e/d25/f28 1090 1 2024-04-26T20:19:11.360 INFO:tasks.workunit.client.0.smithi016.stdout:0/945: chown d2/dc/d18/f1a 1958 1 2024-04-26T20:19:11.360 INFO:tasks.workunit.client.0.smithi016.stdout:0/946: stat d2/d20/c51 0 2024-04-26T20:19:11.361 INFO:tasks.workunit.client.0.smithi016.stdout:0/947: rename d2/d20/d57/d128/d91/d126/ce8 to d2/dc/d1e/d35/c136 0 2024-04-26T20:19:11.373 INFO:tasks.workunit.client.0.smithi016.stdout:0/948: dread d2/d20/d41/d87/d9d/fbd [0,4194304] 0 2024-04-26T20:19:11.408 INFO:tasks.workunit.client.0.smithi016.stdout:0/949: dwrite d2/d20/d41/d72/fff [0,4194304] 0 2024-04-26T20:19:11.408 INFO:tasks.workunit.client.0.smithi016.stdout:0/950: fsync d2/d20/fdc 0 2024-04-26T20:19:11.410 INFO:tasks.workunit.client.0.smithi016.stdout:0/951: mkdir d2/d20/d41/d87/d137 0 2024-04-26T20:19:11.436 INFO:tasks.workunit.client.0.smithi016.stdout:3/938: dwrite d3/df/d20/d5b/d11d/db5/d118/d74/fa6 [0,4194304] 0 2024-04-26T20:19:11.437 INFO:tasks.workunit.client.0.smithi016.stdout:3/939: symlink d3/df/d25/d2a/d4a/de4/l128 0 2024-04-26T20:19:11.438 INFO:tasks.workunit.client.0.smithi016.stdout:3/940: mkdir d3/d70/d129 0 2024-04-26T20:19:11.449 INFO:tasks.workunit.client.0.smithi016.stdout:3/941: dread d3/df/d25/d2a/d4a/fc1 [0,4194304] 0 2024-04-26T20:19:11.450 INFO:tasks.workunit.client.0.smithi016.stdout:3/942: mknod d3/df/d20/d5b/d11d/db5/d118/d76/c12a 0 2024-04-26T20:19:11.451 INFO:tasks.workunit.client.0.smithi016.stdout:3/943: creat d3/df/f12b x:0 0 0 2024-04-26T20:19:11.452 INFO:tasks.workunit.client.0.smithi016.stdout:3/944: creat d3/df/d20/db0/f12c x:0 0 0 2024-04-26T20:19:11.453 INFO:tasks.workunit.client.0.smithi016.stdout:3/945: symlink d3/d70/d8b/d98/l12d 0 2024-04-26T20:19:11.453 INFO:tasks.workunit.client.0.smithi016.stdout:0/952: dread d2/dc/d18/f96 [0,4194304] 0 2024-04-26T20:19:11.454 INFO:tasks.workunit.client.0.smithi016.stdout:3/946: getdents d3/d9/d2d 0 2024-04-26T20:19:11.455 INFO:tasks.workunit.client.0.smithi016.stdout:3/947: creat d3/d70/f12e x:0 0 0 2024-04-26T20:19:11.457 INFO:tasks.workunit.client.0.smithi016.stdout:3/948: link d3/d9/d2d/d4f/fa9 d3/d9/d18/dd5/f12f 0 2024-04-26T20:19:11.503 INFO:tasks.workunit.client.0.smithi016.stdout:4/940: dwrite d0/d1e/d4e/d52/d88/d115/dbc/dfa/fb5 [0,4194304] 0 2024-04-26T20:19:11.503 INFO:tasks.workunit.client.0.smithi016.stdout:4/941: dread - d0/d1e/d4e/d52/d88/d115/dbc/dfa/ff7 zero size 2024-04-26T20:19:11.503 INFO:tasks.workunit.client.0.smithi016.stdout:4/942: truncate d0/d1e/d4e/d52/d88/d43/d9c/fb9 294192 0 2024-04-26T20:19:11.506 INFO:tasks.workunit.client.0.smithi016.stdout:4/943: rename d0/dd/la8 to d0/dd/d19/d1f/d7b/dca/l12d 0 2024-04-26T20:19:11.512 INFO:tasks.workunit.client.0.smithi016.stdout:7/978: sync 2024-04-26T20:19:11.513 INFO:tasks.workunit.client.0.smithi016.stdout:4/944: truncate d0/d1e/d4e/d52/d88/d115/dbc/dfa/fb5 3803072 0 2024-04-26T20:19:11.514 INFO:tasks.workunit.client.0.smithi016.stdout:7/979: creat d0/d51/dc7/dfc/d100/d122/db3/dc1/f12b x:0 0 0 2024-04-26T20:19:11.516 INFO:tasks.workunit.client.0.smithi016.stdout:4/945: getdents d0/d1e/d4e/d52/d88/d107 0 2024-04-26T20:19:11.516 INFO:tasks.workunit.client.0.smithi016.stdout:4/946: chown d0/dd/dc9/de4/df0/f102 11925 1 2024-04-26T20:19:11.516 INFO:tasks.workunit.client.0.smithi016.stdout:4/947: chown d0/dd/d19/f38 3 1 2024-04-26T20:19:11.518 INFO:tasks.workunit.client.0.smithi016.stdout:4/948: link d0/dd/d19/d1f/d7b/lcd d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/l12e 0 2024-04-26T20:19:11.520 INFO:tasks.workunit.client.0.smithi016.stdout:4/949: truncate d0/d1e/d4e/d52/d88/d115/f48 2168244 0 2024-04-26T20:19:11.520 INFO:tasks.workunit.client.0.smithi016.stdout:0/953: dwrite d2/dc/d45/fe6 [4194304,4194304] 0 2024-04-26T20:19:11.520 INFO:tasks.workunit.client.0.smithi016.stdout:4/950: write d0/d96/dbf/fc4 [4240008,111827] 0 2024-04-26T20:19:11.520 INFO:tasks.workunit.client.0.smithi016.stdout:4/951: write d0/dd/d19/f24 [3241022,96796] 0 2024-04-26T20:19:11.522 INFO:tasks.workunit.client.0.smithi016.stdout:7/980: dread d0/dd5/d34/d25/d3f/d6d/d87/da3/fea [0,4194304] 0 2024-04-26T20:19:11.522 INFO:tasks.workunit.client.0.smithi016.stdout:7/981: truncate d0/dd5/d34/d25/d3f/d6d/d87/f7c 1095091 0 2024-04-26T20:19:11.528 INFO:tasks.workunit.client.0.smithi016.stdout:7/982: mkdir d0/dd5/d6/d12c 0 2024-04-26T20:19:11.528 INFO:tasks.workunit.client.0.smithi016.stdout:7/983: write d0/dd5/d34/d25/d50/f54 [1221943,49521] 0 2024-04-26T20:19:11.530 INFO:tasks.workunit.client.0.smithi016.stdout:7/984: link d0/d83/cbb d0/dd5/d46/d11e/c12d 0 2024-04-26T20:19:11.530 INFO:tasks.workunit.client.0.smithi016.stdout:7/985: chown d0/d51/dc7/dfc/d100/d122/fcb 432 1 2024-04-26T20:19:11.560 INFO:tasks.workunit.client.0.smithi016.stdout:4/952: write d0/f36 [3601262,74197] 0 2024-04-26T20:19:11.568 INFO:tasks.workunit.client.0.smithi016.stdout:0/954: dwrite d2/d20/d41/d87/d9d/db8/fea [0,4194304] 0 2024-04-26T20:19:11.579 INFO:tasks.workunit.client.0.smithi016.stdout:4/953: dread d0/dd/d19/d57/f89 [0,4194304] 0 2024-04-26T20:19:11.609 INFO:tasks.workunit.client.0.smithi016.stdout:4/954: dread d0/d1e/d4e/d52/d88/d115/dbc/dc5/dd7/f11b [0,4194304] 0 2024-04-26T20:19:11.609 INFO:tasks.workunit.client.0.smithi016.stdout:4/955: write d0/dd/dc9/ffd [144751,5896] 0 2024-04-26T20:19:11.609 INFO:tasks.workunit.client.0.smithi016.stdout:4/956: symlink d0/d1e/d4e/d52/d88/d43/l12f 0 2024-04-26T20:19:11.610 INFO:tasks.workunit.client.0.smithi016.stdout:4/957: symlink d0/dd/d19/d1f/l130 0 2024-04-26T20:19:11.612 INFO:tasks.workunit.client.0.smithi016.stdout:4/958: link d0/dd/c67 d0/d1e/d4e/d52/d54/dad/ddf/c131 0 2024-04-26T20:19:11.612 INFO:tasks.workunit.client.0.smithi016.stdout:4/959: fsync d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/f103 0 2024-04-26T20:19:11.616 INFO:tasks.workunit.client.0.smithi016.stdout:4/960: dread d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/f105 [0,4194304] 0 2024-04-26T20:19:11.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/961: mknod d0/d1e/d4e/d52/d88/d43/d5a/c132 0 2024-04-26T20:19:11.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/962: read d0/f11 [3252052,25599] 0 2024-04-26T20:19:11.617 INFO:tasks.workunit.client.0.smithi016.stdout:4/963: chown d0/d1e/d4e/d52/d88/d107/f11e 15 1 2024-04-26T20:19:11.618 INFO:tasks.workunit.client.0.smithi016.stdout:4/964: mkdir d0/d1e/d4e/d52/d54/dad/d133 0 2024-04-26T20:19:11.619 INFO:tasks.workunit.client.0.smithi016.stdout:4/965: rename d0/d1e/d4e/d52/c80 to d0/c134 0 2024-04-26T20:19:11.619 INFO:tasks.workunit.client.0.smithi016.stdout:4/966: write d0/d1e/d4e/d52/d54/fe3 [292328,59802] 0 2024-04-26T20:19:11.620 INFO:tasks.workunit.client.0.smithi016.stdout:4/967: mkdir d0/d1e/d4e/d52/d54/d135 0 2024-04-26T20:19:11.620 INFO:tasks.workunit.client.0.smithi016.stdout:4/968: dread - d0/d1e/d4e/d52/d88/d43/d5a/dd1/f9e zero size 2024-04-26T20:19:11.621 INFO:tasks.workunit.client.0.smithi016.stdout:4/969: unlink d0/dd/d19/d1f/d7b/c111 0 2024-04-26T20:19:11.621 INFO:tasks.workunit.client.0.smithi016.stdout:4/970: truncate d0/dd/d19/d1f/d7b/dca/f12b 834643 0 2024-04-26T20:19:12.135 INFO:tasks.workunit.client.0.smithi016.stdout:7/986: dwrite d0/dd5/d34/dec/fdb [0,4194304] 0 2024-04-26T20:19:12.136 INFO:tasks.workunit.client.0.smithi016.stdout:7/987: creat d0/d51/dc7/dfc/f12e x:0 0 0 2024-04-26T20:19:12.136 INFO:tasks.workunit.client.0.smithi016.stdout:7/988: dread - d0/d51/dc7/dfc/d100/d122/db3/dc1/f12b zero size 2024-04-26T20:19:12.137 INFO:tasks.workunit.client.0.smithi016.stdout:7/989: unlink d0/dd5/d34/db7/fbd 0 2024-04-26T20:19:12.138 INFO:tasks.workunit.client.0.smithi016.stdout:0/955: sync 2024-04-26T20:19:12.138 INFO:tasks.workunit.client.0.smithi016.stdout:4/971: sync 2024-04-26T20:19:12.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/949: sync 2024-04-26T20:19:12.138 INFO:tasks.workunit.client.0.smithi016.stdout:3/950: truncate d3/df/d25/d32/d3f/fef 361588 0 2024-04-26T20:19:12.139 INFO:tasks.workunit.client.0.smithi016.stdout:7/990: rename d0/dd5/d34/d25/d3f/d6d/d79/fc4 to d0/d51/dc7/dfc/d100/d122/f12f 0 2024-04-26T20:19:12.139 INFO:tasks.workunit.client.0.smithi016.stdout:4/972: truncate d0/dd/fc6 941494 0 2024-04-26T20:19:12.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/956: mkdir d2/d20/d57/d128/d91/d126/d5d/d60/d125/d138 0 2024-04-26T20:19:12.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/957: readlink d2/d20/l2d 0 2024-04-26T20:19:12.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/958: truncate d2/dc/d1e/fcf 642922 0 2024-04-26T20:19:12.140 INFO:tasks.workunit.client.0.smithi016.stdout:0/959: read - d2/d8/d119/f127 zero size 2024-04-26T20:19:12.141 INFO:tasks.workunit.client.0.smithi016.stdout:3/951: rename d3/df/d20/d41/f4e to d3/d9/d18/dfa/f130 0 2024-04-26T20:19:12.141 INFO:tasks.workunit.client.0.smithi016.stdout:3/952: symlink d3/df/d25/dc8/l131 2 2024-04-26T20:19:12.141 INFO:tasks.workunit.client.0.smithi016.stdout:7/991: mknod d0/dd5/d4b/d11b/c130 0 2024-04-26T20:19:12.142 INFO:tasks.workunit.client.0.smithi016.stdout:4/973: creat d0/d1e/d4e/d52/d88/d115/dbc/dfa/f136 x:0 0 0 2024-04-26T20:19:12.143 INFO:tasks.workunit.client.0.smithi016.stdout:4/974: write d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/fd4 [568262,4903] 0 2024-04-26T20:19:12.143 INFO:tasks.workunit.client.0.smithi016.stdout:0/960: rmdir d2/d20/d41/d87 39 2024-04-26T20:19:12.144 INFO:tasks.workunit.client.0.smithi016.stdout:3/953: rename d3/l6 to d3/df/d25/dc8/d101/l132 0 2024-04-26T20:19:12.145 INFO:tasks.workunit.client.0.smithi016.stdout:4/975: creat d0/dd/d19/d57/d113/f137 x:0 0 0 2024-04-26T20:19:12.146 INFO:tasks.workunit.client.0.smithi016.stdout:0/961: mkdir d2/d20/d41/d87/d139 0 2024-04-26T20:19:12.147 INFO:tasks.workunit.client.0.smithi016.stdout:4/976: mkdir d0/d1e/d4e/d52/d88/d43/d5a/dd1/daf/d138 0 2024-04-26T20:19:12.147 INFO:tasks.workunit.client.0.smithi016.stdout:4/977: dread - d0/d1e/d64/fae zero size 2024-04-26T20:19:12.150 INFO:tasks.workunit.client.0.smithi016.stdout:0/962: rename d2/d20/d57/d128/d91/d126/d5d/f64 to d2/d8/f13a 0 2024-04-26T20:19:12.151 INFO:tasks.workunit.client.0.smithi016.stdout:0/963: mknod d2/dc/d1e/c13b 0 2024-04-26T20:19:12.151 INFO:tasks.workunit.client.0.smithi016.stdout:0/964: fsync d2/d8/d3b/fa3 0 2024-04-26T20:19:12.152 INFO:tasks.workunit.client.0.smithi016.stdout:0/965: mknod d2/d8/d10a/c13c 0 2024-04-26T20:19:12.156 INFO:tasks.workunit.client.0.smithi016.stdout:3/954: dread d3/d9/d18/d82/fd4 [0,4194304] 0 2024-04-26T20:19:12.157 INFO:tasks.workunit.client.0.smithi016.stdout:3/955: fsync d3/df/f12b 0 2024-04-26T20:19:12.163 INFO:tasks.workunit.client.0.smithi016.stdout:4/978: dread d0/dd/f2a [0,4194304] 0 2024-04-26T20:19:12.164 INFO:tasks.workunit.client.0.smithi016.stdout:4/979: creat d0/d1e/d4e/d52/f139 x:0 0 0 2024-04-26T20:19:12.166 INFO:tasks.workunit.client.0.smithi016.stdout:4/980: creat d0/dd/d19/d57/d113/f13a x:0 0 0 2024-04-26T20:19:12.167 INFO:tasks.workunit.client.0.smithi016.stdout:4/981: mknod d0/d1e/d30/c13b 0 2024-04-26T20:19:12.167 INFO:tasks.workunit.client.0.smithi016.stdout:4/982: write d0/d1e/d4e/d52/d88/d115/dbc/dfa/ff7 [939953,3036] 0 2024-04-26T20:19:12.170 INFO:tasks.workunit.client.0.smithi016.stdout:3/956: rename d3/df/d25/dc8/d101/l132 to d3/d9/l133 0 2024-04-26T20:19:12.172 INFO:tasks.workunit.client.0.smithi016.stdout:3/957: mkdir d3/df/d20/db0/dc2/d121/d134 0 2024-04-26T20:19:12.174 INFO:tasks.workunit.client.0.smithi016.stdout:0/966: dread d2/d20/d41/d87/d9d/db8/d129/fa6 [0,4194304] 0 2024-04-26T20:19:12.174 INFO:tasks.workunit.client.0.smithi016.stdout:0/967: chown d2/d20/d57/d128/d91/d126/d5d/d60/ff1 90904884 1 2024-04-26T20:19:12.193 INFO:tasks.workunit.client.0.smithi016.stdout:4/983: write d0/d1e/d4e/d52/d88/d115/dbc/dfa/fb5 [2533410,41979] 0 2024-04-26T20:19:12.193 INFO:tasks.workunit.client.0.smithi016.stdout:4/984: read d0/d1e/d30/fdb [1919786,80657] 0 2024-04-26T20:19:12.195 INFO:tasks.workunit.client.0.smithi016.stdout:7/992: dwrite d0/d51/dc7/dfc/d100/d122/db3/fd0 [0,4194304] 0 2024-04-26T20:19:12.425 INFO:tasks.workunit.client.0.smithi016.stdout:3/958: link d3/d9/d18/d82/dc6/ce7 d3/df/d20/d5b/d11d/db5/dac/d11e/c135 0 2024-04-26T20:19:12.426 INFO:tasks.workunit.client.0.smithi016.stdout:3/959: fsync d3/df/d20/d5b/d11d/db5/d118/d74/fa6 0 2024-04-26T20:19:12.427 INFO:tasks.workunit.client.0.smithi016.stdout:0/968: symlink d2/d20/d41/d87/d9d/db8/d129/l13d 0 2024-04-26T20:19:12.427 INFO:tasks.workunit.client.0.smithi016.stdout:4/985: mkdir d0/dd/d19/d1f/d7b/dca/d13c 0 2024-04-26T20:19:12.428 INFO:tasks.workunit.client.0.smithi016.stdout:7/993: truncate d0/dd5/d6/d6e/f86 968182 0 2024-04-26T20:19:12.430 INFO:tasks.workunit.client.0.smithi016.stdout:4/986: symlink d0/d1e/d30/l13d 0 2024-04-26T20:19:12.430 INFO:tasks.workunit.client.0.smithi016.stdout:4/987: chown d0/dd/d19/d57/d113/f137 5 1 2024-04-26T20:19:12.449 INFO:tasks.workunit.client.0.smithi016.stdout:7/994: dread d0/f42 [0,4194304] 0 2024-04-26T20:19:12.449 INFO:tasks.workunit.client.0.smithi016.stdout:7/995: chown d0/dd5/d6/lad 0 1 2024-04-26T20:19:12.458 INFO:tasks.workunit.client.0.smithi016.stdout:4/988: dread d0/dd/d19/f24 [0,4194304] 0 2024-04-26T20:19:12.468 INFO:tasks.workunit.client.0.smithi016.stdout:7/996: dread d0/f94 [0,4194304] 0 2024-04-26T20:19:12.656 INFO:tasks.workunit.client.0.smithi016.stdout:3/960: dwrite d3/df/d25/d32/f95 [0,4194304] 0 2024-04-26T20:19:12.672 INFO:tasks.workunit.client.0.smithi016.stdout:0/969: dwrite d2/dc/de3/ff7 [0,4194304] 0 2024-04-26T20:19:12.709 INFO:tasks.workunit.client.0.smithi016.stdout:4/989: truncate d0/d1e/d4e/d52/d88/d115/f27 175553 0 2024-04-26T20:19:12.710 INFO:tasks.workunit.client.0.smithi016.stdout:4/990: dread - d0/d1e/d4e/d52/f139 zero size 2024-04-26T20:19:12.710 INFO:tasks.workunit.client.0.smithi016.stdout:7/997: getdents d0/dd5/d34/dec/dff 0 2024-04-26T20:19:12.711 INFO:tasks.workunit.client.0.smithi016.stdout:3/961: rename d3/df/d20/d5b/d11d/db5/d118/d76/c12a to d3/df/d20/db0/c136 0 2024-04-26T20:19:12.712 INFO:tasks.workunit.client.0.smithi016.stdout:3/962: fsync d3/d9/d18/d59/f109 0 2024-04-26T20:19:12.715 INFO:tasks.workunit.client.0.smithi016.stdout:4/991: write d0/d1e/d4e/d52/d88/d43/fb0 [772673,86721] 0 2024-04-26T20:19:12.725 INFO:tasks.workunit.client.0.smithi016.stdout:7/998: link d0/dd5/d4b/lcf d0/dd5/d6/d12c/l131 0 2024-04-26T20:19:12.725 INFO:tasks.workunit.client.0.smithi016.stdout:7/999: truncate d0/dd5/d6/f3d 4327822 0 2024-04-26T20:19:12.773 INFO:tasks.workunit.client.0.smithi016.stdout:3/963: dwrite d3/d9/fa2 [0,4194304] 0 2024-04-26T20:19:12.775 INFO:tasks.workunit.client.0.smithi016.stdout:3/964: creat d3/df/d25/f137 x:0 0 0 2024-04-26T20:19:12.775 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:12.776 INFO:tasks.workunit.client.0.smithi016.stdout:3/965: unlink d3/df/d20/f4b 0 2024-04-26T20:19:12.779 INFO:tasks.workunit.client.0.smithi016.stdout:3/966: rename d3/df/d20/d5b/d11d/db5/d118/d74/fa6 to d3/df/d25/d32/f138 0 2024-04-26T20:19:12.779 INFO:tasks.workunit.client.0.smithi016.stdout:3/967: stat d3/d9/f65 0 2024-04-26T20:19:12.779 INFO:tasks.workunit.client.0.smithi016.stdout:3/968: mkdir d3/df/d20/d5b/d11d/d139 0 2024-04-26T20:19:12.779 INFO:tasks.workunit.client.0.smithi016.stdout:3/969: chown d3/d70/d8b/ddc/deb/f106 46 1 2024-04-26T20:19:12.781 INFO:tasks.workunit.client.0.smithi016.stdout:4/992: dwrite d0/d1e/d64/f92 [0,4194304] 0 2024-04-26T20:19:12.781 INFO:tasks.workunit.client.0.smithi016.stdout:4/993: write d0/d1e/d4e/d52/d88/d43/fb0 [2165980,107179] 0 2024-04-26T20:19:12.793 INFO:tasks.workunit.client.0.smithi016.stdout:4/994: dread d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/fa3 [0,4194304] 0 2024-04-26T20:19:12.793 INFO:tasks.workunit.client.0.smithi016.stdout:4/995: fsync d0/f11 0 2024-04-26T20:19:12.795 INFO:tasks.workunit.client.0.smithi016.stdout:4/996: dread d0/d1e/fcf [0,4194304] 0 2024-04-26T20:19:12.834 INFO:tasks.workunit.client.0.smithi016.stdout:3/970: dwrite d3/df/d25/f5c [4194304,4194304] 0 2024-04-26T20:19:12.835 INFO:tasks.workunit.client.0.smithi016.stdout:3/971: dread d3/df/d25/d2a/d4a/fc1 [0,4194304] 0 2024-04-26T20:19:12.835 INFO:tasks.workunit.client.0.smithi016.stdout:3/972: write d3/df/d20/d5b/d11d/db5/d118/d74/f8d [2685865,21523] 0 2024-04-26T20:19:12.846 INFO:tasks.workunit.client.0.smithi016.stdout:4/997: dwrite d0/d1e/d4e/d52/d88/d43/d5a/dd1/dce/ffb [0,4194304] 0 2024-04-26T20:19:12.848 INFO:tasks.workunit.client.0.smithi016.stdout:4/998: mknod d0/d1e/d4e/d52/d88/d43/c13e 0 2024-04-26T20:19:12.859 INFO:tasks.workunit.client.0.smithi016.stdout:4/999: read d0/d1e/d4e/d52/d88/d115/dbc/dfa/d6f/fa3 [1041882,116729] 0 2024-04-26T20:19:12.860 INFO:tasks.workunit.client.0.smithi016.stdout:3/973: write d3/df/d25/d32/f138 [2157861,104032] 0 2024-04-26T20:19:12.862 INFO:tasks.workunit.client.0.smithi016.stdout:3/974: link d3/d70/d8b/d98/cfc d3/d9/d2d/d4f/c13a 0 2024-04-26T20:19:12.875 INFO:tasks.workunit.client.0.smithi016.stdout:0/970: sync 2024-04-26T20:19:12.875 INFO:tasks.workunit.client.0.smithi016.stdout:0/971: read - d2/d8/f102 zero size 2024-04-26T20:19:12.875 INFO:tasks.workunit.client.0.smithi016.stdout:0/972: dread - d2/d20/d41/f111 zero size 2024-04-26T20:19:12.875 INFO:tasks.workunit.client.0.smithi016.stdout:0/973: chown d2/dc/de3/c12e 126768 1 2024-04-26T20:19:12.878 INFO:tasks.workunit.client.0.smithi016.stdout:3/975: write d3/d9/d2d/f127 [725499,23691] 0 2024-04-26T20:19:12.878 INFO:tasks.workunit.client.0.smithi016.stdout:0/974: rename d2/dc/de3 to d2/dc/d1e/d13e 0 2024-04-26T20:19:12.878 INFO:tasks.workunit.client.0.smithi016.stdout:0/975: dread - d2/d20/d57/d128/f114 zero size 2024-04-26T20:19:12.879 INFO:tasks.workunit.client.0.smithi016.stdout:0/976: symlink d2/dc/d18/dd7/df5/l13f 0 2024-04-26T20:19:12.880 INFO:tasks.workunit.client.0.smithi016.stdout:0/977: getdents d2/d8/d10a 0 2024-04-26T20:19:12.881 INFO:tasks.workunit.client.0.smithi016.stdout:0/978: mknod d2/d20/d41/d87/d9d/dda/c140 0 2024-04-26T20:19:12.881 INFO:tasks.workunit.client.0.smithi016.stdout:0/979: dread - d2/d20/d57/d128/d91/d126/f123 zero size 2024-04-26T20:19:12.904 INFO:tasks.workunit.client.0.smithi016.stdout:3/976: write d3/d9/d2d/f5f [3352856,113664] 0 2024-04-26T20:19:12.906 INFO:tasks.workunit.client.0.smithi016.stdout:3/977: symlink d3/df/d20/db0/l13b 0 2024-04-26T20:19:12.911 INFO:tasks.workunit.client.0.smithi016.stdout:3/978: write d3/df/d25/d2a/d4a/de4/de8/f107 [518135,121255] 0 2024-04-26T20:19:12.937 INFO:tasks.workunit.client.0.smithi016.stdout:0/980: dwrite d2/dc/d18/d24/fb3 [0,4194304] 0 2024-04-26T20:19:12.939 INFO:tasks.workunit.client.0.smithi016.stdout:0/981: rename d2/d20/d41/d87/d9d/db8/d129/cc3 to d2/d20/d57/d128/d91/d126/c141 0 2024-04-26T20:19:12.939 INFO:tasks.workunit.client.0.smithi016.stdout:0/982: fsync d2/d20/d57/d128/d91/f9c 0 2024-04-26T20:19:12.939 INFO:tasks.workunit.client.0.smithi016.stdout:0/983: fsync d2/dc/d45/f92 0 2024-04-26T20:19:12.940 INFO:tasks.workunit.client.0.smithi016.stdout:0/984: rmdir d2/d20/d41/d87/d9d/dda 39 2024-04-26T20:19:12.940 INFO:tasks.workunit.client.0.smithi016.stdout:0/985: truncate d2/fb 4987559 0 2024-04-26T20:19:12.940 INFO:tasks.workunit.client.0.smithi016.stdout:0/986: dread - d2/fbe zero size 2024-04-26T20:19:12.940 INFO:tasks.workunit.client.0.smithi016.stdout:0/987: creat d2/d20/d41/d4c/f142 x:0 0 0 2024-04-26T20:19:12.941 INFO:tasks.workunit.client.0.smithi016.stdout:0/988: mkdir d2/dc/d1e/d143 0 2024-04-26T20:19:12.942 INFO:tasks.workunit.client.0.smithi016.stdout:0/989: rmdir d2/dc/d1e/dc5 39 2024-04-26T20:19:12.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd277600640 1 Processor -- start 2024-04-26T20:19:12.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd277600640 1 -- start start 2024-04-26T20:19:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd277600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd270072d70 0x7fd270073190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd277600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd2700c9b60 0x7fd2700c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd277600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd270152fa0 con 0x7fd270152bc0 2024-04-26T20:19:12.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd277600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd270159790 con 0x7fd2700c9b60 2024-04-26T20:19:12.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd277600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd270158930 con 0x7fd270072d70 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd275600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd2700c9b60 0x7fd2700c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd274c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd270152bc0 0x7fd2700c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48738/0 (socket says 172.21.15.16:48738) 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd274c00640 1 -- 172.21.15.16:0/980860069 learned_addr learned my addr 172.21.15.16:0/980860069 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd26fe00640 1 --2- 172.21.15.16:0/980860069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd270072d70 0x7fd270073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd275600640 1 -- 172.21.15.16:0/980860069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd270072d70 msgr2=0x7fd270073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd275600640 1 --2- 172.21.15.16:0/980860069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd270072d70 0x7fd270073190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd275600640 1 -- 172.21.15.16:0/980860069 >> v1:172.21.15.16:6789/0 conn(0x7fd270152bc0 legacy=0x7fd2700c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.955+0000 7fd275600640 1 -- 172.21.15.16:0/980860069 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd270158c10 con 0x7fd2700c9b60 2024-04-26T20:19:12.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd275600640 1 --2- 172.21.15.16:0/980860069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2700c9b60 0x7fd2700c9fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d90 tx=0x7fd26801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c813ab72e66ec5f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:12.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd26f400640 1 -- 172.21.15.16:0/980860069 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b4070 con 0x7fd2700c9b60 2024-04-26T20:19:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd26f400640 1 -- 172.21.15.16:0/980860069 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2680af600 con 0x7fd2700c9b60 2024-04-26T20:19:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd26f400640 1 -- 172.21.15.16:0/980860069 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680af9d0 con 0x7fd2700c9b60 2024-04-26T20:19:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 -- 172.21.15.16:0/980860069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2700c9b60 msgr2=0x7fd2700c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 --2- 172.21.15.16:0/980860069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2700c9b60 0x7fd2700c9fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d90 tx=0x7fd26801f150 comp rx=0 tx=0).stop 2024-04-26T20:19:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 -- 172.21.15.16:0/980860069 shutdown_connections 2024-04-26T20:19:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 --2- 172.21.15.16:0/980860069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2700c9b60 0x7fd2700c9fb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 --2- 172.21.15.16:0/980860069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd270072d70 0x7fd270073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 -- 172.21.15.16:0/980860069 >> 172.21.15.16:0/980860069 conn(0x7fd27006c380 msgr2=0x7fd27006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 -- 172.21.15.16:0/980860069 shutdown_connections 2024-04-26T20:19:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.959+0000 7fd277600640 1 -- 172.21.15.16:0/980860069 wait complete. 2024-04-26T20:19:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 Processor -- start 2024-04-26T20:19:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 -- start start 2024-04-26T20:19:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd270072d70 0x7fd2701f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2700c9b60 0x7fd270156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd270152bc0 0x7fd2701e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701594b0 con 0x7fd270152bc0 2024-04-26T20:19:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701591d0 con 0x7fd270072d70 2024-04-26T20:19:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd2700736d0 con 0x7fd2700c9b60 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd270152bc0 0x7fd2701e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd270152bc0 0x7fd2701e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38438/0 (socket says 172.21.15.16:38438) 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 -- 172.21.15.16:0/1903772203 learned_addr learned my addr 172.21.15.16:0/1903772203 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd26fe00640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2700c9b60 0x7fd270156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd274c00640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd270072d70 0x7fd2701f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 -- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2700c9b60 msgr2=0x7fd270156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2700c9b60 0x7fd270156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 -- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd270072d70 msgr2=0x7fd2701f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd270072d70 0x7fd2701f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 -- 172.21.15.16:0/1903772203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd270157f10 con 0x7fd270152bc0 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd275600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd270152bc0 0x7fd2701e6060 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d90 tx=0x7fd26801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd26cc00640 1 -- 172.21.15.16:0/1903772203 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b4040 con 0x7fd270152bc0 2024-04-26T20:19:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd26cc00640 1 -- 172.21.15.16:0/1903772203 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2680c1070 con 0x7fd270152bc0 2024-04-26T20:19:12.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd270156b70 con 0x7fd270152bc0 2024-04-26T20:19:12.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd26cc00640 1 -- 172.21.15.16:0/1903772203 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd268009450 con 0x7fd270152bc0 2024-04-26T20:19:12.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.963+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2701584b0 con 0x7fd270152bc0 2024-04-26T20:19:12.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.967+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd270077c20 con 0x7fd270152bc0 2024-04-26T20:19:12.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.967+0000 7fd26cc00640 1 -- 172.21.15.16:0/1903772203 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2680ba6b0 con 0x7fd270152bc0 2024-04-26T20:19:12.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.967+0000 7fd26cc00640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd250068380 0x7fd25006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:12.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.967+0000 7fd26cc00640 1 -- 172.21.15.16:0/1903772203 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7fd2681259c0 con 0x7fd270152bc0 2024-04-26T20:19:12.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.967+0000 7fd274c00640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd250068380 0x7fd25006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:12.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.967+0000 7fd274c00640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd250068380 0x7fd25006a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd264000f70 tx=0x7fd264009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:12.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:12.971+0000 7fd26cc00640 1 -- 172.21.15.16:0/1903772203 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd268018cb0 con 0x7fd270152bc0 2024-04-26T20:19:13.161 INFO:tasks.workunit.client.0.smithi016.stdout:3/979: sync 2024-04-26T20:19:13.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.171+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2700c9940 con 0x7fd270152bc0 2024-04-26T20:19:13.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.171+0000 7fd26cc00640 1 -- 172.21.15.16:0/1903772203 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6050 (secure 0 0 0) 0x7fd2680f59b0 con 0x7fd270152bc0 2024-04-26T20:19:13.175 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:13.175 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:11.134785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:19:13.176 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 23 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd250068380 msgr2=0x7fd25006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd250068380 0x7fd25006a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd264000f70 tx=0x7fd264009040 comp rx=0 tx=0).stop 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd270152bc0 msgr2=0x7fd2701e6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd270152bc0 0x7fd2701e6060 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d90 tx=0x7fd26801bef0 comp rx=0 tx=0).stop 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 shutdown_connections 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd250068380 0x7fd25006a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd270152bc0 0x7fd2701e6060 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2700c9b60 0x7fd270156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 --2- 172.21.15.16:0/1903772203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd270072d70 0x7fd2701f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 >> 172.21.15.16:0/1903772203 conn(0x7fd27006c380 msgr2=0x7fd2700c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 shutdown_connections 2024-04-26T20:19:13.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:13.175+0000 7fd277600640 1 -- 172.21.15.16:0/1903772203 wait complete. 2024-04-26T20:19:13.197 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:19:13.295 INFO:tasks.workunit.client.0.smithi016.stdout:0/990: sync 2024-04-26T20:19:13.296 INFO:tasks.workunit.client.0.smithi016.stdout:0/991: stat d2/dc/d1e/d35/l9a 0 2024-04-26T20:19:13.296 INFO:tasks.workunit.client.0.smithi016.stdout:0/992: dread - d2/dc/d45/f92 zero size 2024-04-26T20:19:13.297 INFO:tasks.workunit.client.0.smithi016.stdout:0/993: creat d2/dc/f144 x:0 0 0 2024-04-26T20:19:13.373 INFO:tasks.workunit.client.0.smithi016.stdout:0/994: dwrite d2/dc/d18/d5b/fb6 [0,4194304] 0 2024-04-26T20:19:13.373 INFO:tasks.workunit.client.0.smithi016.stdout:0/995: fsync d2/d20/d41/d4c/d4e/f11e 0 2024-04-26T20:19:13.373 INFO:tasks.workunit.client.0.smithi016.stdout:0/996: fsync d2/dc/d1e/d13e/ff7 0 2024-04-26T20:19:13.373 INFO:tasks.workunit.client.0.smithi016.stdout:0/997: truncate d2/d20/d41/d4c/f112 894260 0 2024-04-26T20:19:13.379 INFO:tasks.workunit.client.0.smithi016.stdout:3/980: sync 2024-04-26T20:19:13.380 INFO:tasks.workunit.client.0.smithi016.stdout:3/981: mknod d3/df/d20/db0/c13c 0 2024-04-26T20:19:13.380 INFO:tasks.workunit.client.0.smithi016.stdout:3/982: readlink d3/df/d25/d2a/lcb 0 2024-04-26T20:19:13.380 INFO:tasks.workunit.client.0.smithi016.stdout:3/983: chown d3/df/d25/d32 1 1 2024-04-26T20:19:13.381 INFO:tasks.workunit.client.0.smithi016.stdout:3/984: symlink d3/df/d25/d2a/d4a/de4/l13d 0 2024-04-26T20:19:13.381 INFO:tasks.workunit.client.0.smithi016.stdout:3/985: mknod d3/df/d20/db0/dd1/c13e 0 2024-04-26T20:19:13.382 INFO:tasks.workunit.client.0.smithi016.stdout:3/986: mknod d3/d9/d18/d5a/c13f 0 2024-04-26T20:19:13.392 INFO:tasks.workunit.client.0.smithi016.stdout:0/998: write d2/d20/d57/d128/fb1 [3203258,118026] 0 2024-04-26T20:19:13.414 INFO:tasks.workunit.client.0.smithi016.stdout:3/987: dwrite f0 [8388608,4194304] 0 2024-04-26T20:19:13.416 INFO:tasks.workunit.client.0.smithi016.stdout:3/988: creat d3/d70/df7/f140 x:0 0 0 2024-04-26T20:19:13.419 INFO:tasks.workunit.client.0.smithi016.stdout:3/989: creat d3/df/d20/db0/f141 x:0 0 0 2024-04-26T20:19:13.426 INFO:tasks.workunit.client.0.smithi016.stdout:0/999: dwrite d2/d20/f9e [0,4194304] 0 2024-04-26T20:19:13.468 INFO:tasks.workunit.client.0.smithi016.stdout:3/990: dwrite d3/f19 [0,4194304] 0 2024-04-26T20:19:13.471 INFO:tasks.workunit.client.0.smithi016.stdout:3/991: rename d3/df/d20/d5b/d11d/db5/d118/d74/f8d to d3/d9/d2d/d4f/f142 0 2024-04-26T20:19:13.471 INFO:tasks.workunit.client.0.smithi016.stdout:3/992: truncate d3/d70/d8b/ddc/f11c 325446 0 2024-04-26T20:19:13.505 INFO:tasks.workunit.client.0.smithi016.stdout:3/993: dwrite d3/df/d20/d5b/d11d/db5/f6c [0,4194304] 0 2024-04-26T20:19:13.506 INFO:tasks.workunit.client.0.smithi016.stdout:3/994: truncate d3/d9/d2d/d4f/f142 4423869 0 2024-04-26T20:19:13.507 INFO:tasks.workunit.client.0.smithi016.stdout:3/995: mknod d3/df/d20/d5b/d11d/db5/c143 0 2024-04-26T20:19:13.516 INFO:tasks.workunit.client.0.smithi016.stdout:3/996: truncate f0 5303412 0 2024-04-26T20:19:13.516 INFO:tasks.workunit.client.0.smithi016.stdout:3/997: write d3/f19 [4269827,10544] 0 2024-04-26T20:19:13.516 INFO:tasks.workunit.client.0.smithi016.stdout:3/998: stat d3/df/d25/d2a/d4a/f7e 0 2024-04-26T20:19:13.516 INFO:tasks.workunit.client.0.smithi016.stdout:3/999: stat d3/d9/d2d 0 2024-04-26T20:19:13.519 INFO:tasks.workunit.client.0.smithi016.stderr:+ rm -rf -- ./tmp.PykkLdafQs 2024-04-26T20:19:15.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55df200640 1 Processor -- start 2024-04-26T20:19:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55df200640 1 -- start start 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55df200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55d8153af0 0x7f55d815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55df200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 0x7f55d80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55df200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d80c9d90 con 0x7f55d80c9010 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55df200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f55d80ca630 con 0x7f55d8153af0 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55df200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f55d80ca070 con 0x7f55d80c7b80 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55dd200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f55d80c9010 0x7f55d80c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52644/0 (socket says 172.21.15.16:52644) 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55dd200640 1 -- 172.21.15.16:0/3018146878 learned_addr learned my addr 172.21.15.16:0/3018146878 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3018146878 >> v2:172.21.15.192:3300/0 conn(0x7f55d8153af0 0x7f55d815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55cf400640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 0x7f55d80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520469664 0 0) 0x7f55d80c9d90 con 0x7f55d80c9010 2024-04-26T20:19:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55bc003530 con 0x7f55d80c9010 2024-04-26T20:19:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3834772450 0 0) 0x7f55bc003530 con 0x7f55d80c9010 2024-04-26T20:19:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 msgr2=0x7f55d80c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 0x7f55d80c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 >> v2:172.21.15.192:3300/0 conn(0x7f55d8153af0 msgr2=0x7f55d815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 --2- 172.21.15.16:0/3018146878 >> v2:172.21.15.192:3300/0 conn(0x7f55d8153af0 0x7f55d815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d80ca350 con 0x7f55d80c9010 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f55d0001a00 con 0x7f55d80c9010 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 >> v1:172.21.15.16:6789/0 conn(0x7f55d80c9010 legacy=0x7f55d80c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 0x7f55bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc004d50 0x7f55bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55d80ca630 con 0x7f55bc0039c0 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f55d80ca070 con 0x7f55bc004d50 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc00b9d0 con 0x7f55d80c7b80 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55cf400640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 0x7f55bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.347+0000 7f55dd200640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc004d50 0x7f55bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7e00640 1 -- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 msgr2=0x7f55bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:15.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d80c7b80 0x7f55bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7e00640 1 -- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc004d50 msgr2=0x7f55bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:15.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc004d50 0x7f55bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7e00640 1 -- 172.21.15.16:0/3018146878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc003530 con 0x7f55bc0039c0 2024-04-26T20:19:15.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009ae0 tx=0x7f55c801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67f3bfc9c7cf8ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:15.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c80b2070 con 0x7f55bc0039c0 2024-04-26T20:19:15.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c80a5590 con 0x7f55bc0039c0 2024-04-26T20:19:15.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55d7400640 1 -- 172.21.15.16:0/3018146878 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c80096b0 con 0x7f55bc0039c0 2024-04-26T20:19:15.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55df200640 1 -- 172.21.15.16:0/3018146878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55bc0039c0 msgr2=0x7f55bc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55df200640 1 --2- 172.21.15.16:0/3018146878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009ae0 tx=0x7f55c801cab0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.351+0000 7f55dd200640 1 -- 172.21.15.16:0/3018146878 reap_dead start 2024-04-26T20:19:15.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- 172.21.15.16:0/3018146878 shutdown_connections 2024-04-26T20:19:15.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- 172.21.15.16:0/3018146878 >> 172.21.15.16:0/3018146878 conn(0x7f55d806c380 msgr2=0x7f55d806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:15.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- 172.21.15.16:0/3018146878 shutdown_connections 2024-04-26T20:19:15.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- 172.21.15.16:0/3018146878 wait complete. 2024-04-26T20:19:15.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 Processor -- start 2024-04-26T20:19:15.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- start start 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0039c0 0x7f55d80c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d81e5190 0x7f55d814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d81efcf0 0x7f55d81f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55d8153ed0 con 0x7f55d81efcf0 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f55d815d290 con 0x7f55bc0039c0 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55df200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f55d8154050 con 0x7f55d81e5190 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d81efcf0 0x7f55d81f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d81efcf0 0x7f55d81f01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36826/0 (socket says 172.21.15.16:36826) 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 -- 172.21.15.16:0/3364790491 learned_addr learned my addr 172.21.15.16:0/3364790491 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0039c0 0x7f55d80c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55cf400640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d81e5190 0x7f55d814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 -- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d81e5190 msgr2=0x7f55d814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d81e5190 0x7f55d814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 -- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0039c0 msgr2=0x7f55d80c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0039c0 0x7f55d80c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 -- 172.21.15.16:0/3364790491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d81ef830 con 0x7f55d81efcf0 2024-04-26T20:19:15.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.355+0000 7f55dd200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d81efcf0 0x7f55d81f01a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f55d80744b0 tx=0x7f55d0007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:15.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55d4c00640 1 -- 172.21.15.16:0/3364790491 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d001c070 con 0x7f55d81efcf0 2024-04-26T20:19:15.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55d4c00640 1 -- 172.21.15.16:0/3364790491 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0011780 con 0x7f55d81efcf0 2024-04-26T20:19:15.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d81e2430 con 0x7f55d81efcf0 2024-04-26T20:19:15.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55d4c00640 1 -- 172.21.15.16:0/3364790491 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0010040 con 0x7f55d81efcf0 2024-04-26T20:19:15.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d81e29f0 con 0x7f55d81efcf0 2024-04-26T20:19:15.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d8077c20 con 0x7f55d81efcf0 2024-04-26T20:19:15.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55d4c00640 1 -- 172.21.15.16:0/3364790491 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55d001f070 con 0x7f55d81efcf0 2024-04-26T20:19:15.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55d4c00640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f55b40683b0 0x7f55b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:15.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55d4c00640 1 -- 172.21.15.16:0/3364790491 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f55d0089b70 con 0x7f55d81efcf0 2024-04-26T20:19:15.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.359+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f55b40683b0 0x7f55b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:15.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.363+0000 7f55d7e00640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f55b40683b0 0x7f55b406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f55c80af000 tx=0x7f55c80046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:15.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.363+0000 7f55d4c00640 1 -- 172.21.15.16:0/3364790491 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f55d81ef830 con 0x7f55d81efcf0 2024-04-26T20:19:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55d8153420 con 0x7f55d81efcf0 2024-04-26T20:19:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55d4c00640 1 -- 172.21.15.16:0/3364790491 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6050 (secure 0 0 0) 0x7f55d0059610 con 0x7f55d81efcf0 2024-04-26T20:19:15.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:15.565 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:11.134785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279]},"id":1}]} 2024-04-26T20:19:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 23 2024-04-26T20:19:15.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f55b40683b0 msgr2=0x7f55b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f55b40683b0 0x7f55b406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f55c80af000 tx=0x7f55c80046d0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d81efcf0 msgr2=0x7f55d81f01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d81efcf0 0x7f55d81f01a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f55d80744b0 tx=0x7f55d0007af0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 shutdown_connections 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f55b40683b0 0x7f55b406a870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d81efcf0 0x7f55d81f01a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55d81e5190 0x7f55d814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 --2- 172.21.15.16:0/3364790491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0039c0 0x7f55d80c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 >> 172.21.15.16:0/3364790491 conn(0x7f55d806c380 msgr2=0x7f55d8157950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 shutdown_connections 2024-04-26T20:19:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:15.563+0000 7f55df200640 1 -- 172.21.15.16:0/3364790491 wait complete. 2024-04-26T20:19:15.587 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4276": { "addr": "172.21.15.16:6836/1882507975", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6834", "nonce": 1882507975, "type": "v2" }, { "addr": "172.21.15.16:6836", "nonce": 1882507975, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4276, "incarnation": 9, "join_fscid": -1, "name": "c", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4279": { "addr": "172.21.15.16:6837/1962586875", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6835", "nonce": 1962586875, "type": "v2" }, { "addr": "172.21.15.16:6837", "nonce": 1962586875, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4279, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 5 }, "gid_5127": { "addr": "172.21.15.16:6833/1748916109", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6832", "nonce": 1748916109, "type": "v2" }, { "addr": "172.21.15.16:6833", "nonce": 1748916109, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5127, "incarnation": 21, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:reconnect", "state_seq": 27 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:19:11.134785+0000", "qdb_cluster": [ 4276, 4279 ], "qdb_leader": 4279, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4279, "mds_1": 4276, "mds_2": 5127 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:19:17.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:19:17.072 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:19:17.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:17.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.727+0000 7fbe07200640 1 Processor -- start 2024-04-26T20:19:17.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.727+0000 7fbe07200640 1 -- start start 2024-04-26T20:19:17.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.727+0000 7fbe07200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 0x7fbe0015c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.727+0000 7fbe07200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0015c890 con 0x7fbe000c8b20 2024-04-26T20:19:17.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.727+0000 7fbe07200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe001561b0 con 0x7fbe00155dd0 2024-04-26T20:19:17.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.727+0000 7fbe07200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbe000c9260 con 0x7fbe0015bec0 2024-04-26T20:19:17.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbe000c8b20 0x7fbe000c9e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52646/0 (socket says 172.21.15.16:52646) 2024-04-26T20:19:17.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05400640 1 -- 172.21.15.16:0/1502766163 learned_addr learned my addr 172.21.15.16:0/1502766163 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:17.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe06800640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 0x7fbe0015c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 510942974 0 0) 0x7fbe0015c890 con 0x7fbe000c8b20 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde8003530 con 0x7fbe000c8b20 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170018520 0 0) 0x7fbe001561b0 con 0x7fbe00155dd0 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe0015c890 con 0x7fbe00155dd0 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3041850597 0 0) 0x7fbde8003530 con 0x7fbe000c8b20 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 msgr2=0x7fbe0015c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 0x7fbe0015c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 >> v1:172.21.15.192:6789/0 conn(0x7fbe00155dd0 legacy=0x7fbe0006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe000cab10 con 0x7fbe000c8b20 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fbdf0001680 con 0x7fbe000c8b20 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 >> v1:172.21.15.16:6789/0 conn(0x7fbe000c8b20 legacy=0x7fbe000c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbde8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde8004810 0x7fbde8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 0x7fbde80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000c9260 con 0x7fbde8003b80 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbde800ba80 con 0x7fbde8004810 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbde800bc50 con 0x7fbe0015bec0 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05e00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbde8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe06800640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 0x7fbde80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05400640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde8004810 0x7fbde8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05e00640 1 -- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 msgr2=0x7fbde80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05e00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe0015bec0 0x7fbde80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05e00640 1 -- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde8004810 msgr2=0x7fbde8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05e00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde8004810 0x7fbde8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05e00640 1 -- 172.21.15.16:0/1502766163 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde8003530 con 0x7fbde8003b80 2024-04-26T20:19:17.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.731+0000 7fbe05400640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbde8004810 0x7fbde8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:17.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe05e00640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbde8003f80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40018d0 tx=0x7fbdf401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c05e2173c66d6b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:17.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4001520 con 0x7fbde8003b80 2024-04-26T20:19:17.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf40052f0 con 0x7fbde8003b80 2024-04-26T20:19:17.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe04a00640 1 -- 172.21.15.16:0/1502766163 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4003840 con 0x7fbde8003b80 2024-04-26T20:19:17.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 -- 172.21.15.16:0/1502766163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 msgr2=0x7fbde8003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 --2- 172.21.15.16:0/1502766163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbde8003f80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40018d0 tx=0x7fbdf401c520 comp rx=0 tx=0).stop 2024-04-26T20:19:17.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe06800640 1 -- 172.21.15.16:0/1502766163 reap_dead start 2024-04-26T20:19:17.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 -- 172.21.15.16:0/1502766163 shutdown_connections 2024-04-26T20:19:17.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 -- 172.21.15.16:0/1502766163 >> 172.21.15.16:0/1502766163 conn(0x7fbe00073470 msgr2=0x7fbe00070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:17.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 -- 172.21.15.16:0/1502766163 shutdown_connections 2024-04-26T20:19:17.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 -- 172.21.15.16:0/1502766163 wait complete. 2024-04-26T20:19:17.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 Processor -- start 2024-04-26T20:19:17.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.735+0000 7fbe07200640 1 -- start start 2024-04-26T20:19:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbe00157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe001572c0 0x7fbe0014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe001563a0 0x7fbe00148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0006d750 con 0x7fbde8003b80 2024-04-26T20:19:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000c8f00 con 0x7fbe001572c0 2024-04-26T20:19:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbe000ca5a0 con 0x7fbe001563a0 2024-04-26T20:19:17.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbe00157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbe00157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36842/0 (socket says 172.21.15.16:36842) 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 -- 172.21.15.16:0/2622841186 learned_addr learned my addr 172.21.15.16:0/2622841186 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe06800640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe001563a0 0x7fbe00148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05400640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe001572c0 0x7fbe0014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 -- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe001563a0 msgr2=0x7fbe00148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe001563a0 0x7fbe00148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 -- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe001572c0 msgr2=0x7fbe0014a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe001572c0 0x7fbe0014a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 -- 172.21.15.16:0/2622841186 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe00147d50 con 0x7fbde8003b80 2024-04-26T20:19:17.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe05e00640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbe00157e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40ad040 tx=0x7fbde8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:17.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbdfa000640 1 -- 172.21.15.16:0/2622841186 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40054a0 con 0x7fbde8003b80 2024-04-26T20:19:17.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbdfa000640 1 -- 172.21.15.16:0/2622841186 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf4001500 con 0x7fbde8003b80 2024-04-26T20:19:17.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbdfa000640 1 -- 172.21.15.16:0/2622841186 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40067e0 con 0x7fbde8003b80 2024-04-26T20:19:17.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe001590b0 con 0x7fbde8003b80 2024-04-26T20:19:17.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe00158810 con 0x7fbde8003b80 2024-04-26T20:19:17.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe000506d0 con 0x7fbde8003b80 2024-04-26T20:19:17.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.739+0000 7fbdfa000640 1 -- 172.21.15.16:0/2622841186 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbdf40c1060 con 0x7fbde8003b80 2024-04-26T20:19:17.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.743+0000 7fbdfa000640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbde40683b0 0x7fbde406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:17.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.743+0000 7fbdfa000640 1 -- 172.21.15.16:0/2622841186 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7fbdf41205b0 con 0x7fbde8003b80 2024-04-26T20:19:17.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.743+0000 7fbe05400640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbde40683b0 0x7fbde406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:17.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.743+0000 7fbe05400640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbde40683b0 0x7fbde406a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe0015a1e0 tx=0x7fbdf0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:17.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.747+0000 7fbdfa000640 1 -- 172.21.15.16:0/2622841186 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbdf4016230 con 0x7fbde8003b80 2024-04-26T20:19:17.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.947+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe000c94f0 con 0x7fbde8003b80 2024-04-26T20:19:17.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.947+0000 7fbdfa000640 1 -- 172.21.15.16:0/2622841186 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6047 (secure 0 0 0) 0x7fbdf40f0620 con 0x7fbde8003b80 2024-04-26T20:19:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:17.951 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:16.180022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:rejoin","state_seq":29,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:19:17.952 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-04-26T20:19:17.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbde40683b0 msgr2=0x7fbde406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbde40683b0 0x7fbde406a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe0015a1e0 tx=0x7fbdf0009040 comp rx=0 tx=0).stop 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 msgr2=0x7fbe00157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbe00157e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40ad040 tx=0x7fbde8005840 comp rx=0 tx=0).stop 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 shutdown_connections 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fbde40683b0 0x7fbde406a870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe001563a0 0x7fbe00148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe001572c0 0x7fbe0014a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 --2- 172.21.15.16:0/2622841186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbde8003b80 0x7fbe00157e10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 >> 172.21.15.16:0/2622841186 conn(0x7fbe00073470 msgr2=0x7fbe00153ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 shutdown_connections 2024-04-26T20:19:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:17.951+0000 7fbe07200640 1 -- 172.21.15.16:0/2622841186 wait complete. 2024-04-26T20:19:17.973 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:19:19.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:20.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.111+0000 7f19bcc00640 1 Processor -- start 2024-04-26T20:19:20.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.111+0000 7f19bcc00640 1 -- start start 2024-04-26T20:19:20.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19bcc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b81574b0 0x7f19b80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19bcc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19b80b47e0 0x7f19b806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19bcc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19b80cb7f0 con 0x7f19b80c63f0 2024-04-26T20:19:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19bcc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f19b80c9e80 con 0x7f19b80b47e0 2024-04-26T20:19:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19bcc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f19b80ca0d0 con 0x7f19b81574b0 2024-04-26T20:19:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19afe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19b80b47e0 0x7f19b806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19afe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19b80b47e0 0x7f19b806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36848/0 (socket says 172.21.15.16:36848) 2024-04-26T20:19:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19afe00640 1 -- 172.21.15.16:0/2529024972 learned_addr learned my addr 172.21.15.16:0/2529024972 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19b6800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f19b80c63f0 0x7f19b80cbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52650/0 (socket says 172.21.15.16:52650) 2024-04-26T20:19:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19b5e00640 1 --2- 172.21.15.16:0/2529024972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b81574b0 0x7f19b80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19afe00640 1 -- 172.21.15.16:0/2529024972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b81574b0 msgr2=0x7f19b80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19afe00640 1 --2- 172.21.15.16:0/2529024972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b81574b0 0x7f19b80ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19afe00640 1 -- 172.21.15.16:0/2529024972 >> v1:172.21.15.16:6789/0 conn(0x7f19b80c63f0 legacy=0x7f19b80cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.115+0000 7f19afe00640 1 -- 172.21.15.16:0/2529024972 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b80cba90 con 0x7f19b80b47e0 2024-04-26T20:19:20.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19afe00640 1 --2- 172.21.15.16:0/2529024972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80b47e0 0x7f19b806feb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d490d669926b42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:20.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19b5400640 1 -- 172.21.15.16:0/2529024972 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a00ab650 con 0x7f19b80b47e0 2024-04-26T20:19:20.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19b5400640 1 -- 172.21.15.16:0/2529024972 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a00b0070 con 0x7f19b80b47e0 2024-04-26T20:19:20.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19b5400640 1 -- 172.21.15.16:0/2529024972 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a00aba10 con 0x7f19b80b47e0 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 -- 172.21.15.16:0/2529024972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80b47e0 msgr2=0x7f19b806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 --2- 172.21.15.16:0/2529024972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80b47e0 0x7f19b806feb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a001c560 comp rx=0 tx=0).stop 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 -- 172.21.15.16:0/2529024972 shutdown_connections 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 --2- 172.21.15.16:0/2529024972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80b47e0 0x7f19b806feb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 --2- 172.21.15.16:0/2529024972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b81574b0 0x7f19b80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 -- 172.21.15.16:0/2529024972 >> 172.21.15.16:0/2529024972 conn(0x7f19b8071160 msgr2=0x7f19b8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 -- 172.21.15.16:0/2529024972 shutdown_connections 2024-04-26T20:19:20.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 -- 172.21.15.16:0/2529024972 wait complete. 2024-04-26T20:19:20.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 Processor -- start 2024-04-26T20:19:20.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.119+0000 7f19bcc00640 1 -- start start 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b80b47e0 0x7f19b8142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80c63f0 0x7f19b81f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b81574b0 0x7f19b81471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f19b80703f0 con 0x7f19b80c63f0 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19b80ccc90 con 0x7f19b81574b0 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f19b8070570 con 0x7f19b80b47e0 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80c63f0 0x7f19b81f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80c63f0 0x7f19b81f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36852/0 (socket says 172.21.15.16:36852) 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 -- 172.21.15.16:0/3308260668 learned_addr learned my addr 172.21.15.16:0/3308260668 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:20.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19b5e00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b80b47e0 0x7f19b8142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19b6800640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b81574b0 0x7f19b81471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 -- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b80b47e0 msgr2=0x7f19b8142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b80b47e0 0x7f19b8142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 -- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b81574b0 msgr2=0x7f19b81471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b81574b0 0x7f19b81471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 -- 172.21.15.16:0/3308260668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b8156cd0 con 0x7f19b80c63f0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19b6800640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b81574b0 0x7f19b81471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19afe00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80c63f0 0x7f19b81f6460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f19a00ad040 tx=0x7f19a001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19ae000640 1 -- 172.21.15.16:0/3308260668 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a00be5f0 con 0x7f19b80c63f0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19ae000640 1 -- 172.21.15.16:0/3308260668 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a00be790 con 0x7f19b80c63f0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19ae000640 1 -- 172.21.15.16:0/3308260668 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a00beb80 con 0x7f19b80c63f0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b80cd490 con 0x7f19b80c63f0 2024-04-26T20:19:20.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b80cda50 con 0x7f19b80c63f0 2024-04-26T20:19:20.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b8077c20 con 0x7f19b80c63f0 2024-04-26T20:19:20.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.123+0000 7f19ae000640 1 -- 172.21.15.16:0/3308260668 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19a00b43f0 con 0x7f19b80c63f0 2024-04-26T20:19:20.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.127+0000 7f19ae000640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f19940683b0 0x7f199406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:20.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.127+0000 7f19ae000640 1 -- 172.21.15.16:0/3308260668 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f19a01219c0 con 0x7f19b80c63f0 2024-04-26T20:19:20.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.127+0000 7f19b5e00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f19940683b0 0x7f199406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:20.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.127+0000 7f19b5e00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f19940683b0 0x7f199406a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19a800b930 tx=0x7f19a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:20.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.131+0000 7f19ae000640 1 -- 172.21.15.16:0/3308260668 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f19a0016150 con 0x7f19b80c63f0 2024-04-26T20:19:20.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.331+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19b815ab70 con 0x7f19b80c63f0 2024-04-26T20:19:20.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19ae000640 1 -- 172.21.15.16:0/3308260668 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6047 (secure 0 0 0) 0x7f19a00f1470 con 0x7f19b80c63f0 2024-04-26T20:19:20.337 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:20.337 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:16.180022+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:rejoin","state_seq":29,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4276]},"id":1}]} 2024-04-26T20:19:20.337 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 24 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f19940683b0 msgr2=0x7f199406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f19940683b0 0x7f199406a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19a800b930 tx=0x7f19a8008040 comp rx=0 tx=0).stop 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80c63f0 msgr2=0x7f19b81f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80c63f0 0x7f19b81f6460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f19a00ad040 tx=0x7f19a001ada0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 shutdown_connections 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f19940683b0 0x7f199406a870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19b81574b0 0x7f19b81471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19b80c63f0 0x7f19b81f6460 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 --2- 172.21.15.16:0/3308260668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19b80b47e0 0x7f19b8142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 >> 172.21.15.16:0/3308260668 conn(0x7f19b8071160 msgr2=0x7f19b80b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:20.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 shutdown_connections 2024-04-26T20:19:20.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:20.335+0000 7f19bcc00640 1 -- 172.21.15.16:0/3308260668 wait complete. 2024-04-26T20:19:20.357 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:19:22.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:22.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.495+0000 7f5ae0800640 1 Processor -- start 2024-04-26T20:19:22.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.495+0000 7f5ae0800640 1 -- start start 2024-04-26T20:19:22.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5ae0800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5ae0800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ad80c6340 0x7f5ad80703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5ae0800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad80cfb50 con 0x7f5ad80c9e80 2024-04-26T20:19:22.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5ae0800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad80cce10 con 0x7f5ad80c6340 2024-04-26T20:19:22.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5ae0800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad80cfe10 con 0x7f5ad80b1d80 2024-04-26T20:19:22.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5add400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ad80c6340 0x7f5ad80703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5ade800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5ad80c9e80 0x7f5ad815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52666/0 (socket says 172.21.15.16:52666) 2024-04-26T20:19:22.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5ade800640 1 -- 172.21.15.16:0/3430878272 learned_addr learned my addr 172.21.15.16:0/3430878272 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:22.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5adde00640 1 --2- 172.21.15.16:0/3430878272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5adca00640 1 -- 172.21.15.16:0/3430878272 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187638574 0 0) 0x7f5ad80cfb50 con 0x7f5ad80c9e80 2024-04-26T20:19:22.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5adca00640 1 -- 172.21.15.16:0/3430878272 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ac0003530 con 0x7f5ad80c9e80 2024-04-26T20:19:22.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5add400640 1 -- 172.21.15.16:0/3430878272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 msgr2=0x7f5ad806feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:22.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5add400640 1 --2- 172.21.15.16:0/3430878272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad806feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5add400640 1 -- 172.21.15.16:0/3430878272 >> v1:172.21.15.16:6789/0 conn(0x7f5ad80c9e80 legacy=0x7f5ad815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.499+0000 7f5add400640 1 -- 172.21.15.16:0/3430878272 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad806d650 con 0x7f5ad80c6340 2024-04-26T20:19:22.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5add400640 1 --2- 172.21.15.16:0/3430878272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad80703f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80097c0 tx=0x7f5ac801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed38830efd6a54cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5adca00640 1 -- 172.21.15.16:0/3430878272 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80b5070 con 0x7f5ad80c6340 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5adca00640 1 -- 172.21.15.16:0/3430878272 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac80a8990 con 0x7f5ad80c6340 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5adca00640 1 -- 172.21.15.16:0/3430878272 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80a8d60 con 0x7f5ad80c6340 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- 172.21.15.16:0/3430878272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 msgr2=0x7f5ad80703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3430878272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad80703f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80097c0 tx=0x7f5ac801ec90 comp rx=0 tx=0).stop 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- 172.21.15.16:0/3430878272 shutdown_connections 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3430878272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad80703f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3430878272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad806feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- 172.21.15.16:0/3430878272 >> 172.21.15.16:0/3430878272 conn(0x7f5ad8071160 msgr2=0x7f5ad8068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- 172.21.15.16:0/3430878272 shutdown_connections 2024-04-26T20:19:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- 172.21.15.16:0/3430878272 wait complete. 2024-04-26T20:19:22.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 Processor -- start 2024-04-26T20:19:22.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- start start 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad80c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad81f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ad80c9e80 0x7f5ad8150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b2160 con 0x7f5ad80c6340 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad806dc10 con 0x7f5ad80c9e80 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.503+0000 7f5ae0800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad8071970 con 0x7f5ad80b1d80 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad81f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad81f49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36874/0 (socket says 172.21.15.16:36874) 2024-04-26T20:19:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 -- 172.21.15.16:0/3993638579 learned_addr learned my addr 172.21.15.16:0/3993638579 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5adde00640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad80c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5ade800640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ad80c9e80 0x7f5ad8150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 -- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 msgr2=0x7f5ad80c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad80c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 -- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ad80c9e80 msgr2=0x7f5ad8150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ad80c9e80 0x7f5ad8150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 -- 172.21.15.16:0/3993638579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad80c8820 con 0x7f5ad80c6340 2024-04-26T20:19:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5add400640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad81f49a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5ac801c8c0 tx=0x7f5ac801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5ad2000640 1 -- 172.21.15.16:0/3993638579 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80bf070 con 0x7f5ad80c6340 2024-04-26T20:19:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5ad2000640 1 -- 172.21.15.16:0/3993638579 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac80b0700 con 0x7f5ad80c6340 2024-04-26T20:19:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5ad2000640 1 -- 172.21.15.16:0/3993638579 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80b5040 con 0x7f5ad80c6340 2024-04-26T20:19:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad80b2530 con 0x7f5ad80c6340 2024-04-26T20:19:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad80c8d70 con 0x7f5ad80c6340 2024-04-26T20:19:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.507+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad8077c20 con 0x7f5ad80c6340 2024-04-26T20:19:22.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.511+0000 7f5ad2000640 1 -- 172.21.15.16:0/3993638579 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ac80c2070 con 0x7f5ad80c6340 2024-04-26T20:19:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.511+0000 7f5ad2000640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5abc068380 0x7f5abc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.511+0000 7f5ad2000640 1 -- 172.21.15.16:0/3993638579 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f5ac8123590 con 0x7f5ad80c6340 2024-04-26T20:19:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.511+0000 7f5adde00640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5abc068380 0x7f5abc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:22.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.511+0000 7f5adde00640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5abc068380 0x7f5abc06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009af0 tx=0x7f5acc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.515+0000 7f5ad2000640 1 -- 172.21.15.16:0/3993638579 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5ac80187f0 con 0x7f5ad80c6340 2024-04-26T20:19:22.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ad80d0210 con 0x7f5ad80c6340 2024-04-26T20:19:22.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ad2000640 1 -- 172.21.15.16:0/3993638579 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6052 (secure 0 0 0) 0x7f5ac80f3600 con 0x7f5ad80c6340 2024-04-26T20:19:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:22.722 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279,5127]},"id":1}]} 2024-04-26T20:19:22.722 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5abc068380 msgr2=0x7f5abc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5abc068380 0x7f5abc06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009af0 tx=0x7f5acc008040 comp rx=0 tx=0).stop 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 msgr2=0x7f5ad81f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad81f49a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5ac801c8c0 tx=0x7f5ac801ba30 comp rx=0 tx=0).stop 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 shutdown_connections 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5abc068380 0x7f5abc06a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ad80c9e80 0x7f5ad8150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad80c6340 0x7f5ad81f49a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 --2- 172.21.15.16:0/3993638579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ad80b1d80 0x7f5ad80c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 >> 172.21.15.16:0/3993638579 conn(0x7f5ad8071160 msgr2=0x7f5ad80ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 shutdown_connections 2024-04-26T20:19:22.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:22.719+0000 7f5ae0800640 1 -- 172.21.15.16:0/3993638579 wait complete. 2024-04-26T20:19:22.743 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a has gained rank=2, replacing gid=4261 2024-04-26T20:19:22.743 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 1 secs before reviving mds.b 2024-04-26T20:19:23.075 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-26T20:19:23.071+0000 7f31e9800640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T20:19:23.744 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.b 2024-04-26T20:19:23.745 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T20:19:23.745 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T20:19:23.748 INFO:tasks.ceph.mds.b:Started 2024-04-26T20:19:23.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:23.825 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-04-26T20:19:23.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f138ca00640 1 Processor -- start 2024-04-26T20:19:23.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f138ca00640 1 -- start start 2024-04-26T20:19:23.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f138ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f138806cdd0 0x7f13880c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f138ca00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1388070000 con 0x7f138806e5c0 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f138ca00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13880702e0 con 0x7f1388153a60 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f138ca00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f138806c380 con 0x7f138806cdd0 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f1387e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f138806e5c0 0x7f13880c78a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52674/0 (socket says 172.21.15.16:52674) 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f1387e00640 1 -- 172.21.15.16:0/3174786495 learned_addr learned my addr 172.21.15.16:0/3174786495 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f137fe00640 1 --2- 172.21.15.16:0/3174786495 >> v2:172.21.15.192:3300/0 conn(0x7f138806cdd0 0x7f13880c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f1386a00640 1 -- 172.21.15.16:0/3174786495 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642227214 0 0) 0x7f1388070000 con 0x7f138806e5c0 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f1386a00640 1 -- 172.21.15.16:0/3174786495 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f136c003530 con 0x7f138806e5c0 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f137fe00640 1 -- 172.21.15.16:0/3174786495 >> v1:172.21.15.192:6789/0 conn(0x7f1388153a60 legacy=0x7f138815cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f137fe00640 1 -- 172.21.15.16:0/3174786495 >> v1:172.21.15.16:6789/0 conn(0x7f138806e5c0 legacy=0x7f13880c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:23.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.887+0000 7f137fe00640 1 -- 172.21.15.16:0/3174786495 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13880705c0 con 0x7f138806cdd0 2024-04-26T20:19:23.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f137fe00640 1 --2- 172.21.15.16:0/3174786495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 0x7f13880c4f70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f13700097c0 tx=0x7f137001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5961e3b76dd41bd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f1386a00640 1 -- 172.21.15.16:0/3174786495 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700b5070 con 0x7f138806cdd0 2024-04-26T20:19:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f1386a00640 1 -- 172.21.15.16:0/3174786495 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13700a8990 con 0x7f138806cdd0 2024-04-26T20:19:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f1386a00640 1 -- 172.21.15.16:0/3174786495 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700a8d40 con 0x7f138806cdd0 2024-04-26T20:19:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f138ca00640 1 -- 172.21.15.16:0/3174786495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 msgr2=0x7f13880c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f138ca00640 1 --2- 172.21.15.16:0/3174786495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 0x7f13880c4f70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f13700097c0 tx=0x7f137001ec90 comp rx=0 tx=0).stop 2024-04-26T20:19:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f138ca00640 1 -- 172.21.15.16:0/3174786495 shutdown_connections 2024-04-26T20:19:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f138ca00640 1 --2- 172.21.15.16:0/3174786495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 0x7f13880c4f70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f138ca00640 1 -- 172.21.15.16:0/3174786495 >> 172.21.15.16:0/3174786495 conn(0x7f1388070cc0 msgr2=0x7f13880710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f138ca00640 1 -- 172.21.15.16:0/3174786495 shutdown_connections 2024-04-26T20:19:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.891+0000 7f138ca00640 1 -- 172.21.15.16:0/3174786495 wait complete. 2024-04-26T20:19:23.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 Processor -- start 2024-04-26T20:19:23.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 -- start start 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 0x7f13881f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f138806e5c0 0x7f13880cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1388153a60 0x7f13881478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13880c94a0 con 0x7f138806e5c0 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f138806c940 con 0x7f138806cdd0 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f13880c7fb0 con 0x7f1388153a60 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f138806e5c0 0x7f13880cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f138806e5c0 0x7f13880cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36890/0 (socket says 172.21.15.16:36890) 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 -- 172.21.15.16:0/2503274437 learned_addr learned my addr 172.21.15.16:0/2503274437 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f1387400640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 0x7f13881f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f1387e00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1388153a60 0x7f13881478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 -- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1388153a60 msgr2=0x7f13881478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1388153a60 0x7f13881478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 -- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 msgr2=0x7f13881f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 0x7f13881f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 -- 172.21.15.16:0/2503274437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13880cdc80 con 0x7f138806e5c0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f1387e00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1388153a60 0x7f13881478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137fe00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f138806e5c0 0x7f13880cc2c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f13700b3040 tx=0x7f137001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137f400640 1 -- 172.21.15.16:0/2503274437 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700bf070 con 0x7f138806e5c0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137f400640 1 -- 172.21.15.16:0/2503274437 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13700043c0 con 0x7f138806e5c0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13880ccf00 con 0x7f138806e5c0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f137f400640 1 -- 172.21.15.16:0/2503274437 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700b5040 con 0x7f138806e5c0 2024-04-26T20:19:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1388149490 con 0x7f138806e5c0 2024-04-26T20:19:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.895+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13880506d0 con 0x7f138806e5c0 2024-04-26T20:19:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.899+0000 7f137f400640 1 -- 172.21.15.16:0/2503274437 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13700c2070 con 0x7f138806e5c0 2024-04-26T20:19:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.899+0000 7f137f400640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1364068380 0x7f136406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.899+0000 7f137f400640 1 -- 172.21.15.16:0/2503274437 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f1370123820 con 0x7f138806e5c0 2024-04-26T20:19:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.899+0000 7f1387400640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1364068380 0x7f136406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:23.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.899+0000 7f1387400640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1364068380 0x7f136406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1378001770 tx=0x7f1378009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:23.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:23.903+0000 7f137f400640 1 -- 172.21.15.16:0/2503274437 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f13700187f0 con 0x7f138806e5c0 2024-04-26T20:19:24.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f138814fe10 con 0x7f138806e5c0 2024-04-26T20:19:24.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f137f400640 1 -- 172.21.15.16:0/2503274437 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6052 (secure 0 0 0) 0x7f13700f3240 con 0x7f138806e5c0 2024-04-26T20:19:24.110 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:24.110 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4276,4279,5127]},"id":1}]} 2024-04-26T20:19:24.110 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1364068380 msgr2=0x7f136406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1364068380 0x7f136406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1378001770 tx=0x7f1378009040 comp rx=0 tx=0).stop 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f138806e5c0 msgr2=0x7f13880cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f138806e5c0 0x7f13880cc2c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f13700b3040 tx=0x7f137001ba30 comp rx=0 tx=0).stop 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 shutdown_connections 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1364068380 0x7f136406a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1388153a60 0x7f13881478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f138806e5c0 0x7f13880cc2c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:24.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 --2- 172.21.15.16:0/2503274437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138806cdd0 0x7f13881f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:24.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 >> 172.21.15.16:0/2503274437 conn(0x7f1388070cc0 msgr2=0x7f138814c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:24.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 shutdown_connections 2024-04-26T20:19:24.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:24.107+0000 7f138ca00640 1 -- 172.21.15.16:0/2503274437 wait complete. 2024-04-26T20:19:24.131 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-04-26T20:19:26.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:19:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 Processor -- start 2024-04-26T20:19:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 -- start start 2024-04-26T20:19:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7694150580 0x7f76940c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7694071180 0x7f76940c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f76940c7620 0x7f76940ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f76940ca1c0 con 0x7f7694071180 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f769415a8d0 con 0x7f76940c7620 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.307+0000 7f769bc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7694159d50 con 0x7f7694150580 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7694071180 0x7f76940c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7694071180 0x7f76940c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40848/0 (socket says 172.21.15.16:40848) 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 -- 172.21.15.16:0/2115064169 learned_addr learned my addr 172.21.15.16:0/2115064169 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7699200640 1 --2- 172.21.15.16:0/2115064169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7694150580 0x7f76940c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7699c00640 1 --2- 172.21.15.16:0/2115064169 >> v2:172.21.15.192:3300/0 conn(0x7f76940c7620 0x7f76940ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:26.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 -- 172.21.15.16:0/2115064169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7694150580 msgr2=0x7f76940c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 --2- 172.21.15.16:0/2115064169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7694150580 0x7f76940c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 -- 172.21.15.16:0/2115064169 >> v2:172.21.15.192:3300/0 conn(0x7f76940c7620 msgr2=0x7f76940ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:19:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 --2- 172.21.15.16:0/2115064169 >> v2:172.21.15.192:3300/0 conn(0x7f76940c7620 0x7f76940ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 -- 172.21.15.16:0/2115064169 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769415a030 con 0x7f7694071180 2024-04-26T20:19:26.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693e00640 1 --2- 172.21.15.16:0/2115064169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694071180 0x7f76940c70e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7694070f30 tx=0x7f768001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce34f5d0b51c23c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693400640 1 -- 172.21.15.16:0/2115064169 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76800b5070 con 0x7f7694071180 2024-04-26T20:19:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693400640 1 -- 172.21.15.16:0/2115064169 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76800a89d0 con 0x7f7694071180 2024-04-26T20:19:26.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.311+0000 7f7693400640 1 -- 172.21.15.16:0/2115064169 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76800a8da0 con 0x7f7694071180 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- 172.21.15.16:0/2115064169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694071180 msgr2=0x7f76940c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 --2- 172.21.15.16:0/2115064169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694071180 0x7f76940c70e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7694070f30 tx=0x7f768001ed10 comp rx=0 tx=0).stop 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- 172.21.15.16:0/2115064169 shutdown_connections 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 --2- 172.21.15.16:0/2115064169 >> v2:172.21.15.192:3300/0 conn(0x7f76940c7620 0x7f76940ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 --2- 172.21.15.16:0/2115064169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694071180 0x7f76940c70e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 --2- 172.21.15.16:0/2115064169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7694150580 0x7f76940c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- 172.21.15.16:0/2115064169 >> 172.21.15.16:0/2115064169 conn(0x7f769406c380 msgr2=0x7f769406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- 172.21.15.16:0/2115064169 shutdown_connections 2024-04-26T20:19:26.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- 172.21.15.16:0/2115064169 wait complete. 2024-04-26T20:19:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 Processor -- start 2024-04-26T20:19:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- start start 2024-04-26T20:19:26.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7694071180 0x7f76941442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:26.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76940c7620 0x7f7694144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:26.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694150580 0x7f76940c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76940c8910 con 0x7f7694150580 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f769415a5f0 con 0x7f7694071180 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f769bc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7694159980 con 0x7f76940c7620 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694150580 0x7f76940c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694150580 0x7f76940c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40858/0 (socket says 172.21.15.16:40858) 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 -- 172.21.15.16:0/3320729943 learned_addr learned my addr 172.21.15.16:0/3320729943 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699200640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7694071180 0x7f76941442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7693e00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76940c7620 0x7f7694144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 -- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76940c7620 msgr2=0x7f7694144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76940c7620 0x7f7694144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 -- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7694071180 msgr2=0x7f76941442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7694071180 0x7f76941442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 -- 172.21.15.16:0/3320729943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7694143520 con 0x7f7694150580 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699200640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7694071180 0x7f76941442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:19:26.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7699c00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694150580 0x7f76940c5940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f768c007d40 tx=0x7f768c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7690c00640 1 -- 172.21.15.16:0/3320729943 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c014420 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.315+0000 7f7690c00640 1 -- 172.21.15.16:0/3320729943 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f768c019070 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76940c4f80 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f7690c00640 1 -- 172.21.15.16:0/3320729943 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c014820 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7694143ac0 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7694076570 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f7690c00640 1 -- 172.21.15.16:0/3320729943 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f768c0149c0 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f7690c00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7674068380 0x7f767406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f7690c00640 1 -- 172.21.15.16:0/3320729943 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f768c087620 con 0x7f7694150580 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.319+0000 7f7699200640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7674068380 0x7f767406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:19:26.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.323+0000 7f7699200640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7674068380 0x7f767406a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7688009b10 tx=0x7f7688008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:19:26.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.323+0000 7f7690c00640 1 -- 172.21.15.16:0/3320729943 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f768c057690 con 0x7f7694150580 2024-04-26T20:19:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.527+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7694077c20 con 0x7f7694150580 2024-04-26T20:19:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f7690c00640 1 -- 172.21.15.16:0/3320729943 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7f768c056f90 con 0x7f7694150580 2024-04-26T20:19:26.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:19:26.533 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:19:26.533 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7674068380 msgr2=0x7f767406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7674068380 0x7f767406a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7688009b10 tx=0x7f7688008040 comp rx=0 tx=0).stop 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694150580 msgr2=0x7f76940c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694150580 0x7f76940c5940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f768c007d40 tx=0x7f768c00e4b0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 shutdown_connections 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7674068380 0x7f767406a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7694150580 0x7f76940c5940 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76940c7620 0x7f7694144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 --2- 172.21.15.16:0/3320729943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7694071180 0x7f76941442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 >> 172.21.15.16:0/3320729943 conn(0x7f769406c380 msgr2=0x7f7694157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 shutdown_connections 2024-04-26T20:19:26.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:19:26.531+0000 7f769bc00640 1 -- 172.21.15.16:0/3320729943 wait complete. 2024-04-26T20:19:26.554 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b reported in up:standby state 2024-04-26T20:19:26.554 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 67 secs before thrashing 2024-04-26T20:19:47.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:19:47.137 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:19:58.335 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T20:19:58.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T20:20:17.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:20:17.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:20:33.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:33.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d59e00640 1 Processor -- start 2024-04-26T20:20:33.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d59e00640 1 -- start start 2024-04-26T20:20:33.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d59e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d540c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d59e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d54152fa0 con 0x7f0d54073480 2024-04-26T20:20:33.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d59e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d54159790 con 0x7f0d540c9340 2024-04-26T20:20:33.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d59e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0d54158930 con 0x7f0d54152bc0 2024-04-26T20:20:33.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d53400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0d54073480 0x7f0d540c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:56650/0 (socket says 172.21.15.16:56650) 2024-04-26T20:20:33.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d53400640 1 -- 172.21.15.16:0/1957349774 learned_addr learned my addr 172.21.15.16:0/1957349774 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:20:33.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d52a00640 1 --2- 172.21.15.16:0/1957349774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d540c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d52000640 1 -- 172.21.15.16:0/1957349774 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512705582 0 0) 0x7f0d54152fa0 con 0x7f0d54073480 2024-04-26T20:20:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.694+0000 7f0d52000640 1 -- 172.21.15.16:0/1957349774 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d38003530 con 0x7f0d54073480 2024-04-26T20:20:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d52a00640 1 -- 172.21.15.16:0/1957349774 >> v1:172.21.15.192:6789/0 conn(0x7f0d540c9340 legacy=0x7f0d54072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d52a00640 1 -- 172.21.15.16:0/1957349774 >> v1:172.21.15.16:6789/0 conn(0x7f0d54073480 legacy=0x7f0d540c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d52a00640 1 -- 172.21.15.16:0/1957349774 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d54158c10 con 0x7f0d54152bc0 2024-04-26T20:20:33.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d52a00640 1 --2- 172.21.15.16:0/1957349774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d540c8e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0d440097f0 tx=0x7f0d4401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b496d5bce2fc4610 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d52000640 1 -- 172.21.15.16:0/1957349774 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440b5070 con 0x7f0d54152bc0 2024-04-26T20:20:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d52000640 1 -- 172.21.15.16:0/1957349774 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d440a89d0 con 0x7f0d54152bc0 2024-04-26T20:20:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d52000640 1 -- 172.21.15.16:0/1957349774 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440a8d80 con 0x7f0d54152bc0 2024-04-26T20:20:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d59e00640 1 -- 172.21.15.16:0/1957349774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 msgr2=0x7f0d540c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.698+0000 7f0d59e00640 1 --2- 172.21.15.16:0/1957349774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d540c8e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0d440097f0 tx=0x7f0d4401ecd0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- 172.21.15.16:0/1957349774 shutdown_connections 2024-04-26T20:20:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 --2- 172.21.15.16:0/1957349774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d540c8e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- 172.21.15.16:0/1957349774 >> 172.21.15.16:0/1957349774 conn(0x7f0d5406c380 msgr2=0x7f0d5406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- 172.21.15.16:0/1957349774 shutdown_connections 2024-04-26T20:20:33.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- 172.21.15.16:0/1957349774 wait complete. 2024-04-26T20:20:33.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 Processor -- start 2024-04-26T20:20:33.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- start start 2024-04-26T20:20:33.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54073480 0x7f0d54145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d540c9340 0x7f0d5414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d5414b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541594b0 con 0x7f0d54073480 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0d541591d0 con 0x7f0d540c9340 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d59e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0d540c47d0 con 0x7f0d54152bc0 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54073480 0x7f0d54145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54073480 0x7f0d54145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48364/0 (socket says 172.21.15.16:48364) 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 -- 172.21.15.16:0/2786500996 learned_addr learned my addr 172.21.15.16:0/2786500996 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d53400640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d5414b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d4be00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d540c9340 0x7f0d5414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 -- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 msgr2=0x7f0d5414b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d5414b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 -- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d540c9340 msgr2=0x7f0d5414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d540c9340 0x7f0d5414ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 -- 172.21.15.16:0/2786500996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d541f2560 con 0x7f0d54073480 2024-04-26T20:20:33.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d4be00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d540c9340 0x7f0d5414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:33.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.702+0000 7f0d52a00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54073480 0x7f0d54145b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0d440b3040 tx=0x7f0d4401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:33.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d4b400640 1 -- 172.21.15.16:0/2786500996 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440c1070 con 0x7f0d54073480 2024-04-26T20:20:33.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d4b400640 1 -- 172.21.15.16:0/2786500996 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d44004300 con 0x7f0d54073480 2024-04-26T20:20:33.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d541e67a0 con 0x7f0d54073480 2024-04-26T20:20:33.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d4b400640 1 -- 172.21.15.16:0/2786500996 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440b5040 con 0x7f0d54073480 2024-04-26T20:20:33.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d541e6a80 con 0x7f0d54073480 2024-04-26T20:20:33.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d54077c20 con 0x7f0d54073480 2024-04-26T20:20:33.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d4b400640 1 -- 172.21.15.16:0/2786500996 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0d44003820 con 0x7f0d54073480 2024-04-26T20:20:33.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d4b400640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0d30068380 0x7f0d3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:33.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d4b400640 1 -- 172.21.15.16:0/2786500996 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f0d44123e30 con 0x7f0d54073480 2024-04-26T20:20:33.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.706+0000 7f0d4be00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0d30068380 0x7f0d3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.710+0000 7f0d4be00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0d30068380 0x7f0d3006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0d540ccc80 tx=0x7f0d3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:33.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.710+0000 7f0d4b400640 1 -- 172.21.15.16:0/2786500996 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0d44018830 con 0x7f0d54073480 2024-04-26T20:20:33.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.910+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d540c4320 con 0x7f0d54073480 2024-04-26T20:20:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.910+0000 7f0d4b400640 1 -- 172.21.15.16:0/2786500996 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7f0d440044b0 con 0x7f0d54073480 2024-04-26T20:20:33.915 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:33.915 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0d30068380 msgr2=0x7f0d3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0d30068380 0x7f0d3006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0d540ccc80 tx=0x7f0d3c009040 comp rx=0 tx=0).stop 2024-04-26T20:20:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54073480 msgr2=0x7f0d54145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54073480 0x7f0d54145b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0d440b3040 tx=0x7f0d4401ba70 comp rx=0 tx=0).stop 2024-04-26T20:20:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 shutdown_connections 2024-04-26T20:20:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0d30068380 0x7f0d3006a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d54152bc0 0x7f0d5414b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d540c9340 0x7f0d5414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 --2- 172.21.15.16:0/2786500996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d54073480 0x7f0d54145b30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 >> 172.21.15.16:0/2786500996 conn(0x7f0d5406c380 msgr2=0x7f0d540c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 shutdown_connections 2024-04-26T20:20:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:33.914+0000 7f0d59e00640 1 -- 172.21.15.16:0/2786500996 wait complete. 2024-04-26T20:20:33.935 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.c (rank=1) 2024-04-26T20:20:33.936 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T20:20:33.936 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:20:33.951 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T20:20:33.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:34.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb341400640 1 Processor -- start 2024-04-26T20:20:34.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb341400640 1 -- start start 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb341400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb33c153af0 0x7fb33c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb341400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c0c7b80 0x7fb33c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb341400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33c0c9d90 con 0x7fb33c0c9010 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb341400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb33c0ca630 con 0x7fb33c153af0 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb341400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb33c0ca070 con 0x7fb33c0c7b80 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb33a800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb33c153af0 0x7fb33c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb33b200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb33c0c9010 0x7fb33c0c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:56666/0 (socket says 172.21.15.16:56666) 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb33b200640 1 -- 172.21.15.16:0/2335847349 learned_addr learned my addr 172.21.15.16:0/2335847349 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb331e00640 1 --2- 172.21.15.16:0/2335847349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c0c7b80 0x7fb33c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb33a800640 1 -- 172.21.15.16:0/2335847349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c0c7b80 msgr2=0x7fb33c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb33a800640 1 --2- 172.21.15.16:0/2335847349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c0c7b80 0x7fb33c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb33a800640 1 -- 172.21.15.16:0/2335847349 >> v1:172.21.15.16:6789/0 conn(0x7fb33c0c9010 legacy=0x7fb33c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:34.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.138+0000 7fb33a800640 1 -- 172.21.15.16:0/2335847349 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c0ca350 con 0x7fb33c153af0 2024-04-26T20:20:34.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb33a800640 1 --2- 172.21.15.16:0/2335847349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c153af0 0x7fb33c15d7b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009d90 tx=0x7fb32c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17525d89e3d6ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:34.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb339e00640 1 -- 172.21.15.16:0/2335847349 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0b4070 con 0x7fb33c153af0 2024-04-26T20:20:34.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb339e00640 1 -- 172.21.15.16:0/2335847349 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c0af600 con 0x7fb33c153af0 2024-04-26T20:20:34.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb339e00640 1 -- 172.21.15.16:0/2335847349 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0af9d0 con 0x7fb33c153af0 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 -- 172.21.15.16:0/2335847349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c153af0 msgr2=0x7fb33c15d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 --2- 172.21.15.16:0/2335847349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c153af0 0x7fb33c15d7b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009d90 tx=0x7fb32c01f150 comp rx=0 tx=0).stop 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 -- 172.21.15.16:0/2335847349 shutdown_connections 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 --2- 172.21.15.16:0/2335847349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c0c7b80 0x7fb33c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 --2- 172.21.15.16:0/2335847349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c153af0 0x7fb33c15d7b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 -- 172.21.15.16:0/2335847349 >> 172.21.15.16:0/2335847349 conn(0x7fb33c06c380 msgr2=0x7fb33c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 -- 172.21.15.16:0/2335847349 shutdown_connections 2024-04-26T20:20:34.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.142+0000 7fb341400640 1 -- 172.21.15.16:0/2335847349 wait complete. 2024-04-26T20:20:34.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 Processor -- start 2024-04-26T20:20:34.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 -- start start 2024-04-26T20:20:34.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb33c0c7b80 0x7fb33c0c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:34.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c0c9010 0x7fb33c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:34.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c153af0 0x7fb33c0cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:34.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c153ed0 con 0x7fb33c0c9010 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c15d290 con 0x7fb33c0c7b80 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb33c154050 con 0x7fb33c153af0 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c0c9010 0x7fb33c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c0c9010 0x7fb33c0cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48388/0 (socket says 172.21.15.16:48388) 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 -- 172.21.15.16:0/1015208430 learned_addr learned my addr 172.21.15.16:0/1015208430 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb33b200640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c153af0 0x7fb33c0cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb33a800640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb33c0c7b80 0x7fb33c0c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 -- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c153af0 msgr2=0x7fb33c0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:34.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c153af0 0x7fb33c0cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 -- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb33c0c7b80 msgr2=0x7fb33c0c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb33c0c7b80 0x7fb33c0c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 -- 172.21.15.16:0/1015208430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c154400 con 0x7fb33c0c9010 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb33a800640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb33c0c7b80 0x7fb33c0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb331e00640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c0c9010 0x7fb33c0cb7b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb32400d830 tx=0x7fb32400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb333400640 1 -- 172.21.15.16:0/1015208430 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32400b6c0 con 0x7fb33c0c9010 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb333400640 1 -- 172.21.15.16:0/1015208430 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb324019070 con 0x7fb33c0c9010 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb333400640 1 -- 172.21.15.16:0/1015208430 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32400ba60 con 0x7fb33c0c9010 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33c1546c0 con 0x7fb33c0c9010 2024-04-26T20:20:34.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.146+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33c154c80 con 0x7fb33c0c9010 2024-04-26T20:20:34.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.150+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c077c20 con 0x7fb33c0c9010 2024-04-26T20:20:34.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.150+0000 7fb333400640 1 -- 172.21.15.16:0/1015208430 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb32401e460 con 0x7fb33c0c9010 2024-04-26T20:20:34.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.150+0000 7fb333400640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3180683b0 0x7fb31806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:34.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.150+0000 7fb333400640 1 -- 172.21.15.16:0/1015208430 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7fb324087600 con 0x7fb33c0c9010 2024-04-26T20:20:34.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.150+0000 7fb33a800640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3180683b0 0x7fb31806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:34.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.150+0000 7fb33a800640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3180683b0 0x7fb31806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0b1000 tx=0x7fb32c0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:34.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.154+0000 7fb333400640 1 -- 172.21.15.16:0/1015208430 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb3240575e0 con 0x7fb33c0c9010 2024-04-26T20:20:34.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.442+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb33c157930 con 0x7fb33c0c9010 2024-04-26T20:20:34.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.450+0000 7fb333400640 1 -- 172.21.15.16:0/1015208430 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7fb324056ee0 con 0x7fb33c0c9010 2024-04-26T20:20:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:34.455 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:34.455 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:34.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3180683b0 msgr2=0x7fb31806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:34.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3180683b0 0x7fb31806a870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0b1000 tx=0x7fb32c0aa000 comp rx=0 tx=0).stop 2024-04-26T20:20:34.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c0c9010 msgr2=0x7fb33c0cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:34.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c0c9010 0x7fb33c0cb7b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb32400d830 tx=0x7fb32400dcf0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 shutdown_connections 2024-04-26T20:20:34.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb3180683b0 0x7fb31806a870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb33c153af0 0x7fb33c0cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb33c0c9010 0x7fb33c0cb7b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 --2- 172.21.15.16:0/1015208430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb33c0c7b80 0x7fb33c0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:34.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.454+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 >> 172.21.15.16:0/1015208430 conn(0x7fb33c06c380 msgr2=0x7fb33c152d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:34.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.458+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 shutdown_connections 2024-04-26T20:20:34.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:34.458+0000 7fb341400640 1 -- 172.21.15.16:0/1015208430 wait complete. 2024-04-26T20:20:34.517 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-26T20:20:36.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:36.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e4000640 1 Processor -- start 2024-04-26T20:20:36.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e4000640 1 -- start start 2024-04-26T20:20:36.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e4000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0dc0c6340 0x7ff0dc15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:36.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e4000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c9e80 0x7ff0dc15c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:36.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e4000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0dc0cfb50 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e4000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff0dc0cce10 con 0x7ff0dc0c6340 2024-04-26T20:20:36.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e4000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff0dc0cfe10 con 0x7ff0dc0c9e80 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0dc0c6340 0x7ff0dc15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0dc0c6340 0x7ff0dc15c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40814/0 (socket says 172.21.15.16:40814) 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e0c00640 1 -- 172.21.15.16:0/3742225259 learned_addr learned my addr 172.21.15.16:0/3742225259 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e2000640 1 --2- 172.21.15.16:0/3742225259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c9e80 0x7ff0dc15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e0c00640 1 -- 172.21.15.16:0/3742225259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c9e80 msgr2=0x7ff0dc15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e0c00640 1 --2- 172.21.15.16:0/3742225259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c9e80 0x7ff0dc15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e0c00640 1 -- 172.21.15.16:0/3742225259 >> v1:172.21.15.192:6789/0 conn(0x7ff0dc0b1d80 legacy=0x7ff0dc06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:36.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.658+0000 7ff0e0c00640 1 -- 172.21.15.16:0/3742225259 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc06d650 con 0x7ff0dc0c6340 2024-04-26T20:20:36.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e0c00640 1 --2- 172.21.15.16:0/3742225259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0c6340 0x7ff0dc15c0d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009870 tx=0x7ff0c801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7fcd1b6ee8b60f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:36.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0dbe00640 1 -- 172.21.15.16:0/3742225259 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80b5070 con 0x7ff0dc0c6340 2024-04-26T20:20:36.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0dbe00640 1 -- 172.21.15.16:0/3742225259 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c80a8a50 con 0x7ff0dc0c6340 2024-04-26T20:20:36.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0dbe00640 1 -- 172.21.15.16:0/3742225259 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80a8e20 con 0x7ff0dc0c6340 2024-04-26T20:20:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 -- 172.21.15.16:0/3742225259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0c6340 msgr2=0x7ff0dc15c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3742225259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0c6340 0x7ff0dc15c0d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009870 tx=0x7ff0c801ed50 comp rx=0 tx=0).stop 2024-04-26T20:20:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 -- 172.21.15.16:0/3742225259 shutdown_connections 2024-04-26T20:20:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3742225259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c9e80 0x7ff0dc15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3742225259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0c6340 0x7ff0dc15c0d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 -- 172.21.15.16:0/3742225259 >> 172.21.15.16:0/3742225259 conn(0x7ff0dc071160 msgr2=0x7ff0dc068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:36.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 -- 172.21.15.16:0/3742225259 shutdown_connections 2024-04-26T20:20:36.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 -- 172.21.15.16:0/3742225259 wait complete. 2024-04-26T20:20:36.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 Processor -- start 2024-04-26T20:20:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.662+0000 7ff0e4000640 1 -- start start 2024-04-26T20:20:36.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0b1d80 0x7ff0dc152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:36.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c6340 0x7ff0dc157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:36.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0dc0c9e80 0x7ff0dc1f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc0b2160 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc06dc10 con 0x7ff0dc0c9e80 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff0dc071970 con 0x7ff0dc0c6340 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0b1d80 0x7ff0dc152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0b1d80 0x7ff0dc152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40830/0 (socket says 172.21.15.16:40830) 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 -- 172.21.15.16:0/3142630827 learned_addr learned my addr 172.21.15.16:0/3142630827 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e0c00640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c6340 0x7ff0dc157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e2000640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0dc0c9e80 0x7ff0dc1f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 -- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c6340 msgr2=0x7ff0dc157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c6340 0x7ff0dc157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 -- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0dc0c9e80 msgr2=0x7ff0dc1f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0dc0c9e80 0x7ff0dc1f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 -- 172.21.15.16:0/3142630827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc0c5f30 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e1600640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0b1d80 0x7ff0dc152630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c420 tx=0x7ff0d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0d9600640 1 -- 172.21.15.16:0/3142630827 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00052d0 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0d9600640 1 -- 172.21.15.16:0/3142630827 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d0005470 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0d9600640 1 -- 172.21.15.16:0/3142630827 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0007260 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc1544d0 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc154a90 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.666+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc077c20 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.670+0000 7ff0d9600640 1 -- 172.21.15.16:0/3142630827 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0d0007400 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.670+0000 7ff0d9600640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0bc068380 0x7ff0bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:36.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.670+0000 7ff0d9600640 1 -- 172.21.15.16:0/3142630827 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7ff0d00864a0 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.670+0000 7ff0e0c00640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0bc068380 0x7ff0bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:36.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.670+0000 7ff0e0c00640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0bc068380 0x7ff0bc06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80b2000 tx=0x7ff0c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.674+0000 7ff0d9600640 1 -- 172.21.15.16:0/3142630827 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff0d0056480 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.878+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0dc0d0210 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.878+0000 7ff0d9600640 1 -- 172.21.15.16:0/3142630827 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7ff0d0055d80 con 0x7ff0dc0b1d80 2024-04-26T20:20:36.884 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:36.884 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:36.884 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:36.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0bc068380 msgr2=0x7ff0bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:36.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0bc068380 0x7ff0bc06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80b2000 tx=0x7ff0c8008040 comp rx=0 tx=0).stop 2024-04-26T20:20:36.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0b1d80 msgr2=0x7ff0dc152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0b1d80 0x7ff0dc152630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c420 tx=0x7ff0d000c8e0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 shutdown_connections 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff0bc068380 0x7ff0bc06a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0dc0c9e80 0x7ff0dc1f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0dc0c6340 0x7ff0dc157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 --2- 172.21.15.16:0/3142630827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0dc0b1d80 0x7ff0dc152630 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 >> 172.21.15.16:0/3142630827 conn(0x7ff0dc071160 msgr2=0x7ff0dc0cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 shutdown_connections 2024-04-26T20:20:36.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:36.882+0000 7ff0e4000640 1 -- 172.21.15.16:0/3142630827 wait complete. 2024-04-26T20:20:36.910 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-26T20:20:38.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:39.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc9400640 1 Processor -- start 2024-04-26T20:20:39.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc9400640 1 -- start start 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc9400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffbc4155f20 0x7ffbc40722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc406fb60 0x7ffbc406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc9400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc40c7e40 con 0x7ffbc415c590 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc9400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc4156300 con 0x7ffbc4155f20 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc9400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40c8120 con 0x7ffbc406fb60 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffbc4155f20 0x7ffbc40722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffbc4155f20 0x7ffbc40722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40842/0 (socket says 172.21.15.16:40842) 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc2800640 1 -- 172.21.15.16:0/1453999062 learned_addr learned my addr 172.21.15.16:0/1453999062 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc3200640 1 --2- 172.21.15.16:0/1453999062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc406fb60 0x7ffbc406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc2800640 1 -- 172.21.15.16:0/1453999062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc406fb60 msgr2=0x7ffbc406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:39.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc2800640 1 --2- 172.21.15.16:0/1453999062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc406fb60 0x7ffbc406fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc2800640 1 -- 172.21.15.16:0/1453999062 >> v1:172.21.15.192:6789/0 conn(0x7ffbc415c590 legacy=0x7ffbc4073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:39.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.062+0000 7ffbc2800640 1 -- 172.21.15.16:0/1453999062 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc4072d50 con 0x7ffbc4155f20 2024-04-26T20:20:39.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc2800640 1 --2- 172.21.15.16:0/1453999062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc4155f20 0x7ffbc40722a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf6267e4addb0a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:39.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc1400640 1 -- 172.21.15.16:0/1453999062 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40b4070 con 0x7ffbc4155f20 2024-04-26T20:20:39.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc1400640 1 -- 172.21.15.16:0/1453999062 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb40af400 con 0x7ffbc4155f20 2024-04-26T20:20:39.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc1400640 1 -- 172.21.15.16:0/1453999062 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40af7d0 con 0x7ffbc4155f20 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 -- 172.21.15.16:0/1453999062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc4155f20 msgr2=0x7ffbc40722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 --2- 172.21.15.16:0/1453999062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc4155f20 0x7ffbc40722a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009e50 tx=0x7ffbb401f1e0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 -- 172.21.15.16:0/1453999062 shutdown_connections 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 --2- 172.21.15.16:0/1453999062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc406fb60 0x7ffbc406fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 --2- 172.21.15.16:0/1453999062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc4155f20 0x7ffbc40722a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 -- 172.21.15.16:0/1453999062 >> 172.21.15.16:0/1453999062 conn(0x7ffbc406c380 msgr2=0x7ffbc406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 -- 172.21.15.16:0/1453999062 shutdown_connections 2024-04-26T20:20:39.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.066+0000 7ffbc9400640 1 -- 172.21.15.16:0/1453999062 wait complete. 2024-04-26T20:20:39.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 Processor -- start 2024-04-26T20:20:39.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 -- start start 2024-04-26T20:20:39.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc406fb60 0x7ffbc41e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbc4155f20 0x7ffbc41499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc415c590 0x7ffbc4149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc415cb60 con 0x7ffbc406fb60 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc415c9e0 con 0x7ffbc4155f20 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40c51e0 con 0x7ffbc415c590 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc406fb60 0x7ffbc41e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc406fb60 0x7ffbc41e67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40858/0 (socket says 172.21.15.16:40858) 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 -- 172.21.15.16:0/815412995 learned_addr learned my addr 172.21.15.16:0/815412995 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc1e00640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbc4155f20 0x7ffbc41499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc3200640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc415c590 0x7ffbc4149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 -- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc415c590 msgr2=0x7ffbc4149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc415c590 0x7ffbc4149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 -- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbc4155f20 msgr2=0x7ffbc41499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbc4155f20 0x7ffbc41499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 -- 172.21.15.16:0/815412995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc41e7b90 con 0x7ffbc406fb60 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc3200640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc415c590 0x7ffbc4149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc2800640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc406fb60 0x7ffbc41e67e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffbb401d890 tx=0x7ffbb401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbbaa00640 1 -- 172.21.15.16:0/815412995 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40b4040 con 0x7ffbc406fb60 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbbaa00640 1 -- 172.21.15.16:0/815412995 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb40afe30 con 0x7ffbc406fb60 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbbaa00640 1 -- 172.21.15.16:0/815412995 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4009510 con 0x7ffbc406fb60 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc41e7340 con 0x7ffbc406fb60 2024-04-26T20:20:39.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc4158e30 con 0x7ffbc406fb60 2024-04-26T20:20:39.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.070+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc4077c20 con 0x7ffbc406fb60 2024-04-26T20:20:39.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.074+0000 7ffbbaa00640 1 -- 172.21.15.16:0/815412995 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffbb40c2020 con 0x7ffbc406fb60 2024-04-26T20:20:39.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.074+0000 7ffbbaa00640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ffba4068380 0x7ffba406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:39.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.074+0000 7ffbbaa00640 1 -- 172.21.15.16:0/815412995 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7ffbb4124910 con 0x7ffbc406fb60 2024-04-26T20:20:39.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.074+0000 7ffbc1e00640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ffba4068380 0x7ffba406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:39.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.074+0000 7ffbc1e00640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ffba4068380 0x7ffba406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffbc406c8c0 tx=0x7ffbb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:39.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.078+0000 7ffbbaa00640 1 -- 172.21.15.16:0/815412995 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffbb40c9020 con 0x7ffbc406fb60 2024-04-26T20:20:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.278+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbc40c70e0 con 0x7ffbc406fb60 2024-04-26T20:20:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.278+0000 7ffbbaa00640 1 -- 172.21.15.16:0/815412995 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7ffbb4018d40 con 0x7ffbc406fb60 2024-04-26T20:20:39.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:39.284 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:39.284 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:39.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ffba4068380 msgr2=0x7ffba406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ffba4068380 0x7ffba406a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffbc406c8c0 tx=0x7ffbb0008040 comp rx=0 tx=0).stop 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc406fb60 msgr2=0x7ffbc41e67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc406fb60 0x7ffbc41e67e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffbb401d890 tx=0x7ffbb401bf80 comp rx=0 tx=0).stop 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 shutdown_connections 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ffba4068380 0x7ffba406a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbc415c590 0x7ffbc4149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbc4155f20 0x7ffbc41499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 --2- 172.21.15.16:0/815412995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc406fb60 0x7ffbc41e67e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 >> 172.21.15.16:0/815412995 conn(0x7ffbc406c380 msgr2=0x7ffbc414bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 shutdown_connections 2024-04-26T20:20:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:39.282+0000 7ffbc9400640 1 -- 172.21.15.16:0/815412995 wait complete. 2024-04-26T20:20:39.304 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-26T20:20:41.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203e00640 1 Processor -- start 2024-04-26T20:20:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203e00640 1 -- start start 2024-04-26T20:20:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204155f50 0x7fd20415f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd204072960 con 0x7fd204073f30 2024-04-26T20:20:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd204068370 con 0x7fd204155b70 2024-04-26T20:20:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd204068140 con 0x7fd204155f50 2024-04-26T20:20:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd1fbe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd204073f30 0x7fd20415bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59078/0 (socket says 172.21.15.16:59078) 2024-04-26T20:20:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd1fbe00640 1 -- 172.21.15.16:0/211231649 learned_addr learned my addr 172.21.15.16:0/211231649 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:20:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203400640 1 --2- 172.21.15.16:0/211231649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204155f50 0x7fd20415f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721289309 0 0) 0x7fd204072960 con 0x7fd204073f30 2024-04-26T20:20:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e8003530 con 0x7fd204073f30 2024-04-26T20:20:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167813339 0 0) 0x7fd204068370 con 0x7fd204155b70 2024-04-26T20:20:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd204072960 con 0x7fd204155b70 2024-04-26T20:20:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2801457586 0 0) 0x7fd1e8003530 con 0x7fd204073f30 2024-04-26T20:20:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203400640 1 -- 172.21.15.16:0/211231649 >> v1:172.21.15.192:6789/0 conn(0x7fd204155b70 legacy=0x7fd204073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203400640 1 -- 172.21.15.16:0/211231649 >> v1:172.21.15.16:6789/0 conn(0x7fd204073f30 legacy=0x7fd20415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.462+0000 7fd203400640 1 -- 172.21.15.16:0/211231649 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd204068650 con 0x7fd204155f50 2024-04-26T20:20:41.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203400640 1 --2- 172.21.15.16:0/211231649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204155f50 0x7fd20415f9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009dc0 tx=0x7fd1fc01f0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c1abcd02e7545e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0b5070 con 0x7fd204155f50 2024-04-26T20:20:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0a8c30 con 0x7fd204155f50 2024-04-26T20:20:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd202000640 1 -- 172.21.15.16:0/211231649 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec001680 con 0x7fd204155f50 2024-04-26T20:20:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203e00640 1 -- 172.21.15.16:0/211231649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204155f50 msgr2=0x7fd20415f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203e00640 1 --2- 172.21.15.16:0/211231649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204155f50 0x7fd20415f9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009dc0 tx=0x7fd1fc01f0a0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203e00640 1 -- 172.21.15.16:0/211231649 shutdown_connections 2024-04-26T20:20:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203e00640 1 --2- 172.21.15.16:0/211231649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204155f50 0x7fd20415f9f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203e00640 1 -- 172.21.15.16:0/211231649 >> 172.21.15.16:0/211231649 conn(0x7fd2040cdc10 msgr2=0x7fd2040cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203e00640 1 -- 172.21.15.16:0/211231649 shutdown_connections 2024-04-26T20:20:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.466+0000 7fd203e00640 1 -- 172.21.15.16:0/211231649 wait complete. 2024-04-26T20:20:41.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 Processor -- start 2024-04-26T20:20:41.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 -- start start 2024-04-26T20:20:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204073f30 0x7fd2041f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd204155b70 0x7fd2041f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204155f50 0x7fd20415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd204073a60 con 0x7fd204155f50 2024-04-26T20:20:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd204072f00 con 0x7fd204155b70 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd204073be0 con 0x7fd204073f30 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204155f50 0x7fd20415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204155f50 0x7fd20415ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40870/0 (socket says 172.21.15.16:40870) 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 -- 172.21.15.16:0/1359369342 learned_addr learned my addr 172.21.15.16:0/1359369342 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd202a00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204073f30 0x7fd2041f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd1fbe00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd204155b70 0x7fd2041f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 -- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204073f30 msgr2=0x7fd2041f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204073f30 0x7fd2041f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 -- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd204155b70 msgr2=0x7fd2041f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd204155b70 0x7fd2041f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 -- 172.21.15.16:0/1359369342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20414e060 con 0x7fd204155f50 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd1fbe00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd204155b70 0x7fd2041f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203400640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204155f50 0x7fd20415ec30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc01ccd0 tx=0x7fd1fc01be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:41.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd1faa00640 1 -- 172.21.15.16:0/1359369342 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0b5070 con 0x7fd204155f50 2024-04-26T20:20:41.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd1faa00640 1 -- 172.21.15.16:0/1359369342 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0c0070 con 0x7fd204155f50 2024-04-26T20:20:41.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20414e340 con 0x7fd204155f50 2024-04-26T20:20:41.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd1faa00640 1 -- 172.21.15.16:0/1359369342 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc009450 con 0x7fd204155f50 2024-04-26T20:20:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2041f4d30 con 0x7fd204155f50 2024-04-26T20:20:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.470+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2040506d0 con 0x7fd204155f50 2024-04-26T20:20:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.474+0000 7fd1faa00640 1 -- 172.21.15.16:0/1359369342 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd1fc004650 con 0x7fd204155f50 2024-04-26T20:20:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.474+0000 7fd1faa00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd1e0068380 0x7fd1e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.474+0000 7fd1faa00640 1 -- 172.21.15.16:0/1359369342 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7fd1fc124ef0 con 0x7fd204155f50 2024-04-26T20:20:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.474+0000 7fd202a00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd1e0068380 0x7fd1e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.474+0000 7fd202a00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd1e0068380 0x7fd1e006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40011f0 tx=0x7fd1f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.478+0000 7fd1faa00640 1 -- 172.21.15.16:0/1359369342 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd1fc018c00 con 0x7fd204155f50 2024-04-26T20:20:41.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.678+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd204153780 con 0x7fd204155f50 2024-04-26T20:20:41.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.678+0000 7fd1faa00640 1 -- 172.21.15.16:0/1359369342 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7fd1fc0f5080 con 0x7fd204155f50 2024-04-26T20:20:41.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:41.683 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd1e0068380 msgr2=0x7fd1e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd1e0068380 0x7fd1e006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40011f0 tx=0x7fd1f4009040 comp rx=0 tx=0).stop 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204155f50 msgr2=0x7fd20415ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204155f50 0x7fd20415ec30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc01ccd0 tx=0x7fd1fc01be40 comp rx=0 tx=0).stop 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 shutdown_connections 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd1e0068380 0x7fd1e006a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd204155f50 0x7fd20415ec30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd204155b70 0x7fd2041f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 --2- 172.21.15.16:0/1359369342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd204073f30 0x7fd2041f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 >> 172.21.15.16:0/1359369342 conn(0x7fd2040cdc10 msgr2=0x7fd2040ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 shutdown_connections 2024-04-26T20:20:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:41.682+0000 7fd203e00640 1 -- 172.21.15.16:0/1359369342 wait complete. 2024-04-26T20:20:41.704 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-26T20:20:43.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:43.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.854+0000 7f5f3aa00640 1 Processor -- start 2024-04-26T20:20:43.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.854+0000 7f5f3aa00640 1 -- start start 2024-04-26T20:20:43.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.854+0000 7f5f3aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5f3406e440 0x7f5f340c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:43.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.854+0000 7f5f3aa00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f34070380 con 0x7f5f3406d490 2024-04-26T20:20:43.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.854+0000 7f5f3aa00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f34070660 con 0x7f5f34155ee0 2024-04-26T20:20:43.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.854+0000 7f5f3aa00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5f3406d8d0 con 0x7f5f3406e440 2024-04-26T20:20:43.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f38a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5f3406e440 0x7f5f340c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:43.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f33400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5f3406d490 0x7f5f3406dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59086/0 (socket says 172.21.15.16:59086) 2024-04-26T20:20:43.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f33400640 1 -- 172.21.15.16:0/2290429190 learned_addr learned my addr 172.21.15.16:0/2290429190 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:20:43.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f38a00640 1 -- 172.21.15.16:0/2290429190 >> v1:172.21.15.192:6789/0 conn(0x7f5f34155ee0 legacy=0x7f5f3415fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:43.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f38a00640 1 -- 172.21.15.16:0/2290429190 >> v1:172.21.15.16:6789/0 conn(0x7f5f3406d490 legacy=0x7f5f3406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:43.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f38a00640 1 -- 172.21.15.16:0/2290429190 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f34070940 con 0x7f5f3406e440 2024-04-26T20:20:43.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f38a00640 1 --2- 172.21.15.16:0/2290429190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f3406e440 0x7f5f340c4d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009d90 tx=0x7f5f2c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a01effae29751b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:43.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f32a00640 1 -- 172.21.15.16:0/2290429190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0b4070 con 0x7f5f3406e440 2024-04-26T20:20:43.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f32a00640 1 -- 172.21.15.16:0/2290429190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0af600 con 0x7f5f3406e440 2024-04-26T20:20:43.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.858+0000 7f5f32a00640 1 -- 172.21.15.16:0/2290429190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0af9d0 con 0x7f5f3406e440 2024-04-26T20:20:43.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- 172.21.15.16:0/2290429190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f3406e440 msgr2=0x7f5f340c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:43.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/2290429190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f3406e440 0x7f5f340c4d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009d90 tx=0x7f5f2c01f150 comp rx=0 tx=0).stop 2024-04-26T20:20:43.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- 172.21.15.16:0/2290429190 shutdown_connections 2024-04-26T20:20:43.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/2290429190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f3406e440 0x7f5f340c4d00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:43.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- 172.21.15.16:0/2290429190 >> 172.21.15.16:0/2290429190 conn(0x7f5f34071f60 msgr2=0x7f5f34072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:43.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- 172.21.15.16:0/2290429190 shutdown_connections 2024-04-26T20:20:43.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- 172.21.15.16:0/2290429190 wait complete. 2024-04-26T20:20:43.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 Processor -- start 2024-04-26T20:20:43.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- start start 2024-04-26T20:20:43.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3406d490 0x7f5f340cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:43.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f34155ee0 0x7f5f3415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:43.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f34159a70 0x7f5f3415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:43.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5f341562c0 con 0x7f5f34155ee0 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5f34070f00 con 0x7f5f34159a70 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f3aa00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5f340c9fe0 con 0x7f5f3406d490 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f34155ee0 0x7f5f3415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f34155ee0 0x7f5f3415bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40890/0 (socket says 172.21.15.16:40890) 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 -- 172.21.15.16:0/3357909226 learned_addr learned my addr 172.21.15.16:0/3357909226 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f38a00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f34159a70 0x7f5f3415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33e00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3406d490 0x7f5f340cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 -- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3406d490 msgr2=0x7f5f340cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3406d490 0x7f5f340cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 -- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f34159a70 msgr2=0x7f5f3415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f34159a70 0x7f5f3415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.862+0000 7f5f33400640 1 -- 172.21.15.16:0/3357909226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3415b4b0 con 0x7f5f34155ee0 2024-04-26T20:20:43.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f33400640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f34155ee0 0x7f5f3415bc40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c500 tx=0x7f5f2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:43.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f2be00640 1 -- 172.21.15.16:0/3357909226 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20017070 con 0x7f5f34155ee0 2024-04-26T20:20:43.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f2be00640 1 -- 172.21.15.16:0/3357909226 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f20005cf0 con 0x7f5f34155ee0 2024-04-26T20:20:43.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f2be00640 1 -- 172.21.15.16:0/3357909226 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f200072f0 con 0x7f5f34155ee0 2024-04-26T20:20:43.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3415cd50 con 0x7f5f34155ee0 2024-04-26T20:20:43.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f340ce880 con 0x7f5f34155ee0 2024-04-26T20:20:43.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f34077c20 con 0x7f5f34155ee0 2024-04-26T20:20:43.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f2be00640 1 -- 172.21.15.16:0/3357909226 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f2001a070 con 0x7f5f34155ee0 2024-04-26T20:20:43.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f2be00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5f14068380 0x7f5f1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:43.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f2be00640 1 -- 172.21.15.16:0/3357909226 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f5f200861a0 con 0x7f5f34155ee0 2024-04-26T20:20:43.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.866+0000 7f5f33e00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5f14068380 0x7f5f1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:43.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.870+0000 7f5f33e00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5f14068380 0x7f5f1406a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f240015b0 tx=0x7f5f24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:43.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:43.870+0000 7f5f2be00640 1 -- 172.21.15.16:0/3357909226 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5f20055c50 con 0x7f5f34155ee0 2024-04-26T20:20:44.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f340caa80 con 0x7f5f34155ee0 2024-04-26T20:20:44.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f2be00640 1 -- 172.21.15.16:0/3357909226 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7f5f20059f50 con 0x7f5f34155ee0 2024-04-26T20:20:44.078 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:44.078 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:44.078 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:44.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5f14068380 msgr2=0x7f5f1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5f14068380 0x7f5f1406a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f240015b0 tx=0x7f5f24009040 comp rx=0 tx=0).stop 2024-04-26T20:20:44.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f34155ee0 msgr2=0x7f5f3415bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:44.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f34155ee0 0x7f5f3415bc40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c500 tx=0x7f5f2000c9c0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 shutdown_connections 2024-04-26T20:20:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5f14068380 0x7f5f1406a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f34159a70 0x7f5f3415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f34155ee0 0x7f5f3415bc40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 --2- 172.21.15.16:0/3357909226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f3406d490 0x7f5f340cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.074+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 >> 172.21.15.16:0/3357909226 conn(0x7f5f34071f60 msgr2=0x7f5f34156a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.078+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 shutdown_connections 2024-04-26T20:20:44.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:44.078+0000 7f5f3aa00640 1 -- 172.21.15.16:0/3357909226 wait complete. 2024-04-26T20:20:44.099 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-26T20:20:46.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:46.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.250+0000 7f785be00640 1 Processor -- start 2024-04-26T20:20:46.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.250+0000 7f785be00640 1 -- start start 2024-04-26T20:20:46.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f785c155c00 0x7f785c0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:46.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f785c0ce800 0x7f785c06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:46.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785be00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785c06f9f0 con 0x7f785c0703e0 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785be00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f785c070810 con 0x7f785c155c00 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785be00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f785c0c8fd0 con 0x7f785c0ce800 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f785c155c00 0x7f785c0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f785c155c00 0x7f785c0ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59414/0 (socket says 172.21.15.16:59414) 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785aa00640 1 -- 172.21.15.16:0/2635521383 learned_addr learned my addr 172.21.15.16:0/2635521383 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785a000640 1 --2- 172.21.15.16:0/2635521383 >> v2:172.21.15.192:3300/0 conn(0x7f785c0ce800 0x7f785c06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785aa00640 1 -- 172.21.15.16:0/2635521383 >> v2:172.21.15.192:3300/0 conn(0x7f785c0ce800 msgr2=0x7f785c06fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785aa00640 1 --2- 172.21.15.16:0/2635521383 >> v2:172.21.15.192:3300/0 conn(0x7f785c0ce800 0x7f785c06fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785aa00640 1 -- 172.21.15.16:0/2635521383 >> v1:172.21.15.192:6789/0 conn(0x7f785c0703e0 legacy=0x7f785c06c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:46.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.254+0000 7f785aa00640 1 -- 172.21.15.16:0/2635521383 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785c15bd70 con 0x7f785c155c00 2024-04-26T20:20:46.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785aa00640 1 --2- 172.21.15.16:0/2635521383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c155c00 0x7f785c0ce2c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f785c072e30 tx=0x7f784c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b5d83280362238 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:46.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f7859600640 1 -- 172.21.15.16:0/2635521383 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c0b5070 con 0x7f785c155c00 2024-04-26T20:20:46.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f7859600640 1 -- 172.21.15.16:0/2635521383 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784c0a89d0 con 0x7f785c155c00 2024-04-26T20:20:46.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f7859600640 1 -- 172.21.15.16:0/2635521383 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c0a8da0 con 0x7f785c155c00 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 -- 172.21.15.16:0/2635521383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c155c00 msgr2=0x7f785c0ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 --2- 172.21.15.16:0/2635521383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c155c00 0x7f785c0ce2c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f785c072e30 tx=0x7f784c01ecd0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 -- 172.21.15.16:0/2635521383 shutdown_connections 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 --2- 172.21.15.16:0/2635521383 >> v2:172.21.15.192:3300/0 conn(0x7f785c0ce800 0x7f785c06fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 --2- 172.21.15.16:0/2635521383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c155c00 0x7f785c0ce2c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 -- 172.21.15.16:0/2635521383 >> 172.21.15.16:0/2635521383 conn(0x7f785c070d40 msgr2=0x7f785c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 -- 172.21.15.16:0/2635521383 shutdown_connections 2024-04-26T20:20:46.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 -- 172.21.15.16:0/2635521383 wait complete. 2024-04-26T20:20:46.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 Processor -- start 2024-04-26T20:20:46.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.258+0000 7f785be00640 1 -- start start 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c0703e0 0x7f785c1f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c0ce800 0x7f785c0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f785c155c00 0x7f785c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f785c15c610 con 0x7f785c0703e0 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f785c15c330 con 0x7f785c0ce800 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f785c15ba40 con 0x7f785c155c00 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c0703e0 0x7f785c1f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:46.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c0703e0 0x7f785c1f1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59424/0 (socket says 172.21.15.16:59424) 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 -- 172.21.15.16:0/3048427630 learned_addr learned my addr 172.21.15.16:0/3048427630 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785a000640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c0ce800 0x7f785c0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785b400640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f785c155c00 0x7f785c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 -- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f785c155c00 msgr2=0x7f785c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f785c155c00 0x7f785c154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 -- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c0ce800 msgr2=0x7f785c0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c0ce800 0x7f785c0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 -- 172.21.15.16:0/3048427630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785c0c6590 con 0x7f785c0703e0 2024-04-26T20:20:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785aa00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c0703e0 0x7f785c1f1290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f784c0b3040 tx=0x7f784c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f7853400640 1 -- 172.21.15.16:0/3048427630 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c0c0070 con 0x7f785c0703e0 2024-04-26T20:20:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f7853400640 1 -- 172.21.15.16:0/3048427630 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784c0b0a50 con 0x7f785c0703e0 2024-04-26T20:20:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f7853400640 1 -- 172.21.15.16:0/3048427630 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c0b5070 con 0x7f785c0703e0 2024-04-26T20:20:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785c0c6870 con 0x7f785c0703e0 2024-04-26T20:20:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785c0c6e30 con 0x7f785c0703e0 2024-04-26T20:20:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.262+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785c0506d0 con 0x7f785c0703e0 2024-04-26T20:20:46.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.266+0000 7f7853400640 1 -- 172.21.15.16:0/3048427630 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f784c0ba3e0 con 0x7f785c0703e0 2024-04-26T20:20:46.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.266+0000 7f7853400640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f783c0683b0 0x7f783c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:46.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.266+0000 7f7853400640 1 -- 172.21.15.16:0/3048427630 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f784c123f50 con 0x7f785c0703e0 2024-04-26T20:20:46.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.266+0000 7f785a000640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f783c0683b0 0x7f783c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:46.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.266+0000 7f785a000640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f783c0683b0 0x7f783c06a870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f785c1f23c0 tx=0x7f7848008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:46.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.270+0000 7f7853400640 1 -- 172.21.15.16:0/3048427630 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f784c018830 con 0x7f785c0703e0 2024-04-26T20:20:46.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f785c0c7e50 con 0x7f785c0703e0 2024-04-26T20:20:46.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f7853400640 1 -- 172.21.15.16:0/3048427630 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7f784c0f3a00 con 0x7f785c0703e0 2024-04-26T20:20:46.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:46.542 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:46.542 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f783c0683b0 msgr2=0x7f783c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f783c0683b0 0x7f783c06a870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f785c1f23c0 tx=0x7f7848008040 comp rx=0 tx=0).stop 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c0703e0 msgr2=0x7f785c1f1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c0703e0 0x7f785c1f1290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f784c0b3040 tx=0x7f784c01ba70 comp rx=0 tx=0).stop 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 shutdown_connections 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f783c0683b0 0x7f783c06a870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f785c155c00 0x7f785c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f785c0ce800 0x7f785c0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 --2- 172.21.15.16:0/3048427630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f785c0703e0 0x7f785c1f1290 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 >> 172.21.15.16:0/3048427630 conn(0x7f785c070d40 msgr2=0x7f785c0c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 shutdown_connections 2024-04-26T20:20:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:46.538+0000 7f785be00640 1 -- 172.21.15.16:0/3048427630 wait complete. 2024-04-26T20:20:46.563 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-26T20:20:48.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:20:48.391 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:20:48.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:48.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.714+0000 7f67f1800640 1 Processor -- start 2024-04-26T20:20:48.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.714+0000 7f67f1800640 1 -- start start 2024-04-26T20:20:48.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67f1800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67ec0c7b80 0x7f67ec0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:48.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67f1800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:48.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67f1800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ec0c99c0 con 0x7f67ec153af0 2024-04-26T20:20:48.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67f1800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f67ec15dec0 con 0x7f67ec0c7b80 2024-04-26T20:20:48.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67f1800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec0ca630 con 0x7f67ec0c9010 2024-04-26T20:20:48.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67ea000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67ec0c7b80 0x7f67ec0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:48.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67ea000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67ec0c7b80 0x7f67ec0c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:47068/0 (socket says 172.21.15.16:47068) 2024-04-26T20:20:48.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67ea000640 1 -- 172.21.15.16:0/940113011 learned_addr learned my addr 172.21.15.16:0/940113011 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:48.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67eb400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:48.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67eaa00640 1 --1- 172.21.15.16:0/940113011 >> v1:172.21.15.192:6789/0 conn(0x7f67ec153af0 0x7f67ec15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:60234/0 (socket says 172.21.15.16:60234) 2024-04-26T20:20:48.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67ea000640 1 -- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 msgr2=0x7f67ec0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:48.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67ea000640 1 --2- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67ea000640 1 -- 172.21.15.16:0/940113011 >> v1:172.21.15.192:6789/0 conn(0x7f67ec153af0 legacy=0x7f67ec15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:48.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67ea000640 1 -- 172.21.15.16:0/940113011 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec0c9d90 con 0x7f67ec0c7b80 2024-04-26T20:20:48.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.718+0000 7f67eb400640 1 --2- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:20:48.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67ea000640 1 --2- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec0c7b80 0x7f67ec0c7f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009870 tx=0x7f67d801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=456c388872377ec4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67e9600640 1 -- 172.21.15.16:0/940113011 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d80b5070 con 0x7f67ec0c7b80 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67e9600640 1 -- 172.21.15.16:0/940113011 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d80a8a50 con 0x7f67ec0c7b80 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67e9600640 1 -- 172.21.15.16:0/940113011 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d80a8e20 con 0x7f67ec0c7b80 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec0c7b80 msgr2=0x7f67ec0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 --2- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec0c7b80 0x7f67ec0c7f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009870 tx=0x7f67d801ed50 comp rx=0 tx=0).stop 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- 172.21.15.16:0/940113011 shutdown_connections 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 --2- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 --2- 172.21.15.16:0/940113011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec0c7b80 0x7f67ec0c7f80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- 172.21.15.16:0/940113011 >> 172.21.15.16:0/940113011 conn(0x7f67ec06c380 msgr2=0x7f67ec06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:48.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- 172.21.15.16:0/940113011 shutdown_connections 2024-04-26T20:20:48.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- 172.21.15.16:0/940113011 wait complete. 2024-04-26T20:20:48.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 Processor -- start 2024-04-26T20:20:48.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- start start 2024-04-26T20:20:48.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ec0c7b80 0x7f67ec158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:48.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:48.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec153af0 0x7f67ec1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:48.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec15cfb0 con 0x7f67ec0c7b80 2024-04-26T20:20:48.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec0ca350 con 0x7f67ec153af0 2024-04-26T20:20:48.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67f1800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f67ec15d290 con 0x7f67ec0c9010 2024-04-26T20:20:48.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.722+0000 7f67eaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ec0c7b80 0x7f67ec158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ec0c7b80 0x7f67ec158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59436/0 (socket says 172.21.15.16:59436) 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 -- 172.21.15.16:0/2191173334 learned_addr learned my addr 172.21.15.16:0/2191173334 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67ea000640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eb400640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec153af0 0x7f67ec1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 -- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 msgr2=0x7f67ec1f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec1f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 -- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec153af0 msgr2=0x7f67ec1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec153af0 0x7f67ec1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 -- 172.21.15.16:0/2191173334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec157810 con 0x7f67ec0c7b80 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67ea000640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec1f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67eaa00640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ec0c7b80 0x7f67ec158b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00c430 tx=0x7f67dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:48.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67e2a00640 1 -- 172.21.15.16:0/2191173334 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0074e0 con 0x7f67ec0c7b80 2024-04-26T20:20:48.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67e2a00640 1 -- 172.21.15.16:0/2191173334 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc007680 con 0x7f67ec0c7b80 2024-04-26T20:20:48.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67e2a00640 1 -- 172.21.15.16:0/2191173334 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004a10 con 0x7f67ec0c7b80 2024-04-26T20:20:48.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec157af0 con 0x7f67ec0c7b80 2024-04-26T20:20:48.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec1580b0 con 0x7f67ec0c7b80 2024-04-26T20:20:48.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ec077c20 con 0x7f67ec0c7b80 2024-04-26T20:20:48.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.726+0000 7f67e2a00640 1 -- 172.21.15.16:0/2191173334 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67dc01a020 con 0x7f67ec0c7b80 2024-04-26T20:20:48.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.730+0000 7f67e2a00640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f67cc068380 0x7f67cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:48.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.730+0000 7f67e2a00640 1 -- 172.21.15.16:0/2191173334 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6907+0+0 (secure 0 0 0) 0x7f67dc086630 con 0x7f67ec0c7b80 2024-04-26T20:20:48.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.730+0000 7f67ea000640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f67cc068380 0x7f67cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:48.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.730+0000 7f67ea000640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f67cc068380 0x7f67cc06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f67d80b2000 tx=0x7f67d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:48.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.734+0000 7f67e2a00640 1 -- 172.21.15.16:0/2191173334 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f67dc056730 con 0x7f67ec0c7b80 2024-04-26T20:20:48.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.930+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67ec073850 con 0x7f67ec0c7b80 2024-04-26T20:20:48.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67e2a00640 1 -- 172.21.15.16:0/2191173334 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6880 (secure 0 0 0) 0x7f67dc056030 con 0x7f67ec0c7b80 2024-04-26T20:20:48.936 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:48.937 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:19:21.216071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4276,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/1882507975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1882507975},{"type":"v1","addr":"172.21.15.16:6836","nonce":1882507975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279,4276]},"id":1}]} 2024-04-26T20:20:48.937 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 26 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f67cc068380 msgr2=0x7f67cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f67cc068380 0x7f67cc06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f67d80b2000 tx=0x7f67d8008040 comp rx=0 tx=0).stop 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ec0c7b80 msgr2=0x7f67ec158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ec0c7b80 0x7f67ec158b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00c430 tx=0x7f67dc00c8f0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 shutdown_connections 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f67cc068380 0x7f67cc06a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67ec153af0 0x7f67ec1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67ec0c9010 0x7f67ec1f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 --2- 172.21.15.16:0/2191173334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ec0c7b80 0x7f67ec158b90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 >> 172.21.15.16:0/2191173334 conn(0x7f67ec06c380 msgr2=0x7f67ec0759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 shutdown_connections 2024-04-26T20:20:48.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:48.934+0000 7f67f1800640 1 -- 172.21.15.16:0/2191173334 wait complete. 2024-04-26T20:20:48.958 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-26T20:20:50.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:51.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae08600640 1 Processor -- start 2024-04-26T20:20:51.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae08600640 1 -- start start 2024-04-26T20:20:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae08600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000b47e0 0x7fae0006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae08600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae000c63f0 0x7fae000703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae08600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae000cb7f0 con 0x7fae001574b0 2024-04-26T20:20:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae08600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fae000ccd80 con 0x7fae000c63f0 2024-04-26T20:20:51.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae08600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fae000c9e80 con 0x7fae000b47e0 2024-04-26T20:20:51.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae05200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000b47e0 0x7fae0006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae05200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000b47e0 0x7fae0006feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:50240/0 (socket says 172.21.15.16:50240) 2024-04-26T20:20:51.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae05200640 1 -- 172.21.15.16:0/394565343 learned_addr learned my addr 172.21.15.16:0/394565343 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:51.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae06600640 1 --2- 172.21.15.16:0/394565343 >> v2:172.21.15.192:3300/0 conn(0x7fae000c63f0 0x7fae000703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae05200640 1 -- 172.21.15.16:0/394565343 >> v2:172.21.15.192:3300/0 conn(0x7fae000c63f0 msgr2=0x7fae000703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:51.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae05200640 1 --2- 172.21.15.16:0/394565343 >> v2:172.21.15.192:3300/0 conn(0x7fae000c63f0 0x7fae000703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae05200640 1 -- 172.21.15.16:0/394565343 >> v1:172.21.15.192:6789/0 conn(0x7fae001574b0 legacy=0x7fae000ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.102+0000 7fae05200640 1 -- 172.21.15.16:0/394565343 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae000ca0d0 con 0x7fae000b47e0 2024-04-26T20:20:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.106+0000 7fae05200640 1 --2- 172.21.15.16:0/394565343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000b47e0 0x7fae0006feb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadec009870 tx=0x7fadec01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de3991a6b23003b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.106+0000 7fadffe00640 1 -- 172.21.15.16:0/394565343 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec0ab650 con 0x7fae000b47e0 2024-04-26T20:20:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.106+0000 7fadffe00640 1 -- 172.21.15.16:0/394565343 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec0b0070 con 0x7fae000b47e0 2024-04-26T20:20:51.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.106+0000 7fadffe00640 1 -- 172.21.15.16:0/394565343 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec0aba10 con 0x7fae000b47e0 2024-04-26T20:20:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- 172.21.15.16:0/394565343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000b47e0 msgr2=0x7fae0006feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 --2- 172.21.15.16:0/394565343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000b47e0 0x7fae0006feb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadec009870 tx=0x7fadec01c560 comp rx=0 tx=0).stop 2024-04-26T20:20:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- 172.21.15.16:0/394565343 shutdown_connections 2024-04-26T20:20:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 --2- 172.21.15.16:0/394565343 >> v2:172.21.15.192:3300/0 conn(0x7fae000c63f0 0x7fae000703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 --2- 172.21.15.16:0/394565343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000b47e0 0x7fae0006feb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- 172.21.15.16:0/394565343 >> 172.21.15.16:0/394565343 conn(0x7fae00071160 msgr2=0x7fae00068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- 172.21.15.16:0/394565343 shutdown_connections 2024-04-26T20:20:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- 172.21.15.16:0/394565343 wait complete. 2024-04-26T20:20:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 Processor -- start 2024-04-26T20:20:51.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- start start 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae000b47e0 0x7fae000c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000c63f0 0x7fae000c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae001574b0 0x7fae001473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae00166ec0 con 0x7fae000b47e0 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae00166d40 con 0x7fae001574b0 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae08600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fae00167040 con 0x7fae000c63f0 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae000b47e0 0x7fae000c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae000b47e0 0x7fae000c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59444/0 (socket says 172.21.15.16:59444) 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 -- 172.21.15.16:0/2795249790 learned_addr learned my addr 172.21.15.16:0/2795249790 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05200640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000c63f0 0x7fae000c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae06600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae001574b0 0x7fae001473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 -- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000c63f0 msgr2=0x7fae000c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000c63f0 0x7fae000c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 -- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae001574b0 msgr2=0x7fae001473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae001574b0 0x7fae001473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.110+0000 7fae05c00640 1 -- 172.21.15.16:0/2795249790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae000ce2f0 con 0x7fae000b47e0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fae05c00640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae000b47e0 0x7fae000c8510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c370 tx=0x7fadf400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fadfd600640 1 -- 172.21.15.16:0/2795249790 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40052d0 con 0x7fae000b47e0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fadfd600640 1 -- 172.21.15.16:0/2795249790 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf4005470 con 0x7fae000b47e0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fadfd600640 1 -- 172.21.15.16:0/2795249790 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4007260 con 0x7fae000b47e0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae000c78e0 con 0x7fae000b47e0 2024-04-26T20:20:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae000cdd30 con 0x7fae000b47e0 2024-04-26T20:20:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae00077c20 con 0x7fae000b47e0 2024-04-26T20:20:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fadfd600640 1 -- 172.21.15.16:0/2795249790 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fadf4007400 con 0x7fae000b47e0 2024-04-26T20:20:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fadfd600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fade0068380 0x7fade006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fadfd600640 1 -- 172.21.15.16:0/2795249790 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7fadf40862c0 con 0x7fae000b47e0 2024-04-26T20:20:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.114+0000 7fae05200640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fade0068380 0x7fade006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.118+0000 7fae05200640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fade0068380 0x7fade006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fadec0af000 tx=0x7fadec0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.118+0000 7fadfd600640 1 -- 172.21.15.16:0/2795249790 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fae000c78e0 con 0x7fae000b47e0 2024-04-26T20:20:51.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.322+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae00076f90 con 0x7fae000b47e0 2024-04-26T20:20:51.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.322+0000 7fadfd600640 1 -- 172.21.15.16:0/2795249790 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6050 (secure 0 0 0) 0x7fadf4055d10 con 0x7fae000b47e0 2024-04-26T20:20:51.323 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:51.323 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:20:50.864370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,5127]},"id":1}]} 2024-04-26T20:20:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fade0068380 msgr2=0x7fade006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fade0068380 0x7fade006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fadec0af000 tx=0x7fadec0a7000 comp rx=0 tx=0).stop 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae000b47e0 msgr2=0x7fae000c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae000b47e0 0x7fae000c8510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c370 tx=0x7fadf400c830 comp rx=0 tx=0).stop 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 shutdown_connections 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fade0068380 0x7fade006a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae001574b0 0x7fae001473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae000c63f0 0x7fae000c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 --2- 172.21.15.16:0/2795249790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae000b47e0 0x7fae000c8510 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 >> 172.21.15.16:0/2795249790 conn(0x7fae00071160 msgr2=0x7fae000759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 shutdown_connections 2024-04-26T20:20:51.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.326+0000 7fae08600640 1 -- 172.21.15.16:0/2795249790 wait complete. 2024-04-26T20:20:51.343 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c down, removed from mdsmap 2024-04-26T20:20:51.343 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-26T20:20:51.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:51.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.486+0000 7fba99a00640 1 Processor -- start 2024-04-26T20:20:51.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.486+0000 7fba99a00640 1 -- start start 2024-04-26T20:20:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba99a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fba940c7b80 0x7fba940c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba99a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba940c9d90 con 0x7fba94153af0 2024-04-26T20:20:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba99a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba940ca070 con 0x7fba940c9010 2024-04-26T20:20:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba99a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fba9415dec0 con 0x7fba940c7b80 2024-04-26T20:20:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba92a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fba94153af0 0x7fba9415d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40602/0 (socket says 172.21.15.16:40602) 2024-04-26T20:20:51.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba92a00640 1 -- 172.21.15.16:0/160594038 learned_addr learned my addr 172.21.15.16:0/160594038 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:20:51.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba8be00640 1 --2- 172.21.15.16:0/160594038 >> v2:172.21.15.16:3300/0 conn(0x7fba940c7b80 0x7fba940c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba8be00640 1 -- 172.21.15.16:0/160594038 >> v1:172.21.15.192:6789/0 conn(0x7fba940c9010 legacy=0x7fba940c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:51.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba8be00640 1 -- 172.21.15.16:0/160594038 >> v1:172.21.15.16:6789/0 conn(0x7fba94153af0 legacy=0x7fba9415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.490+0000 7fba8be00640 1 -- 172.21.15.16:0/160594038 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba940ca350 con 0x7fba940c7b80 2024-04-26T20:20:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba8be00640 1 --2- 172.21.15.16:0/160594038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c7b80 0x7fba940c7f80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0097c0 tx=0x7fba7c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7db58ba43d7f66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba92000640 1 -- 172.21.15.16:0/160594038 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b2070 con 0x7fba940c7b80 2024-04-26T20:20:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba92000640 1 -- 172.21.15.16:0/160594038 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c0a9070 con 0x7fba940c7b80 2024-04-26T20:20:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba92000640 1 -- 172.21.15.16:0/160594038 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0ad880 con 0x7fba940c7b80 2024-04-26T20:20:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 -- 172.21.15.16:0/160594038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c7b80 msgr2=0x7fba940c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 --2- 172.21.15.16:0/160594038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c7b80 0x7fba940c7f80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0097c0 tx=0x7fba7c01c380 comp rx=0 tx=0).stop 2024-04-26T20:20:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 -- 172.21.15.16:0/160594038 shutdown_connections 2024-04-26T20:20:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 --2- 172.21.15.16:0/160594038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c7b80 0x7fba940c7f80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 -- 172.21.15.16:0/160594038 >> 172.21.15.16:0/160594038 conn(0x7fba9406c380 msgr2=0x7fba9406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 -- 172.21.15.16:0/160594038 shutdown_connections 2024-04-26T20:20:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 -- 172.21.15.16:0/160594038 wait complete. 2024-04-26T20:20:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 Processor -- start 2024-04-26T20:20:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.494+0000 7fba99a00640 1 -- start start 2024-04-26T20:20:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba940c7b80 0x7fba9414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c9010 0x7fba940ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba94153af0 0x7fba940cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba9415d290 con 0x7fba940c9010 2024-04-26T20:20:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba940ca630 con 0x7fba940c7b80 2024-04-26T20:20:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fba94153ed0 con 0x7fba94153af0 2024-04-26T20:20:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c9010 0x7fba940ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c9010 0x7fba940ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59464/0 (socket says 172.21.15.16:59464) 2024-04-26T20:20:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 -- 172.21.15.16:0/150293992 learned_addr learned my addr 172.21.15.16:0/150293992 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba92a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba940c7b80 0x7fba9414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba93400640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba94153af0 0x7fba940cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 -- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba94153af0 msgr2=0x7fba940cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba94153af0 0x7fba940cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 -- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba940c7b80 msgr2=0x7fba9414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba940c7b80 0x7fba9414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 -- 172.21.15.16:0/150293992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba940c99f0 con 0x7fba940c9010 2024-04-26T20:20:51.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8be00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c9010 0x7fba940ccb60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fba7c01aa30 tx=0x7fba7c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8aa00640 1 -- 172.21.15.16:0/150293992 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b2050 con 0x7fba940c9010 2024-04-26T20:20:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8aa00640 1 -- 172.21.15.16:0/150293992 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c0be070 con 0x7fba940c9010 2024-04-26T20:20:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba940731f0 con 0x7fba940c9010 2024-04-26T20:20:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba8aa00640 1 -- 172.21.15.16:0/150293992 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b7b10 con 0x7fba940c9010 2024-04-26T20:20:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba941595f0 con 0x7fba940c9010 2024-04-26T20:20:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.498+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba94077c20 con 0x7fba940c9010 2024-04-26T20:20:51.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.502+0000 7fba8aa00640 1 -- 172.21.15.16:0/150293992 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba7c0ab070 con 0x7fba940c9010 2024-04-26T20:20:51.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.502+0000 7fba8aa00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fba70068380 0x7fba7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:51.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.502+0000 7fba8aa00640 1 -- 172.21.15.16:0/150293992 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7fba7c121940 con 0x7fba940c9010 2024-04-26T20:20:51.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.502+0000 7fba92a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fba70068380 0x7fba7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:51.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.502+0000 7fba92a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fba70068380 0x7fba7006a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba84009fd0 tx=0x7fba8400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:51.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.506+0000 7fba8aa00640 1 -- 172.21.15.16:0/150293992 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba7c015fb0 con 0x7fba940c9010 2024-04-26T20:20:51.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.722+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba9415ccc0 con 0x7fba940c9010 2024-04-26T20:20:51.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.722+0000 7fba8aa00640 1 -- 172.21.15.16:0/150293992 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6050 (secure 0 0 0) 0x7fba7c0f1a70 con 0x7fba940c9010 2024-04-26T20:20:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:51.724 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:20:50.864370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,5127]},"id":1}]} 2024-04-26T20:20:51.724 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fba70068380 msgr2=0x7fba7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fba70068380 0x7fba7006a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba84009fd0 tx=0x7fba8400b040 comp rx=0 tx=0).stop 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c9010 msgr2=0x7fba940ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c9010 0x7fba940ccb60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fba7c01aa30 tx=0x7fba7c01abc0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 shutdown_connections 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fba70068380 0x7fba7006a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba94153af0 0x7fba940cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940c9010 0x7fba940ccb60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 --2- 172.21.15.16:0/150293992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba940c7b80 0x7fba9414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 >> 172.21.15.16:0/150293992 conn(0x7fba9406c380 msgr2=0x7fba9415d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:51.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 shutdown_connections 2024-04-26T20:20:51.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:51.726+0000 7fba99a00640 1 -- 172.21.15.16:0/150293992 wait complete. 2024-04-26T20:20:51.745 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 27, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 27, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4279": { "addr": "172.21.15.16:6837/1962586875", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6835", "nonce": 1962586875, "type": "v2" }, { "addr": "172.21.15.16:6837", "nonce": 1962586875, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4279, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 5 }, "gid_4970": { "addr": "172.21.15.192:6838/3304030586", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6836", "nonce": 3304030586, "type": "v2" }, { "addr": "172.21.15.192:6838", "nonce": 3304030586, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4970, "incarnation": 27, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:replay", "state_seq": 1 }, "gid_5127": { "addr": "172.21.15.16:6833/1748916109", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6832", "nonce": 1748916109, "type": "v2" }, { "addr": "172.21.15.16:6833", "nonce": 1748916109, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5127, "incarnation": 21, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:active", "state_seq": 31 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:20:50.864370+0000", "qdb_cluster": [ 4279, 5127 ], "qdb_leader": 4279, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4279, "mds_1": 4970, "mds_2": 5127 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:20:53.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:53.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.950+0000 7faa08e00640 1 Processor -- start 2024-04-26T20:20:53.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.954+0000 7faa08e00640 1 -- start start 2024-04-26T20:20:53.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.954+0000 7faa08e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa04151cd0 0x7faa0415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:53.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.954+0000 7faa08e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa041520b0 0x7faa04158500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.954+0000 7faa01e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa04151cd0 0x7faa0415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.954+0000 7faa01e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faa04151cd0 0x7faa0415b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:47128/0 (socket says 172.21.15.16:47128) 2024-04-26T20:20:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa01e00640 1 -- 172.21.15.16:0/952636953 learned_addr learned my addr 172.21.15.16:0/952636953 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:53.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa040ca620 con 0x7faa040c82d0 2024-04-26T20:20:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7faa0415b820 con 0x7faa041520b0 2024-04-26T20:20:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7faa0415bb00 con 0x7faa04151cd0 2024-04-26T20:20:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa01400640 1 --2- 172.21.15.16:0/952636953 >> v2:172.21.15.16:3300/0 conn(0x7faa041520b0 0x7faa04158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa01400640 1 -- 172.21.15.16:0/952636953 >> v2:172.21.15.192:3300/0 conn(0x7faa04151cd0 msgr2=0x7faa0415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa01400640 1 --2- 172.21.15.16:0/952636953 >> v2:172.21.15.192:3300/0 conn(0x7faa04151cd0 0x7faa0415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa01400640 1 -- 172.21.15.16:0/952636953 >> v1:172.21.15.16:6789/0 conn(0x7faa040c82d0 legacy=0x7faa040722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:53.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.958+0000 7faa01400640 1 -- 172.21.15.16:0/952636953 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0415bde0 con 0x7faa041520b0 2024-04-26T20:20:53.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.962+0000 7faa01400640 1 --2- 172.21.15.16:0/952636953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa041520b0 0x7faa04158500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faa04070c30 tx=0x7fa9f401fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a95833a1194403 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:53.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.962+0000 7faa00a00640 1 -- 172.21.15.16:0/952636953 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4008be0 con 0x7faa041520b0 2024-04-26T20:20:53.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.962+0000 7faa00a00640 1 -- 172.21.15.16:0/952636953 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4008d80 con 0x7faa041520b0 2024-04-26T20:20:53.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.962+0000 7faa00a00640 1 -- 172.21.15.16:0/952636953 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40a9a70 con 0x7faa041520b0 2024-04-26T20:20:53.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa041520b0 msgr2=0x7faa04158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:53.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 --2- 172.21.15.16:0/952636953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa041520b0 0x7faa04158500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faa04070c30 tx=0x7fa9f401fc40 comp rx=0 tx=0).stop 2024-04-26T20:20:53.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 shutdown_connections 2024-04-26T20:20:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 --2- 172.21.15.16:0/952636953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa041520b0 0x7faa04158500 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 --2- 172.21.15.16:0/952636953 >> v2:172.21.15.192:3300/0 conn(0x7faa04151cd0 0x7faa0415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 >> 172.21.15.16:0/952636953 conn(0x7faa0406c380 msgr2=0x7faa0406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 shutdown_connections 2024-04-26T20:20:53.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 -- 172.21.15.16:0/952636953 wait complete. 2024-04-26T20:20:53.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 Processor -- start 2024-04-26T20:20:53.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.966+0000 7faa08e00640 1 -- start start 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa040c82d0 0x7faa041531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04151cd0 0x7faa040c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa041520b0 0x7faa041f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa04157fe0 con 0x7faa04151cd0 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faa04157d00 con 0x7faa040c82d0 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faa04072d90 con 0x7faa041520b0 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa040c82d0 0x7faa041531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa040c82d0 0x7faa041531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:47138/0 (socket says 172.21.15.16:47138) 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01e00640 1 -- 172.21.15.16:0/2637078178 learned_addr learned my addr 172.21.15.16:0/2637078178 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:53.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa02800640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa041520b0 0x7faa041f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:53.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01400640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04151cd0 0x7faa040c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01400640 1 -- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa041520b0 msgr2=0x7faa041f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01400640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa041520b0 0x7faa041f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01400640 1 -- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa040c82d0 msgr2=0x7faa041531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01400640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa040c82d0 0x7faa041531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01400640 1 -- 172.21.15.16:0/2637078178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa04155310 con 0x7faa04151cd0 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa01400640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04151cd0 0x7faa040c9090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7faa040763c0 tx=0x7fa9f401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7fa9fa000640 1 -- 172.21.15.16:0/2637078178 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40a9a60 con 0x7faa04151cd0 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7fa9fa000640 1 -- 172.21.15.16:0/2637078178 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f40a9c00 con 0x7faa04151cd0 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7fa9fa000640 1 -- 172.21.15.16:0/2637078178 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f400a0d0 con 0x7faa04151cd0 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa040c70c0 con 0x7faa04151cd0 2024-04-26T20:20:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.970+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa04153df0 con 0x7faa04151cd0 2024-04-26T20:20:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.974+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa04154400 con 0x7faa04151cd0 2024-04-26T20:20:53.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.974+0000 7fa9fa000640 1 -- 172.21.15.16:0/2637078178 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa9f40c4020 con 0x7faa04151cd0 2024-04-26T20:20:53.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.982+0000 7fa9fa000640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa9e00683b0 0x7fa9e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:53.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.982+0000 7fa9fa000640 1 -- 172.21.15.16:0/2637078178 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7fa9f4124890 con 0x7faa04151cd0 2024-04-26T20:20:53.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.982+0000 7faa01e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa9e00683b0 0x7fa9e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.986+0000 7faa01e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa9e00683b0 0x7fa9e006a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0094a0 tx=0x7fa9fc009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:53.990+0000 7fa9fa000640 1 -- 172.21.15.16:0/2637078178 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa9f40cb020 con 0x7faa04151cd0 2024-04-26T20:20:54.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa04077c20 con 0x7faa04151cd0 2024-04-26T20:20:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7fa9fa000640 1 -- 172.21.15.16:0/2637078178 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6050 (secure 0 0 0) 0x7fa9f40197a0 con 0x7faa04151cd0 2024-04-26T20:20:54.221 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:54.221 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:20:50.864370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,5127]},"id":1}]} 2024-04-26T20:20:54.222 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 27 2024-04-26T20:20:54.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa9e00683b0 msgr2=0x7fa9e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:54.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa9e00683b0 0x7fa9e006a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0094a0 tx=0x7fa9fc009240 comp rx=0 tx=0).stop 2024-04-26T20:20:54.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04151cd0 msgr2=0x7faa040c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:54.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04151cd0 0x7faa040c9090 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7faa040763c0 tx=0x7fa9f401c9e0 comp rx=0 tx=0).stop 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 shutdown_connections 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa9e00683b0 0x7fa9e006a870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faa041520b0 0x7faa041f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04151cd0 0x7faa040c9090 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 --2- 172.21.15.16:0/2637078178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa040c82d0 0x7faa041531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 >> 172.21.15.16:0/2637078178 conn(0x7faa0406c380 msgr2=0x7faa041564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 shutdown_connections 2024-04-26T20:20:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:54.222+0000 7faa08e00640 1 -- 172.21.15.16:0/2637078178 wait complete. 2024-04-26T20:20:54.242 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:20:56.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:56.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.414+0000 7f193a200640 1 Processor -- start 2024-04-26T20:20:56.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.414+0000 7f193a200640 1 -- start start 2024-04-26T20:20:56.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f193a200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f192c0e71f0 0x7f192c0462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:56.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f193a200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f192c0467e0 0x7f192c04ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:56.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f193a200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192c04c690 con 0x7f192c0dd2c0 2024-04-26T20:20:56.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f193a200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f192c0454e0 con 0x7f192c0467e0 2024-04-26T20:20:56.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f193a200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f192c0457c0 con 0x7f192c0e71f0 2024-04-26T20:20:56.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1933e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f192c0e71f0 0x7f192c0462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:56.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1933e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f192c0e71f0 0x7f192c0462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.16:40008/0 (socket says 172.21.15.16:40008) 2024-04-26T20:20:56.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1933e00640 1 -- 172.21.15.16:0/4227545533 learned_addr learned my addr 172.21.15.16:0/4227545533 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:56.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1939800640 1 --2- 172.21.15.16:0/4227545533 >> v2:172.21.15.16:3300/0 conn(0x7f192c0467e0 0x7f192c04ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:56.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1933e00640 1 -- 172.21.15.16:0/4227545533 >> v2:172.21.15.16:3300/0 conn(0x7f192c0467e0 msgr2=0x7f192c04ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:20:56.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1933e00640 1 --2- 172.21.15.16:0/4227545533 >> v2:172.21.15.16:3300/0 conn(0x7f192c0467e0 0x7f192c04ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1933e00640 1 -- 172.21.15.16:0/4227545533 >> v1:172.21.15.192:6789/0 conn(0x7f192c0dd2c0 legacy=0x7f192c0e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:56.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.418+0000 7f1933e00640 1 -- 172.21.15.16:0/4227545533 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192c045aa0 con 0x7f192c0e71f0 2024-04-26T20:20:56.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.426+0000 7f1933e00640 1 --2- 172.21.15.16:0/4227545533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0e71f0 0x7f192c0462a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f192c00db70 tx=0x7f192001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f964bbc52338298b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:56.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.426+0000 7f1933400640 1 -- 172.21.15.16:0/4227545533 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200b5070 con 0x7f192c0e71f0 2024-04-26T20:20:56.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.426+0000 7f1933400640 1 -- 172.21.15.16:0/4227545533 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19200a8910 con 0x7f192c0e71f0 2024-04-26T20:20:56.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.426+0000 7f1933400640 1 -- 172.21.15.16:0/4227545533 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200a8ce0 con 0x7f192c0e71f0 2024-04-26T20:20:56.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.426+0000 7f193a200640 1 -- 172.21.15.16:0/4227545533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0e71f0 msgr2=0x7f192c0462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:56.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.426+0000 7f193a200640 1 --2- 172.21.15.16:0/4227545533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0e71f0 0x7f192c0462a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f192c00db70 tx=0x7f192001ed10 comp rx=0 tx=0).stop 2024-04-26T20:20:56.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.430+0000 7f193a200640 1 -- 172.21.15.16:0/4227545533 shutdown_connections 2024-04-26T20:20:56.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.430+0000 7f193a200640 1 --2- 172.21.15.16:0/4227545533 >> v2:172.21.15.16:3300/0 conn(0x7f192c0467e0 0x7f192c04ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.430+0000 7f193a200640 1 --2- 172.21.15.16:0/4227545533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0e71f0 0x7f192c0462a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.430+0000 7f193a200640 1 -- 172.21.15.16:0/4227545533 >> 172.21.15.16:0/4227545533 conn(0x7f192c050190 msgr2=0x7f192c0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:56.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.434+0000 7f193a200640 1 -- 172.21.15.16:0/4227545533 shutdown_connections 2024-04-26T20:20:56.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.434+0000 7f193a200640 1 -- 172.21.15.16:0/4227545533 wait complete. 2024-04-26T20:20:56.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.438+0000 7f193a200640 1 Processor -- start 2024-04-26T20:20:56.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.438+0000 7f193a200640 1 -- start start 2024-04-26T20:20:56.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f193a200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f192c0467e0 0x7f192c048650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:56.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f193a200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0dd2c0 0x7f192c048b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:56.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f193a200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192c0e71f0 0x7f192c0d8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:56.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f193a200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f192c0e6e00 con 0x7f192c0e71f0 2024-04-26T20:20:56.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f193a200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f192c04c970 con 0x7f192c0dd2c0 2024-04-26T20:20:56.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f193a200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f192c0e6f80 con 0x7f192c0467e0 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f192c0467e0 0x7f192c048650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f192c0467e0 0x7f192c048650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:55290/0 (socket says 172.21.15.16:55290) 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 -- 172.21.15.16:0/1696784514 learned_addr learned my addr 172.21.15.16:0/1696784514 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1933e00640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0dd2c0 0x7f192c048b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1939800640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192c0e71f0 0x7f192c0d8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 -- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0dd2c0 msgr2=0x7f192c048b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0dd2c0 0x7f192c048b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 -- 172.21.15.16:0/1696784514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192c0e71f0 msgr2=0x7f192c0d8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192c0e71f0 0x7f192c0d8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 -- 172.21.15.16:0/1696784514 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192c1822e0 con 0x7f192c0467e0 2024-04-26T20:20:56.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.442+0000 7f1938e00640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f192c0467e0 0x7f192c048650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f192800c3f0 tx=0x7f192800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.446+0000 7f1930c00640 1 -- 172.21.15.16:0/1696784514 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928017070 con 0x7f192c0467e0 2024-04-26T20:20:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.446+0000 7f1930c00640 1 -- 172.21.15.16:0/1696784514 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19280052d0 con 0x7f192c0467e0 2024-04-26T20:20:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.446+0000 7f1930c00640 1 -- 172.21.15.16:0/1696784514 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928003840 con 0x7f192c0467e0 2024-04-26T20:20:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.446+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192c0475b0 con 0x7f192c0467e0 2024-04-26T20:20:56.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.446+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f192c047b70 con 0x7f192c0467e0 2024-04-26T20:20:56.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.450+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f192c0053a0 con 0x7f192c0467e0 2024-04-26T20:20:56.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.458+0000 7f1930c00640 1 -- 172.21.15.16:0/1696784514 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f192801a070 con 0x7f192c0467e0 2024-04-26T20:20:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.458+0000 7f1930c00640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1914068450 0x7f191406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.458+0000 7f1930c00640 1 -- 172.21.15.16:0/1696784514 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f19280862f0 con 0x7f192c0467e0 2024-04-26T20:20:56.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.458+0000 7f1933e00640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1914068450 0x7f191406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:56.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.458+0000 7f1933e00640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1914068450 0x7f191406a910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f19200b2000 tx=0x7f19200aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:56.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.470+0000 7f1930c00640 1 -- 172.21.15.16:0/1696784514 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1928021080 con 0x7f192c0467e0 2024-04-26T20:20:56.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.794+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f192c04b850 con 0x7f192c0467e0 2024-04-26T20:20:56.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f1930c00640 1 -- 172.21.15.16:0/1696784514 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6052 (secure 0 0 0) 0x7f1928005480 con 0x7f192c0467e0 2024-04-26T20:20:56.796 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:56.796 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:20:55.878888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:resolve","state_seq":25,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279]},"id":1}]} 2024-04-26T20:20:56.797 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-04-26T20:20:56.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1914068450 msgr2=0x7f191406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1914068450 0x7f191406a910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f19200b2000 tx=0x7f19200aa070 comp rx=0 tx=0).stop 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f192c0467e0 msgr2=0x7f192c048650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f192c0467e0 0x7f192c048650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f192800c3f0 tx=0x7f192800c7f0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 shutdown_connections 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f1914068450 0x7f191406a910 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192c0e71f0 0x7f192c0d8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f192c0dd2c0 0x7f192c048b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 --2- 172.21.15.16:0/1696784514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f192c0467e0 0x7f192c048650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 >> 172.21.15.16:0/1696784514 conn(0x7f192c050190 msgr2=0x7f192c04eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 shutdown_connections 2024-04-26T20:20:56.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:56.798+0000 7f193a200640 1 -- 172.21.15.16:0/1696784514 wait complete. 2024-04-26T20:20:56.819 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:20:58.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:20:58.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39d6e00640 1 Processor -- start 2024-04-26T20:20:58.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39d6e00640 1 -- start start 2024-04-26T20:20:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39d6e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39d006c9c0 0x7f39d00c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39d6e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39d015f3f0 con 0x7f39d006c5e0 2024-04-26T20:20:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39d6e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39d015f690 con 0x7f39d00cb970 2024-04-26T20:20:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39d6e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f39d015f930 con 0x7f39d006c9c0 2024-04-26T20:20:58.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39cf400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39d006c9c0 0x7f39d00c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:58.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39cf400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39d006c9c0 0x7f39d00c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37016/0 (socket says 172.21.15.16:37016) 2024-04-26T20:20:58.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39cf400640 1 -- 172.21.15.16:0/1057670338 learned_addr learned my addr 172.21.15.16:0/1057670338 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:58.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39cf400640 1 -- 172.21.15.16:0/1057670338 >> v1:172.21.15.192:6789/0 conn(0x7f39d00cb970 legacy=0x7f39d015c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:58.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39cf400640 1 -- 172.21.15.16:0/1057670338 >> v1:172.21.15.16:6789/0 conn(0x7f39d006c5e0 legacy=0x7f39d0155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:58.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.961+0000 7f39cf400640 1 -- 172.21.15.16:0/1057670338 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d015fc10 con 0x7f39d006c9c0 2024-04-26T20:20:58.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39cf400640 1 --2- 172.21.15.16:0/1057670338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d006c9c0 0x7f39d00c9730 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009870 tx=0x7f39bc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0ad24318bc744 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:58.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39cea00640 1 -- 172.21.15.16:0/1057670338 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0b2070 con 0x7f39d006c9c0 2024-04-26T20:20:58.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39cea00640 1 -- 172.21.15.16:0/1057670338 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc0a9070 con 0x7f39d006c9c0 2024-04-26T20:20:58.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39cea00640 1 -- 172.21.15.16:0/1057670338 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0ad880 con 0x7f39d006c9c0 2024-04-26T20:20:58.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39d6e00640 1 -- 172.21.15.16:0/1057670338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d006c9c0 msgr2=0x7f39d00c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:58.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39d6e00640 1 --2- 172.21.15.16:0/1057670338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d006c9c0 0x7f39d00c9730 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009870 tx=0x7f39bc01c560 comp rx=0 tx=0).stop 2024-04-26T20:20:58.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39d6e00640 1 -- 172.21.15.16:0/1057670338 shutdown_connections 2024-04-26T20:20:58.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39d6e00640 1 --2- 172.21.15.16:0/1057670338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d006c9c0 0x7f39d00c9730 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:58.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39d6e00640 1 -- 172.21.15.16:0/1057670338 >> 172.21.15.16:0/1057670338 conn(0x7f39d0073240 msgr2=0x7f39d0073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:58.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39d6e00640 1 -- 172.21.15.16:0/1057670338 shutdown_connections 2024-04-26T20:20:58.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.965+0000 7f39d6e00640 1 -- 172.21.15.16:0/1057670338 wait complete. 2024-04-26T20:20:58.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 Processor -- start 2024-04-26T20:20:58.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 -- start start 2024-04-26T20:20:58.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d006c5e0 0x7f39d0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:58.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d006c9c0 0x7f39d015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:58.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d00cb970 0x7f39d00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:58.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01565a0 con 0x7f39d00cb970 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0156420 con 0x7f39d006c5e0 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f39d015cbc0 con 0x7f39d006c9c0 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d00cb970 0x7f39d00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d00cb970 0x7f39d00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37024/0 (socket says 172.21.15.16:37024) 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 -- 172.21.15.16:0/4170725027 learned_addr learned my addr 172.21.15.16:0/4170725027 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39cf400640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d006c9c0 0x7f39d015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39cfe00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d006c5e0 0x7f39d0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 -- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d006c9c0 msgr2=0x7f39d015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d006c9c0 0x7f39d015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 -- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d006c5e0 msgr2=0x7f39d0150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d006c5e0 0x7f39d0150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 -- 172.21.15.16:0/4170725027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d01f8d00 con 0x7f39d00cb970 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d4e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d00cb970 0x7f39d00ceac0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f39c800c760 tx=0x7f39c800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:58.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39c7e00640 1 -- 172.21.15.16:0/4170725027 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8003ba0 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39c7e00640 1 -- 172.21.15.16:0/4170725027 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8003d40 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39c7e00640 1 -- 172.21.15.16:0/4170725027 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c800aa90 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d014b460 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.969+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d00ce2c0 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.973+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d0077c20 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.973+0000 7f39c7e00640 1 -- 172.21.15.16:0/4170725027 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39c800ac30 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.973+0000 7f39c7e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f39b00683b0 0x7f39b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.973+0000 7f39c7e00640 1 -- 172.21.15.16:0/4170725027 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f39c8086d80 con 0x7f39d00cb970 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.973+0000 7f39cfe00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f39b00683b0 0x7f39b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:20:58.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.973+0000 7f39cfe00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f39b00683b0 0x7f39b006a870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39c0000f70 tx=0x7f39c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:20:58.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:58.977+0000 7f39c7e00640 1 -- 172.21.15.16:0/4170725027 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f39c8056d90 con 0x7f39d00cb970 2024-04-26T20:20:59.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39d00c5d00 con 0x7f39d00cb970 2024-04-26T20:20:59.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39c7e00640 1 -- 172.21.15.16:0/4170725027 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6052 (secure 0 0 0) 0x7f39c8056690 con 0x7f39d00cb970 2024-04-26T20:20:59.177 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:20:59.177 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:20:55.878888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:resolve","state_seq":25,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279]},"id":1}]} 2024-04-26T20:20:59.177 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-04-26T20:20:59.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f39b00683b0 msgr2=0x7f39b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f39b00683b0 0x7f39b006a870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39c0000f70 tx=0x7f39c0009040 comp rx=0 tx=0).stop 2024-04-26T20:20:59.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d00cb970 msgr2=0x7f39d00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:20:59.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d00cb970 0x7f39d00ceac0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f39c800c760 tx=0x7f39c800cc20 comp rx=0 tx=0).stop 2024-04-26T20:20:59.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 shutdown_connections 2024-04-26T20:20:59.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f39b00683b0 0x7f39b006a870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39d00cb970 0x7f39d00ceac0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d006c9c0 0x7f39d015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 --2- 172.21.15.16:0/4170725027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d006c5e0 0x7f39d0150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:20:59.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 >> 172.21.15.16:0/4170725027 conn(0x7f39d0073240 msgr2=0x7f39d014c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:20:59.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 shutdown_connections 2024-04-26T20:20:59.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:20:59.177+0000 7f39d6e00640 1 -- 172.21.15.16:0/4170725027 wait complete. 2024-04-26T20:20:59.198 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:21:01.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53cce00640 1 Processor -- start 2024-04-26T20:21:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53cce00640 1 -- start start 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53cce00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53c815ca90 0x7f53c8070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53cce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53c80712e0 0x7f53c80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53cce00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c80c9560 con 0x7f53c81594f0 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53cce00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f53c81598d0 con 0x7f53c815ca90 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53cce00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f53c8160240 con 0x7f53c80712e0 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53c5e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f53c81594f0 0x7f53c80c8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50294/0 (socket says 172.21.15.16:50294) 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53c5e00640 1 -- 172.21.15.16:0/1931612147 learned_addr learned my addr 172.21.15.16:0/1931612147 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:01.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.341+0000 7f53bfe00640 1 --2- 172.21.15.16:0/1931612147 >> v2:172.21.15.16:3300/0 conn(0x7f53c815ca90 0x7f53c8070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53c6800640 1 --2- 172.21.15.16:0/1931612147 >> v2:172.21.15.192:3300/0 conn(0x7f53c80712e0 0x7f53c80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53bfe00640 1 -- 172.21.15.16:0/1931612147 >> v2:172.21.15.192:3300/0 conn(0x7f53c80712e0 msgr2=0x7f53c80ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:01.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53bfe00640 1 --2- 172.21.15.16:0/1931612147 >> v2:172.21.15.192:3300/0 conn(0x7f53c80712e0 0x7f53c80ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53bfe00640 1 -- 172.21.15.16:0/1931612147 >> v1:172.21.15.16:6789/0 conn(0x7f53c81594f0 legacy=0x7f53c80c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53bfe00640 1 -- 172.21.15.16:0/1931612147 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c815f6c0 con 0x7f53c815ca90 2024-04-26T20:21:01.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53c5400640 1 -- 172.21.15.16:0/1931612147 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750260054 0 0) 0x7f53c80c9560 con 0x7f53c81594f0 2024-04-26T20:21:01.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53bfe00640 1 --2- 172.21.15.16:0/1931612147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c815ca90 0x7f53c8070da0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f53c806eab0 tx=0x7f53b001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6a6a19810e67b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53c5400640 1 -- 172.21.15.16:0/1931612147 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b00b5070 con 0x7f53c815ca90 2024-04-26T20:21:01.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53c5400640 1 -- 172.21.15.16:0/1931612147 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b00a8970 con 0x7f53c815ca90 2024-04-26T20:21:01.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53c5400640 1 -- 172.21.15.16:0/1931612147 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b00a8d40 con 0x7f53c815ca90 2024-04-26T20:21:01.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53cce00640 1 -- 172.21.15.16:0/1931612147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c815ca90 msgr2=0x7f53c8070da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.345+0000 7f53cce00640 1 --2- 172.21.15.16:0/1931612147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c815ca90 0x7f53c8070da0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f53c806eab0 tx=0x7f53b001ec70 comp rx=0 tx=0).stop 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- 172.21.15.16:0/1931612147 shutdown_connections 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 --2- 172.21.15.16:0/1931612147 >> v2:172.21.15.192:3300/0 conn(0x7f53c80712e0 0x7f53c80ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 --2- 172.21.15.16:0/1931612147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c815ca90 0x7f53c8070da0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- 172.21.15.16:0/1931612147 >> 172.21.15.16:0/1931612147 conn(0x7f53c80ce2c0 msgr2=0x7f53c80ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- 172.21.15.16:0/1931612147 shutdown_connections 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- 172.21.15.16:0/1931612147 wait complete. 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 Processor -- start 2024-04-26T20:21:01.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- start start 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c80712e0 0x7f53c8153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53c81594f0 0x7f53c81e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c815ca90 0x7f53c80c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f53c815ff60 con 0x7f53c80712e0 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f53c815fc80 con 0x7f53c815ca90 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f53c80c9c50 con 0x7f53c81594f0 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c80712e0 0x7f53c8153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c80712e0 0x7f53c8153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37046/0 (socket says 172.21.15.16:37046) 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 -- 172.21.15.16:0/2911332957 learned_addr learned my addr 172.21.15.16:0/2911332957 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:01.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53bfe00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53c81594f0 0x7f53c81e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c6800640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c815ca90 0x7f53c80c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 -- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53c81594f0 msgr2=0x7f53c81e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53c81594f0 0x7f53c81e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 -- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c815ca90 msgr2=0x7f53c80c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c815ca90 0x7f53c80c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 -- 172.21.15.16:0/2911332957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c80c65e0 con 0x7f53c80712e0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53c5e00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c80712e0 0x7f53c8153c70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f53b80011f0 tx=0x7f53b800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53be000640 1 -- 172.21.15.16:0/2911332957 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8018070 con 0x7f53c80712e0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53be000640 1 -- 172.21.15.16:0/2911332957 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b80074e0 con 0x7f53c80712e0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c80c6880 con 0x7f53c80712e0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.349+0000 7f53be000640 1 -- 172.21.15.16:0/2911332957 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8004a10 con 0x7f53c80712e0 2024-04-26T20:21:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.353+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c80cc0c0 con 0x7f53c80712e0 2024-04-26T20:21:01.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.353+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c8077c20 con 0x7f53c80712e0 2024-04-26T20:21:01.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.353+0000 7f53be000640 1 -- 172.21.15.16:0/2911332957 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53b801b070 con 0x7f53c80712e0 2024-04-26T20:21:01.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.353+0000 7f53be000640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f53a40683d0 0x7f53a406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:01.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.353+0000 7f53be000640 1 -- 172.21.15.16:0/2911332957 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f53b8086160 con 0x7f53c80712e0 2024-04-26T20:21:01.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.353+0000 7f53bfe00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f53a40683d0 0x7f53a406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:01.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.357+0000 7f53bfe00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f53a40683d0 0x7f53a406a890 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53b00b2000 tx=0x7f53b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.357+0000 7f53be000640 1 -- 172.21.15.16:0/2911332957 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f53b8055d30 con 0x7f53c80712e0 2024-04-26T20:21:01.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53c80c6a50 con 0x7f53c80712e0 2024-04-26T20:21:01.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53be000640 1 -- 172.21.15.16:0/2911332957 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6052 (secure 0 0 0) 0x7f53b805a030 con 0x7f53c80712e0 2024-04-26T20:21:01.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:01.565 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:20:55.878888+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:resolve","state_seq":25,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279]},"id":1}]} 2024-04-26T20:21:01.565 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 28 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f53a40683d0 msgr2=0x7f53a406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f53a40683d0 0x7f53a406a890 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53b00b2000 tx=0x7f53b0008040 comp rx=0 tx=0).stop 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c80712e0 msgr2=0x7f53c8153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c80712e0 0x7f53c8153c70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f53b80011f0 tx=0x7f53b800c9b0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 shutdown_connections 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f53a40683d0 0x7f53a406a890 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53c815ca90 0x7f53c80c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53c81594f0 0x7f53c81e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 --2- 172.21.15.16:0/2911332957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53c80712e0 0x7f53c8153c70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 >> 172.21.15.16:0/2911332957 conn(0x7f53c80ce2c0 msgr2=0x7f53c8156cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 shutdown_connections 2024-04-26T20:21:01.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:01.565+0000 7f53cce00640 1 -- 172.21.15.16:0/2911332957 wait complete. 2024-04-26T20:21:01.587 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:21:03.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:03.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdcec00640 1 Processor -- start 2024-04-26T20:21:03.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdcec00640 1 -- start start 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdcec00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc8152bc0 0x7efdc80c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdcec00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efdc8073480 0x7efdc80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdcec00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc8152fa0 con 0x7efdc80c9340 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdcec00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7efdc8159790 con 0x7efdc8073480 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdcec00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efdc8158930 con 0x7efdc8152bc0 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdccc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efdc8073480 0x7efdc80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdccc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efdc8073480 0x7efdc80c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37054/0 (socket says 172.21.15.16:37054) 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdccc00640 1 -- 172.21.15.16:0/3715150288 learned_addr learned my addr 172.21.15.16:0/3715150288 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdc7e00640 1 --2- 172.21.15.16:0/3715150288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc8152bc0 0x7efdc80c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdccc00640 1 -- 172.21.15.16:0/3715150288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc8152bc0 msgr2=0x7efdc80c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:03.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdccc00640 1 --2- 172.21.15.16:0/3715150288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc8152bc0 0x7efdc80c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdccc00640 1 -- 172.21.15.16:0/3715150288 >> v1:172.21.15.192:6789/0 conn(0x7efdc80c9340 legacy=0x7efdc8072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.729+0000 7efdccc00640 1 -- 172.21.15.16:0/3715150288 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc8158c10 con 0x7efdc8073480 2024-04-26T20:21:03.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdccc00640 1 --2- 172.21.15.16:0/3715150288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8073480 0x7efdc80c9b60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009e50 tx=0x7efdc001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b1a68c3b972f06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdc7400640 1 -- 172.21.15.16:0/3715150288 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00b4070 con 0x7efdc8073480 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdc7400640 1 -- 172.21.15.16:0/3715150288 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc00af400 con 0x7efdc8073480 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdc7400640 1 -- 172.21.15.16:0/3715150288 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00af7d0 con 0x7efdc8073480 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 -- 172.21.15.16:0/3715150288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8073480 msgr2=0x7efdc80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 --2- 172.21.15.16:0/3715150288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8073480 0x7efdc80c9b60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009e50 tx=0x7efdc001f210 comp rx=0 tx=0).stop 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 -- 172.21.15.16:0/3715150288 shutdown_connections 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 --2- 172.21.15.16:0/3715150288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8073480 0x7efdc80c9b60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 --2- 172.21.15.16:0/3715150288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc8152bc0 0x7efdc80c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 -- 172.21.15.16:0/3715150288 >> 172.21.15.16:0/3715150288 conn(0x7efdc806c380 msgr2=0x7efdc806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 -- 172.21.15.16:0/3715150288 shutdown_connections 2024-04-26T20:21:03.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.733+0000 7efdcec00640 1 -- 172.21.15.16:0/3715150288 wait complete. 2024-04-26T20:21:03.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 Processor -- start 2024-04-26T20:21:03.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 -- start start 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc8073480 0x7efdc81f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc80c9340 0x7efdc80c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8152bc0 0x7efdc815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81594b0 con 0x7efdc8152bc0 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81591d0 con 0x7efdc8073480 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efdc80c47d0 con 0x7efdc80c9340 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8152bc0 0x7efdc815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8152bc0 0x7efdc815adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37068/0 (socket says 172.21.15.16:37068) 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 -- 172.21.15.16:0/3258326042 learned_addr learned my addr 172.21.15.16:0/3258326042 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdbfe00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc80c9340 0x7efdc80c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdc7e00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc8073480 0x7efdc81f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 -- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc80c9340 msgr2=0x7efdc80c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc80c9340 0x7efdc80c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 -- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc8073480 msgr2=0x7efdc81f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc8073480 0x7efdc81f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 -- 172.21.15.16:0/3258326042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc81f60d0 con 0x7efdc8152bc0 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdccc00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8152bc0 0x7efdc815adf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efdc001ce40 tx=0x7efdc001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdc4c00640 1 -- 172.21.15.16:0/3258326042 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00b4040 con 0x7efdc8152bc0 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdc4c00640 1 -- 172.21.15.16:0/3258326042 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc00afd30 con 0x7efdc8152bc0 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdc4c00640 1 -- 172.21.15.16:0/3258326042 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0009510 con 0x7efdc8152bc0 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc81441d0 con 0x7efdc8152bc0 2024-04-26T20:21:03.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.737+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc8144790 con 0x7efdc8152bc0 2024-04-26T20:21:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.741+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc8077c20 con 0x7efdc8152bc0 2024-04-26T20:21:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.741+0000 7efdc4c00640 1 -- 172.21.15.16:0/3258326042 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efdc00c2020 con 0x7efdc8152bc0 2024-04-26T20:21:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.741+0000 7efdc4c00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efda40683b0 0x7efda406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:03.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.741+0000 7efdc4c00640 1 -- 172.21.15.16:0/3258326042 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7efdc0124940 con 0x7efdc8152bc0 2024-04-26T20:21:03.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.741+0000 7efdc7e00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efda40683b0 0x7efda406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:03.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.741+0000 7efdc7e00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efda40683b0 0x7efda406a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b930 tx=0x7efdb8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:03.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.745+0000 7efdc4c00640 1 -- 172.21.15.16:0/3258326042 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efdc00c9020 con 0x7efdc8152bc0 2024-04-26T20:21:03.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.969+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdc80c4320 con 0x7efdc8152bc0 2024-04-26T20:21:03.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.969+0000 7efdc4c00640 1 -- 172.21.15.16:0/3258326042 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6054 (secure 0 0 0) 0x7efdc0018d70 con 0x7efdc8152bc0 2024-04-26T20:21:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:03.971 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:01.263445+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,5127]},"id":1}]} 2024-04-26T20:21:03.971 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 29 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efda40683b0 msgr2=0x7efda406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efda40683b0 0x7efda406a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b930 tx=0x7efdb8008040 comp rx=0 tx=0).stop 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8152bc0 msgr2=0x7efdc815adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8152bc0 0x7efdc815adf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efdc001ce40 tx=0x7efdc001bfb0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 shutdown_connections 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7efda40683b0 0x7efda406a870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdc8152bc0 0x7efdc815adf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdc80c9340 0x7efdc80c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 --2- 172.21.15.16:0/3258326042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdc8073480 0x7efdc81f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 >> 172.21.15.16:0/3258326042 conn(0x7efdc806c380 msgr2=0x7efdc80c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:03.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 shutdown_connections 2024-04-26T20:21:03.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:03.973+0000 7efdcec00640 1 -- 172.21.15.16:0/3258326042 wait complete. 2024-04-26T20:21:03.992 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 29, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 29, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4279": { "addr": "172.21.15.16:6837/1962586875", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6835", "nonce": 1962586875, "type": "v2" }, { "addr": "172.21.15.16:6837", "nonce": 1962586875, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4279, "incarnation": 4, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:active", "state_seq": 5 }, "gid_4970": { "addr": "172.21.15.192:6838/3304030586", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6836", "nonce": 3304030586, "type": "v2" }, { "addr": "172.21.15.192:6838", "nonce": 3304030586, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4970, "incarnation": 27, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:reconnect", "state_seq": 27 }, "gid_5127": { "addr": "172.21.15.16:6833/1748916109", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6832", "nonce": 1748916109, "type": "v2" }, { "addr": "172.21.15.16:6833", "nonce": 1748916109, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5127, "incarnation": 21, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:active", "state_seq": 31 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:21:01.263445+0000", "qdb_cluster": [ 4279, 5127 ], "qdb_leader": 4279, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4279, "mds_1": 4970, "mds_2": 5127 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:21:05.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85ae600640 1 Processor -- start 2024-04-26T20:21:06.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85ae600640 1 -- start start 2024-04-26T20:21:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85ae600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85a8155ee0 0x7f85a806d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85ae600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a8070380 con 0x7f85a806e440 2024-04-26T20:21:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85ae600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a8070660 con 0x7f85a815fbb0 2024-04-26T20:21:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85ae600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f85a8070940 con 0x7f85a8155ee0 2024-04-26T20:21:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a7e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f85a806e440 0x7f85a80c4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41786/0 (socket says 172.21.15.16:41786) 2024-04-26T20:21:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a7e00640 1 -- 172.21.15.16:0/1141656041 learned_addr learned my addr 172.21.15.16:0/1141656041 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:06.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a7400640 1 --2- 172.21.15.16:0/1141656041 >> v2:172.21.15.192:3300/0 conn(0x7f85a8155ee0 0x7f85a806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621615774 0 0) 0x7f85a8070380 con 0x7f85a806e440 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f858c003530 con 0x7f85a806e440 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225765375 0 0) 0x7f85a8070660 con 0x7f85a815fbb0 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85a8070380 con 0x7f85a815fbb0 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2548921065 0 0) 0x7f858c003530 con 0x7f85a806e440 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 >> v2:172.21.15.192:3300/0 conn(0x7f85a8155ee0 msgr2=0x7f85a806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 --2- 172.21.15.16:0/1141656041 >> v2:172.21.15.192:3300/0 conn(0x7f85a8155ee0 0x7f85a806d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 >> v1:172.21.15.192:6789/0 conn(0x7f85a815fbb0 legacy=0x7f85a806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a8070c20 con 0x7f85a806e440 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f85a0001a00 con 0x7f85a806e440 2024-04-26T20:21:06.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 >> v1:172.21.15.16:6789/0 conn(0x7f85a806e440 legacy=0x7f85a80c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f858c003ba0 0x7f858c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c004810 0x7f858c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f858c0051d0 0x7f858c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85a8070940 con 0x7f858c0051d0 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f858c00c0a0 con 0x7f858c004810 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.137+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f858c00c2a0 con 0x7f858c003ba0 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f858c0051d0 0x7f858c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f859fe00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c004810 0x7f858c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7400640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f858c003ba0 0x7f858c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 -- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f858c003ba0 msgr2=0x7f858c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f858c003ba0 0x7f858c003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 -- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c004810 msgr2=0x7f858c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c004810 0x7f858c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 -- 172.21.15.16:0/1141656041 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c003530 con 0x7f858c0051d0 2024-04-26T20:21:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 -- 172.21.15.16:0/1141656041 reap_dead start 2024-04-26T20:21:06.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.141+0000 7f85a7e00640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f858c0051d0 0x7f858c00b9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f85a000a730 tx=0x7f85a001f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8981bc38a2d3aa6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a000a350 con 0x7f858c0051d0 2024-04-26T20:21:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a00ac450 con 0x7f858c0051d0 2024-04-26T20:21:06.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85a6a00640 1 -- 172.21.15.16:0/1141656041 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a00ac860 con 0x7f858c0051d0 2024-04-26T20:21:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- 172.21.15.16:0/1141656041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f858c0051d0 msgr2=0x7f858c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f858c0051d0 0x7f858c00b9d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f85a000a730 tx=0x7f85a001f9a0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- 172.21.15.16:0/1141656041 shutdown_connections 2024-04-26T20:21:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 --2- 172.21.15.16:0/1141656041 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f858c0051d0 0x7f858c00b9d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- 172.21.15.16:0/1141656041 >> 172.21.15.16:0/1141656041 conn(0x7f85a8071f60 msgr2=0x7f85a8072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- 172.21.15.16:0/1141656041 shutdown_connections 2024-04-26T20:21:06.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- 172.21.15.16:0/1141656041 wait complete. 2024-04-26T20:21:06.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 Processor -- start 2024-04-26T20:21:06.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- start start 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c0051d0 0x7f85a815f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85a814b890 0x7f85a80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85a80cf4d0 0x7f85a814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85a80701a0 con 0x7f85a814b890 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f85a806da60 con 0x7f858c0051d0 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85ae600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f85a81562c0 con 0x7f85a80cf4d0 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f859fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85a814b890 0x7f85a80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f859fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85a814b890 0x7f85a80cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39956/0 (socket says 172.21.15.16:39956) 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f859fe00640 1 -- 172.21.15.16:0/2495545944 learned_addr learned my addr 172.21.15.16:0/2495545944 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85a7e00640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85a80cf4d0 0x7f85a814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.145+0000 7f85a7400640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c0051d0 0x7f85a815f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859fe00640 1 -- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85a80cf4d0 msgr2=0x7f85a814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859fe00640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85a80cf4d0 0x7f85a814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859fe00640 1 -- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c0051d0 msgr2=0x7f85a815f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859fe00640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c0051d0 0x7f85a815f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859fe00640 1 -- 172.21.15.16:0/2495545944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a80cffc0 con 0x7f85a814b890 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f85a7400640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c0051d0 0x7f85a815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:06.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859fe00640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85a814b890 0x7f85a80cef90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f859000f7a0 tx=0x7f859000fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:06.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859f400640 1 -- 172.21.15.16:0/2495545944 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859001a070 con 0x7f85a814b890 2024-04-26T20:21:06.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859f400640 1 -- 172.21.15.16:0/2495545944 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8590005110 con 0x7f85a814b890 2024-04-26T20:21:06.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a8151e00 con 0x7f85a814b890 2024-04-26T20:21:06.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859f400640 1 -- 172.21.15.16:0/2495545944 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85900067e0 con 0x7f85a814b890 2024-04-26T20:21:06.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a80cd660 con 0x7f85a814b890 2024-04-26T20:21:06.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a8077c20 con 0x7f85a814b890 2024-04-26T20:21:06.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859f400640 1 -- 172.21.15.16:0/2495545944 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f859001d070 con 0x7f85a814b890 2024-04-26T20:21:06.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859f400640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8584068380 0x7f858406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:06.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f859f400640 1 -- 172.21.15.16:0/2495545944 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f8590086670 con 0x7f85a814b890 2024-04-26T20:21:06.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.149+0000 7f85a7400640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8584068380 0x7f858406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:06.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.153+0000 7f85a7400640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8584068380 0x7f858406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8598009b60 tx=0x7f8598008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:06.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.153+0000 7f859f400640 1 -- 172.21.15.16:0/2495545944 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8590056790 con 0x7f85a814b890 2024-04-26T20:21:06.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.357+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85a814ef40 con 0x7f85a814b890 2024-04-26T20:21:06.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.357+0000 7f859f400640 1 -- 172.21.15.16:0/2495545944 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6054 (secure 0 0 0) 0x7f8590056090 con 0x7f85a814b890 2024-04-26T20:21:06.358 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:06.358 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:01.263445+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:reconnect","state_seq":27,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,5127]},"id":1}]} 2024-04-26T20:21:06.359 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 29 2024-04-26T20:21:06.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.357+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8584068380 msgr2=0x7f858406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:06.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.357+0000 7f85ae600640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8584068380 0x7f858406a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8598009b60 tx=0x7f8598008040 comp rx=0 tx=0).stop 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85a814b890 msgr2=0x7f85a80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85a814b890 0x7f85a80cef90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f859000f7a0 tx=0x7f859000fba0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 shutdown_connections 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8584068380 0x7f858406a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85a80cf4d0 0x7f85a814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85a814b890 0x7f85a80cef90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 --2- 172.21.15.16:0/2495545944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858c0051d0 0x7f85a815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 >> 172.21.15.16:0/2495545944 conn(0x7f85a8071f60 msgr2=0x7f85a80b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 shutdown_connections 2024-04-26T20:21:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:06.361+0000 7f85ae600640 1 -- 172.21.15.16:0/2495545944 wait complete. 2024-04-26T20:21:06.379 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:21:08.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:08.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b1a800640 1 Processor -- start 2024-04-26T20:21:08.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b1a800640 1 -- start start 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b1a800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 0x7f2b14073190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b1a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b140c9b60 0x7f2b140c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b1a800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b14152fa0 con 0x7f2b14152bc0 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b1a800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f2b14159790 con 0x7f2b140c9b60 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b1a800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2b14158930 con 0x7f2b14072d70 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b13400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2b14152bc0 0x7f2b140c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41788/0 (socket says 172.21.15.16:41788) 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b13400640 1 -- 172.21.15.16:0/1281256408 learned_addr learned my addr 172.21.15.16:0/1281256408 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b0be00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 0x7f2b14073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b13e00640 1 --2- 172.21.15.16:0/1281256408 >> v2:172.21.15.192:3300/0 conn(0x7f2b140c9b60 0x7f2b140c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4007684922 0 0) 0x7f2b14152fa0 con 0x7f2b14152bc0 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af8005740 con 0x7f2b14152bc0 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 702578362 0 0) 0x7f2af8005740 con 0x7f2b14152bc0 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 msgr2=0x7f2b14073190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 0x7f2b14073190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 >> v2:172.21.15.192:3300/0 conn(0x7f2b140c9b60 msgr2=0x7f2b140c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 --2- 172.21.15.16:0/1281256408 >> v2:172.21.15.192:3300/0 conn(0x7f2b140c9b60 0x7f2b140c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b14158c10 con 0x7f2b14152bc0 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f2b04001680 con 0x7f2b14152bc0 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b0be00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 0x7f2b14073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 >> v1:172.21.15.16:6789/0 conn(0x7f2b14152bc0 legacy=0x7f2b140c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2af8005bd0 0x7f2af8005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.521+0000 7f2b12a00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 0x7f2af8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b12a00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8006f60 0x7f2af80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14159790 con 0x7f2af8005bd0 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14158930 con 0x7f2af8006f60 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2af800dbe0 con 0x7f2b14072d70 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13400640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2af8005bd0 0x7f2af8005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b0be00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 0x7f2af8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13e00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8006f60 0x7f2af80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13400640 1 -- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 msgr2=0x7f2af8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13400640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b14072d70 0x7f2af8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13400640 1 -- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8006f60 msgr2=0x7f2af80073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13400640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8006f60 0x7f2af80073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13400640 1 -- 172.21.15.16:0/1281256408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af8005740 con 0x7f2af8005bd0 2024-04-26T20:21:08.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13e00640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8006f60 0x7f2af80073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:08.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b13400640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2af8005bd0 0x7f2af8005ff0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c2c0 tx=0x7f2b0401f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743afb96c7ccbe1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:08.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04007d60 con 0x7f2af8005bd0 2024-04-26T20:21:08.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b04005b00 con 0x7f2af8005bd0 2024-04-26T20:21:08.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.525+0000 7f2b12a00640 1 -- 172.21.15.16:0/1281256408 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04007070 con 0x7f2af8005bd0 2024-04-26T20:21:08.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 -- 172.21.15.16:0/1281256408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2af8005bd0 msgr2=0x7f2af8005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 --2- 172.21.15.16:0/1281256408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2af8005bd0 0x7f2af8005ff0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c2c0 tx=0x7f2b0401f4b0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b13e00640 1 -- 172.21.15.16:0/1281256408 reap_dead start 2024-04-26T20:21:08.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 -- 172.21.15.16:0/1281256408 shutdown_connections 2024-04-26T20:21:08.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 -- 172.21.15.16:0/1281256408 >> 172.21.15.16:0/1281256408 conn(0x7f2b1406c380 msgr2=0x7f2b1406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:08.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 -- 172.21.15.16:0/1281256408 shutdown_connections 2024-04-26T20:21:08.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 -- 172.21.15.16:0/1281256408 wait complete. 2024-04-26T20:21:08.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 Processor -- start 2024-04-26T20:21:08.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.529+0000 7f2b1a800640 1 -- start start 2024-04-26T20:21:08.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8005bd0 0x7f2b141e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b140c3ec0 0x7f2b140c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b140c3960 0x7f2b14146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2b141594b0 con 0x7f2b140c3ec0 2024-04-26T20:21:08.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b141591d0 con 0x7f2af8005bd0 2024-04-26T20:21:08.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2b140ca4f0 con 0x7f2b140c3960 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b140c3ec0 0x7f2b140c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b140c3ec0 0x7f2b140c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39972/0 (socket says 172.21.15.16:39972) 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 -- 172.21.15.16:0/962196863 learned_addr learned my addr 172.21.15.16:0/962196863 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b13e00640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b140c3960 0x7f2b14146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b13400640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8005bd0 0x7f2b141e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 -- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b140c3960 msgr2=0x7f2b14146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b140c3960 0x7f2b14146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 -- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8005bd0 msgr2=0x7f2b141e3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8005bd0 0x7f2b141e3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 -- 172.21.15.16:0/962196863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b141f1920 con 0x7f2b140c3ec0 2024-04-26T20:21:08.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b13400640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8005bd0 0x7f2b141e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:08.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0be00640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b140c3ec0 0x7f2b140c3420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0119d0 tx=0x7f2afc011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:08.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0b400640 1 -- 172.21.15.16:0/962196863 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00faf0 con 0x7f2b140c3ec0 2024-04-26T20:21:08.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0b400640 1 -- 172.21.15.16:0/962196863 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2afc00fc90 con 0x7f2b140c3ec0 2024-04-26T20:21:08.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b141f1b90 con 0x7f2b140c3ec0 2024-04-26T20:21:08.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0b400640 1 -- 172.21.15.16:0/962196863 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc004030 con 0x7f2b140c3ec0 2024-04-26T20:21:08.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b141f2150 con 0x7f2b140c3ec0 2024-04-26T20:21:08.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b14077c20 con 0x7f2b140c3ec0 2024-04-26T20:21:08.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.533+0000 7f2b0b400640 1 -- 172.21.15.16:0/962196863 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2afc012040 con 0x7f2b140c3ec0 2024-04-26T20:21:08.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.537+0000 7f2b0b400640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2af00683b0 0x7f2af006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:08.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.537+0000 7f2b0b400640 1 -- 172.21.15.16:0/962196863 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f2afc087270 con 0x7f2b140c3ec0 2024-04-26T20:21:08.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.537+0000 7f2b13400640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2af00683b0 0x7f2af006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:08.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.537+0000 7f2b13400640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2af00683b0 0x7f2af006a870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b040ae000 tx=0x7f2b04001a50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:08.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.541+0000 7f2b0b400640 1 -- 172.21.15.16:0/962196863 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2afc019070 con 0x7f2b140c3ec0 2024-04-26T20:21:08.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b140c9940 con 0x7f2b140c3ec0 2024-04-26T20:21:08.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b0b400640 1 -- 172.21.15.16:0/962196863 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6051 (secure 0 0 0) 0x7f2afc056c30 con 0x7f2b140c3ec0 2024-04-26T20:21:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:08.741 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:07.187547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:rejoin","state_seq":29,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279]},"id":1}]} 2024-04-26T20:21:08.741 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 30 2024-04-26T20:21:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2af00683b0 msgr2=0x7f2af006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2af00683b0 0x7f2af006a870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b040ae000 tx=0x7f2b04001a50 comp rx=0 tx=0).stop 2024-04-26T20:21:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b140c3ec0 msgr2=0x7f2b140c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b140c3ec0 0x7f2b140c3420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0119d0 tx=0x7f2afc011e90 comp rx=0 tx=0).stop 2024-04-26T20:21:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 shutdown_connections 2024-04-26T20:21:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2af00683b0 0x7f2af006a870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b140c3960 0x7f2b14146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b140c3ec0 0x7f2b140c3420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 --2- 172.21.15.16:0/962196863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2af8005bd0 0x7f2b141e3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 >> 172.21.15.16:0/962196863 conn(0x7f2b1406c380 msgr2=0x7f2b140c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 shutdown_connections 2024-04-26T20:21:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:08.741+0000 7f2b1a800640 1 -- 172.21.15.16:0/962196863 wait complete. 2024-04-26T20:21:08.762 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:21:10.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:10.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.933+0000 7f01c1400640 1 Processor -- start 2024-04-26T20:21:10.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c1400640 1 -- start start 2024-04-26T20:21:10.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c1400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01bc0c5b50 0x7f01bc0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:10.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c1400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0b1d90 0x7f01bc15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:10.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f01bc0cf290 0x7f01bc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:10.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c1400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f01bc0c6470 con 0x7f01bc0c5b50 2024-04-26T20:21:10.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c1400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f01bc070b60 con 0x7f01bc0cf290 2024-04-26T20:21:10.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c1400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f01bc0ca550 con 0x7f01bc0b1d90 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01bc0c5b50 0x7f01bc0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01bc0c5b50 0x7f01bc0c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39986/0 (socket says 172.21.15.16:39986) 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 -- 172.21.15.16:0/1110885000 learned_addr learned my addr 172.21.15.16:0/1110885000 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bb400640 1 --2- 172.21.15.16:0/1110885000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0b1d90 0x7f01bc15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c0a00640 1 --2- 172.21.15.16:0/1110885000 >> v2:172.21.15.192:3300/0 conn(0x7f01bc0cf290 0x7f01bc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 -- 172.21.15.16:0/1110885000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0b1d90 msgr2=0x7f01bc15bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 --2- 172.21.15.16:0/1110885000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0b1d90 0x7f01bc15bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 -- 172.21.15.16:0/1110885000 >> v2:172.21.15.192:3300/0 conn(0x7f01bc0cf290 msgr2=0x7f01bc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 --2- 172.21.15.16:0/1110885000 >> v2:172.21.15.192:3300/0 conn(0x7f01bc0cf290 0x7f01bc0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bbe00640 1 -- 172.21.15.16:0/1110885000 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc070db0 con 0x7f01bc0c5b50 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01bb400640 1 --2- 172.21.15.16:0/1110885000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0b1d90 0x7f01bc15bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:21:10.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.937+0000 7f01c0a00640 1 --2- 172.21.15.16:0/1110885000 >> v2:172.21.15.192:3300/0 conn(0x7f01bc0cf290 0x7f01bc0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:21:10.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01bbe00640 1 --2- 172.21.15.16:0/1110885000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0c5b50 0x7f01bc0c5f30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f01bc070510 tx=0x7f01ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba85140103b717cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:10.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01baa00640 1 -- 172.21.15.16:0/1110885000 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0b1070 con 0x7f01bc0c5b50 2024-04-26T20:21:10.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01baa00640 1 -- 172.21.15.16:0/1110885000 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac0ac630 con 0x7f01bc0c5b50 2024-04-26T20:21:10.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01baa00640 1 -- 172.21.15.16:0/1110885000 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0a8050 con 0x7f01bc0c5b50 2024-04-26T20:21:10.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 -- 172.21.15.16:0/1110885000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0c5b50 msgr2=0x7f01bc0c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:10.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 --2- 172.21.15.16:0/1110885000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0c5b50 0x7f01bc0c5f30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f01bc070510 tx=0x7f01ac01c520 comp rx=0 tx=0).stop 2024-04-26T20:21:10.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 -- 172.21.15.16:0/1110885000 shutdown_connections 2024-04-26T20:21:10.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 --2- 172.21.15.16:0/1110885000 >> v2:172.21.15.192:3300/0 conn(0x7f01bc0cf290 0x7f01bc0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:10.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 --2- 172.21.15.16:0/1110885000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0b1d90 0x7f01bc15bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:10.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 --2- 172.21.15.16:0/1110885000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0c5b50 0x7f01bc0c5f30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:10.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 -- 172.21.15.16:0/1110885000 >> 172.21.15.16:0/1110885000 conn(0x7f01bc06c7b0 msgr2=0x7f01bc068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:10.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 -- 172.21.15.16:0/1110885000 shutdown_connections 2024-04-26T20:21:10.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 -- 172.21.15.16:0/1110885000 wait complete. 2024-04-26T20:21:10.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 Processor -- start 2024-04-26T20:21:10.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.941+0000 7f01c1400640 1 -- start start 2024-04-26T20:21:10.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0b1d90 0x7f01bc0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:10.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc0c5b50 0x7f01bc1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0cf290 0x7f01bc157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc0cafa0 con 0x7f01bc0b1d90 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc0c9d40 con 0x7f01bc0c5b50 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f01bc0cb120 con 0x7f01bc0cf290 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0b1d90 0x7f01bc0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0b1d90 0x7f01bc0b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39996/0 (socket says 172.21.15.16:39996) 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 -- 172.21.15.16:0/1221065383 learned_addr learned my addr 172.21.15.16:0/1221065383 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c0a00640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0cf290 0x7f01bc157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bb400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc0c5b50 0x7f01bc1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 -- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0cf290 msgr2=0x7f01bc157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:10.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0cf290 0x7f01bc157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 -- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc0c5b50 msgr2=0x7f01bc1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc0c5b50 0x7f01bc1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 -- 172.21.15.16:0/1221065383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc155370 con 0x7f01bc0b1d90 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c0a00640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0cf290 0x7f01bc157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bb400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc0c5b50 0x7f01bc1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01bbe00640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0b1d90 0x7f01bc0b3e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0af040 tx=0x7f01ac0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01b3e00640 1 -- 172.21.15.16:0/1221065383 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0bc070 con 0x7f01bc0b1d90 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01b3e00640 1 -- 172.21.15.16:0/1221065383 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ac0ab800 con 0x7f01bc0b1d90 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01bc1547f0 con 0x7f01bc0b1d90 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01b3e00640 1 -- 172.21.15.16:0/1221065383 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0b1070 con 0x7f01bc0b1d90 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01bc154db0 con 0x7f01bc0b1d90 2024-04-26T20:21:10.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01bc0506d0 con 0x7f01bc0b1d90 2024-04-26T20:21:10.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.945+0000 7f01b3e00640 1 -- 172.21.15.16:0/1221065383 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01ac0bf070 con 0x7f01bc0b1d90 2024-04-26T20:21:10.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.949+0000 7f01b3e00640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f019c068380 0x7f019c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:10.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.949+0000 7f01b3e00640 1 -- 172.21.15.16:0/1221065383 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f01ac120aa0 con 0x7f01bc0b1d90 2024-04-26T20:21:10.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.949+0000 7f01bb400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f019c068380 0x7f019c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:10.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.949+0000 7f01bb400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f019c068380 0x7f019c06a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01a8006fd0 tx=0x7f01a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:10.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:10.953+0000 7f01b3e00640 1 -- 172.21.15.16:0/1221065383 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f01ac016110 con 0x7f01bc0b1d90 2024-04-26T20:21:11.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.153+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01bc071430 con 0x7f01bc0b1d90 2024-04-26T20:21:11.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.153+0000 7f01b3e00640 1 -- 172.21.15.16:0/1221065383 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6051 (secure 0 0 0) 0x7f01ac0f0b40 con 0x7f01bc0b1d90 2024-04-26T20:21:11.154 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:11.154 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:07.187547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:rejoin","state_seq":29,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4279]},"id":1}]} 2024-04-26T20:21:11.154 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 30 2024-04-26T20:21:11.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.153+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f019c068380 msgr2=0x7f019c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:11.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.153+0000 7f01c1400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f019c068380 0x7f019c06a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01a8006fd0 tx=0x7f01a8008040 comp rx=0 tx=0).stop 2024-04-26T20:21:11.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0b1d90 msgr2=0x7f01bc0b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:11.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0b1d90 0x7f01bc0b3e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0af040 tx=0x7f01ac0192c0 comp rx=0 tx=0).stop 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 shutdown_connections 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f019c068380 0x7f019c06a840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc0cf290 0x7f01bc157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc0c5b50 0x7f01bc1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 --2- 172.21.15.16:0/1221065383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01bc0b1d90 0x7f01bc0b3e40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 >> 172.21.15.16:0/1221065383 conn(0x7f01bc06c7b0 msgr2=0x7f01bc068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 shutdown_connections 2024-04-26T20:21:11.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:11.157+0000 7f01c1400640 1 -- 172.21.15.16:0/1221065383 wait complete. 2024-04-26T20:21:11.175 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:21:13.089 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-26T20:21:13.089+0000 7f31e9800640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T20:21:13.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:13.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ec5800640 1 Processor -- start 2024-04-26T20:21:13.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ec5800640 1 -- start start 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 0x7f3ec00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ec5800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00c9d90 con 0x7f3ec0153af0 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ec5800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00ca070 con 0x7f3ec00c7b80 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ec5800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec015dec0 con 0x7f3ec00c9720 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ebea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ec0153af0 0x7f3ec015d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41802/0 (socket says 172.21.15.16:41802) 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ebea00640 1 -- 172.21.15.16:0/3325399029 learned_addr learned my addr 172.21.15.16:0/3325399029 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ebf400640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 0x7f3ec00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105831242 0 0) 0x7f3ec00c9d90 con 0x7f3ec0153af0 2024-04-26T20:21:13.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.365+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ea4003530 con 0x7f3ec0153af0 2024-04-26T20:21:13.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2519036423 0 0) 0x7f3ea4003530 con 0x7f3ec0153af0 2024-04-26T20:21:13.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 msgr2=0x7f3ec00c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:13.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 0x7f3ec00c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 >> v1:172.21.15.192:6789/0 conn(0x7f3ec00c7b80 legacy=0x7f3ec00c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:13.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec00ca350 con 0x7f3ec0153af0 2024-04-26T20:21:13.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f3eb0001680 con 0x7f3ec0153af0 2024-04-26T20:21:13.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 >> v1:172.21.15.16:6789/0 conn(0x7f3ec0153af0 legacy=0x7f3ec015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 0x7f3ea40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea4003f30 0x7f3ea4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4004d50 0x7f3ea40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec015dec0 con 0x7f3ea4003f30 2024-04-26T20:21:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea400ba30 con 0x7f3ea4004d50 2024-04-26T20:21:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea400bc30 con 0x7f3ec00c9720 2024-04-26T20:21:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3eb6000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea4003f30 0x7f3ea4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebea00640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 0x7f3ea40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3ebf400640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4004d50 0x7f3ea40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3eb6000640 1 -- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 msgr2=0x7f3ea40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3eb6000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec00c9720 0x7f3ea40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3eb6000640 1 -- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4004d50 msgr2=0x7f3ea40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3eb6000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4004d50 0x7f3ea40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.369+0000 7f3eb6000640 1 -- 172.21.15.16:0/3325399029 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea4003530 con 0x7f3ea4003f30 2024-04-26T20:21:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3eb6000640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea4003f30 0x7f3ea4004810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8001860 tx=0x7f3ea801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27840170f8e5e97f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80b2070 con 0x7f3ea4003f30 2024-04-26T20:21:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea80ad680 con 0x7f3ea4003f30 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebe000640 1 -- 172.21.15.16:0/3325399029 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8001460 con 0x7f3ea4003f30 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- 172.21.15.16:0/3325399029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea4003f30 msgr2=0x7f3ea4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 --2- 172.21.15.16:0/3325399029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea4003f30 0x7f3ea4004810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8001860 tx=0x7f3ea801c440 comp rx=0 tx=0).stop 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebf400640 1 -- 172.21.15.16:0/3325399029 reap_dead start 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- 172.21.15.16:0/3325399029 shutdown_connections 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- 172.21.15.16:0/3325399029 >> 172.21.15.16:0/3325399029 conn(0x7f3ec006c380 msgr2=0x7f3ec006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- 172.21.15.16:0/3325399029 shutdown_connections 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- 172.21.15.16:0/3325399029 wait complete. 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 Processor -- start 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- start start 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4003f30 0x7f3ec01e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec01e61c0 0x7f3ec01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec0154470 0x7f3ec01e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec015d290 con 0x7f3ec0154470 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00ca630 con 0x7f3ea4003f30 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ec5800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec0153ed0 con 0x7f3ec01e61c0 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebf400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec0154470 0x7f3ec01e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebf400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec0154470 0x7f3ec01e5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40014/0 (socket says 172.21.15.16:40014) 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebf400640 1 -- 172.21.15.16:0/2953086995 learned_addr learned my addr 172.21.15.16:0/2953086995 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3ebea00640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4003f30 0x7f3ec01e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.373+0000 7f3eb6000640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec01e61c0 0x7f3ec01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ebf400640 1 -- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec01e61c0 msgr2=0x7f3ec01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ebf400640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec01e61c0 0x7f3ec01555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ebf400640 1 -- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4003f30 msgr2=0x7f3ec01e3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ebf400640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4003f30 0x7f3ec01e3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ebf400640 1 -- 172.21.15.16:0/2953086995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec01e3e40 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ebf400640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec0154470 0x7f3ec01e5490 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8007cf0 tx=0x7f3eb80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3eb7400640 1 -- 172.21.15.16:0/2953086995 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8011e40 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3eb7400640 1 -- 172.21.15.16:0/2953086995 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb801b070 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec01ef2a0 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3eb7400640 1 -- 172.21.15.16:0/2953086995 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80039a0 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec01f35a0 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec0077c20 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3eb7400640 1 -- 172.21.15.16:0/2953086995 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3eb8003b40 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3eb7400640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e9c068380 0x7f3e9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3eb7400640 1 -- 172.21.15.16:0/2953086995 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f3eb8087680 con 0x7f3ec0154470 2024-04-26T20:21:13.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.377+0000 7f3ebea00640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e9c068380 0x7f3e9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.381+0000 7f3ebea00640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e9c068380 0x7f3e9c06a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0000f70 tx=0x7f3eb0000ee0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.381+0000 7f3eb7400640 1 -- 172.21.15.16:0/2953086995 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3eb8025020 con 0x7f3ec0154470 2024-04-26T20:21:13.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ec00c43a0 con 0x7f3ec0154470 2024-04-26T20:21:13.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3eb7400640 1 -- 172.21.15.16:0/2953086995 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6056 (secure 0 0 0) 0x7f3eb8057720 con 0x7f3ec0154470 2024-04-26T20:21:13.589 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:13.589 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4970,5127]},"id":1}]} 2024-04-26T20:21:13.590 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 31 2024-04-26T20:21:13.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e9c068380 msgr2=0x7f3e9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:13.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e9c068380 0x7f3e9c06a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0000f70 tx=0x7f3eb0000ee0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec0154470 msgr2=0x7f3ec01e5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec0154470 0x7f3ec01e5490 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8007cf0 tx=0x7f3eb80115a0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 shutdown_connections 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3e9c068380 0x7f3e9c06a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec0154470 0x7f3ec01e5490 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec01e61c0 0x7f3ec01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 --2- 172.21.15.16:0/2953086995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ea4003f30 0x7f3ec01e3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 >> 172.21.15.16:0/2953086995 conn(0x7f3ec006c380 msgr2=0x7f3ec00c4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 shutdown_connections 2024-04-26T20:21:13.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:13.589+0000 7f3ec5800640 1 -- 172.21.15.16:0/2953086995 wait complete. 2024-04-26T20:21:13.611 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=1, replacing gid=4276 2024-04-26T20:21:13.611 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 5 secs before reviving mds.c 2024-04-26T20:21:18.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:21:18.454 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:21:18.612 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.c 2024-04-26T20:21:18.612 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T20:21:18.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T20:21:18.615 INFO:tasks.ceph.mds.c:Started 2024-04-26T20:21:18.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:18.720 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-04-26T20:21:18.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.789+0000 7f9d37e00640 1 Processor -- start 2024-04-26T20:21:18.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.789+0000 7f9d37e00640 1 -- start start 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.789+0000 7f9d37e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9d300c68c0 0x7f9d3016c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.789+0000 7f9d37e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9d300c8a20 0x7f9d300c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.789+0000 7f9d37e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d3016ce50 con 0x7f9d300c7250 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.789+0000 7f9d37e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9d30072540 con 0x7f9d300c68c0 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.789+0000 7f9d37e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f9d300c8350 con 0x7f9d300c8a20 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.793+0000 7f9d35400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9d300c68c0 0x7f9d3016c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.793+0000 7f9d35400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9d300c68c0 0x7f9d3016c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59760/0 (socket says 172.21.15.16:59760) 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.793+0000 7f9d35400640 1 -- 172.21.15.16:0/3782007869 learned_addr learned my addr 172.21.15.16:0/3782007869 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.793+0000 7f9d2fe00640 1 -- 172.21.15.16:0/3782007869 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 287972821 0 0) 0x7f9d3016ce50 con 0x7f9d300c7250 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.793+0000 7f9d35e00640 1 --2- 172.21.15.16:0/3782007869 >> v2:172.21.15.192:3300/0 conn(0x7f9d300c8a20 0x7f9d300c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.797+0000 7f9d2fe00640 1 -- 172.21.15.16:0/3782007869 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d18003510 con 0x7f9d300c7250 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.797+0000 7f9d35400640 1 -- 172.21.15.16:0/3782007869 >> v2:172.21.15.192:3300/0 conn(0x7f9d300c8a20 msgr2=0x7f9d300c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:18.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.797+0000 7f9d35400640 1 --2- 172.21.15.16:0/3782007869 >> v2:172.21.15.192:3300/0 conn(0x7f9d300c8a20 0x7f9d300c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.797+0000 7f9d35400640 1 -- 172.21.15.16:0/3782007869 >> v1:172.21.15.192:6789/0 conn(0x7f9d300c7250 legacy=0x7f9d30072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:18.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.797+0000 7f9d35400640 1 -- 172.21.15.16:0/3782007869 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d301698b0 con 0x7f9d300c68c0 2024-04-26T20:21:18.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d35400640 1 --2- 172.21.15.16:0/3782007869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d3016c910 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9d300747d0 tx=0x7f9d2401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e7ed2497649439 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:18.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d2fe00640 1 -- 172.21.15.16:0/3782007869 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24008be0 con 0x7f9d300c68c0 2024-04-26T20:21:18.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d2fe00640 1 -- 172.21.15.16:0/3782007869 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d24008d80 con 0x7f9d300c68c0 2024-04-26T20:21:18.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d2fe00640 1 -- 172.21.15.16:0/3782007869 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d240a8a80 con 0x7f9d300c68c0 2024-04-26T20:21:18.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 -- 172.21.15.16:0/3782007869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 msgr2=0x7f9d3016c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:18.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 --2- 172.21.15.16:0/3782007869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d3016c910 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9d300747d0 tx=0x7f9d2401ec70 comp rx=0 tx=0).stop 2024-04-26T20:21:18.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 -- 172.21.15.16:0/3782007869 shutdown_connections 2024-04-26T20:21:18.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 --2- 172.21.15.16:0/3782007869 >> v2:172.21.15.192:3300/0 conn(0x7f9d300c8a20 0x7f9d300c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 --2- 172.21.15.16:0/3782007869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d3016c910 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 -- 172.21.15.16:0/3782007869 >> 172.21.15.16:0/3782007869 conn(0x7f9d3006c380 msgr2=0x7f9d3006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:18.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 -- 172.21.15.16:0/3782007869 shutdown_connections 2024-04-26T20:21:18.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.801+0000 7f9d37e00640 1 -- 172.21.15.16:0/3782007869 wait complete. 2024-04-26T20:21:18.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 Processor -- start 2024-04-26T20:21:18.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 -- start start 2024-04-26T20:21:18.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d300caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:18.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d300c7250 0x7f9d30161160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d300c8a20 0x7f9d300cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9d30168dd0 con 0x7f9d300c68c0 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d30168af0 con 0x7f9d300c7250 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9d301690b0 con 0x7f9d300c8a20 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d300caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d300caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59774/0 (socket says 172.21.15.16:59774) 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 -- 172.21.15.16:0/2288822830 learned_addr learned my addr 172.21.15.16:0/2288822830 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d34a00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d300c7250 0x7f9d30161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35e00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d300c8a20 0x7f9d300cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 -- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d300c8a20 msgr2=0x7f9d300cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d300c8a20 0x7f9d300cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 -- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d300c7250 msgr2=0x7f9d30161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:18.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d300c7250 0x7f9d30161160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:18.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 -- 172.21.15.16:0/2288822830 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d300cb4c0 con 0x7f9d300c68c0 2024-04-26T20:21:18.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d35400640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d300caf80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9d2401c8a0 tx=0x7f9d2400abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:18.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d2d600640 1 -- 172.21.15.16:0/2288822830 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400a0d0 con 0x7f9d300c68c0 2024-04-26T20:21:18.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d2d600640 1 -- 172.21.15.16:0/2288822830 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2400a270 con 0x7f9d300c68c0 2024-04-26T20:21:18.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d301fe190 con 0x7f9d300c68c0 2024-04-26T20:21:18.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d2d600640 1 -- 172.21.15.16:0/2288822830 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400a640 con 0x7f9d300c68c0 2024-04-26T20:21:18.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.805+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d301fe450 con 0x7f9d300c68c0 2024-04-26T20:21:18.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.809+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d30077c20 con 0x7f9d300c68c0 2024-04-26T20:21:18.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.809+0000 7f9d2d600640 1 -- 172.21.15.16:0/2288822830 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d240c1030 con 0x7f9d300c68c0 2024-04-26T20:21:18.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.809+0000 7f9d2d600640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d10068380 0x7f9d1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:18.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.809+0000 7f9d2d600640 1 -- 172.21.15.16:0/2288822830 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f9d241241d0 con 0x7f9d300c68c0 2024-04-26T20:21:18.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.809+0000 7f9d34a00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d10068380 0x7f9d1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:18.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.809+0000 7f9d34a00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d10068380 0x7f9d1006a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d3015fb50 tx=0x7f9d1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:18.813+0000 7f9d2d600640 1 -- 172.21.15.16:0/2288822830 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9d240187d0 con 0x7f9d300c68c0 2024-04-26T20:21:19.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.013+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d300c8800 con 0x7f9d300c68c0 2024-04-26T20:21:19.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.013+0000 7f9d2d600640 1 -- 172.21.15.16:0/2288822830 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6056 (secure 0 0 0) 0x7f9d240afe40 con 0x7f9d300c68c0 2024-04-26T20:21:19.015 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:19.015 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279,4970,5127]},"id":1}]} 2024-04-26T20:21:19.015 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 31 2024-04-26T20:21:19.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d10068380 msgr2=0x7f9d1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:19.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d10068380 0x7f9d1006a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d3015fb50 tx=0x7f9d1c009040 comp rx=0 tx=0).stop 2024-04-26T20:21:19.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 msgr2=0x7f9d300caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:19.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d300caf80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9d2401c8a0 tx=0x7f9d2400abe0 comp rx=0 tx=0).stop 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 shutdown_connections 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d10068380 0x7f9d1006a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d300c8a20 0x7f9d300cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d300c7250 0x7f9d30161160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 --2- 172.21.15.16:0/2288822830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d300c68c0 0x7f9d300caf80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 >> 172.21.15.16:0/2288822830 conn(0x7f9d3006c380 msgr2=0x7f9d30073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 shutdown_connections 2024-04-26T20:21:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:19.017+0000 7f9d37e00640 1 -- 172.21.15.16:0/2288822830 wait complete. 2024-04-26T20:21:19.035 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-26T20:21:21.037 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:21.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6287c00640 1 Processor -- start 2024-04-26T20:21:21.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6287c00640 1 -- start start 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6287c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62800ca410 0x7f62800ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6287c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f628015c580 0x7f6280166640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6287c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62800cb7d0 con 0x7f62800c97f0 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6287c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f62800c83d0 con 0x7f628015c580 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6287c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f62800cad30 con 0x7f62800ca410 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6285c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f628015c580 0x7f6280166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6285c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f628015c580 0x7f6280166640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59780/0 (socket says 172.21.15.16:59780) 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6285c00640 1 -- 172.21.15.16:0/3577683570 learned_addr learned my addr 172.21.15.16:0/3577683570 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:21.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.181+0000 7f6285200640 1 --2- 172.21.15.16:0/3577683570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62800ca410 0x7f62800ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:21.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6285c00640 1 -- 172.21.15.16:0/3577683570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62800ca410 msgr2=0x7f62800ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:21.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6285c00640 1 --2- 172.21.15.16:0/3577683570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62800ca410 0x7f62800ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6285c00640 1 -- 172.21.15.16:0/3577683570 >> v1:172.21.15.192:6789/0 conn(0x7f62800c97f0 legacy=0x7f628015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:21.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6285c00640 1 -- 172.21.15.16:0/3577683570 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62800cba70 con 0x7f628015c580 2024-04-26T20:21:21.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6285c00640 1 --2- 172.21.15.16:0/3577683570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f628015c580 0x7f6280166640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f627801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573bcb1c5039abd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:21.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f627f400640 1 -- 172.21.15.16:0/3577683570 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62780a57f0 con 0x7f628015c580 2024-04-26T20:21:21.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f627f400640 1 -- 172.21.15.16:0/3577683570 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62780a5990 con 0x7f628015c580 2024-04-26T20:21:21.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f627f400640 1 -- 172.21.15.16:0/3577683570 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62780a5d60 con 0x7f628015c580 2024-04-26T20:21:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6287c00640 1 -- 172.21.15.16:0/3577683570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f628015c580 msgr2=0x7f6280166640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6287c00640 1 --2- 172.21.15.16:0/3577683570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f628015c580 0x7f6280166640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f627801ca30 comp rx=0 tx=0).stop 2024-04-26T20:21:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6287c00640 1 -- 172.21.15.16:0/3577683570 shutdown_connections 2024-04-26T20:21:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6287c00640 1 --2- 172.21.15.16:0/3577683570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f628015c580 0x7f6280166640 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6287c00640 1 --2- 172.21.15.16:0/3577683570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62800ca410 0x7f62800ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.185+0000 7f6287c00640 1 -- 172.21.15.16:0/3577683570 >> 172.21.15.16:0/3577683570 conn(0x7f628006c380 msgr2=0x7f628006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- 172.21.15.16:0/3577683570 shutdown_connections 2024-04-26T20:21:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- 172.21.15.16:0/3577683570 wait complete. 2024-04-26T20:21:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 Processor -- start 2024-04-26T20:21:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- start start 2024-04-26T20:21:21.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62800c97f0 0x7f6280149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:21.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62800ca410 0x7f628015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:21.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f628015c580 0x7f62801f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:21.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f62800cd4c0 con 0x7f62800ca410 2024-04-26T20:21:21.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62800cd1e0 con 0x7f62800c97f0 2024-04-26T20:21:21.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f62800ccbe0 con 0x7f628015c580 2024-04-26T20:21:21.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62800ca410 0x7f628015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62800ca410 0x7f628015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59794/0 (socket says 172.21.15.16:59794) 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 -- 172.21.15.16:0/3290034197 learned_addr learned my addr 172.21.15.16:0/3290034197 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6285c00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f628015c580 0x7f62801f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6285200640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62800c97f0 0x7f6280149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 -- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f628015c580 msgr2=0x7f62801f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f628015c580 0x7f62801f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 -- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62800c97f0 msgr2=0x7f6280149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62800c97f0 0x7f6280149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 -- 172.21.15.16:0/3290034197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628015b5c0 con 0x7f62800ca410 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627fe00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62800ca410 0x7f628015b080 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c450 tx=0x7f626c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627cc00640 1 -- 172.21.15.16:0/3290034197 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c016020 con 0x7f62800ca410 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627cc00640 1 -- 172.21.15.16:0/3290034197 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626c0052d0 con 0x7f62800ca410 2024-04-26T20:21:21.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f627cc00640 1 -- 172.21.15.16:0/3290034197 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c007260 con 0x7f62800ca410 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628015b850 con 0x7f62800ca410 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.189+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62801f81e0 con 0x7f62800ca410 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.193+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6280077c20 con 0x7f62800ca410 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.193+0000 7f627cc00640 1 -- 172.21.15.16:0/3290034197 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f626c007400 con 0x7f62800ca410 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.193+0000 7f627cc00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6260068380 0x7f626006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.193+0000 7f627cc00640 1 -- 172.21.15.16:0/3290034197 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f626c086870 con 0x7f62800ca410 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.193+0000 7f6285200640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6260068380 0x7f626006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:21.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.193+0000 7f6285200640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6260068380 0x7f626006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6274009af0 tx=0x7f6274008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:21.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.197+0000 7f627cc00640 1 -- 172.21.15.16:0/3290034197 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f626c020020 con 0x7f62800ca410 2024-04-26T20:21:21.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.401+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62800cc1a0 con 0x7f62800ca410 2024-04-26T20:21:21.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.401+0000 7f627cc00640 1 -- 172.21.15.16:0/3290034197 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7f626c005480 con 0x7f62800ca410 2024-04-26T20:21:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:21.403 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:21.404 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:21.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6260068380 msgr2=0x7f626006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:21.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6260068380 0x7f626006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6274009af0 tx=0x7f6274008040 comp rx=0 tx=0).stop 2024-04-26T20:21:21.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62800ca410 msgr2=0x7f628015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:21.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62800ca410 0x7f628015b080 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c450 tx=0x7f626c00c910 comp rx=0 tx=0).stop 2024-04-26T20:21:21.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 shutdown_connections 2024-04-26T20:21:21.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6260068380 0x7f626006a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f628015c580 0x7f62801f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62800ca410 0x7f628015b080 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 --2- 172.21.15.16:0/3290034197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62800c97f0 0x7f6280149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:21.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 >> 172.21.15.16:0/3290034197 conn(0x7f628006c380 msgr2=0x7f6280072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:21.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 shutdown_connections 2024-04-26T20:21:21.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:21.405+0000 7f6287c00640 1 -- 172.21.15.16:0/3290034197 wait complete. 2024-04-26T20:21:21.424 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c reported in up:standby state 2024-04-26T20:21:21.424 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 16 secs before thrashing 2024-04-26T20:21:37.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff345000640 1 Processor -- start 2024-04-26T20:21:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff345000640 1 -- start start 2024-04-26T20:21:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff345000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff3400c9b60 0x7ff3400c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff345000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff340152fa0 con 0x7ff340072d70 2024-04-26T20:21:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff345000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff340159790 con 0x7ff340152bc0 2024-04-26T20:21:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff345000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7ff340158930 con 0x7ff3400c9b60 2024-04-26T20:21:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff337e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff340072d70 0x7ff3400731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48976/0 (socket says 172.21.15.16:48976) 2024-04-26T20:21:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.569+0000 7ff337e00640 1 -- 172.21.15.16:0/200529499 learned_addr learned my addr 172.21.15.16:0/200529499 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33e800640 1 --2- 172.21.15.16:0/200529499 >> v2:172.21.15.192:3300/0 conn(0x7ff3400c9b60 0x7ff3400c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789135465 0 0) 0x7ff340152fa0 con 0x7ff340072d70 2024-04-26T20:21:37.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff324003530 con 0x7ff340072d70 2024-04-26T20:21:37.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3213889853 0 0) 0x7ff324003530 con 0x7ff340072d70 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 >> v2:172.21.15.192:3300/0 conn(0x7ff3400c9b60 msgr2=0x7ff3400c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 --2- 172.21.15.16:0/200529499 >> v2:172.21.15.192:3300/0 conn(0x7ff3400c9b60 0x7ff3400c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 >> v1:172.21.15.192:6789/0 conn(0x7ff340152bc0 legacy=0x7ff3400c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff340158c10 con 0x7ff340072d70 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7ff328001680 con 0x7ff340072d70 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33e800640 1 --2- 172.21.15.16:0/200529499 >> v2:172.21.15.192:3300/0 conn(0x7ff3400c9b60 0x7ff3400c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 >> v1:172.21.15.16:6789/0 conn(0x7ff340072d70 legacy=0x7ff3400731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3240039c0 0x7ff324003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324004810 0x7ff324004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3240051d0 0x7ff32400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff340158930 con 0x7ff324004810 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff32400c080 con 0x7ff3240039c0 2024-04-26T20:21:37.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff32400c280 con 0x7ff3240051d0 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff337e00640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324004810 0x7ff324004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33de00640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3240039c0 0x7ff324003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33e800640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3240051d0 0x7ff32400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff337e00640 1 -- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3240051d0 msgr2=0x7ff32400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff337e00640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3240051d0 0x7ff32400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff337e00640 1 -- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3240039c0 msgr2=0x7ff324003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff337e00640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3240039c0 0x7ff324003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff337e00640 1 -- 172.21.15.16:0/200529499 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff324003530 con 0x7ff324004810 2024-04-26T20:21:37.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.573+0000 7ff33e800640 1 -- 172.21.15.16:0/200529499 reap_dead start 2024-04-26T20:21:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff337e00640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324004810 0x7ff324004c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c210 tx=0x7ff32801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bd237bf3d673c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328007d40 con 0x7ff324004810 2024-04-26T20:21:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3280a9070 con 0x7ff324004810 2024-04-26T20:21:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff33d400640 1 -- 172.21.15.16:0/200529499 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280a5dc0 con 0x7ff324004810 2024-04-26T20:21:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- 172.21.15.16:0/200529499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324004810 msgr2=0x7ff324004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324004810 0x7ff324004c90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c210 tx=0x7ff32801cc20 comp rx=0 tx=0).stop 2024-04-26T20:21:37.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- 172.21.15.16:0/200529499 shutdown_connections 2024-04-26T20:21:37.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 --2- 172.21.15.16:0/200529499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff324004810 0x7ff324004c90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- 172.21.15.16:0/200529499 >> 172.21.15.16:0/200529499 conn(0x7ff34006c380 msgr2=0x7ff34006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:37.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- 172.21.15.16:0/200529499 shutdown_connections 2024-04-26T20:21:37.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- 172.21.15.16:0/200529499 wait complete. 2024-04-26T20:21:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 Processor -- start 2024-04-26T20:21:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- start start 2024-04-26T20:21:37.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff324004810 0x7ff3400cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff340147560 0x7ff3401469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff34014ce70 0x7ff340146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401594b0 con 0x7ff34014ce70 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3401591d0 con 0x7ff340147560 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.577+0000 7ff345000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff3400c47d0 con 0x7ff324004810 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff34014ce70 0x7ff340146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff34014ce70 0x7ff340146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45352/0 (socket says 172.21.15.16:45352) 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 -- 172.21.15.16:0/408651010 learned_addr learned my addr 172.21.15.16:0/408651010 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33de00640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff324004810 0x7ff3400cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff337e00640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff340147560 0x7ff3401469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 -- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff324004810 msgr2=0x7ff3400cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff324004810 0x7ff3400cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 -- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff340147560 msgr2=0x7ff3401469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff340147560 0x7ff3401469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 -- 172.21.15.16:0/408651010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3401f1920 con 0x7ff34014ce70 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff337e00640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff340147560 0x7ff3401469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff33e800640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff34014ce70 0x7ff340146f30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff3400ca9f0 tx=0x7ff338009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff336000640 1 -- 172.21.15.16:0/408651010 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338011d70 con 0x7ff34014ce70 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff336000640 1 -- 172.21.15.16:0/408651010 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33801b070 con 0x7ff34014ce70 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff336000640 1 -- 172.21.15.16:0/408651010 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3380039a0 con 0x7ff34014ce70 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3401f1c00 con 0x7ff34014ce70 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3401f21c0 con 0x7ff34014ce70 2024-04-26T20:21:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff340077c20 con 0x7ff34014ce70 2024-04-26T20:21:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.581+0000 7ff336000640 1 -- 172.21.15.16:0/408651010 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff338003b40 con 0x7ff34014ce70 2024-04-26T20:21:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.585+0000 7ff336000640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff31c068380 0x7ff31c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.585+0000 7ff336000640 1 -- 172.21.15.16:0/408651010 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7ff338087930 con 0x7ff34014ce70 2024-04-26T20:21:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.585+0000 7ff33de00640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff31c068380 0x7ff31c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:37.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.585+0000 7ff33de00640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff31c068380 0x7ff31c06a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff34006adf0 tx=0x7ff330009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:37.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.589+0000 7ff336000640 1 -- 172.21.15.16:0/408651010 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff3380578b0 con 0x7ff34014ce70 2024-04-26T20:21:37.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.793+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3400c9940 con 0x7ff34014ce70 2024-04-26T20:21:37.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.793+0000 7ff336000640 1 -- 172.21.15.16:0/408651010 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7ff3380571b0 con 0x7ff34014ce70 2024-04-26T20:21:37.795 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:37.795 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:37.795 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:37.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff31c068380 msgr2=0x7ff31c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff31c068380 0x7ff31c06a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff34006adf0 tx=0x7ff330009040 comp rx=0 tx=0).stop 2024-04-26T20:21:37.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff34014ce70 msgr2=0x7ff340146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:37.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff34014ce70 0x7ff340146f30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff3400ca9f0 tx=0x7ff338009f90 comp rx=0 tx=0).stop 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 shutdown_connections 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff31c068380 0x7ff31c06a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff34014ce70 0x7ff340146f30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff340147560 0x7ff3401469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 --2- 172.21.15.16:0/408651010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff324004810 0x7ff3400cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 >> 172.21.15.16:0/408651010 conn(0x7ff34006c380 msgr2=0x7ff340073c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 shutdown_connections 2024-04-26T20:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:37.797+0000 7ff345000640 1 -- 172.21.15.16:0/408651010 wait complete. 2024-04-26T20:21:37.816 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2024-04-26T20:21:37.817 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-26T20:21:37.817 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:21:37.845 INFO:tasks.ceph.mds.e:Stopped 2024-04-26T20:21:37.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:38.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f248d000640 1 Processor -- start 2024-04-26T20:21:38.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f248d000640 1 -- start start 2024-04-26T20:21:38.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f248d000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f248806d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:38.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f248d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f248815fbb0 0x7f248806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:38.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f248d000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2488070380 con 0x7f248806e270 2024-04-26T20:21:38.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f248d000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2488070660 con 0x7f248815fbb0 2024-04-26T20:21:38.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f248d000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2488070940 con 0x7f2488155ee0 2024-04-26T20:21:38.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f247fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f248815fbb0 0x7f248806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:38.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f247fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f248815fbb0 0x7f248806dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45354/0 (socket says 172.21.15.16:45354) 2024-04-26T20:21:38.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f247fe00640 1 -- 172.21.15.16:0/3507743989 learned_addr learned my addr 172.21.15.16:0/3507743989 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:38.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f2485e00640 1 --2- 172.21.15.16:0/3507743989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f248806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:38.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f247fe00640 1 -- 172.21.15.16:0/3507743989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 msgr2=0x7f248806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:38.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f247fe00640 1 --2- 172.21.15.16:0/3507743989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f248806d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f247fe00640 1 -- 172.21.15.16:0/3507743989 >> v1:172.21.15.192:6789/0 conn(0x7f248806e270 legacy=0x7f24880c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:38.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.029+0000 7f247fe00640 1 -- 172.21.15.16:0/3507743989 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2488070c20 con 0x7f248815fbb0 2024-04-26T20:21:38.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f247fe00640 1 --2- 172.21.15.16:0/3507743989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248815fbb0 0x7f248806dd30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec14b654574db639 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:38.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f2485400640 1 -- 172.21.15.16:0/3507743989 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700b2070 con 0x7f248815fbb0 2024-04-26T20:21:38.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f2485400640 1 -- 172.21.15.16:0/3507743989 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24700a9070 con 0x7f248815fbb0 2024-04-26T20:21:38.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f2485400640 1 -- 172.21.15.16:0/3507743989 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700ad880 con 0x7f248815fbb0 2024-04-26T20:21:38.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 -- 172.21.15.16:0/3507743989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248815fbb0 msgr2=0x7f248806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:38.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 --2- 172.21.15.16:0/3507743989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248815fbb0 0x7f248806dd30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247001c560 comp rx=0 tx=0).stop 2024-04-26T20:21:38.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 -- 172.21.15.16:0/3507743989 shutdown_connections 2024-04-26T20:21:38.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 --2- 172.21.15.16:0/3507743989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248815fbb0 0x7f248806dd30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 --2- 172.21.15.16:0/3507743989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f248806d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 -- 172.21.15.16:0/3507743989 >> 172.21.15.16:0/3507743989 conn(0x7f2488071f60 msgr2=0x7f2488072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:38.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 -- 172.21.15.16:0/3507743989 shutdown_connections 2024-04-26T20:21:38.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 -- 172.21.15.16:0/3507743989 wait complete. 2024-04-26T20:21:38.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 Processor -- start 2024-04-26T20:21:38.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.033+0000 7f248d000640 1 -- start start 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248806e270 0x7f24881566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f24880b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248815fbb0 0x7f2488156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24880ca160 con 0x7f248806e270 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24880c9fe0 con 0x7f248815fbb0 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f24880c61b0 con 0x7f2488155ee0 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248806e270 0x7f24881566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248806e270 0x7f24881566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45358/0 (socket says 172.21.15.16:45358) 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 -- 172.21.15.16:0/1288579955 learned_addr learned my addr 172.21.15.16:0/1288579955 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:38.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f247fe00640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f24880b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2486800640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248815fbb0 0x7f2488156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 -- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 msgr2=0x7f24880b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f24880b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 -- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248815fbb0 msgr2=0x7f2488156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248815fbb0 0x7f2488156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 -- 172.21.15.16:0/1288579955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248814caa0 con 0x7f248806e270 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f247fe00640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f24880b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2486800640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248815fbb0 0x7f2488156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f2485e00640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248806e270 0x7f24881566a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f247800d800 tx=0x7f247800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f247e000640 1 -- 172.21.15.16:0/1288579955 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247800b6c0 con 0x7f248806e270 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f247e000640 1 -- 172.21.15.16:0/1288579955 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478019070 con 0x7f248806e270 2024-04-26T20:21:38.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f247e000640 1 -- 172.21.15.16:0/1288579955 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247800bae0 con 0x7f248806e270 2024-04-26T20:21:38.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248814cd80 con 0x7f248806e270 2024-04-26T20:21:38.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248814d340 con 0x7f248806e270 2024-04-26T20:21:38.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2488077c20 con 0x7f248806e270 2024-04-26T20:21:38.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.037+0000 7f247e000640 1 -- 172.21.15.16:0/1288579955 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f247800bc80 con 0x7f248806e270 2024-04-26T20:21:38.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.041+0000 7f247e000640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2464068380 0x7f246406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:38.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.041+0000 7f247e000640 1 -- 172.21.15.16:0/1288579955 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f2478087490 con 0x7f248806e270 2024-04-26T20:21:38.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.041+0000 7f247fe00640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2464068380 0x7f246406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:38.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.041+0000 7f247fe00640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2464068380 0x7f246406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f24700af000 tx=0x7f2470008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:38.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.045+0000 7f247e000640 1 -- 172.21.15.16:0/1288579955 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2478057530 con 0x7f248806e270 2024-04-26T20:21:38.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.245+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24880caa80 con 0x7f248806e270 2024-04-26T20:21:38.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.245+0000 7f247e000640 1 -- 172.21.15.16:0/1288579955 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7f2478056e30 con 0x7f248806e270 2024-04-26T20:21:38.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:38.248 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:38.248 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:38.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2464068380 msgr2=0x7f246406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:38.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2464068380 0x7f246406a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f24700af000 tx=0x7f2470008040 comp rx=0 tx=0).stop 2024-04-26T20:21:38.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248806e270 msgr2=0x7f24881566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:38.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248806e270 0x7f24881566a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f247800d800 tx=0x7f247800dcc0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 shutdown_connections 2024-04-26T20:21:38.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2464068380 0x7f246406a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f248815fbb0 0x7f2488156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2488155ee0 0x7f24880b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 --2- 172.21.15.16:0/1288579955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f248806e270 0x7f24881566a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:38.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 >> 172.21.15.16:0/1288579955 conn(0x7f2488071f60 msgr2=0x7f24880759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:38.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 shutdown_connections 2024-04-26T20:21:38.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:38.249+0000 7f248d000640 1 -- 172.21.15.16:0/1288579955 wait complete. 2024-04-26T20:21:38.269 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-26T20:21:40.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:40.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b1ba00640 1 Processor -- start 2024-04-26T20:21:40.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b1ba00640 1 -- start start 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b1ba00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9b14155ee0 0x7f9b1406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b1ba00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b1406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b1ba00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b14070380 con 0x7f9b1406e270 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b1ba00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9b14070660 con 0x7f9b14155ee0 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b1ba00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9b14070940 con 0x7f9b1415fbb0 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.421+0000 7f9b19000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9b14155ee0 0x7f9b1406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b19000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9b14155ee0 0x7f9b1406d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45362/0 (socket says 172.21.15.16:45362) 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b19000640 1 -- 172.21.15.16:0/1286547393 learned_addr learned my addr 172.21.15.16:0/1286547393 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b13e00640 1 --2- 172.21.15.16:0/1286547393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b1406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b19000640 1 -- 172.21.15.16:0/1286547393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 msgr2=0x7f9b1406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b19000640 1 --2- 172.21.15.16:0/1286547393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b1406dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b19000640 1 -- 172.21.15.16:0/1286547393 >> v1:172.21.15.192:6789/0 conn(0x7f9b1406e270 legacy=0x7f9b140c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b19000640 1 -- 172.21.15.16:0/1286547393 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b14070c20 con 0x7f9b14155ee0 2024-04-26T20:21:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b19000640 1 --2- 172.21.15.16:0/1286547393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b14155ee0 0x7f9b1406d490 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009870 tx=0x7f9b0801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217c5abdd061d8ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:40.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b13400640 1 -- 172.21.15.16:0/1286547393 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080b2070 con 0x7f9b14155ee0 2024-04-26T20:21:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b13400640 1 -- 172.21.15.16:0/1286547393 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b080a9070 con 0x7f9b14155ee0 2024-04-26T20:21:40.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.425+0000 7f9b13400640 1 -- 172.21.15.16:0/1286547393 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080ad880 con 0x7f9b14155ee0 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- 172.21.15.16:0/1286547393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b14155ee0 msgr2=0x7f9b1406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/1286547393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b14155ee0 0x7f9b1406d490 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009870 tx=0x7f9b0801c560 comp rx=0 tx=0).stop 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- 172.21.15.16:0/1286547393 shutdown_connections 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/1286547393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b1406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/1286547393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b14155ee0 0x7f9b1406d490 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- 172.21.15.16:0/1286547393 >> 172.21.15.16:0/1286547393 conn(0x7f9b14071f60 msgr2=0x7f9b14072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- 172.21.15.16:0/1286547393 shutdown_connections 2024-04-26T20:21:40.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- 172.21.15.16:0/1286547393 wait complete. 2024-04-26T20:21:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 Processor -- start 2024-04-26T20:21:40.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- start start 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b1406e270 0x7f9b14159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b14155ee0 0x7f9b140b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b14142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14160110 con 0x7f9b1406e270 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1415ff90 con 0x7f9b14155ee0 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b1ba00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9b140c61b0 con 0x7f9b1415fbb0 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b1406e270 0x7f9b14159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b1406e270 0x7f9b14159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45370/0 (socket says 172.21.15.16:45370) 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 -- 172.21.15.16:0/156476841 learned_addr learned my addr 172.21.15.16:0/156476841 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19a00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b14142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b13e00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b14155ee0 0x7f9b140b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 -- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 msgr2=0x7f9b14142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b14142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 -- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b14155ee0 msgr2=0x7f9b140b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b14155ee0 0x7f9b140b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 -- 172.21.15.16:0/156476841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b141458d0 con 0x7f9b1406e270 2024-04-26T20:21:40.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19a00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b14142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:40.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.429+0000 7f9b19000640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b1406e270 0x7f9b14159d50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9b080b0040 tx=0x7f9b08019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b10c00640 1 -- 172.21.15.16:0/156476841 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080b2040 con 0x7f9b1406e270 2024-04-26T20:21:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b10c00640 1 -- 172.21.15.16:0/156476841 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b080adb90 con 0x7f9b1406e270 2024-04-26T20:21:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b10c00640 1 -- 172.21.15.16:0/156476841 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080b6440 con 0x7f9b1406e270 2024-04-26T20:21:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b14143d20 con 0x7f9b1406e270 2024-04-26T20:21:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b140b5780 con 0x7f9b1406e270 2024-04-26T20:21:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14077c20 con 0x7f9b1406e270 2024-04-26T20:21:40.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b10c00640 1 -- 172.21.15.16:0/156476841 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b080bd020 con 0x7f9b1406e270 2024-04-26T20:21:40.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b10c00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9af40683b0 0x7f9af406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:40.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b10c00640 1 -- 172.21.15.16:0/156476841 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f9b08120310 con 0x7f9b1406e270 2024-04-26T20:21:40.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.433+0000 7f9b13e00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9af40683b0 0x7f9af406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:40.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.437+0000 7f9b13e00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9af40683b0 0x7f9af406a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9b1414bdb0 tx=0x7f9b00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:40.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.437+0000 7f9b10c00640 1 -- 172.21.15.16:0/156476841 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9b080c4020 con 0x7f9b1406e270 2024-04-26T20:21:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.637+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b140caa80 con 0x7f9b1406e270 2024-04-26T20:21:40.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.637+0000 7f9b10c00640 1 -- 172.21.15.16:0/156476841 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7f9b08016150 con 0x7f9b1406e270 2024-04-26T20:21:40.643 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:40.643 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9af40683b0 msgr2=0x7f9af406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9af40683b0 0x7f9af406a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9b1414bdb0 tx=0x7f9b00008040 comp rx=0 tx=0).stop 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b1406e270 msgr2=0x7f9b14159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b1406e270 0x7f9b14159d50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9b080b0040 tx=0x7f9b08019300 comp rx=0 tx=0).stop 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 shutdown_connections 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9af40683b0 0x7f9af406a870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b1415fbb0 0x7f9b14142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b14155ee0 0x7f9b140b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 --2- 172.21.15.16:0/156476841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9b1406e270 0x7f9b14159d50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:40.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 >> 172.21.15.16:0/156476841 conn(0x7f9b14071f60 msgr2=0x7f9b1415cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:40.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 shutdown_connections 2024-04-26T20:21:40.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:40.641+0000 7f9b1ba00640 1 -- 172.21.15.16:0/156476841 wait complete. 2024-04-26T20:21:40.661 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-26T20:21:42.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.813+0000 7fa300200640 1 Processor -- start 2024-04-26T20:21:42.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.813+0000 7fa300200640 1 -- start start 2024-04-26T20:21:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa300200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 0x7fa2f815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa300200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa2f80c7b80 0x7fa2f80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa300200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f80c9d90 con 0x7fa2f80c9010 2024-04-26T20:21:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa300200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f80ca630 con 0x7fa2f80c7b80 2024-04-26T20:21:42.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa300200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f80ca070 con 0x7fa2f8153af0 2024-04-26T20:21:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fe200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa2f80c9010 0x7fa2f80c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48984/0 (socket says 172.21.15.16:48984) 2024-04-26T20:21:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fe200640 1 -- 172.21.15.16:0/1353188820 learned_addr learned my addr 172.21.15.16:0/1353188820 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fd800640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 0x7fa2f815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fce00640 1 --2- 172.21.15.16:0/1353188820 >> v2:172.21.15.192:3300/0 conn(0x7fa2f80c7b80 0x7fa2f80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227092724 0 0) 0x7fa2f80c9d90 con 0x7fa2f80c9010 2024-04-26T20:21:42.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e0003530 con 0x7fa2f80c9010 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1500856667 0 0) 0x7fa2e0003530 con 0x7fa2f80c9010 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 msgr2=0x7fa2f815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 0x7fa2f815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 >> v2:172.21.15.192:3300/0 conn(0x7fa2f80c7b80 msgr2=0x7fa2f80c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 --2- 172.21.15.16:0/1353188820 >> v2:172.21.15.192:3300/0 conn(0x7fa2f80c7b80 0x7fa2f80c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f80ca350 con 0x7fa2f80c9010 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fa2f0001a00 con 0x7fa2f80c9010 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 >> v1:172.21.15.16:6789/0 conn(0x7fa2f80c9010 legacy=0x7fa2f80c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e00039c0 0x7fa2e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0004810 0x7fa2e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 0x7fa2e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80ca630 con 0x7fa2e00039c0 2024-04-26T20:21:42.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80ca070 con 0x7fa2e0004810 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e000b9d0 con 0x7fa2f8153af0 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fd800640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e00039c0 0x7fa2e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fce00640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0004810 0x7fa2e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fe200640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 0x7fa2e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fd800640 1 -- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 msgr2=0x7fa2e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fd800640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f8153af0 0x7fa2e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fd800640 1 -- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0004810 msgr2=0x7fa2e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fd800640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0004810 0x7fa2e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:42.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.817+0000 7fa2fd800640 1 -- 172.21.15.16:0/1353188820 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e0003530 con 0x7fa2e00039c0 2024-04-26T20:21:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa2fd800640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e00039c0 0x7fa2e0003de0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009ae0 tx=0x7fa2ec01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530f3127c88d095c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0096b0 con 0x7fa2e00039c0 2024-04-26T20:21:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0a6480 con 0x7fa2e00039c0 2024-04-26T20:21:42.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa2f7e00640 1 -- 172.21.15.16:0/1353188820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0a6870 con 0x7fa2e00039c0 2024-04-26T20:21:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa300200640 1 -- 172.21.15.16:0/1353188820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e00039c0 msgr2=0x7fa2e0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa300200640 1 --2- 172.21.15.16:0/1353188820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e00039c0 0x7fa2e0003de0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009ae0 tx=0x7fa2ec01ca70 comp rx=0 tx=0).stop 2024-04-26T20:21:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa2fe200640 1 -- 172.21.15.16:0/1353188820 reap_dead start 2024-04-26T20:21:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa300200640 1 -- 172.21.15.16:0/1353188820 shutdown_connections 2024-04-26T20:21:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa300200640 1 -- 172.21.15.16:0/1353188820 >> 172.21.15.16:0/1353188820 conn(0x7fa2f806c380 msgr2=0x7fa2f806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa300200640 1 -- 172.21.15.16:0/1353188820 shutdown_connections 2024-04-26T20:21:42.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.821+0000 7fa300200640 1 -- 172.21.15.16:0/1353188820 wait complete. 2024-04-26T20:21:42.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 Processor -- start 2024-04-26T20:21:42.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 -- start start 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e00039c0 0x7fa2f81f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f81e48c0 0x7fa2f814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f814f1a0 0x7fa2f8146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8153ed0 con 0x7fa2f81e48c0 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f815d290 con 0x7fa2e00039c0 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f8154050 con 0x7fa2f814f1a0 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f81e48c0 0x7fa2f814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f81e48c0 0x7fa2f814ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45386/0 (socket says 172.21.15.16:45386) 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 -- 172.21.15.16:0/2430585767 learned_addr learned my addr 172.21.15.16:0/2430585767 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fe200640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f814f1a0 0x7fa2f8146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fd800640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e00039c0 0x7fa2f81f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 -- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f814f1a0 msgr2=0x7fa2f8146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:42.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f814f1a0 0x7fa2f8146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:42.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 -- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e00039c0 msgr2=0x7fa2f81f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:42.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e00039c0 0x7fa2f81f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:42.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 -- 172.21.15.16:0/2430585767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f81f2590 con 0x7fa2f81e48c0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2fce00640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f81e48c0 0x7fa2f814ec60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40116c0 tx=0x7fa2e4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2f5600640 1 -- 172.21.15.16:0/2430585767 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400f920 con 0x7fa2f81e48c0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2f5600640 1 -- 172.21.15.16:0/2430585767 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e400fac0 con 0x7fa2f81e48c0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa2f5600640 1 -- 172.21.15.16:0/2430585767 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400fe70 con 0x7fa2f81e48c0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f81513c0 con 0x7fa2f81e48c0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f81e6a30 con 0x7fa2f81e48c0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.825+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f8077c20 con 0x7fa2f81e48c0 2024-04-26T20:21:42.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.829+0000 7fa2f5600640 1 -- 172.21.15.16:0/2430585767 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2e4015460 con 0x7fa2f81e48c0 2024-04-26T20:21:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.829+0000 7fa2f5600640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa2d8068380 0x7fa2d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:42.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.829+0000 7fa2f5600640 1 -- 172.21.15.16:0/2430585767 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7fa2e40872b0 con 0x7fa2f81e48c0 2024-04-26T20:21:42.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.829+0000 7fa2fd800640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa2d8068380 0x7fa2d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:42.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.829+0000 7fa2fd800640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa2d8068380 0x7fa2d806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0ad000 tx=0x7fa2ec0b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:42.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:42.833+0000 7fa2f5600640 1 -- 172.21.15.16:0/2430585767 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa2e4019030 con 0x7fa2f81e48c0 2024-04-26T20:21:43.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2f80c8670 con 0x7fa2f81e48c0 2024-04-26T20:21:43.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa2f5600640 1 -- 172.21.15.16:0/2430585767 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7fa2e4057350 con 0x7fa2f81e48c0 2024-04-26T20:21:43.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:43.033 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:43.034 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:43.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa2d8068380 msgr2=0x7fa2d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:43.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa2d8068380 0x7fa2d806a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0ad000 tx=0x7fa2ec0b3040 comp rx=0 tx=0).stop 2024-04-26T20:21:43.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f81e48c0 msgr2=0x7fa2f814ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:43.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f81e48c0 0x7fa2f814ec60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40116c0 tx=0x7fa2e4011ac0 comp rx=0 tx=0).stop 2024-04-26T20:21:43.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 shutdown_connections 2024-04-26T20:21:43.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fa2d8068380 0x7fa2d806a840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:43.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2f814f1a0 0x7fa2f8146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:43.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2f81e48c0 0x7fa2f814ec60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:43.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 --2- 172.21.15.16:0/2430585767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e00039c0 0x7fa2f81f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:43.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 >> 172.21.15.16:0/2430585767 conn(0x7fa2f806c380 msgr2=0x7fa2f8152eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:43.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 shutdown_connections 2024-04-26T20:21:43.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:43.033+0000 7fa300200640 1 -- 172.21.15.16:0/2430585767 wait complete. 2024-04-26T20:21:43.055 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-26T20:21:45.057 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:45.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f892e600640 1 Processor -- start 2024-04-26T20:21:45.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f892e600640 1 -- start start 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f892e600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 0x7f89280c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f892e600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8928152fa0 con 0x7f8928152bc0 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f892e600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8928159790 con 0x7f8928072d70 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f892e600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8928158930 con 0x7f89280c9b60 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f8927400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8928152bc0 0x7f89280c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55892/0 (socket says 172.21.15.16:55892) 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f8927400640 1 -- 172.21.15.16:0/3188940110 learned_addr learned my addr 172.21.15.16:0/3188940110 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.209+0000 7f8927e00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 0x7f89280c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144428901 0 0) 0x7f8928152fa0 con 0x7f8928152bc0 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f890c005740 con 0x7f8928152bc0 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109855110 0 0) 0x7f8928159790 con 0x7f8928072d70 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8928152fa0 con 0x7f8928072d70 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3406832242 0 0) 0x7f890c005740 con 0x7f8928152bc0 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 msgr2=0x7f89280c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 0x7f89280c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 >> v1:172.21.15.192:6789/0 conn(0x7f8928072d70 legacy=0x7f89280731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8928158c10 con 0x7f8928152bc0 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f8918001a00 con 0x7f8928152bc0 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 >> v1:172.21.15.16:6789/0 conn(0x7f8928152bc0 legacy=0x7f89280c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f890c005d90 0x7f890c006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 0x7f890c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f890c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8928158930 con 0x7f890c006f60 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f890c00dc90 con 0x7f890c005d90 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f890c00de90 con 0x7f89280c9b60 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8927e00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f890c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8927400640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f890c005d90 0x7f890c006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f891ea00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 0x7f890c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8927e00640 1 -- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 msgr2=0x7f890c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8927e00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280c9b60 0x7f890c006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8927e00640 1 -- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f890c005d90 msgr2=0x7f890c006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:45.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8927e00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f890c005d90 0x7f890c006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.213+0000 7f8927e00640 1 -- 172.21.15.16:0/3188940110 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c005740 con 0x7f890c006f60 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f8927e00640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f890c0073e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8920009ae0 tx=0x7f892001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea91a11c538da8d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89200b2070 con 0x7f890c006f60 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200a5660 con 0x7f890c006f60 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f8926a00640 1 -- 172.21.15.16:0/3188940110 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89200096b0 con 0x7f890c006f60 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- 172.21.15.16:0/3188940110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 msgr2=0x7f890c0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 --2- 172.21.15.16:0/3188940110 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f890c0073e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8920009ae0 tx=0x7f892001ca70 comp rx=0 tx=0).stop 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f8927e00640 1 -- 172.21.15.16:0/3188940110 reap_dead start 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- 172.21.15.16:0/3188940110 shutdown_connections 2024-04-26T20:21:45.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- 172.21.15.16:0/3188940110 >> 172.21.15.16:0/3188940110 conn(0x7f892806c380 msgr2=0x7f892806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:45.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- 172.21.15.16:0/3188940110 shutdown_connections 2024-04-26T20:21:45.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- 172.21.15.16:0/3188940110 wait complete. 2024-04-26T20:21:45.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 Processor -- start 2024-04-26T20:21:45.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- start start 2024-04-26T20:21:45.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f8928157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8928156560 0x7f89280cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280cb780 0x7f89281518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89281594b0 con 0x7f890c006f60 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f89281591d0 con 0x7f8928156560 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f892e600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f89280c9510 con 0x7f89280cb780 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.217+0000 7f8927400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f8928157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f8928157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38722/0 (socket says 172.21.15.16:38722) 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 -- 172.21.15.16:0/2025366716 learned_addr learned my addr 172.21.15.16:0/2025366716 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f891ea00640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8928156560 0x7f89280cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927e00640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280cb780 0x7f89281518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 -- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280cb780 msgr2=0x7f89281518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280cb780 0x7f89281518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 -- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8928156560 msgr2=0x7f89280cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8928156560 0x7f89280cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 -- 172.21.15.16:0/2025366716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8928150f70 con 0x7f890c006f60 2024-04-26T20:21:45.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f8927400640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f8928157230 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f89180078c0 tx=0x7f891800a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:45.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f891fe00640 1 -- 172.21.15.16:0/2025366716 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918017020 con 0x7f890c006f60 2024-04-26T20:21:45.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f891fe00640 1 -- 172.21.15.16:0/2025366716 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8918007ad0 con 0x7f890c006f60 2024-04-26T20:21:45.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89281f2550 con 0x7f890c006f60 2024-04-26T20:21:45.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f891fe00640 1 -- 172.21.15.16:0/2025366716 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918013630 con 0x7f890c006f60 2024-04-26T20:21:45.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89280cc220 con 0x7f890c006f60 2024-04-26T20:21:45.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8928077c20 con 0x7f890c006f60 2024-04-26T20:21:45.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f891fe00640 1 -- 172.21.15.16:0/2025366716 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f891801a020 con 0x7f890c006f60 2024-04-26T20:21:45.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f891fe00640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8904068380 0x7f890406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:45.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.221+0000 7f891fe00640 1 -- 172.21.15.16:0/2025366716 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f8918087920 con 0x7f890c006f60 2024-04-26T20:21:45.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.225+0000 7f891ea00640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8904068380 0x7f890406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:45.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.225+0000 7f891ea00640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8904068380 0x7f890406a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89280cbbd0 tx=0x7f8910009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:45.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.225+0000 7f891fe00640 1 -- 172.21.15.16:0/2025366716 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8918021020 con 0x7f890c006f60 2024-04-26T20:21:45.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.429+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89280c72e0 con 0x7f890c006f60 2024-04-26T20:21:45.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.429+0000 7f891fe00640 1 -- 172.21.15.16:0/2025366716 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7f89180579c0 con 0x7f890c006f60 2024-04-26T20:21:45.431 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:45.431 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:45.431 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8904068380 msgr2=0x7f890406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8904068380 0x7f890406a840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89280cbbd0 tx=0x7f8910009040 comp rx=0 tx=0).stop 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 msgr2=0x7f8928157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f8928157230 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f89180078c0 tx=0x7f891800a600 comp rx=0 tx=0).stop 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 shutdown_connections 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8904068380 0x7f890406a840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89280cb780 0x7f89281518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8928156560 0x7f89280cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 --2- 172.21.15.16:0/2025366716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f890c006f60 0x7f8928157230 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:45.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 >> 172.21.15.16:0/2025366716 conn(0x7f892806c380 msgr2=0x7f89280c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:45.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 shutdown_connections 2024-04-26T20:21:45.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:45.433+0000 7f892e600640 1 -- 172.21.15.16:0/2025366716 wait complete. 2024-04-26T20:21:45.453 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-26T20:21:47.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:47.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.605+0000 7f2c05000640 1 Processor -- start 2024-04-26T20:21:47.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.605+0000 7f2c05000640 1 -- start start 2024-04-26T20:21:47.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2c05000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2c000722a0 0x7f2c00073550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:47.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2c05000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0006fb60 0x7f2c0006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:47.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2c05000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c000c7e40 con 0x7f2c00155f20 2024-04-26T20:21:47.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2c05000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f2c00156300 con 0x7f2c000722a0 2024-04-26T20:21:47.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2c05000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c000c8120 con 0x7f2c0006fb60 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bfe800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0006fb60 0x7f2c0006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bf7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2c000722a0 0x7f2c00073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bfe800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0006fb60 0x7f2c0006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:45778/0 (socket says 172.21.15.16:45778) 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bfe800640 1 -- 172.21.15.16:0/3437631166 learned_addr learned my addr 172.21.15.16:0/3437631166 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bfe800640 1 -- 172.21.15.16:0/3437631166 >> v2:172.21.15.192:3300/0 conn(0x7f2c000722a0 msgr2=0x7f2c00073550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bfe800640 1 --2- 172.21.15.16:0/3437631166 >> v2:172.21.15.192:3300/0 conn(0x7f2c000722a0 0x7f2c00073550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bfe800640 1 -- 172.21.15.16:0/3437631166 >> v1:172.21.15.192:6789/0 conn(0x7f2c00155f20 legacy=0x7f2c0015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:47.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bfe800640 1 -- 172.21.15.16:0/3437631166 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c00072d50 con 0x7f2c0006fb60 2024-04-26T20:21:47.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.609+0000 7f2bf7e00640 1 --2- 172.21.15.16:0/3437631166 >> v2:172.21.15.192:3300/0 conn(0x7f2c000722a0 0x7f2c00073550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:21:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2bfe800640 1 --2- 172.21.15.16:0/3437631166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0006fb60 0x7f2c0006fff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009e50 tx=0x7f2bf801f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6aa359286b17b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2bfd400640 1 -- 172.21.15.16:0/3437631166 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80b4070 con 0x7f2c0006fb60 2024-04-26T20:21:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2bfd400640 1 -- 172.21.15.16:0/3437631166 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf80af400 con 0x7f2c0006fb60 2024-04-26T20:21:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2bfd400640 1 -- 172.21.15.16:0/3437631166 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80af7d0 con 0x7f2c0006fb60 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 -- 172.21.15.16:0/3437631166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0006fb60 msgr2=0x7f2c0006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 --2- 172.21.15.16:0/3437631166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0006fb60 0x7f2c0006fff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009e50 tx=0x7f2bf801f210 comp rx=0 tx=0).stop 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 -- 172.21.15.16:0/3437631166 shutdown_connections 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 --2- 172.21.15.16:0/3437631166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c0006fb60 0x7f2c0006fff0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 --2- 172.21.15.16:0/3437631166 >> v2:172.21.15.192:3300/0 conn(0x7f2c000722a0 0x7f2c00073550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 -- 172.21.15.16:0/3437631166 >> 172.21.15.16:0/3437631166 conn(0x7f2c0006c380 msgr2=0x7f2c0006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 -- 172.21.15.16:0/3437631166 shutdown_connections 2024-04-26T20:21:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.613+0000 7f2c05000640 1 -- 172.21.15.16:0/3437631166 wait complete. 2024-04-26T20:21:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 Processor -- start 2024-04-26T20:21:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 -- start start 2024-04-26T20:21:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c0006fb60 0x7f2c000c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000722a0 0x7f2c001f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00155f20 0x7f2c001f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00073c10 con 0x7f2c0006fb60 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00073a90 con 0x7f2c00155f20 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c000c51e0 con 0x7f2c000722a0 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c0006fb60 0x7f2c000c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c0006fb60 0x7f2c000c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38736/0 (socket says 172.21.15.16:38736) 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 -- 172.21.15.16:0/2709924880 learned_addr learned my addr 172.21.15.16:0/2709924880 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bf7e00640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000722a0 0x7f2c001f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfe800640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00155f20 0x7f2c001f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 -- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000722a0 msgr2=0x7f2c001f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000722a0 0x7f2c001f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 -- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00155f20 msgr2=0x7f2c001f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00155f20 0x7f2c001f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 -- 172.21.15.16:0/2709924880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c000ccd40 con 0x7f2c0006fb60 2024-04-26T20:21:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bf7e00640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000722a0 0x7f2c001f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfe800640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00155f20 0x7f2c001f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bfde00640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c0006fb60 0x7f2c000c56f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000c450 tx=0x7f2bf000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bf6000640 1 -- 172.21.15.16:0/2709924880 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0016020 con 0x7f2c0006fb60 2024-04-26T20:21:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bf6000640 1 -- 172.21.15.16:0/2709924880 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf00052d0 con 0x7f2c0006fb60 2024-04-26T20:21:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2bf6000640 1 -- 172.21.15.16:0/2709924880 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0007260 con 0x7f2c0006fb60 2024-04-26T20:21:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c000cc1c0 con 0x7f2c0006fb60 2024-04-26T20:21:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c000cc780 con 0x7f2c0006fb60 2024-04-26T20:21:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.617+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c00077c20 con 0x7f2c0006fb60 2024-04-26T20:21:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.621+0000 7f2bf6000640 1 -- 172.21.15.16:0/2709924880 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2bf0007400 con 0x7f2c0006fb60 2024-04-26T20:21:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.621+0000 7f2bf6000640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bdc0683b0 0x7f2bdc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.621+0000 7f2bf6000640 1 -- 172.21.15.16:0/2709924880 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7f2bf00868a0 con 0x7f2c0006fb60 2024-04-26T20:21:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.621+0000 7f2bf7e00640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bdc0683b0 0x7f2bdc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.621+0000 7f2bf7e00640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bdc0683b0 0x7f2bdc06a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2c000c9ac0 tx=0x7f2be8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.625+0000 7f2bf6000640 1 -- 172.21.15.16:0/2709924880 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2bf0020020 con 0x7f2c0006fb60 2024-04-26T20:21:47.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c0006c760 con 0x7f2c0006fb60 2024-04-26T20:21:47.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2bf6000640 1 -- 172.21.15.16:0/2709924880 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7f2bf0005480 con 0x7f2c0006fb60 2024-04-26T20:21:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:47.825 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:47.826 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:47.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bdc0683b0 msgr2=0x7f2bdc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:47.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bdc0683b0 0x7f2bdc06a870 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2c000c9ac0 tx=0x7f2be8008040 comp rx=0 tx=0).stop 2024-04-26T20:21:47.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c0006fb60 msgr2=0x7f2c000c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:47.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c0006fb60 0x7f2c000c56f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000c450 tx=0x7f2bf000c910 comp rx=0 tx=0).stop 2024-04-26T20:21:47.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 shutdown_connections 2024-04-26T20:21:47.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bdc0683b0 0x7f2bdc06a870 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00155f20 0x7f2c001f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000722a0 0x7f2c001f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 --2- 172.21.15.16:0/2709924880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c0006fb60 0x7f2c000c56f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 >> 172.21.15.16:0/2709924880 conn(0x7f2c0006c380 msgr2=0x7f2c00154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 shutdown_connections 2024-04-26T20:21:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:47.825+0000 7f2c05000640 1 -- 172.21.15.16:0/2709924880 wait complete. 2024-04-26T20:21:47.847 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-26T20:21:48.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:21:48.523 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:21:49.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:50.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:49.997+0000 7fcfa4200640 1 Processor -- start 2024-04-26T20:21:50.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa4200640 1 -- start start 2024-04-26T20:21:50.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa4200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c7b80 0x7fcf9c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa4200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf9c0c9010 0x7fcf9c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa4200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9c0c99e0 con 0x7fcf9c153af0 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa4200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9c15dec0 con 0x7fcf9c0c9010 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa4200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9c0ca630 con 0x7fcf9c0c7b80 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa2200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf9c0c9010 0x7fcf9c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa2200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf9c0c9010 0x7fcf9c0c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38740/0 (socket says 172.21.15.16:38740) 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa2200640 1 -- 172.21.15.16:0/3146136154 learned_addr learned my addr 172.21.15.16:0/3146136154 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:50.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa0e00640 1 --2- 172.21.15.16:0/3146136154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c7b80 0x7fcf9c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:50.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa2200640 1 -- 172.21.15.16:0/3146136154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c7b80 msgr2=0x7fcf9c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:50.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa2200640 1 --2- 172.21.15.16:0/3146136154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c7b80 0x7fcf9c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa2200640 1 -- 172.21.15.16:0/3146136154 >> v1:172.21.15.192:6789/0 conn(0x7fcf9c153af0 legacy=0x7fcf9c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.001+0000 7fcfa2200640 1 -- 172.21.15.16:0/3146136154 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c0c9d90 con 0x7fcf9c0c9010 2024-04-26T20:21:50.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa2200640 1 --2- 172.21.15.16:0/3146136154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c0c9010 0x7fcf9c0c94a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf9401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8528305a0e5e5c25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:50.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcf9be00640 1 -- 172.21.15.16:0/3146136154 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940b4070 con 0x7fcf9c0c9010 2024-04-26T20:21:50.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcf9be00640 1 -- 172.21.15.16:0/3146136154 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf940af400 con 0x7fcf9c0c9010 2024-04-26T20:21:50.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcf9be00640 1 -- 172.21.15.16:0/3146136154 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940af7d0 con 0x7fcf9c0c9010 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 -- 172.21.15.16:0/3146136154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c0c9010 msgr2=0x7fcf9c0c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 --2- 172.21.15.16:0/3146136154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c0c9010 0x7fcf9c0c94a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf9401f210 comp rx=0 tx=0).stop 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 -- 172.21.15.16:0/3146136154 shutdown_connections 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 --2- 172.21.15.16:0/3146136154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c0c9010 0x7fcf9c0c94a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 --2- 172.21.15.16:0/3146136154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c7b80 0x7fcf9c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 -- 172.21.15.16:0/3146136154 >> 172.21.15.16:0/3146136154 conn(0x7fcf9c06c380 msgr2=0x7fcf9c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 -- 172.21.15.16:0/3146136154 shutdown_connections 2024-04-26T20:21:50.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 -- 172.21.15.16:0/3146136154 wait complete. 2024-04-26T20:21:50.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 Processor -- start 2024-04-26T20:21:50.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.005+0000 7fcfa4200640 1 -- start start 2024-04-26T20:21:50.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf9c0c7b80 0x7fcf9c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:50.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c9010 0x7fcf9c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:50.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c153af0 0x7fcf9c1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c15cfb0 con 0x7fcf9c153af0 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c0ca350 con 0x7fcf9c0c7b80 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9c15d290 con 0x7fcf9c0c9010 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c153af0 0x7fcf9c1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c153af0 0x7fcf9c1f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38744/0 (socket says 172.21.15.16:38744) 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 -- 172.21.15.16:0/1624699060 learned_addr learned my addr 172.21.15.16:0/1624699060 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa0e00640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c9010 0x7fcf9c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa1800640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf9c0c7b80 0x7fcf9c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 -- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c9010 msgr2=0x7fcf9c15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c9010 0x7fcf9c15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 -- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf9c0c7b80 msgr2=0x7fcf9c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf9c0c7b80 0x7fcf9c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 -- 172.21.15.16:0/1624699060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c0742b0 con 0x7fcf9c153af0 2024-04-26T20:21:50.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa1800640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf9c0c7b80 0x7fcf9c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:50.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa2200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c153af0 0x7fcf9c1f2830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcf9401ce40 tx=0x7fcf9401bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:50.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcf99600640 1 -- 172.21.15.16:0/1624699060 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940c0070 con 0x7fcf9c153af0 2024-04-26T20:21:50.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcf99600640 1 -- 172.21.15.16:0/1624699060 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf940090d0 con 0x7fcf9c153af0 2024-04-26T20:21:50.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcf99600640 1 -- 172.21.15.16:0/1624699060 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940b4040 con 0x7fcf9c153af0 2024-04-26T20:21:50.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c073210 con 0x7fcf9c153af0 2024-04-26T20:21:50.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c0737d0 con 0x7fcf9c153af0 2024-04-26T20:21:50.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.009+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9c077c20 con 0x7fcf9c153af0 2024-04-26T20:21:50.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.013+0000 7fcf99600640 1 -- 172.21.15.16:0/1624699060 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcf940c3070 con 0x7fcf9c153af0 2024-04-26T20:21:50.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.013+0000 7fcf99600640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf7c068380 0x7fcf7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:50.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.013+0000 7fcf99600640 1 -- 172.21.15.16:0/1624699060 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6993+0+0 (secure 0 0 0) 0x7fcf94124410 con 0x7fcf9c153af0 2024-04-26T20:21:50.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.013+0000 7fcfa1800640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf7c068380 0x7fcf7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:50.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.013+0000 7fcfa1800640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf7c068380 0x7fcf7c06a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf90001670 tx=0x7fcf90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:50.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.017+0000 7fcf99600640 1 -- 172.21.15.16:0/1624699060 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcf94018d70 con 0x7fcf9c153af0 2024-04-26T20:21:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.213+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf9c0c8670 con 0x7fcf9c153af0 2024-04-26T20:21:50.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcf99600640 1 -- 172.21.15.16:0/1624699060 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6881 (secure 0 0 0) 0x7fcf940f3e00 con 0x7fcf9c153af0 2024-04-26T20:21:50.217 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:50.217 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5391,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:12.224789+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.16:6837/1962586875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":1962586875},{"type":"v1","addr":"172.21.15.16:6837","nonce":1962586875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[5127,4970,4279]},"id":1}]} 2024-04-26T20:21:50.217 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 32 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf7c068380 msgr2=0x7fcf7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf7c068380 0x7fcf7c06a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf90001670 tx=0x7fcf90009040 comp rx=0 tx=0).stop 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c153af0 msgr2=0x7fcf9c1f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c153af0 0x7fcf9c1f2830 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcf9401ce40 tx=0x7fcf9401bfb0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 shutdown_connections 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcf7c068380 0x7fcf7c06a840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c153af0 0x7fcf9c1f2830 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf9c0c9010 0x7fcf9c15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 --2- 172.21.15.16:0/1624699060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf9c0c7b80 0x7fcf9c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 >> 172.21.15.16:0/1624699060 conn(0x7fcf9c06c380 msgr2=0x7fcf9c06cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 shutdown_connections 2024-04-26T20:21:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:50.217+0000 7fcfa4200640 1 -- 172.21.15.16:0/1624699060 wait complete. 2024-04-26T20:21:50.239 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-04-26T20:21:52.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:52.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0938400640 1 Processor -- start 2024-04-26T20:21:52.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0938400640 1 -- start start 2024-04-26T20:21:52.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0938400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f09300c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0938400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f093006d490 0x7f0930166800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0938400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093015bf60 con 0x7f09300c6340 2024-04-26T20:21:52.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0938400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f093006d9f0 con 0x7f093006d490 2024-04-26T20:21:52.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0938400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f093006dcd0 con 0x7f0930156280 2024-04-26T20:21:52.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0935000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f09300c6340 0x7f093006feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55900/0 (socket says 172.21.15.16:55900) 2024-04-26T20:21:52.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0935000640 1 -- 172.21.15.16:0/1648139314 learned_addr learned my addr 172.21.15.16:0/1648139314 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:52.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0935a00640 1 --2- 172.21.15.16:0/1648139314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f09300c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0936400640 1 --2- 172.21.15.16:0/1648139314 >> v2:172.21.15.192:3300/0 conn(0x7f093006d490 0x7f0930166800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f092fe00640 1 -- 172.21.15.16:0/1648139314 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697195366 0 0) 0x7f091c001120 con 0x7f09300c6340 2024-04-26T20:21:52.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f092fe00640 1 -- 172.21.15.16:0/1648139314 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0918003530 con 0x7f09300c6340 2024-04-26T20:21:52.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f092fe00640 1 -- 172.21.15.16:0/1648139314 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2244432819 0 0) 0x7f0918003530 con 0x7f09300c6340 2024-04-26T20:21:52.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0935a00640 1 -- 172.21.15.16:0/1648139314 >> v2:172.21.15.192:3300/0 conn(0x7f093006d490 msgr2=0x7f0930166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:52.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0935a00640 1 --2- 172.21.15.16:0/1648139314 >> v2:172.21.15.192:3300/0 conn(0x7f093006d490 0x7f0930166800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0935a00640 1 -- 172.21.15.16:0/1648139314 >> v1:172.21.15.16:6789/0 conn(0x7f09300c6340 legacy=0x7f093006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.393+0000 7f0935a00640 1 -- 172.21.15.16:0/1648139314 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093015c1e0 con 0x7f0930156280 2024-04-26T20:21:52.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0935a00640 1 --2- 172.21.15.16:0/1648139314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f09300c44a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f09240097c0 tx=0x7f092401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c762f3e745764e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:52.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f092fe00640 1 -- 172.21.15.16:0/1648139314 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09240b0070 con 0x7f0930156280 2024-04-26T20:21:52.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f092fe00640 1 -- 172.21.15.16:0/1648139314 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09240ab400 con 0x7f0930156280 2024-04-26T20:21:52.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f092fe00640 1 -- 172.21.15.16:0/1648139314 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c001850 con 0x7f0930156280 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 -- 172.21.15.16:0/1648139314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 msgr2=0x7f09300c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 --2- 172.21.15.16:0/1648139314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f09300c44a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f09240097c0 tx=0x7f092401c330 comp rx=0 tx=0).stop 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 -- 172.21.15.16:0/1648139314 shutdown_connections 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 --2- 172.21.15.16:0/1648139314 >> v2:172.21.15.192:3300/0 conn(0x7f093006d490 0x7f0930166800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 --2- 172.21.15.16:0/1648139314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f09300c44a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 -- 172.21.15.16:0/1648139314 >> 172.21.15.16:0/1648139314 conn(0x7f0930071160 msgr2=0x7f0930068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 -- 172.21.15.16:0/1648139314 shutdown_connections 2024-04-26T20:21:52.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.397+0000 7f0938400640 1 -- 172.21.15.16:0/1648139314 wait complete. 2024-04-26T20:21:52.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 Processor -- start 2024-04-26T20:21:52.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 -- start start 2024-04-26T20:21:52.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093006d490 0x7f0930152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09300c6340 0x7f0930156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f0930156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0930156660 con 0x7f09300c6340 2024-04-26T20:21:52.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f09300c49e0 con 0x7f093006d490 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f09300705c0 con 0x7f0930156280 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09300c6340 0x7f0930156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09300c6340 0x7f0930156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38752/0 (socket says 172.21.15.16:38752) 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 -- 172.21.15.16:0/1763551843 learned_addr learned my addr 172.21.15.16:0/1763551843 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0936400640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f0930156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935a00640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093006d490 0x7f0930152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 -- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 msgr2=0x7f0930156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f0930156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 -- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093006d490 msgr2=0x7f0930152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093006d490 0x7f0930152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 -- 172.21.15.16:0/1763551843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093015a6d0 con 0x7f09300c6340 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0935000640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09300c6340 0x7f0930156940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c750 tx=0x7f091c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:52.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f092d600640 1 -- 172.21.15.16:0/1763551843 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c005af0 con 0x7f09300c6340 2024-04-26T20:21:52.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f092d600640 1 -- 172.21.15.16:0/1763551843 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c005c90 con 0x7f09300c6340 2024-04-26T20:21:52.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f092d600640 1 -- 172.21.15.16:0/1763551843 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c007290 con 0x7f09300c6340 2024-04-26T20:21:52.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09300cc370 con 0x7f09300c6340 2024-04-26T20:21:52.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.401+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09300cbdb0 con 0x7f09300c6340 2024-04-26T20:21:52.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.405+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0930077c20 con 0x7f09300c6340 2024-04-26T20:21:52.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.405+0000 7f092d600640 1 -- 172.21.15.16:0/1763551843 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f091c007430 con 0x7f09300c6340 2024-04-26T20:21:52.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.405+0000 7f092d600640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f09100683b0 0x7f091006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.405+0000 7f092d600640 1 -- 172.21.15.16:0/1763551843 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f091c086dd0 con 0x7f09300c6340 2024-04-26T20:21:52.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.405+0000 7f0935a00640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f09100683b0 0x7f091006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.405+0000 7f0935a00640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f09100683b0 0x7f091006a870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09240ad000 tx=0x7f09240a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:52.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.409+0000 7f092d600640 1 -- 172.21.15.16:0/1763551843 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f093015bf60 con 0x7f09300c6340 2024-04-26T20:21:52.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.613+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f093015a9f0 con 0x7f09300c6340 2024-04-26T20:21:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.613+0000 7f092d600640 1 -- 172.21.15.16:0/1763551843 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6052 (secure 0 0 0) 0x7f091c010300 con 0x7f09300c6340 2024-04-26T20:21:52.616 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:52.616 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:50.874167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:21:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 33 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f09100683b0 msgr2=0x7f091006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f09100683b0 0x7f091006a870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09240ad000 tx=0x7f09240a6000 comp rx=0 tx=0).stop 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09300c6340 msgr2=0x7f0930156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09300c6340 0x7f0930156940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f091c00c750 tx=0x7f091c00cc10 comp rx=0 tx=0).stop 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 shutdown_connections 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f09100683b0 0x7f091006a870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0930156280 0x7f0930156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09300c6340 0x7f0930156940 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 --2- 172.21.15.16:0/1763551843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093006d490 0x7f0930152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 >> 172.21.15.16:0/1763551843 conn(0x7f0930071160 msgr2=0x7f0930159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 shutdown_connections 2024-04-26T20:21:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.617+0000 7f0938400640 1 -- 172.21.15.16:0/1763551843 wait complete. 2024-04-26T20:21:52.637 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-04-26T20:21:52.637 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-04-26T20:21:52.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:52.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61fd600640 1 Processor -- start 2024-04-26T20:21:52.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61fd600640 1 -- start start 2024-04-26T20:21:52.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61fd600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61f8153fb0 0x7f61f8070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61fd600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f806fde0 con 0x7f61f80c5750 2024-04-26T20:21:52.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61fd600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f815aa40 con 0x7f61f815a550 2024-04-26T20:21:52.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61fd600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f61f80c6240 con 0x7f61f8153fb0 2024-04-26T20:21:52.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61f6a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f61f80c5750 0x7f61f80c5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55906/0 (socket says 172.21.15.16:55906) 2024-04-26T20:21:52.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.777+0000 7f61f6a00640 1 -- 172.21.15.16:0/1764012111 learned_addr learned my addr 172.21.15.16:0/1764012111 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f7400640 1 --2- 172.21.15.16:0/1764012111 >> v2:172.21.15.192:3300/0 conn(0x7f61f8153fb0 0x7f61f8070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738054683 0 0) 0x7f61f806fde0 con 0x7f61f80c5750 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61dc003530 con 0x7f61f80c5750 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3880055169 0 0) 0x7f61dc003530 con 0x7f61f80c5750 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 >> v2:172.21.15.192:3300/0 conn(0x7f61f8153fb0 msgr2=0x7f61f8070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 --2- 172.21.15.16:0/1764012111 >> v2:172.21.15.192:3300/0 conn(0x7f61f8153fb0 0x7f61f8070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 >> v1:172.21.15.192:6789/0 conn(0x7f61f815a550 legacy=0x7f61f81538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f80c97e0 con 0x7f61f80c5750 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f61e8001680 con 0x7f61f80c5750 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 >> v1:172.21.15.16:6789/0 conn(0x7f61f80c5750 legacy=0x7f61f80c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61dc0039c0 0x7f61dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc004810 0x7f61dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61f80c6240 con 0x7f61dc0051d0 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc00c170 con 0x7f61dc0039c0 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc00c370 con 0x7f61dc004810 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f7400640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f6a00640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61dc0039c0 0x7f61dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f6000640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc004810 0x7f61dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f7400640 1 -- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc004810 msgr2=0x7f61dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f7400640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc004810 0x7f61dc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f7400640 1 -- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61dc0039c0 msgr2=0x7f61dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f7400640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61dc0039c0 0x7f61dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.781+0000 7f61f7400640 1 -- 172.21.15.16:0/1764012111 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc003530 con 0x7f61dc0051d0 2024-04-26T20:21:52.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61f7400640 1 -- 172.21.15.16:0/1764012111 reap_dead start 2024-04-26T20:21:52.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61f7400640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009f90 tx=0x7f61f001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c681ae363da559b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:52.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00b2070 con 0x7f61dc0051d0 2024-04-26T20:21:52.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f00a5c90 con 0x7f61dc0051d0 2024-04-26T20:21:52.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61f5600640 1 -- 172.21.15.16:0/1764012111 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0009c10 con 0x7f61dc0051d0 2024-04-26T20:21:52.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- 172.21.15.16:0/1764012111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0051d0 msgr2=0x7f61dc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009f90 tx=0x7f61f001cc80 comp rx=0 tx=0).stop 2024-04-26T20:21:52.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- 172.21.15.16:0/1764012111 shutdown_connections 2024-04-26T20:21:52.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 --2- 172.21.15.16:0/1764012111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0051d0 0x7f61dc00b9d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- 172.21.15.16:0/1764012111 >> 172.21.15.16:0/1764012111 conn(0x7f61f80cd5e0 msgr2=0x7f61f80cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:52.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- 172.21.15.16:0/1764012111 shutdown_connections 2024-04-26T20:21:52.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- 172.21.15.16:0/1764012111 wait complete. 2024-04-26T20:21:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 Processor -- start 2024-04-26T20:21:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- start start 2024-04-26T20:21:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc0051d0 0x7f61f814ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f81f1730 0x7f61f8072d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f8150bd0 0x7f61f8073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61f80c9da0 con 0x7f61f8150bd0 2024-04-26T20:21:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61f8070050 con 0x7f61f81f1730 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.785+0000 7f61fd600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61f80c7910 con 0x7f61dc0051d0 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f8150bd0 0x7f61f8073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f8150bd0 0x7f61f8073280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38762/0 (socket says 172.21.15.16:38762) 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 -- 172.21.15.16:0/2768652622 learned_addr learned my addr 172.21.15.16:0/2768652622 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f6000640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f81f1730 0x7f61f8072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f6a00640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc0051d0 0x7f61f814ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 -- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc0051d0 msgr2=0x7f61f814ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc0051d0 0x7f61f814ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 -- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f81f1730 msgr2=0x7f61f8072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f81f1730 0x7f61f8072d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:52.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 -- 172.21.15.16:0/2768652622 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f81f1be0 con 0x7f61f8150bd0 2024-04-26T20:21:52.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61f7400640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f8150bd0 0x7f61f8073280 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f61f001cab0 tx=0x7f61f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:52.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61eea00640 1 -- 172.21.15.16:0/2768652622 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00bd020 con 0x7f61f8150bd0 2024-04-26T20:21:52.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61eea00640 1 -- 172.21.15.16:0/2768652622 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f00a6e50 con 0x7f61f8150bd0 2024-04-26T20:21:52.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61eea00640 1 -- 172.21.15.16:0/2768652622 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f00b2040 con 0x7f61f8150bd0 2024-04-26T20:21:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f81f1ec0 con 0x7f61f8150bd0 2024-04-26T20:21:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f81f2480 con 0x7f61f8150bd0 2024-04-26T20:21:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f8077c20 con 0x7f61f8150bd0 2024-04-26T20:21:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.789+0000 7f61eea00640 1 -- 172.21.15.16:0/2768652622 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61f00adcd0 con 0x7f61f8150bd0 2024-04-26T20:21:52.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.793+0000 7f61eea00640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f61d80683b0 0x7f61d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:52.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.793+0000 7f61eea00640 1 -- 172.21.15.16:0/2768652622 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f61f0121840 con 0x7f61f8150bd0 2024-04-26T20:21:52.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.793+0000 7f61f6a00640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f61d80683b0 0x7f61d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:52.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.793+0000 7f61f6a00640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f61d80683b0 0x7f61d806a870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61e8001060 tx=0x7f61e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.797+0000 7f61eea00640 1 -- 172.21.15.16:0/2768652622 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f61f00c7060 con 0x7f61f8150bd0 2024-04-26T20:21:52.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61f81f2650 con 0x7f61f8150bd0 2024-04-26T20:21:52.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61eea00640 1 -- 172.21.15.16:0/2768652622 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6052 (secure 0 0 0) 0x7f61f0016990 con 0x7f61f8150bd0 2024-04-26T20:21:52.998 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:52.998 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:50.874167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:21:52.998 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 33 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f61d80683b0 msgr2=0x7f61d806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f61d80683b0 0x7f61d806a870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61e8001060 tx=0x7f61e8009040 comp rx=0 tx=0).stop 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f8150bd0 msgr2=0x7f61f8073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f8150bd0 0x7f61f8073280 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f61f001cab0 tx=0x7f61f0009750 comp rx=0 tx=0).stop 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 shutdown_connections 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f61d80683b0 0x7f61d806a870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f8150bd0 0x7f61f8073280 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f81f1730 0x7f61f8072d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 --2- 172.21.15.16:0/2768652622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61dc0051d0 0x7f61f814ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:53.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 >> 172.21.15.16:0/2768652622 conn(0x7f61f80cd5e0 msgr2=0x7f61f80703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:53.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 shutdown_connections 2024-04-26T20:21:53.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:52.997+0000 7f61fd600640 1 -- 172.21.15.16:0/2768652622 wait complete. 2024-04-26T20:21:53.021 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 33, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 33, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4970": { "addr": "172.21.15.192:6838/3304030586", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6836", "nonce": 3304030586, "type": "v2" }, { "addr": "172.21.15.192:6838", "nonce": 3304030586, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4970, "incarnation": 27, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 31 }, "gid_5127": { "addr": "172.21.15.16:6833/1748916109", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6832", "nonce": 1748916109, "type": "v2" }, { "addr": "172.21.15.16:6833", "nonce": 1748916109, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5127, "incarnation": 21, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:active", "state_seq": 31 }, "gid_5391": { "addr": "172.21.15.16:6836/1623880328", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6834", "nonce": 1623880328, "type": "v2" }, { "addr": "172.21.15.16:6836", "nonce": 1623880328, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5391, "incarnation": 33, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:21:50.874167+0000", "qdb_cluster": [ 4970, 5127 ], "qdb_leader": 4970, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5391, "mds_1": 4970, "mds_2": 5127 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:21:55.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.173+0000 7f76c9200640 1 Processor -- start 2024-04-26T20:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.173+0000 7f76c9200640 1 -- start start 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c9200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f76c4152bc0 0x7f76c40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c9200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4073480 0x7f76c40c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c9200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c4152fa0 con 0x7f76c40c9340 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c9200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f76c4159790 con 0x7f76c4152bc0 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c9200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f76c4158930 con 0x7f76c4073480 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76bbe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f76c40c9340 0x7f76c4072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41144/0 (socket says 172.21.15.16:41144) 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76bbe00640 1 -- 172.21.15.16:0/2641956516 learned_addr learned my addr 172.21.15.16:0/2641956516 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1e00640 1 --2- 172.21.15.16:0/2641956516 >> v2:172.21.15.192:3300/0 conn(0x7f76c4152bc0 0x7f76c40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c2800640 1 --2- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4073480 0x7f76c40c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1400640 1 -- 172.21.15.16:0/2641956516 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173326162 0 0) 0x7f76c4152fa0 con 0x7f76c40c9340 2024-04-26T20:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1400640 1 -- 172.21.15.16:0/2641956516 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a8003530 con 0x7f76c40c9340 2024-04-26T20:21:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1400640 1 -- 172.21.15.16:0/2641956516 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3204573753 0 0) 0x7f76a8003530 con 0x7f76c40c9340 2024-04-26T20:21:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1e00640 1 -- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4073480 msgr2=0x7f76c40c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1e00640 1 --2- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4073480 0x7f76c40c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1e00640 1 -- 172.21.15.16:0/2641956516 >> v1:172.21.15.16:6789/0 conn(0x7f76c40c9340 legacy=0x7f76c4072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.177+0000 7f76c1e00640 1 -- 172.21.15.16:0/2641956516 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c4158c10 con 0x7f76c4152bc0 2024-04-26T20:21:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c1e00640 1 --2- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4152bc0 0x7f76c40c8e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce5a0ede3ba74a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c1400640 1 -- 172.21.15.16:0/2641956516 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40b5070 con 0x7f76c4152bc0 2024-04-26T20:21:55.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c1400640 1 -- 172.21.15.16:0/2641956516 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b40a85f0 con 0x7f76c4152bc0 2024-04-26T20:21:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c1400640 1 -- 172.21.15.16:0/2641956516 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac001680 con 0x7f76c4152bc0 2024-04-26T20:21:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 -- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4152bc0 msgr2=0x7f76c40c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 --2- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4152bc0 0x7f76c40c8e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401ebb0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 -- 172.21.15.16:0/2641956516 shutdown_connections 2024-04-26T20:21:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 --2- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4073480 0x7f76c40c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 --2- 172.21.15.16:0/2641956516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4152bc0 0x7f76c40c8e00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 -- 172.21.15.16:0/2641956516 >> 172.21.15.16:0/2641956516 conn(0x7f76c406c380 msgr2=0x7f76c406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 -- 172.21.15.16:0/2641956516 shutdown_connections 2024-04-26T20:21:55.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 -- 172.21.15.16:0/2641956516 wait complete. 2024-04-26T20:21:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 Processor -- start 2024-04-26T20:21:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 -- start start 2024-04-26T20:21:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4073480 0x7f76c4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76c40c9340 0x7f76c414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.181+0000 7f76c9200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4152bc0 0x7f76c41f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c9200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76c41594b0 con 0x7f76c40c9340 2024-04-26T20:21:55.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c9200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76c41591d0 con 0x7f76c4073480 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c9200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f76c40c47d0 con 0x7f76c4152bc0 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76c40c9340 0x7f76c414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76c40c9340 0x7f76c414d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37938/0 (socket says 172.21.15.16:37938) 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 -- 172.21.15.16:0/398978659 learned_addr learned my addr 172.21.15.16:0/398978659 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c1e00640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4073480 0x7f76c4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c2800640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4152bc0 0x7f76c41f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 -- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4152bc0 msgr2=0x7f76c41f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4152bc0 0x7f76c41f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 -- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4073480 msgr2=0x7f76c4151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4073480 0x7f76c4151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 -- 172.21.15.16:0/398978659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c41517f0 con 0x7f76c40c9340 2024-04-26T20:21:55.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76bbe00640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76c40c9340 0x7f76c414d0d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c780 tx=0x7f76ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76ba000640 1 -- 172.21.15.16:0/398978659 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac005ae0 con 0x7f76c40c9340 2024-04-26T20:21:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76ba000640 1 -- 172.21.15.16:0/398978659 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac005ca0 con 0x7f76c40c9340 2024-04-26T20:21:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c41f4e90 con 0x7f76c40c9340 2024-04-26T20:21:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76ba000640 1 -- 172.21.15.16:0/398978659 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0072b0 con 0x7f76c40c9340 2024-04-26T20:21:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c41502d0 con 0x7f76c40c9340 2024-04-26T20:21:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c4077c20 con 0x7f76c40c9340 2024-04-26T20:21:55.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.185+0000 7f76ba000640 1 -- 172.21.15.16:0/398978659 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f76ac007450 con 0x7f76c40c9340 2024-04-26T20:21:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.189+0000 7f76ba000640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76a0068380 0x7f76a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:55.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.189+0000 7f76ba000640 1 -- 172.21.15.16:0/398978659 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f76ac086f60 con 0x7f76c40c9340 2024-04-26T20:21:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.189+0000 7f76c1e00640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76a0068380 0x7f76a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:55.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.189+0000 7f76c1e00640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76a0068380 0x7f76a006a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f76b40b2000 tx=0x7f76b40aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:55.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.193+0000 7f76ba000640 1 -- 172.21.15.16:0/398978659 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f76ac056e90 con 0x7f76c40c9340 2024-04-26T20:21:55.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.393+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76c40c9940 con 0x7f76c40c9340 2024-04-26T20:21:55.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.393+0000 7f76ba000640 1 -- 172.21.15.16:0/398978659 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6052 (secure 0 0 0) 0x7f76ac056790 con 0x7f76c40c9340 2024-04-26T20:21:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:55.396 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:50.874167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:21:55.396 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 33 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76a0068380 msgr2=0x7f76a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76a0068380 0x7f76a006a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f76b40b2000 tx=0x7f76b40aa070 comp rx=0 tx=0).stop 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76c40c9340 msgr2=0x7f76c414d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76c40c9340 0x7f76c414d0d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c780 tx=0x7f76ac00cc40 comp rx=0 tx=0).stop 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 shutdown_connections 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f76a0068380 0x7f76a006a840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76c4152bc0 0x7f76c41f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76c40c9340 0x7f76c414d0d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 --2- 172.21.15.16:0/398978659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c4073480 0x7f76c4151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 >> 172.21.15.16:0/398978659 conn(0x7f76c406c380 msgr2=0x7f76c40c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 shutdown_connections 2024-04-26T20:21:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:55.397+0000 7f76c9200640 1 -- 172.21.15.16:0/398978659 wait complete. 2024-04-26T20:21:55.417 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:21:57.418 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:57.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f507ca00640 1 Processor -- start 2024-04-26T20:21:57.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f507ca00640 1 -- start start 2024-04-26T20:21:57.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f507ca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5078155ee0 0x7f507806d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:57.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f507ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f507806e440 0x7f50780c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:57.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f507ca00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5078070380 con 0x7f507815fbb0 2024-04-26T20:21:57.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f507ca00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5078070660 con 0x7f5078155ee0 2024-04-26T20:21:57.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f507ca00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f5078070940 con 0x7f507806e440 2024-04-26T20:21:57.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5075e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5078155ee0 0x7f507806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:57.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5075e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5078155ee0 0x7f507806d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37948/0 (socket says 172.21.15.16:37948) 2024-04-26T20:21:57.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5075e00640 1 -- 172.21.15.16:0/2938416666 learned_addr learned my addr 172.21.15.16:0/2938416666 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:57.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5076800640 1 --2- 172.21.15.16:0/2938416666 >> v2:172.21.15.192:3300/0 conn(0x7f507806e440 0x7f50780c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:57.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5075e00640 1 -- 172.21.15.16:0/2938416666 >> v2:172.21.15.192:3300/0 conn(0x7f507806e440 msgr2=0x7f50780c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:57.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5075e00640 1 --2- 172.21.15.16:0/2938416666 >> v2:172.21.15.192:3300/0 conn(0x7f507806e440 0x7f50780c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5075e00640 1 -- 172.21.15.16:0/2938416666 >> v1:172.21.15.192:6789/0 conn(0x7f507815fbb0 legacy=0x7f507806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:57.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.565+0000 7f5075e00640 1 -- 172.21.15.16:0/2938416666 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5078070c20 con 0x7f5078155ee0 2024-04-26T20:21:57.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f5075e00640 1 --2- 172.21.15.16:0/2938416666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5078155ee0 0x7f507806d490 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5078072a80 tx=0x7f506801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a483a378ee1716 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:57.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f5075400640 1 -- 172.21.15.16:0/2938416666 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50680ab5f0 con 0x7f5078155ee0 2024-04-26T20:21:57.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f5075400640 1 -- 172.21.15.16:0/2938416666 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50680b0070 con 0x7f5078155ee0 2024-04-26T20:21:57.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f5075400640 1 -- 172.21.15.16:0/2938416666 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50680ab9b0 con 0x7f5078155ee0 2024-04-26T20:21:57.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 -- 172.21.15.16:0/2938416666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5078155ee0 msgr2=0x7f507806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:57.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 --2- 172.21.15.16:0/2938416666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5078155ee0 0x7f507806d490 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5078072a80 tx=0x7f506801c520 comp rx=0 tx=0).stop 2024-04-26T20:21:57.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 -- 172.21.15.16:0/2938416666 shutdown_connections 2024-04-26T20:21:57.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 --2- 172.21.15.16:0/2938416666 >> v2:172.21.15.192:3300/0 conn(0x7f507806e440 0x7f50780c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 --2- 172.21.15.16:0/2938416666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5078155ee0 0x7f507806d490 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 -- 172.21.15.16:0/2938416666 >> 172.21.15.16:0/2938416666 conn(0x7f5078071f60 msgr2=0x7f5078072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:57.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 -- 172.21.15.16:0/2938416666 shutdown_connections 2024-04-26T20:21:57.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.569+0000 7f507ca00640 1 -- 172.21.15.16:0/2938416666 wait complete. 2024-04-26T20:21:57.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 Processor -- start 2024-04-26T20:21:57.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 -- start start 2024-04-26T20:21:57.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5078155ee0 0x7f50781f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:57.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f507815fbb0 0x7f5078153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:57.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f507815c8a0 0x7f507814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:57.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f50780ca160 con 0x7f507815fbb0 2024-04-26T20:21:57.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f50780c9fe0 con 0x7f5078155ee0 2024-04-26T20:21:57.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f507ca00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f507815ff90 con 0x7f507815c8a0 2024-04-26T20:21:57.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f506fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f507815fbb0 0x7f5078153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:57.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f506fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f507815fbb0 0x7f5078153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37960/0 (socket says 172.21.15.16:37960) 2024-04-26T20:21:57.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f5075e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5078155ee0 0x7f50781f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:57.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f506fe00640 1 -- 172.21.15.16:0/507086677 learned_addr learned my addr 172.21.15.16:0/507086677 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:57.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.573+0000 7f5076800640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f507815c8a0 0x7f507814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:57.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506fe00640 1 -- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f507815c8a0 msgr2=0x7f507814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:57.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506fe00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f507815c8a0 0x7f507814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506fe00640 1 -- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5078155ee0 msgr2=0x7f50781f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:57.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506fe00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5078155ee0 0x7f50781f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506fe00640 1 -- 172.21.15.16:0/507086677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5078154480 con 0x7f507815fbb0 2024-04-26T20:21:57.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506fe00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f507815fbb0 0x7f5078153620 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f506000c450 tx=0x7f506000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:57.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506e000640 1 -- 172.21.15.16:0/507086677 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060016020 con 0x7f507815fbb0 2024-04-26T20:21:57.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506e000640 1 -- 172.21.15.16:0/507086677 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50600052d0 con 0x7f507815fbb0 2024-04-26T20:21:57.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506e000640 1 -- 172.21.15.16:0/507086677 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060007260 con 0x7f507815fbb0 2024-04-26T20:21:57.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50781f7e50 con 0x7f507815fbb0 2024-04-26T20:21:57.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5078152c70 con 0x7f507815fbb0 2024-04-26T20:21:57.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5078077c20 con 0x7f507815fbb0 2024-04-26T20:21:57.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.577+0000 7f506e000640 1 -- 172.21.15.16:0/507086677 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5060007400 con 0x7f507815fbb0 2024-04-26T20:21:57.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.581+0000 7f506e000640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5054068380 0x7f505406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:57.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.581+0000 7f506e000640 1 -- 172.21.15.16:0/507086677 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f5060086720 con 0x7f507815fbb0 2024-04-26T20:21:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.581+0000 7f5075e00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5054068380 0x7f505406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:57.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.581+0000 7f5075e00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5054068380 0x7f505406a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f50680af000 tx=0x7f50680a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:57.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.585+0000 7f506e000640 1 -- 172.21.15.16:0/507086677 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5060020020 con 0x7f507815fbb0 2024-04-26T20:21:57.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.801+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50780caa80 con 0x7f507815fbb0 2024-04-26T20:21:57.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.801+0000 7f506e000640 1 -- 172.21.15.16:0/507086677 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6052 (secure 0 0 0) 0x7f5078154480 con 0x7f507815fbb0 2024-04-26T20:21:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:21:57.803 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:50.874167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:21:57.803 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 33 2024-04-26T20:21:57.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5054068380 msgr2=0x7f505406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:57.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5054068380 0x7f505406a840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f50680af000 tx=0x7f50680a7000 comp rx=0 tx=0).stop 2024-04-26T20:21:57.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f507815fbb0 msgr2=0x7f5078153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:57.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f507815fbb0 0x7f5078153620 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f506000c450 tx=0x7f506000c910 comp rx=0 tx=0).stop 2024-04-26T20:21:57.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 shutdown_connections 2024-04-26T20:21:57.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5054068380 0x7f505406a840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f507815c8a0 0x7f507814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f507815fbb0 0x7f5078153620 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 --2- 172.21.15.16:0/507086677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5078155ee0 0x7f50781f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:57.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 >> 172.21.15.16:0/507086677 conn(0x7f5078071f60 msgr2=0x7f5078156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:57.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 shutdown_connections 2024-04-26T20:21:57.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:57.805+0000 7f507ca00640 1 -- 172.21.15.16:0/507086677 wait complete. 2024-04-26T20:21:57.833 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:21:59.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:21:59.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ea00640 1 Processor -- start 2024-04-26T20:21:59.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ea00640 1 -- start start 2024-04-26T20:21:59.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5868153af0 0x7f586815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ea00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58680c9720 0x7f58680c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ea00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58680c9d90 con 0x7f58680c7b80 2024-04-26T20:21:59.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ea00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f58680ca630 con 0x7f5868153af0 2024-04-26T20:21:59.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ea00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f58680ca070 con 0x7f58680c9720 2024-04-26T20:21:59.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5868153af0 0x7f586815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5868153af0 0x7f586815d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37976/0 (socket says 172.21.15.16:37976) 2024-04-26T20:21:59.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867e00640 1 -- 172.21.15.16:0/3591828594 learned_addr learned my addr 172.21.15.16:0/3591828594 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:59.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f586ca00640 1 --2- 172.21.15.16:0/3591828594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58680c9720 0x7f58680c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867e00640 1 -- 172.21.15.16:0/3591828594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58680c9720 msgr2=0x7f58680c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:21:59.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867e00640 1 --2- 172.21.15.16:0/3591828594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58680c9720 0x7f58680c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867e00640 1 -- 172.21.15.16:0/3591828594 >> v1:172.21.15.16:6789/0 conn(0x7f58680c7b80 legacy=0x7f58680c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867e00640 1 -- 172.21.15.16:0/3591828594 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58680ca350 con 0x7f5868153af0 2024-04-26T20:21:59.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.977+0000 7f5867400640 1 -- 172.21.15.16:0/3591828594 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819870436 0 0) 0x7f58680c9d90 con 0x7f58680c7b80 2024-04-26T20:21:59.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f5867e00640 1 --2- 172.21.15.16:0/3591828594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868153af0 0x7f586815d7b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5858009870 tx=0x7f585801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7c1bc6481a7107 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:59.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f5867400640 1 -- 172.21.15.16:0/3591828594 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58580b5070 con 0x7f5868153af0 2024-04-26T20:21:59.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f5867400640 1 -- 172.21.15.16:0/3591828594 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58580a8a50 con 0x7f5868153af0 2024-04-26T20:21:59.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f5867400640 1 -- 172.21.15.16:0/3591828594 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58580a8e20 con 0x7f5868153af0 2024-04-26T20:21:59.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 -- 172.21.15.16:0/3591828594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868153af0 msgr2=0x7f586815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 --2- 172.21.15.16:0/3591828594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868153af0 0x7f586815d7b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5858009870 tx=0x7f585801ed50 comp rx=0 tx=0).stop 2024-04-26T20:21:59.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 -- 172.21.15.16:0/3591828594 shutdown_connections 2024-04-26T20:21:59.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 --2- 172.21.15.16:0/3591828594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58680c9720 0x7f58680c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 --2- 172.21.15.16:0/3591828594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5868153af0 0x7f586815d7b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 -- 172.21.15.16:0/3591828594 >> 172.21.15.16:0/3591828594 conn(0x7f586806c380 msgr2=0x7f586806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:21:59.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 -- 172.21.15.16:0/3591828594 shutdown_connections 2024-04-26T20:21:59.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.981+0000 7f586ea00640 1 -- 172.21.15.16:0/3591828594 wait complete. 2024-04-26T20:21:59.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 Processor -- start 2024-04-26T20:21:59.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 -- start start 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58680c7b80 0x7f586814f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58680c9720 0x7f586806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5868153af0 0x7f58680cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5868153ed0 con 0x7f58680c9720 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f586815d290 con 0x7f58680c7b80 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ea00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5868154050 con 0x7f5868153af0 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58680c9720 0x7f586806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58680c9720 0x7f586806fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37990/0 (socket says 172.21.15.16:37990) 2024-04-26T20:21:59.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 -- 172.21.15.16:0/1132781621 learned_addr learned my addr 172.21.15.16:0/1132781621 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f586ca00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5868153af0 0x7f58680cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f5867e00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58680c7b80 0x7f586814f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 -- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5868153af0 msgr2=0x7f58680cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5868153af0 0x7f58680cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 -- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58680c7b80 msgr2=0x7f586814f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58680c7b80 0x7f586814f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.985+0000 7f585fe00640 1 -- 172.21.15.16:0/1132781621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586814e720 con 0x7f58680c9720 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f586ca00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5868153af0 0x7f58680cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:21:59.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f585fe00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58680c9720 0x7f586806fda0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f585000c500 tx=0x7f585000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:59.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f5864c00640 1 -- 172.21.15.16:0/1132781621 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850017070 con 0x7f58680c9720 2024-04-26T20:21:59.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f5864c00640 1 -- 172.21.15.16:0/1132781621 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5850003600 con 0x7f58680c9720 2024-04-26T20:21:59.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586814e9e0 con 0x7f58680c9720 2024-04-26T20:21:59.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f5864c00640 1 -- 172.21.15.16:0/1132781621 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58500039f0 con 0x7f58680c9720 2024-04-26T20:21:59.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5868151090 con 0x7f58680c9720 2024-04-26T20:21:59.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5868077c20 con 0x7f58680c9720 2024-04-26T20:21:59.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.989+0000 7f5864c00640 1 -- 172.21.15.16:0/1132781621 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f585001a070 con 0x7f58680c9720 2024-04-26T20:21:59.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.993+0000 7f5864c00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f58440683b0 0x7f584406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:21:59.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.993+0000 7f5864c00640 1 -- 172.21.15.16:0/1132781621 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f5850086270 con 0x7f58680c9720 2024-04-26T20:21:59.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.993+0000 7f5867e00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f58440683b0 0x7f584406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:21:59.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.993+0000 7f5867e00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f58440683b0 0x7f584406a870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f58580b2000 tx=0x7f5858009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:21:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:21:59.997+0000 7f5864c00640 1 -- 172.21.15.16:0/1132781621 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5850055d30 con 0x7f58680c9720 2024-04-26T20:22:00.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.293+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58680c8670 con 0x7f58680c9720 2024-04-26T20:22:00.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.293+0000 7f5864c00640 1 -- 172.21.15.16:0/1132781621 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+6052 (secure 0 0 0) 0x7f585005a030 con 0x7f58680c9720 2024-04-26T20:22:00.295 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:00.295 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:21:50.874167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:22:00.296 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 33 2024-04-26T20:22:00.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f58440683b0 msgr2=0x7f584406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f58440683b0 0x7f584406a870 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f58580b2000 tx=0x7f5858009040 comp rx=0 tx=0).stop 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58680c9720 msgr2=0x7f586806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58680c9720 0x7f586806fda0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f585000c500 tx=0x7f585000c9c0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 shutdown_connections 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f58440683b0 0x7f584406a870 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5868153af0 0x7f58680cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58680c9720 0x7f586806fda0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 --2- 172.21.15.16:0/1132781621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58680c7b80 0x7f586814f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 >> 172.21.15.16:0/1132781621 conn(0x7f586806c380 msgr2=0x7f5868152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 shutdown_connections 2024-04-26T20:22:00.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:00.297+0000 7f586ea00640 1 -- 172.21.15.16:0/1132781621 wait complete. 2024-04-26T20:22:00.316 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:22:02.317 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:02.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab8600640 1 Processor -- start 2024-04-26T20:22:02.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab8600640 1 -- start start 2024-04-26T20:22:02.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab8600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0156010 0x7f9ab00cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab8600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ab015c680 0x7f9ab00cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab8600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab015f4c0 con 0x7f9ab00cd4d0 2024-04-26T20:22:02.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab8600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab015f270 con 0x7f9ab015c680 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab8600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab015f7a0 con 0x7f9ab0156010 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab6600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ab015c680 0x7f9ab00cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab6600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ab015c680 0x7f9ab00cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37996/0 (socket says 172.21.15.16:37996) 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab6600640 1 -- 172.21.15.16:0/2136503698 learned_addr learned my addr 172.21.15.16:0/2136503698 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab5c00640 1 --2- 172.21.15.16:0/2136503698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0156010 0x7f9ab00cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab6600640 1 -- 172.21.15.16:0/2136503698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0156010 msgr2=0x7f9ab00cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab6600640 1 --2- 172.21.15.16:0/2136503698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0156010 0x7f9ab00cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab6600640 1 -- 172.21.15.16:0/2136503698 >> v1:172.21.15.192:6789/0 conn(0x7f9ab00cd4d0 legacy=0x7f9ab015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.469+0000 7f9ab6600640 1 -- 172.21.15.16:0/2136503698 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab015fa80 con 0x7f9ab015c680 2024-04-26T20:22:02.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab6600640 1 --2- 172.21.15.16:0/2136503698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab015c680 0x7f9ab00cc940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e50 tx=0x7f9aa801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4a374c1bc23d77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9aafe00640 1 -- 172.21.15.16:0/2136503698 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80a58d0 con 0x7f9ab015c680 2024-04-26T20:22:02.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9aafe00640 1 -- 172.21.15.16:0/2136503698 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa80a5a70 con 0x7f9ab015c680 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9aafe00640 1 -- 172.21.15.16:0/2136503698 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80a5e40 con 0x7f9ab015c680 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 -- 172.21.15.16:0/2136503698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab015c680 msgr2=0x7f9ab00cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 --2- 172.21.15.16:0/2136503698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab015c680 0x7f9ab00cc940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009e50 tx=0x7f9aa801ca00 comp rx=0 tx=0).stop 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 -- 172.21.15.16:0/2136503698 shutdown_connections 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 --2- 172.21.15.16:0/2136503698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab015c680 0x7f9ab00cc940 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 --2- 172.21.15.16:0/2136503698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab0156010 0x7f9ab00cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 -- 172.21.15.16:0/2136503698 >> 172.21.15.16:0/2136503698 conn(0x7f9ab006c380 msgr2=0x7f9ab006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 -- 172.21.15.16:0/2136503698 shutdown_connections 2024-04-26T20:22:02.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.473+0000 7f9ab8600640 1 -- 172.21.15.16:0/2136503698 wait complete. 2024-04-26T20:22:02.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 Processor -- start 2024-04-26T20:22:02.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 -- start start 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ab00cd4d0 0x7f9ab01f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab0156010 0x7f9ab0158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab015c680 0x7f9ab014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00cab30 con 0x7f9ab0156010 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00ca9b0 con 0x7f9ab00cd4d0 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab00cacb0 con 0x7f9ab015c680 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab0156010 0x7f9ab0158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab0156010 0x7f9ab0158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38006/0 (socket says 172.21.15.16:38006) 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ab00cd4d0 0x7f9ab01f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 -- 172.21.15.16:0/3263521148 learned_addr learned my addr 172.21.15.16:0/3263521148 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab6600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab015c680 0x7f9ab014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 -- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab015c680 msgr2=0x7f9ab014f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab015c680 0x7f9ab014f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 -- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ab00cd4d0 msgr2=0x7f9ab01f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ab00cd4d0 0x7f9ab01f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 -- 172.21.15.16:0/3263521148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab01f4c40 con 0x7f9ab0156010 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab5200640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab0156010 0x7f9ab0158520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00c460 tx=0x7f9a9c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9aad600640 1 -- 172.21.15.16:0/3263521148 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c016020 con 0x7f9ab0156010 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9aad600640 1 -- 172.21.15.16:0/3263521148 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0052d0 con 0x7f9ab0156010 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab01f4f20 con 0x7f9ab0156010 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9aad600640 1 -- 172.21.15.16:0/3263521148 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c007260 con 0x7f9ab0156010 2024-04-26T20:22:02.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.477+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab01f54e0 con 0x7f9ab0156010 2024-04-26T20:22:02.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.481+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab0077c20 con 0x7f9ab0156010 2024-04-26T20:22:02.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.481+0000 7f9aad600640 1 -- 172.21.15.16:0/3263521148 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9a9c007400 con 0x7f9ab0156010 2024-04-26T20:22:02.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.481+0000 7f9aad600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9a90068380 0x7f9a9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:02.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.481+0000 7f9aad600640 1 -- 172.21.15.16:0/3263521148 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f9a9c086770 con 0x7f9ab0156010 2024-04-26T20:22:02.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.481+0000 7f9ab5c00640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9a90068380 0x7f9a9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:02.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.481+0000 7f9ab5c00640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9a90068380 0x7f9a9006a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4007a60 tx=0x7f9aa4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.485+0000 7f9aad600640 1 -- 172.21.15.16:0/3263521148 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9a9c020020 con 0x7f9ab0156010 2024-04-26T20:22:02.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ab00cc1e0 con 0x7f9ab0156010 2024-04-26T20:22:02.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9aad600640 1 -- 172.21.15.16:0/3263521148 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6054 (secure 0 0 0) 0x7f9a9c005480 con 0x7f9ab0156010 2024-04-26T20:22:02.694 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:02.694 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:00.452016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:resolve","state_seq":12,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[5127,4970]},"id":1}]} 2024-04-26T20:22:02.694 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 34 2024-04-26T20:22:02.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9a90068380 msgr2=0x7f9a9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9a90068380 0x7f9a9006a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4007a60 tx=0x7f9aa4008040 comp rx=0 tx=0).stop 2024-04-26T20:22:02.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab0156010 msgr2=0x7f9ab0158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:02.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab0156010 0x7f9ab0158520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00c460 tx=0x7f9a9c00c920 comp rx=0 tx=0).stop 2024-04-26T20:22:02.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 shutdown_connections 2024-04-26T20:22:02.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9a90068380 0x7f9a9006a840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ab015c680 0x7f9ab014f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ab0156010 0x7f9ab0158520 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 --2- 172.21.15.16:0/3263521148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ab00cd4d0 0x7f9ab01f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:02.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 >> 172.21.15.16:0/3263521148 conn(0x7f9ab006c380 msgr2=0x7f9ab0153660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:02.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 shutdown_connections 2024-04-26T20:22:02.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:02.693+0000 7f9ab8600640 1 -- 172.21.15.16:0/3263521148 wait complete. 2024-04-26T20:22:02.715 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:22:04.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:04.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3e200640 1 Processor -- start 2024-04-26T20:22:04.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3e200640 1 -- start start 2024-04-26T20:22:04.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3e200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcb380c5830 0x7fcb380c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3e200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb380c7430 con 0x7fcb381529c0 2024-04-26T20:22:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3e200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb380c7710 con 0x7fcb3815bc20 2024-04-26T20:22:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3e200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fcb38158bf0 con 0x7fcb380c5830 2024-04-26T20:22:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3ce00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcb381529c0 0x7fcb38159080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:41164/0 (socket says 172.21.15.16:41164) 2024-04-26T20:22:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3ce00640 1 -- 172.21.15.16:0/4177784511 learned_addr learned my addr 172.21.15.16:0/4177784511 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb3d800640 1 --2- 172.21.15.16:0/4177784511 >> v2:172.21.15.192:3300/0 conn(0x7fcb380c5830 0x7fcb380c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319423728 0 0) 0x7fcb380c7430 con 0x7fcb381529c0 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb1c003530 con 0x7fcb381529c0 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2601062 0 0) 0x7fcb1c003530 con 0x7fcb381529c0 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 >> v2:172.21.15.192:3300/0 conn(0x7fcb380c5830 msgr2=0x7fcb380c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 --2- 172.21.15.16:0/4177784511 >> v2:172.21.15.192:3300/0 conn(0x7fcb380c5830 0x7fcb380c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 >> v1:172.21.15.192:6789/0 conn(0x7fcb3815bc20 legacy=0x7fcb380ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb380c79f0 con 0x7fcb381529c0 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fcb28001680 con 0x7fcb381529c0 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 >> v1:172.21.15.16:6789/0 conn(0x7fcb381529c0 legacy=0x7fcb38159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb1c0039c0 0x7fcb1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb1c004810 0x7fcb1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c0051d0 0x7fcb1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38158bf0 con 0x7fcb1c004810 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c00c080 con 0x7fcb1c0039c0 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.869+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1c00c280 con 0x7fcb1c0051d0 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb2fe00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb1c004810 0x7fcb1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb3ce00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb1c0039c0 0x7fcb1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb3d800640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c0051d0 0x7fcb1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb2fe00640 1 -- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c0051d0 msgr2=0x7fcb1c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb2fe00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c0051d0 0x7fcb1c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb2fe00640 1 -- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb1c0039c0 msgr2=0x7fcb1c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb2fe00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb1c0039c0 0x7fcb1c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb2fe00640 1 -- 172.21.15.16:0/4177784511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c003530 con 0x7fcb1c004810 2024-04-26T20:22:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb3d800640 1 -- 172.21.15.16:0/4177784511 reap_dead start 2024-04-26T20:22:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb2fe00640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb1c004810 0x7fcb1c004c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcb20001750 tx=0x7fcb2001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68004a963641c2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200013a0 con 0x7fcb1c004810 2024-04-26T20:22:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb200052f0 con 0x7fcb1c004810 2024-04-26T20:22:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.873+0000 7fcb37e00640 1 -- 172.21.15.16:0/4177784511 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20003840 con 0x7fcb1c004810 2024-04-26T20:22:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- 172.21.15.16:0/4177784511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb1c004810 msgr2=0x7fcb1c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb1c004810 0x7fcb1c004c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcb20001750 tx=0x7fcb2001c3e0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- 172.21.15.16:0/4177784511 shutdown_connections 2024-04-26T20:22:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 --2- 172.21.15.16:0/4177784511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb1c004810 0x7fcb1c004c90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- 172.21.15.16:0/4177784511 >> 172.21.15.16:0/4177784511 conn(0x7fcb38070d40 msgr2=0x7fcb38071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- 172.21.15.16:0/4177784511 shutdown_connections 2024-04-26T20:22:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- 172.21.15.16:0/4177784511 wait complete. 2024-04-26T20:22:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 Processor -- start 2024-04-26T20:22:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- start start 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c004810 0x7fcb381f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb381549e0 0x7fcb38159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb38150f30 0x7fcb381f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38070580 con 0x7fcb38150f30 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38152da0 con 0x7fcb381549e0 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3e200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcb380c8390 con 0x7fcb1c004810 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb38150f30 0x7fcb381f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb38150f30 0x7fcb381f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38024/0 (socket says 172.21.15.16:38024) 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 -- 172.21.15.16:0/967939097 learned_addr learned my addr 172.21.15.16:0/967939097 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3ce00640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c004810 0x7fcb381f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb2fe00640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb381549e0 0x7fcb38159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 -- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c004810 msgr2=0x7fcb381f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c004810 0x7fcb381f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 -- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb381549e0 msgr2=0x7fcb38159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb381549e0 0x7fcb38159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3d800640 1 -- 172.21.15.16:0/967939097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3814bd50 con 0x7fcb38150f30 2024-04-26T20:22:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.877+0000 7fcb3ce00640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c004810 0x7fcb381f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb3d800640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb38150f30 0x7fcb381f4710 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcb380cef20 tx=0x7fcb300115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb35600640 1 -- 172.21.15.16:0/967939097 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb30011de0 con 0x7fcb38150f30 2024-04-26T20:22:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb35600640 1 -- 172.21.15.16:0/967939097 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3001b070 con 0x7fcb38150f30 2024-04-26T20:22:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb35600640 1 -- 172.21.15.16:0/967939097 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb300039a0 con 0x7fcb38150f30 2024-04-26T20:22:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb381f13b0 con 0x7fcb38150f30 2024-04-26T20:22:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb381f1650 con 0x7fcb38150f30 2024-04-26T20:22:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb381f11a0 con 0x7fcb38150f30 2024-04-26T20:22:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb35600640 1 -- 172.21.15.16:0/967939097 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb30003b40 con 0x7fcb38150f30 2024-04-26T20:22:04.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb35600640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcb14068380 0x7fcb1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:04.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb35600640 1 -- 172.21.15.16:0/967939097 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fcb300878e0 con 0x7fcb38150f30 2024-04-26T20:22:04.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.881+0000 7fcb3ce00640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcb14068380 0x7fcb1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:04.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.885+0000 7fcb3ce00640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcb14068380 0x7fcb1406a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb28007cc0 tx=0x7fcb28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:04.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:04.885+0000 7fcb35600640 1 -- 172.21.15.16:0/967939097 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb30057810 con 0x7fcb38150f30 2024-04-26T20:22:05.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.085+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb380506d0 con 0x7fcb38150f30 2024-04-26T20:22:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.085+0000 7fcb35600640 1 -- 172.21.15.16:0/967939097 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+6054 (secure 0 0 0) 0x7fcb30057110 con 0x7fcb38150f30 2024-04-26T20:22:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:05.087 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:00.452016+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:resolve","state_seq":12,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[5127,4970]},"id":1}]} 2024-04-26T20:22:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 34 2024-04-26T20:22:05.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcb14068380 msgr2=0x7fcb1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcb14068380 0x7fcb1406a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb28007cc0 tx=0x7fcb28009040 comp rx=0 tx=0).stop 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb38150f30 msgr2=0x7fcb381f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb38150f30 0x7fcb381f4710 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcb380cef20 tx=0x7fcb300115a0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 shutdown_connections 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcb14068380 0x7fcb1406a840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb38150f30 0x7fcb381f4710 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb381549e0 0x7fcb38159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 --2- 172.21.15.16:0/967939097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcb1c004810 0x7fcb381f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 >> 172.21.15.16:0/967939097 conn(0x7fcb38070d40 msgr2=0x7fcb380ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 shutdown_connections 2024-04-26T20:22:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:05.089+0000 7fcb3e200640 1 -- 172.21.15.16:0/967939097 wait complete. 2024-04-26T20:22:05.109 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 34, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 34, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4970": { "addr": "172.21.15.192:6838/3304030586", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6836", "nonce": 3304030586, "type": "v2" }, { "addr": "172.21.15.192:6838", "nonce": 3304030586, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4970, "incarnation": 27, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 31 }, "gid_5127": { "addr": "172.21.15.16:6833/1748916109", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6832", "nonce": 1748916109, "type": "v2" }, { "addr": "172.21.15.16:6833", "nonce": 1748916109, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5127, "incarnation": 21, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:active", "state_seq": 31 }, "gid_5391": { "addr": "172.21.15.16:6836/1623880328", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6834", "nonce": 1623880328, "type": "v2" }, { "addr": "172.21.15.16:6836", "nonce": 1623880328, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5391, "incarnation": 33, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:resolve", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:22:00.452016+0000", "qdb_cluster": [ 5127, 4970 ], "qdb_leader": 4970, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5391, "mds_1": 4970, "mds_2": 5127 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:22:07.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.261+0000 7f7ac8c00640 1 Processor -- start 2024-04-26T20:22:07.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.261+0000 7f7ac8c00640 1 -- start start 2024-04-26T20:22:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac8c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ac40c7b80 0x7f7ac40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac8c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac40c9d90 con 0x7f7ac4153af0 2024-04-26T20:22:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac8c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac40ca070 con 0x7f7ac40c9010 2024-04-26T20:22:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac8c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac415dec0 con 0x7f7ac40c7b80 2024-04-26T20:22:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7ac4153af0 0x7f7ac415d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55926/0 (socket says 172.21.15.16:55926) 2024-04-26T20:22:07.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1e00640 1 -- 172.21.15.16:0/2776188851 learned_addr learned my addr 172.21.15.16:0/2776188851 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:22:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7abbe00640 1 --2- 172.21.15.16:0/2776188851 >> v2:172.21.15.192:3300/0 conn(0x7f7ac40c7b80 0x7f7ac40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260962757 0 0) 0x7f7ac40c9d90 con 0x7f7ac4153af0 2024-04-26T20:22:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa8003530 con 0x7f7ac4153af0 2024-04-26T20:22:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4253454160 0 0) 0x7f7aa8003530 con 0x7f7ac4153af0 2024-04-26T20:22:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 >> v2:172.21.15.192:3300/0 conn(0x7f7ac40c7b80 msgr2=0x7f7ac40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 --2- 172.21.15.16:0/2776188851 >> v2:172.21.15.192:3300/0 conn(0x7f7ac40c7b80 0x7f7ac40c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 >> v1:172.21.15.192:6789/0 conn(0x7f7ac40c9010 legacy=0x7f7ac40c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac40ca350 con 0x7f7ac4153af0 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f7ab4001680 con 0x7f7ac4153af0 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 >> v1:172.21.15.16:6789/0 conn(0x7f7ac4153af0 legacy=0x7f7ac415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aa80039c0 0x7f7aa8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa8004810 0x7f7aa8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7aa80051d0 0x7f7aa800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac415dec0 con 0x7f7aa80051d0 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa800c080 con 0x7f7aa8004810 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa800c280 con 0x7f7aa80039c0 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac2800640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7aa80051d0 0x7f7aa800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7abbe00640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa8004810 0x7f7aa8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aa80039c0 0x7f7aa8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac2800640 1 -- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aa80039c0 msgr2=0x7f7aa8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac2800640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7aa80039c0 0x7f7aa8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac2800640 1 -- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa8004810 msgr2=0x7f7aa8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac2800640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa8004810 0x7f7aa8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.265+0000 7f7ac2800640 1 -- 172.21.15.16:0/2776188851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa8003530 con 0x7f7aa80051d0 2024-04-26T20:22:07.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac2800640 1 -- 172.21.15.16:0/2776188851 reap_dead start 2024-04-26T20:22:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac2800640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7aa80051d0 0x7f7aa800b9d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7abc001e70 tx=0x7f7abc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0cc556a2b015d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc001a90 con 0x7f7aa80051d0 2024-04-26T20:22:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7abc003bc0 con 0x7f7aa80051d0 2024-04-26T20:22:07.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac1400640 1 -- 172.21.15.16:0/2776188851 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc005020 con 0x7f7aa80051d0 2024-04-26T20:22:07.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac8c00640 1 -- 172.21.15.16:0/2776188851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7aa80051d0 msgr2=0x7f7aa800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:07.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7aa80051d0 0x7f7aa800b9d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7abc001e70 tx=0x7f7abc01c780 comp rx=0 tx=0).stop 2024-04-26T20:22:07.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac8c00640 1 -- 172.21.15.16:0/2776188851 shutdown_connections 2024-04-26T20:22:07.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/2776188851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7aa80051d0 0x7f7aa800b9d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac8c00640 1 -- 172.21.15.16:0/2776188851 >> 172.21.15.16:0/2776188851 conn(0x7f7ac406c380 msgr2=0x7f7ac406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:07.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac8c00640 1 -- 172.21.15.16:0/2776188851 shutdown_connections 2024-04-26T20:22:07.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.269+0000 7f7ac8c00640 1 -- 172.21.15.16:0/2776188851 wait complete. 2024-04-26T20:22:07.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 Processor -- start 2024-04-26T20:22:07.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 -- start start 2024-04-26T20:22:07.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa80051d0 0x7f7ac40cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac4159a00 0x7f7ac414a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41f5750 0x7f7ac4158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac40ca630 con 0x7f7ac41f5750 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac40c9c10 con 0x7f7aa80051d0 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac415d290 con 0x7f7ac4159a00 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41f5750 0x7f7ac4158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41f5750 0x7f7ac4158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41456/0 (socket says 172.21.15.16:41456) 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 -- 172.21.15.16:0/4176591215 learned_addr learned my addr 172.21.15.16:0/4176591215 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa80051d0 0x7f7ac40cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7abbe00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac4159a00 0x7f7ac414a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 -- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac4159a00 msgr2=0x7f7ac414a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac4159a00 0x7f7ac414a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 -- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa80051d0 msgr2=0x7f7ac40cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa80051d0 0x7f7ac40cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 -- 172.21.15.16:0/4176591215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac40cc090 con 0x7f7ac41f5750 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa80051d0 0x7f7ac40cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac2800640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41f5750 0x7f7ac4158f30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7abc01d020 tx=0x7f7aa8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7aba000640 1 -- 172.21.15.16:0/4176591215 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc007dc0 con 0x7f7ac41f5750 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7aba000640 1 -- 172.21.15.16:0/4176591215 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7abc001260 con 0x7f7ac41f5750 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7aba000640 1 -- 172.21.15.16:0/4176591215 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc006d70 con 0x7f7ac41f5750 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac41f4cb0 con 0x7f7ac41f5750 2024-04-26T20:22:07.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac4073d90 con 0x7f7ac41f5750 2024-04-26T20:22:07.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.273+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac41e5bd0 con 0x7f7ac41f5750 2024-04-26T20:22:07.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.277+0000 7f7aba000640 1 -- 172.21.15.16:0/4176591215 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7abc0a6480 con 0x7f7ac41f5750 2024-04-26T20:22:07.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.277+0000 7f7aba000640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa0068380 0x7f7aa006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:07.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.277+0000 7f7aba000640 1 -- 172.21.15.16:0/4176591215 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f7abc1208c0 con 0x7f7ac41f5750 2024-04-26T20:22:07.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.277+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa0068380 0x7f7aa006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:07.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.277+0000 7f7ac1e00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa0068380 0x7f7aa006a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4001060 tx=0x7f7ab4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:07.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.281+0000 7f7aba000640 1 -- 172.21.15.16:0/4176591215 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7abc016490 con 0x7f7ac41f5750 2024-04-26T20:22:07.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ac4077c20 con 0x7f7ac41f5750 2024-04-26T20:22:07.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7aba000640 1 -- 172.21.15.16:0/4176591215 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+6056 (secure 0 0 0) 0x7f7abc0f0880 con 0x7f7ac41f5750 2024-04-26T20:22:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:06.324811+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:22:07.486 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 35 2024-04-26T20:22:07.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa0068380 msgr2=0x7f7aa006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:07.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa0068380 0x7f7aa006a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4001060 tx=0x7f7ab4009040 comp rx=0 tx=0).stop 2024-04-26T20:22:07.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41f5750 msgr2=0x7f7ac4158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41f5750 0x7f7ac4158f30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7abc01d020 tx=0x7f7aa8005840 comp rx=0 tx=0).stop 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 shutdown_connections 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f7aa0068380 0x7f7aa006a840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac41f5750 0x7f7ac4158f30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ac4159a00 0x7f7ac414a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 --2- 172.21.15.16:0/4176591215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7aa80051d0 0x7f7ac40cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 >> 172.21.15.16:0/4176591215 conn(0x7f7ac406c380 msgr2=0x7f7ac40c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 shutdown_connections 2024-04-26T20:22:07.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:07.485+0000 7f7ac8c00640 1 -- 172.21.15.16:0/4176591215 wait complete. 2024-04-26T20:22:07.506 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:22:09.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:09.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.657+0000 7f0547200640 1 Processor -- start 2024-04-26T20:22:09.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0547200640 1 -- start start 2024-04-26T20:22:09.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0547200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054815c8b0 0x7f05480cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0547200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05480b1d90 0x7f054815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0547200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05480ca540 con 0x7f0548071650 2024-04-26T20:22:09.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0547200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f054815cc90 con 0x7f05480b1d90 2024-04-26T20:22:09.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0547200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f05480708f0 con 0x7f054815c8b0 2024-04-26T20:22:09.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0545e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054815c8b0 0x7f05480cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f053d400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0548071650 0x7f05480cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:38456/0 (socket says 172.21.15.16:38456) 2024-04-26T20:22:09.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0546800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05480b1d90 0x7f054815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f053d400640 1 -- 172.21.15.16:0/455333880 learned_addr learned my addr 172.21.15.16:0/455333880 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:22:09.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0545e00640 1 -- 172.21.15.16:0/455333880 >> v2:172.21.15.192:3300/0 conn(0x7f05480b1d90 msgr2=0x7f054815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:09.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0545e00640 1 --2- 172.21.15.16:0/455333880 >> v2:172.21.15.192:3300/0 conn(0x7f05480b1d90 0x7f054815bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0545e00640 1 -- 172.21.15.16:0/455333880 >> v1:172.21.15.192:6789/0 conn(0x7f0548071650 legacy=0x7f05480cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0545e00640 1 -- 172.21.15.16:0/455333880 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05480c6380 con 0x7f054815c8b0 2024-04-26T20:22:09.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.661+0000 7f0546800640 1 --2- 172.21.15.16:0/455333880 >> v2:172.21.15.192:3300/0 conn(0x7f05480b1d90 0x7f054815bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:22:09.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0545e00640 1 --2- 172.21.15.16:0/455333880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054815c8b0 0x7f05480cad00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05380097c0 tx=0x7f053801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=763b6dd496633e72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:09.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0545400640 1 -- 172.21.15.16:0/455333880 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380b0070 con 0x7f054815c8b0 2024-04-26T20:22:09.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0545400640 1 -- 172.21.15.16:0/455333880 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05380ab600 con 0x7f054815c8b0 2024-04-26T20:22:09.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0545400640 1 -- 172.21.15.16:0/455333880 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380ab9d0 con 0x7f054815c8b0 2024-04-26T20:22:09.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 -- 172.21.15.16:0/455333880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054815c8b0 msgr2=0x7f05480cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 --2- 172.21.15.16:0/455333880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054815c8b0 0x7f05480cad00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05380097c0 tx=0x7f053801c410 comp rx=0 tx=0).stop 2024-04-26T20:22:09.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 -- 172.21.15.16:0/455333880 shutdown_connections 2024-04-26T20:22:09.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 --2- 172.21.15.16:0/455333880 >> v2:172.21.15.192:3300/0 conn(0x7f05480b1d90 0x7f054815bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 --2- 172.21.15.16:0/455333880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f054815c8b0 0x7f05480cad00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 -- 172.21.15.16:0/455333880 >> 172.21.15.16:0/455333880 conn(0x7f054806c7b0 msgr2=0x7f0548068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:09.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 -- 172.21.15.16:0/455333880 shutdown_connections 2024-04-26T20:22:09.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.665+0000 7f0547200640 1 -- 172.21.15.16:0/455333880 wait complete. 2024-04-26T20:22:09.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 Processor -- start 2024-04-26T20:22:09.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 -- start start 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0548071650 0x7f05480c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05480b1d90 0x7f054815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054815c8b0 0x7f05481f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05480cfb20 con 0x7f054815c8b0 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05480cf9a0 con 0x7f0548071650 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0548168d80 con 0x7f05480b1d90 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054815c8b0 0x7f05481f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054815c8b0 0x7f05481f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41462/0 (socket says 172.21.15.16:41462) 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 -- 172.21.15.16:0/1176093847 learned_addr learned my addr 172.21.15.16:0/1176093847 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0545e00640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0548071650 0x7f05480c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f053d400640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05480b1d90 0x7f054815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 -- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05480b1d90 msgr2=0x7f054815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05480b1d90 0x7f054815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 -- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0548071650 msgr2=0x7f05480c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0548071650 0x7f05480c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 -- 172.21.15.16:0/1176093847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05480c9850 con 0x7f054815c8b0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0546800640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054815c8b0 0x7f05481f8110 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f054000efc0 tx=0x7f054000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f053ea00640 1 -- 172.21.15.16:0/1176093847 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540018020 con 0x7f054815c8b0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f053ea00640 1 -- 172.21.15.16:0/1176093847 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540014480 con 0x7f054815c8b0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f053ea00640 1 -- 172.21.15.16:0/1176093847 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540014870 con 0x7f054815c8b0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05481567d0 con 0x7f054815c8b0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05480b43d0 con 0x7f054815c8b0 2024-04-26T20:22:09.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.669+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05480506d0 con 0x7f054815c8b0 2024-04-26T20:22:09.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.673+0000 7f053ea00640 1 -- 172.21.15.16:0/1176093847 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f054001b020 con 0x7f054815c8b0 2024-04-26T20:22:09.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.673+0000 7f053ea00640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0524068380 0x7f052406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:09.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.673+0000 7f053ea00640 1 -- 172.21.15.16:0/1176093847 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f0540087b40 con 0x7f054815c8b0 2024-04-26T20:22:09.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.673+0000 7f0545e00640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0524068380 0x7f052406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:09.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.673+0000 7f0545e00640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0524068380 0x7f052406a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05380ad000 tx=0x7f05380a4f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:09.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.677+0000 7f053ea00640 1 -- 172.21.15.16:0/1176093847 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0540022030 con 0x7f054815c8b0 2024-04-26T20:22:09.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.873+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05480c9fd0 con 0x7f054815c8b0 2024-04-26T20:22:09.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.873+0000 7f053ea00640 1 -- 172.21.15.16:0/1176093847 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+6056 (secure 0 0 0) 0x7f0540010040 con 0x7f054815c8b0 2024-04-26T20:22:09.876 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:09.876 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:06.324811+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:22:09.876 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 35 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0524068380 msgr2=0x7f052406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0524068380 0x7f052406a840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05380ad000 tx=0x7f05380a4f90 comp rx=0 tx=0).stop 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054815c8b0 msgr2=0x7f05481f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054815c8b0 0x7f05481f8110 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f054000efc0 tx=0x7f054000c490 comp rx=0 tx=0).stop 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 shutdown_connections 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0524068380 0x7f052406a840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054815c8b0 0x7f05481f8110 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05480b1d90 0x7f054815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 --2- 172.21.15.16:0/1176093847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0548071650 0x7f05480c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:09.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 >> 172.21.15.16:0/1176093847 conn(0x7f054806c7b0 msgr2=0x7f05480c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:09.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 shutdown_connections 2024-04-26T20:22:09.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:09.877+0000 7f0547200640 1 -- 172.21.15.16:0/1176093847 wait complete. 2024-04-26T20:22:09.897 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:22:11.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:12.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.048+0000 7f0cc6800640 1 Processor -- start 2024-04-26T20:22:12.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.048+0000 7f0cc6800640 1 -- start start 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cc6800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cc0152bc0 0x7f0cc00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cc6800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc0152fa0 con 0x7f0cc00c9340 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cc6800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc0159790 con 0x7f0cc0073480 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cc6800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc0158930 con 0x7f0cc0152bc0 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cbf400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cc0152bc0 0x7f0cc00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cbf400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cc0152bc0 0x7f0cc00c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41466/0 (socket says 172.21.15.16:41466) 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cbf400640 1 -- 172.21.15.16:0/2463502197 learned_addr learned my addr 172.21.15.16:0/2463502197 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:12.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cb7e00640 1 --1- 172.21.15.16:0/2463502197 >> v1:172.21.15.16:6789/0 conn(0x7f0cc00c9340 0x7f0cc0072d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55936/0 (socket says 172.21.15.16:55936) 2024-04-26T20:22:12.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cbf400640 1 -- 172.21.15.16:0/2463502197 >> v1:172.21.15.192:6789/0 conn(0x7f0cc0073480 legacy=0x7f0cc00c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:12.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cbf400640 1 -- 172.21.15.16:0/2463502197 >> v1:172.21.15.16:6789/0 conn(0x7f0cc00c9340 legacy=0x7f0cc0072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:12.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cbf400640 1 -- 172.21.15.16:0/2463502197 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc0158c10 con 0x7f0cc0152bc0 2024-04-26T20:22:12.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.052+0000 7f0cbea00640 1 -- 172.21.15.16:0/2463502197 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843870301 0 0) 0x7f0cc0152fa0 con 0x7f0cc00c9340 2024-04-26T20:22:12.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cbf400640 1 --2- 172.21.15.16:0/2463502197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c8e00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00098a0 tx=0x7f0cb001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbe6e7a9f9542c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cbea00640 1 -- 172.21.15.16:0/2463502197 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00b5070 con 0x7f0cc0152bc0 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cbea00640 1 -- 172.21.15.16:0/2463502197 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb00a8a30 con 0x7f0cc0152bc0 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cbea00640 1 -- 172.21.15.16:0/2463502197 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00a8e00 con 0x7f0cc0152bc0 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 -- 172.21.15.16:0/2463502197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0152bc0 msgr2=0x7f0cc00c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2463502197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c8e00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00098a0 tx=0x7f0cb001ed30 comp rx=0 tx=0).stop 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 -- 172.21.15.16:0/2463502197 shutdown_connections 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2463502197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c8e00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 -- 172.21.15.16:0/2463502197 >> 172.21.15.16:0/2463502197 conn(0x7f0cc006c380 msgr2=0x7f0cc006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 -- 172.21.15.16:0/2463502197 shutdown_connections 2024-04-26T20:22:12.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 -- 172.21.15.16:0/2463502197 wait complete. 2024-04-26T20:22:12.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 Processor -- start 2024-04-26T20:22:12.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.056+0000 7f0cc6800640 1 -- start start 2024-04-26T20:22:12.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0073480 0x7f0cc0153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:12.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0cc00c9340 0x7f0cc00c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:12.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:12.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc01594b0 con 0x7f0cc0073480 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc01591d0 con 0x7f0cc0152bc0 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00c47d0 con 0x7f0cc00c9340 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0073480 0x7f0cc0153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0073480 0x7f0cc0153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41476/0 (socket says 172.21.15.16:41476) 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 -- 172.21.15.16:0/2302308812 learned_addr learned my addr 172.21.15.16:0/2302308812 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cb7e00640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0cc00c9340 0x7f0cc00c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbfe00640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 -- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0cc00c9340 msgr2=0x7f0cc00c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0cc00c9340 0x7f0cc00c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 -- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cc0152bc0 msgr2=0x7f0cc00c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:12.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 -- 172.21.15.16:0/2302308812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc01f53d0 con 0x7f0cc0073480 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbfe00640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cbf400640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0073480 0x7f0cc0153a90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00b3040 tx=0x7f0cb001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cb7400640 1 -- 172.21.15.16:0/2302308812 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00c0070 con 0x7f0cc0073480 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cb7400640 1 -- 172.21.15.16:0/2302308812 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb00b0be0 con 0x7f0cc0073480 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cb7400640 1 -- 172.21.15.16:0/2302308812 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00b5070 con 0x7f0cc0073480 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc01f5650 con 0x7f0cc0073480 2024-04-26T20:22:12.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc01f5c10 con 0x7f0cc0073480 2024-04-26T20:22:12.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc0077c20 con 0x7f0cc0073480 2024-04-26T20:22:12.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.060+0000 7f0cb7400640 1 -- 172.21.15.16:0/2302308812 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0cb00c3070 con 0x7f0cc0073480 2024-04-26T20:22:12.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.064+0000 7f0cb7400640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c9c068380 0x7f0c9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:12.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.064+0000 7f0cb7400640 1 -- 172.21.15.16:0/2302308812 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f0cb01240f0 con 0x7f0cc0073480 2024-04-26T20:22:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.064+0000 7f0cb7e00640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c9c068380 0x7f0c9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:12.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.064+0000 7f0cb7e00640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c9c068380 0x7f0c9c06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8007fd0 tx=0x7f0ca8007ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:12.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.068+0000 7f0cb7400640 1 -- 172.21.15.16:0/2302308812 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0cc01f53d0 con 0x7f0cc0073480 2024-04-26T20:22:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cc00c9940 con 0x7f0cc0073480 2024-04-26T20:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cb7400640 1 -- 172.21.15.16:0/2302308812 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+6056 (secure 0 0 0) 0x7f0cb0018890 con 0x7f0cc0073480 2024-04-26T20:22:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:12.269 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:06.324811+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[4970,5127]},"id":1}]} 2024-04-26T20:22:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 35 2024-04-26T20:22:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c9c068380 msgr2=0x7f0c9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c9c068380 0x7f0c9c06a840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8007fd0 tx=0x7f0ca8007ba0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0073480 msgr2=0x7f0cc0153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0073480 0x7f0cc0153a90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00b3040 tx=0x7f0cb001bad0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 shutdown_connections 2024-04-26T20:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0c9c068380 0x7f0c9c06a840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cc0152bc0 0x7f0cc00c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0cc00c9340 0x7f0cc00c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 --2- 172.21.15.16:0/2302308812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc0073480 0x7f0cc0153a90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 >> 172.21.15.16:0/2302308812 conn(0x7f0cc006c380 msgr2=0x7f0cc0140280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 shutdown_connections 2024-04-26T20:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:12.268+0000 7f0cc6800640 1 -- 172.21.15.16:0/2302308812 wait complete. 2024-04-26T20:22:12.291 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:22:14.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.440+0000 7fc6e4a00640 1 Processor -- start 2024-04-26T20:22:14.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.440+0000 7fc6e4a00640 1 -- start start 2024-04-26T20:22:14.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6e4a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:14.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6e4a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e0152fa0 con 0x7fc6e0152bc0 2024-04-26T20:22:14.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6e4a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e0159790 con 0x7fc6e0072d70 2024-04-26T20:22:14.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6e4a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e0158930 con 0x7fc6e00c9b60 2024-04-26T20:22:14.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6dde00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc6e0152bc0 0x7fc6e00c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55944/0 (socket says 172.21.15.16:55944) 2024-04-26T20:22:14.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6dde00640 1 -- 172.21.15.16:0/2093033503 learned_addr learned my addr 172.21.15.16:0/2093033503 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:22:14.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6de800640 1 --2- 172.21.15.16:0/2093033503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:14.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6dd400640 1 -- 172.21.15.16:0/2093033503 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229637163 0 0) 0x7fc6e0152fa0 con 0x7fc6e0152bc0 2024-04-26T20:22:14.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6dd400640 1 -- 172.21.15.16:0/2093033503 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6c4003530 con 0x7fc6e0152bc0 2024-04-26T20:22:14.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6de800640 1 -- 172.21.15.16:0/2093033503 >> v1:172.21.15.192:6789/0 conn(0x7fc6e0072d70 legacy=0x7fc6e00731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:14.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6dd400640 1 -- 172.21.15.16:0/2093033503 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414896877 0 0) 0x7fc6c4003530 con 0x7fc6e0152bc0 2024-04-26T20:22:14.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6de800640 1 -- 172.21.15.16:0/2093033503 >> v1:172.21.15.16:6789/0 conn(0x7fc6e0152bc0 legacy=0x7fc6e00c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:14.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.444+0000 7fc6de800640 1 -- 172.21.15.16:0/2093033503 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e0158c10 con 0x7fc6e00c9b60 2024-04-26T20:22:14.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6de800640 1 --2- 172.21.15.16:0/2093033503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00c9fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009dc0 tx=0x7fc6d801c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89df0e5d7ed6587e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:14.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6dd400640 1 -- 172.21.15.16:0/2093033503 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80b2070 con 0x7fc6e00c9b60 2024-04-26T20:22:14.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6dd400640 1 -- 172.21.15.16:0/2093033503 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d80a5650 con 0x7fc6e00c9b60 2024-04-26T20:22:14.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6dd400640 1 -- 172.21.15.16:0/2093033503 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0001680 con 0x7fc6e00c9b60 2024-04-26T20:22:14.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- 172.21.15.16:0/2093033503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 msgr2=0x7fc6e00c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:14.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/2093033503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00c9fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009dc0 tx=0x7fc6d801c7f0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- 172.21.15.16:0/2093033503 shutdown_connections 2024-04-26T20:22:14.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/2093033503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00c9fd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- 172.21.15.16:0/2093033503 >> 172.21.15.16:0/2093033503 conn(0x7fc6e006c380 msgr2=0x7fc6e006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:14.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- 172.21.15.16:0/2093033503 shutdown_connections 2024-04-26T20:22:14.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- 172.21.15.16:0/2093033503 wait complete. 2024-04-26T20:22:14.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 Processor -- start 2024-04-26T20:22:14.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- start start 2024-04-26T20:22:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6e0072d70 0x7fc6e0143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e0152bc0 0x7fc6e01f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e01594b0 con 0x7fc6e0072d70 2024-04-26T20:22:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e01591d0 con 0x7fc6e0152bc0 2024-04-26T20:22:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.448+0000 7fc6e4a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e00ca510 con 0x7fc6e00c9b60 2024-04-26T20:22:14.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6e0072d70 0x7fc6e0143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6e0072d70 0x7fc6e0143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41480/0 (socket says 172.21.15.16:41480) 2024-04-26T20:22:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 -- 172.21.15.16:0/236388107 learned_addr learned my addr 172.21.15.16:0/236388107 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6d5400640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:14.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6de800640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e0152bc0 0x7fc6e01f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:14.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 -- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 msgr2=0x7fc6e00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:14.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 -- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e0152bc0 msgr2=0x7fc6e01f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:14.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e0152bc0 0x7fc6e01f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 -- 172.21.15.16:0/236388107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e00cb8c0 con 0x7fc6e0072d70 2024-04-26T20:22:14.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6dde00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6e0072d70 0x7fc6e0143960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4e0 tx=0x7fc6d000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:14.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6d6a00640 1 -- 172.21.15.16:0/236388107 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0018070 con 0x7fc6e0072d70 2024-04-26T20:22:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6d6a00640 1 -- 172.21.15.16:0/236388107 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0007500 con 0x7fc6e0072d70 2024-04-26T20:22:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6d6a00640 1 -- 172.21.15.16:0/236388107 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0004a30 con 0x7fc6e0072d70 2024-04-26T20:22:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e0145e50 con 0x7fc6e0072d70 2024-04-26T20:22:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e0146410 con 0x7fc6e0072d70 2024-04-26T20:22:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e0077c20 con 0x7fc6e0072d70 2024-04-26T20:22:14.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.452+0000 7fc6d6a00640 1 -- 172.21.15.16:0/236388107 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc6d001b070 con 0x7fc6e0072d70 2024-04-26T20:22:14.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.456+0000 7fc6d6a00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc6bc0683b0 0x7fc6bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:14.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.456+0000 7fc6d6a00640 1 -- 172.21.15.16:0/236388107 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fc6d00862e0 con 0x7fc6e0072d70 2024-04-26T20:22:14.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.456+0000 7fc6d5400640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc6bc0683b0 0x7fc6bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:14.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.456+0000 7fc6d5400640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc6bc0683b0 0x7fc6bc06a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6e01f62a0 tx=0x7fc6c8009a30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:14.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.460+0000 7fc6d6a00640 1 -- 172.21.15.16:0/236388107 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc6d0055c50 con 0x7fc6e0072d70 2024-04-26T20:22:14.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6e01523f0 con 0x7fc6e0072d70 2024-04-26T20:22:14.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6d6a00640 1 -- 172.21.15.16:0/236388107 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+6053 (secure 0 0 0) 0x7fc6d0059f50 con 0x7fc6e0072d70 2024-04-26T20:22:14.665 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:14.665 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:12.172821+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[5127,4970]},"id":1}]} 2024-04-26T20:22:14.666 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 36 2024-04-26T20:22:14.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc6bc0683b0 msgr2=0x7fc6bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc6bc0683b0 0x7fc6bc06a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6e01f62a0 tx=0x7fc6c8009a30 comp rx=0 tx=0).stop 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6e0072d70 msgr2=0x7fc6e0143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6e0072d70 0x7fc6e0143960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c4e0 tx=0x7fc6d000c9a0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 shutdown_connections 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc6bc0683b0 0x7fc6bc06a870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e0152bc0 0x7fc6e01f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc6e00c9b60 0x7fc6e00caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 --2- 172.21.15.16:0/236388107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6e0072d70 0x7fc6e0143960 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 >> 172.21.15.16:0/236388107 conn(0x7fc6e006c380 msgr2=0x7fc6e00c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 shutdown_connections 2024-04-26T20:22:14.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:14.664+0000 7fc6e4a00640 1 -- 172.21.15.16:0/236388107 wait complete. 2024-04-26T20:22:14.687 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-04-26T20:22:16.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:16.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc7600640 1 Processor -- start 2024-04-26T20:22:16.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc7600640 1 -- start start 2024-04-26T20:22:16.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc7600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc01574b0 0x7f9dc00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc7600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9dc00b47e0 0x7f9dc006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc7600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc00cb7f0 con 0x7f9dc00c63f0 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc7600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc00c9e80 con 0x7f9dc00b47e0 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc7600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc00ca0d0 con 0x7f9dc01574b0 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9db7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9dc00b47e0 0x7f9dc006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9db7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9dc00b47e0 0x7f9dc006feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55934/0 (socket says 172.21.15.16:55934) 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9db7e00640 1 -- 172.21.15.16:0/418011036 learned_addr learned my addr 172.21.15.16:0/418011036 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9dc4c00640 1 --2- 172.21.15.16:0/418011036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc01574b0 0x7f9dc00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9db7e00640 1 -- 172.21.15.16:0/418011036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc01574b0 msgr2=0x7f9dc00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9db7e00640 1 --2- 172.21.15.16:0/418011036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc01574b0 0x7f9dc00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9db7e00640 1 -- 172.21.15.16:0/418011036 >> v1:172.21.15.16:6789/0 conn(0x7f9dc00c63f0 legacy=0x7f9dc00cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:16.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.840+0000 7f9db7e00640 1 -- 172.21.15.16:0/418011036 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc00cba90 con 0x7f9dc00b47e0 2024-04-26T20:22:16.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9db7e00640 1 --2- 172.21.15.16:0/418011036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00b47e0 0x7f9dc006feb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009870 tx=0x7f9da801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a70789572381af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:16.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dbfe00640 1 -- 172.21.15.16:0/418011036 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80ab650 con 0x7f9dc00b47e0 2024-04-26T20:22:16.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dbfe00640 1 -- 172.21.15.16:0/418011036 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da80b0070 con 0x7f9dc00b47e0 2024-04-26T20:22:16.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dbfe00640 1 -- 172.21.15.16:0/418011036 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80aba10 con 0x7f9dc00b47e0 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 -- 172.21.15.16:0/418011036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00b47e0 msgr2=0x7f9dc006feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 --2- 172.21.15.16:0/418011036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00b47e0 0x7f9dc006feb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009870 tx=0x7f9da801c560 comp rx=0 tx=0).stop 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 -- 172.21.15.16:0/418011036 shutdown_connections 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 --2- 172.21.15.16:0/418011036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00b47e0 0x7f9dc006feb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 --2- 172.21.15.16:0/418011036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc01574b0 0x7f9dc00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 -- 172.21.15.16:0/418011036 >> 172.21.15.16:0/418011036 conn(0x7f9dc0071160 msgr2=0x7f9dc0068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 -- 172.21.15.16:0/418011036 shutdown_connections 2024-04-26T20:22:16.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.844+0000 7f9dc7600640 1 -- 172.21.15.16:0/418011036 wait complete. 2024-04-26T20:22:16.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 Processor -- start 2024-04-26T20:22:16.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 -- start start 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc00b47e0 0x7f9dc01ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00c63f0 0x7f9dc00cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc01574b0 0x7f9dc0144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc00703f0 con 0x7f9dc00c63f0 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc00ccc90 con 0x7f9dc01574b0 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc0070570 con 0x7f9dc00b47e0 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00c63f0 0x7f9dc00cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00c63f0 0x7f9dc00cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55950/0 (socket says 172.21.15.16:55950) 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 -- 172.21.15.16:0/4147960725 learned_addr learned my addr 172.21.15.16:0/4147960725 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc4c00640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc00b47e0 0x7f9dc01ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc5600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc01574b0 0x7f9dc0144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:16.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 -- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc00b47e0 msgr2=0x7f9dc01ece90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:16.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc00b47e0 0x7f9dc01ece90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:16.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 -- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc01574b0 msgr2=0x7f9dc0144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:16.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc01574b0 0x7f9dc0144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:16.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 -- 172.21.15.16:0/4147960725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc01ed3d0 con 0x7f9dc00c63f0 2024-04-26T20:22:16.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc4c00640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc00b47e0 0x7f9dc01ece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9db7e00640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00c63f0 0x7f9dc00cdc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9da80ad040 tx=0x7f9da801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dbd600640 1 -- 172.21.15.16:0/4147960725 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80be5f0 con 0x7f9dc00c63f0 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dbd600640 1 -- 172.21.15.16:0/4147960725 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da80be790 con 0x7f9dc00c63f0 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dbd600640 1 -- 172.21.15.16:0/4147960725 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80beb80 con 0x7f9dc00c63f0 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc01ec3f0 con 0x7f9dc00c63f0 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc00cef60 con 0x7f9dc00c63f0 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.848+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc0077c20 con 0x7f9dc00c63f0 2024-04-26T20:22:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.852+0000 7f9dbd600640 1 -- 172.21.15.16:0/4147960725 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9da80b43f0 con 0x7f9dc00c63f0 2024-04-26T20:22:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.852+0000 7f9dbd600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d9c068380 0x7f9d9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:16.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.852+0000 7f9dbd600640 1 -- 172.21.15.16:0/4147960725 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f9da8121e20 con 0x7f9dc00c63f0 2024-04-26T20:22:16.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.852+0000 7f9dc4c00640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d9c068380 0x7f9d9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:16.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.852+0000 7f9dc4c00640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d9c068380 0x7f9d9c06a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009b10 tx=0x7f9db0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:16.856+0000 7f9dbd600640 1 -- 172.21.15.16:0/4147960725 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9da80c4060 con 0x7f9dc00c63f0 2024-04-26T20:22:17.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.052+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dc0150260 con 0x7f9dc00c63f0 2024-04-26T20:22:17.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.052+0000 7f9dbd600640 1 -- 172.21.15.16:0/4147960725 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+6053 (secure 0 0 0) 0x7f9da8016150 con 0x7f9dc00c63f0 2024-04-26T20:22:17.056 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:17.056 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:12.172821+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4970,"qdb_cluster":[5127,4970]},"id":1}]} 2024-04-26T20:22:17.056 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 36 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d9c068380 msgr2=0x7f9d9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d9c068380 0x7f9d9c06a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009b10 tx=0x7f9db0008040 comp rx=0 tx=0).stop 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00c63f0 msgr2=0x7f9dc00cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00c63f0 0x7f9dc00cdc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9da80ad040 tx=0x7f9da801ada0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 shutdown_connections 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9d9c068380 0x7f9d9c06a840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc01574b0 0x7f9dc0144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00c63f0 0x7f9dc00cdc90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 --2- 172.21.15.16:0/4147960725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc00b47e0 0x7f9dc01ece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 >> 172.21.15.16:0/4147960725 conn(0x7f9dc0071160 msgr2=0x7f9dc00b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 shutdown_connections 2024-04-26T20:22:17.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:17.056+0000 7f9dc7600640 1 -- 172.21.15.16:0/4147960725 wait complete. 2024-04-26T20:22:17.078 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 36, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-26T20:14:13.851430+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 36, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4970": { "addr": "172.21.15.192:6838/3304030586", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6836", "nonce": 3304030586, "type": "v2" }, { "addr": "172.21.15.192:6838", "nonce": 3304030586, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4970, "incarnation": 27, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 31 }, "gid_5127": { "addr": "172.21.15.16:6833/1748916109", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6832", "nonce": 1748916109, "type": "v2" }, { "addr": "172.21.15.16:6833", "nonce": 1748916109, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5127, "incarnation": 21, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:active", "state_seq": 31 }, "gid_5391": { "addr": "172.21.15.16:6836/1623880328", "addrs": { "addrvec": [ { "addr": "172.21.15.16:6834", "nonce": 1623880328, "type": "v2" }, { "addr": "172.21.15.16:6836", "nonce": 1623880328, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5391, "incarnation": 33, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 16 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-26T20:22:12.172821+0000", "qdb_cluster": [ 5127, 4970 ], "qdb_leader": 4970, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5391, "mds_1": 4970, "mds_2": 5127 } } } ], "standbys": [ { "addr": "172.21.15.192:6839/3427733929", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6837", "nonce": 3427733929, "type": "v2" }, { "addr": "172.21.15.192:6839", "nonce": 3427733929, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4235, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.192:6835/3360160288", "addrs": { "addrvec": [ { "addr": "172.21.15.192:6834", "nonce": 3360160288, "type": "v2" }, { "addr": "172.21.15.192:6835", "nonce": 3360160288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4258, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-26T20:22:18.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:22:18.580 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:22:19.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:19.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0530a00640 1 Processor -- start 2024-04-26T20:22:19.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0530a00640 1 -- start start 2024-04-26T20:22:19.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0530a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f052c0c7b80 0x7f052c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:19.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0530a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f052c0c9d90 con 0x7f052c153af0 2024-04-26T20:22:19.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0530a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f052c0ca070 con 0x7f052c0c9010 2024-04-26T20:22:19.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0530a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f052c15dec0 con 0x7f052c0c7b80 2024-04-26T20:22:19.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0529e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f052c153af0 0x7f052c15d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36826/0 (socket says 172.21.15.16:36826) 2024-04-26T20:22:19.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0529e00640 1 -- 172.21.15.16:0/4071680176 learned_addr learned my addr 172.21.15.16:0/4071680176 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:22:19.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0521400640 1 --2- 172.21.15.16:0/4071680176 >> v2:172.21.15.16:3300/0 conn(0x7f052c0c7b80 0x7f052c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:19.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0521400640 1 -- 172.21.15.16:0/4071680176 >> v1:172.21.15.192:6789/0 conn(0x7f052c0c9010 legacy=0x7f052c0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:19.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0521400640 1 -- 172.21.15.16:0/4071680176 >> v1:172.21.15.16:6789/0 conn(0x7f052c153af0 legacy=0x7f052c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:19.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0521400640 1 -- 172.21.15.16:0/4071680176 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c0ca350 con 0x7f052c0c7b80 2024-04-26T20:22:19.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.232+0000 7f0529400640 1 -- 172.21.15.16:0/4071680176 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504827465 0 0) 0x7f052c0c9d90 con 0x7f052c153af0 2024-04-26T20:22:19.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0521400640 1 --2- 172.21.15.16:0/4071680176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c0c7b80 0x7f052c0c7f80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f05140097c0 tx=0x7f051401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53edf35f067de4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:19.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0529400640 1 -- 172.21.15.16:0/4071680176 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140b5070 con 0x7f052c0c7b80 2024-04-26T20:22:19.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0529400640 1 -- 172.21.15.16:0/4071680176 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05140a8990 con 0x7f052c0c7b80 2024-04-26T20:22:19.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0529400640 1 -- 172.21.15.16:0/4071680176 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140a8d60 con 0x7f052c0c7b80 2024-04-26T20:22:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0530a00640 1 -- 172.21.15.16:0/4071680176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c0c7b80 msgr2=0x7f052c0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0530a00640 1 --2- 172.21.15.16:0/4071680176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c0c7b80 0x7f052c0c7f80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f05140097c0 tx=0x7f051401ec90 comp rx=0 tx=0).stop 2024-04-26T20:22:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0530a00640 1 -- 172.21.15.16:0/4071680176 shutdown_connections 2024-04-26T20:22:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0530a00640 1 --2- 172.21.15.16:0/4071680176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c0c7b80 0x7f052c0c7f80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0530a00640 1 -- 172.21.15.16:0/4071680176 >> 172.21.15.16:0/4071680176 conn(0x7f052c06c380 msgr2=0x7f052c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0530a00640 1 -- 172.21.15.16:0/4071680176 shutdown_connections 2024-04-26T20:22:19.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.236+0000 7f0530a00640 1 -- 172.21.15.16:0/4071680176 wait complete. 2024-04-26T20:22:19.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 Processor -- start 2024-04-26T20:22:19.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 -- start start 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f052c0c7b80 0x7f052c1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f052c0c9010 0x7f052c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c153af0 0x7f052c148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f052c15d290 con 0x7f052c153af0 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f052c0ca630 con 0x7f052c0c9010 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f052c153ed0 con 0x7f052c0c7b80 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c153af0 0x7f052c148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c153af0 0x7f052c148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55970/0 (socket says 172.21.15.16:55970) 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 -- 172.21.15.16:0/4235637353 learned_addr learned my addr 172.21.15.16:0/4235637353 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0529e00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f052c0c7b80 0x7f052c1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:19.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0521400640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f052c0c9010 0x7f052c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 -- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f052c0c7b80 msgr2=0x7f052c1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f052c0c7b80 0x7f052c1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 -- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f052c0c9010 msgr2=0x7f052c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f052c0c9010 0x7f052c1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 -- 172.21.15.16:0/4235637353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c152260 con 0x7f052c153af0 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0521400640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f052c0c9010 0x7f052c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f052a800640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c153af0 0x7f052c148750 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f052400c430 tx=0x7f052400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0522a00640 1 -- 172.21.15.16:0/4235637353 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0524005220 con 0x7f052c153af0 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0522a00640 1 -- 172.21.15.16:0/4235637353 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05240053c0 con 0x7f052c153af0 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0522a00640 1 -- 172.21.15.16:0/4235637353 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0524007270 con 0x7f052c153af0 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c151ca0 con 0x7f052c153af0 2024-04-26T20:22:19.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.240+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c1f4d20 con 0x7f052c153af0 2024-04-26T20:22:19.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.244+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052c077c20 con 0x7f052c153af0 2024-04-26T20:22:19.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.244+0000 7f0522a00640 1 -- 172.21.15.16:0/4235637353 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0524019020 con 0x7f052c153af0 2024-04-26T20:22:19.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.244+0000 7f0522a00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0508068380 0x7f050806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:19.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.244+0000 7f0522a00640 1 -- 172.21.15.16:0/4235637353 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f0524086230 con 0x7f052c153af0 2024-04-26T20:22:19.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.244+0000 7f0529e00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0508068380 0x7f050806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:19.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.248+0000 7f0529e00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0508068380 0x7f050806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f051c001950 tx=0x7f051c0018e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:19.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.248+0000 7f0522a00640 1 -- 172.21.15.16:0/4235637353 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0524056270 con 0x7f052c153af0 2024-04-26T20:22:19.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.448+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f052c151850 con 0x7f052c153af0 2024-04-26T20:22:19.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.448+0000 7f0522a00640 1 -- 172.21.15.16:0/4235637353 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6058 (secure 0 0 0) 0x7f0524055b70 con 0x7f052c153af0 2024-04-26T20:22:19.451 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:19.451 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:19.199857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":18,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5391,"qdb_cluster":[4970,5127,5391]},"id":1}]} 2024-04-26T20:22:19.451 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 37 2024-04-26T20:22:19.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.448+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0508068380 msgr2=0x7f050806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:19.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.448+0000 7f0530a00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0508068380 0x7f050806a840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f051c001950 tx=0x7f051c0018e0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c153af0 msgr2=0x7f052c148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c153af0 0x7f052c148750 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f052400c430 tx=0x7f052400c830 comp rx=0 tx=0).stop 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 shutdown_connections 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0508068380 0x7f050806a840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f052c153af0 0x7f052c148750 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f052c0c9010 0x7f052c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 --2- 172.21.15.16:0/4235637353 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f052c0c7b80 0x7f052c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 >> 172.21.15.16:0/4235637353 conn(0x7f052c06c380 msgr2=0x7f052c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 shutdown_connections 2024-04-26T20:22:19.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:19.452+0000 7f0530a00640 1 -- 172.21.15.16:0/4235637353 wait complete. 2024-04-26T20:22:19.471 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c has gained rank=0, replacing gid=4279 2024-04-26T20:22:19.471 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 2 secs before reviving mds.e 2024-04-26T20:22:21.472 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2024-04-26T20:22:21.472 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-26T20:22:21.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-26T20:22:21.476 INFO:tasks.ceph.mds.e:Started 2024-04-26T20:22:21.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:21.572 INFO:tasks.ceph.mds.e.smithi016.stdout:starting mds.e at 2024-04-26T20:22:21.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.628+0000 7f6ba2600640 1 Processor -- start 2024-04-26T20:22:21.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.628+0000 7f6ba2600640 1 -- start start 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6ba2600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6b9c153af0 0x7f6b9c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6ba2600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0c9d90 con 0x7f6b9c0c7b80 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6ba2600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0ca070 con 0x7f6b9c0c9720 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6ba2600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9c0ca630 con 0x7f6b9c153af0 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b9b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6b9c153af0 0x7f6b9c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b9b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6b9c153af0 0x7f6b9c15d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56008/0 (socket says 172.21.15.16:56008) 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b92a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6b9c0c7b80 0x7f6b9c0c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36852/0 (socket says 172.21.15.16:36852) 2024-04-26T20:22:21.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b9b400640 1 -- 172.21.15.16:0/2261246320 learned_addr learned my addr 172.21.15.16:0/2261246320 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:21.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b9b400640 1 -- 172.21.15.16:0/2261246320 >> v1:172.21.15.192:6789/0 conn(0x7f6b9c0c9720 legacy=0x7f6b9c1642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b9b400640 1 -- 172.21.15.16:0/2261246320 >> v1:172.21.15.16:6789/0 conn(0x7f6b9c0c7b80 legacy=0x7f6b9c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b9b400640 1 -- 172.21.15.16:0/2261246320 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c0ca350 con 0x7f6b9c153af0 2024-04-26T20:22:21.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.632+0000 7f6b9aa00640 1 -- 172.21.15.16:0/2261246320 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943100625 0 0) 0x7f6b9c0c9d90 con 0x7f6b9c0c7b80 2024-04-26T20:22:21.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6b9b400640 1 --2- 172.21.15.16:0/2261246320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c153af0 0x7f6b9c15d7b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009e50 tx=0x7f6b8c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ace60345af5809 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:21.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6b9aa00640 1 -- 172.21.15.16:0/2261246320 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0b4070 con 0x7f6b9c153af0 2024-04-26T20:22:21.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6b9aa00640 1 -- 172.21.15.16:0/2261246320 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0af400 con 0x7f6b9c153af0 2024-04-26T20:22:21.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6b9aa00640 1 -- 172.21.15.16:0/2261246320 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0af7d0 con 0x7f6b9c153af0 2024-04-26T20:22:21.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 -- 172.21.15.16:0/2261246320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c153af0 msgr2=0x7f6b9c15d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 --2- 172.21.15.16:0/2261246320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c153af0 0x7f6b9c15d7b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009e50 tx=0x7f6b8c01f210 comp rx=0 tx=0).stop 2024-04-26T20:22:21.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 -- 172.21.15.16:0/2261246320 shutdown_connections 2024-04-26T20:22:21.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 --2- 172.21.15.16:0/2261246320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c153af0 0x7f6b9c15d7b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 -- 172.21.15.16:0/2261246320 >> 172.21.15.16:0/2261246320 conn(0x7f6b9c06c380 msgr2=0x7f6b9c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:21.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 -- 172.21.15.16:0/2261246320 shutdown_connections 2024-04-26T20:22:21.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 -- 172.21.15.16:0/2261246320 wait complete. 2024-04-26T20:22:21.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 Processor -- start 2024-04-26T20:22:21.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 -- start start 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.636+0000 7f6ba2600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9c0c7b80 0x7f6b9c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c0c9720 0x7f6b9c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9c153af0 0x7f6b9c151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c153ed0 con 0x7f6b9c0c9720 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c15d290 con 0x7f6b9c153af0 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c154050 con 0x7f6b9c0c7b80 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c0c9720 0x7f6b9c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c0c9720 0x7f6b9c151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56012/0 (socket says 172.21.15.16:56012) 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 -- 172.21.15.16:0/1829341206 learned_addr learned my addr 172.21.15.16:0/1829341206 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b9b400640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9c0c7b80 0x7f6b9c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b9be00640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9c153af0 0x7f6b9c151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 -- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9c0c7b80 msgr2=0x7f6b9c14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9c0c7b80 0x7f6b9c14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 -- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9c153af0 msgr2=0x7f6b9c151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9c153af0 0x7f6b9c151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 -- 172.21.15.16:0/1829341206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c1f1640 con 0x7f6b9c0c9720 2024-04-26T20:22:21.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b9b400640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9c0c7b80 0x7f6b9c14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:22:21.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b92a00640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c0c9720 0x7f6b9c151800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c4d0 tx=0x7f6b8400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b93e00640 1 -- 172.21.15.16:0/1829341206 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84018070 con 0x7f6b9c0c9720 2024-04-26T20:22:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b93e00640 1 -- 172.21.15.16:0/1829341206 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b840074e0 con 0x7f6b9c0c9720 2024-04-26T20:22:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b93e00640 1 -- 172.21.15.16:0/1829341206 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84004a30 con 0x7f6b9c0c9720 2024-04-26T20:22:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c1f1920 con 0x7f6b9c0c9720 2024-04-26T20:22:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1f1ee0 con 0x7f6b9c0c9720 2024-04-26T20:22:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c077c20 con 0x7f6b9c0c9720 2024-04-26T20:22:21.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.640+0000 7f6b93e00640 1 -- 172.21.15.16:0/1829341206 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b8401b070 con 0x7f6b9c0c9720 2024-04-26T20:22:21.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.644+0000 7f6b93e00640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6b78068380 0x7f6b7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:21.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.644+0000 7f6b93e00640 1 -- 172.21.15.16:0/1829341206 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f6b84086250 con 0x7f6b9c0c9720 2024-04-26T20:22:21.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.644+0000 7f6b9b400640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6b78068380 0x7f6b7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:21.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.644+0000 7f6b9b400640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6b78068380 0x7f6b7806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0b1000 tx=0x7f6b8c0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:21.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.648+0000 7f6b93e00640 1 -- 172.21.15.16:0/1829341206 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6b84055b30 con 0x7f6b9c0c9720 2024-04-26T20:22:21.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.844+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b9c157430 con 0x7f6b9c0c9720 2024-04-26T20:22:21.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.844+0000 7f6b93e00640 1 -- 172.21.15.16:0/1829341206 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+6058 (secure 0 0 0) 0x7f6b84059e30 con 0x7f6b9c0c9720 2024-04-26T20:22:21.848 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:21.848 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:19.199857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":18,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5391,"qdb_cluster":[4970,5127,5391]},"id":1}]} 2024-04-26T20:22:21.848 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 37 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6b78068380 msgr2=0x7f6b7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6b78068380 0x7f6b7806a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0b1000 tx=0x7f6b8c0aa000 comp rx=0 tx=0).stop 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c0c9720 msgr2=0x7f6b9c151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c0c9720 0x7f6b9c151800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c4d0 tx=0x7f6b8400c990 comp rx=0 tx=0).stop 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 shutdown_connections 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6b78068380 0x7f6b7806a840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9c153af0 0x7f6b9c151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6b9c0c9720 0x7f6b9c151800 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 --2- 172.21.15.16:0/1829341206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9c0c7b80 0x7f6b9c14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 >> 172.21.15.16:0/1829341206 conn(0x7f6b9c06c380 msgr2=0x7f6b9c157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:21.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 shutdown_connections 2024-04-26T20:22:21.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:21.848+0000 7f6ba2600640 1 -- 172.21.15.16:0/1829341206 wait complete. 2024-04-26T20:22:21.869 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is in active, standby or standby-replay 2024-04-26T20:22:23.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:22:24.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.020+0000 7f8340e00640 1 Processor -- start 2024-04-26T20:22:24.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8340e00640 1 -- start start 2024-04-26T20:22:24.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8340e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f833c153af0 0x7f833c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:24.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8340e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:24.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8340e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833c0c9d90 con 0x7f833c0c7b80 2024-04-26T20:22:24.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8340e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f833c0ca630 con 0x7f833c153af0 2024-04-26T20:22:24.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8340e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f833c0ca070 con 0x7f833c0c9720 2024-04-26T20:22:24.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8339e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f833c153af0 0x7f833c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:24.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8331400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f833c0c7b80 0x7f833c0c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36860/0 (socket says 172.21.15.16:36860) 2024-04-26T20:22:24.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8331400640 1 -- 172.21.15.16:0/3625344978 learned_addr learned my addr 172.21.15.16:0/3625344978 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:22:24.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f833a800640 1 --2- 172.21.15.16:0/3625344978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:24.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8339e00640 1 -- 172.21.15.16:0/3625344978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 msgr2=0x7f833c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:22:24.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8339e00640 1 --2- 172.21.15.16:0/3625344978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8339e00640 1 -- 172.21.15.16:0/3625344978 >> v1:172.21.15.16:6789/0 conn(0x7f833c0c7b80 legacy=0x7f833c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:24.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8339e00640 1 -- 172.21.15.16:0/3625344978 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c0ca350 con 0x7f833c153af0 2024-04-26T20:22:24.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.024+0000 7f8339400640 1 -- 172.21.15.16:0/3625344978 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180156620 0 0) 0x7f833c0c9d90 con 0x7f833c0c7b80 2024-04-26T20:22:24.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8339e00640 1 --2- 172.21.15.16:0/3625344978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c15d7b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f832c0097c0 tx=0x7f832c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55100853cb0ec35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:24.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8339400640 1 -- 172.21.15.16:0/3625344978 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0b5070 con 0x7f833c153af0 2024-04-26T20:22:24.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8339400640 1 -- 172.21.15.16:0/3625344978 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c0a8990 con 0x7f833c153af0 2024-04-26T20:22:24.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8339400640 1 -- 172.21.15.16:0/3625344978 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0a8d60 con 0x7f833c153af0 2024-04-26T20:22:24.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 -- 172.21.15.16:0/3625344978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 msgr2=0x7f833c15d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:24.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 --2- 172.21.15.16:0/3625344978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c15d7b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f832c0097c0 tx=0x7f832c01ec90 comp rx=0 tx=0).stop 2024-04-26T20:22:24.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 -- 172.21.15.16:0/3625344978 shutdown_connections 2024-04-26T20:22:24.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 --2- 172.21.15.16:0/3625344978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 --2- 172.21.15.16:0/3625344978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c15d7b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 -- 172.21.15.16:0/3625344978 >> 172.21.15.16:0/3625344978 conn(0x7f833c06c380 msgr2=0x7f833c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:24.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 -- 172.21.15.16:0/3625344978 shutdown_connections 2024-04-26T20:22:24.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 -- 172.21.15.16:0/3625344978 wait complete. 2024-04-26T20:22:24.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 Processor -- start 2024-04-26T20:22:24.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.028+0000 7f8340e00640 1 -- start start 2024-04-26T20:22:24.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f833c0c7b80 0x7f833c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c1f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f833c153ed0 con 0x7f833c153af0 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f833c15d290 con 0x7f833c0c7b80 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f833c154050 con 0x7f833c0c9720 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c1f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c1f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56030/0 (socket says 172.21.15.16:56030) 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 -- 172.21.15.16:0/2440400582 learned_addr learned my addr 172.21.15.16:0/2440400582 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8331400640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8339e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f833c0c7b80 0x7f833c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 -- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 msgr2=0x7f833c15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c15c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 -- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f833c0c7b80 msgr2=0x7f833c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f833c0c7b80 0x7f833c158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 -- 172.21.15.16:0/2440400582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c1e4820 con 0x7f833c153af0 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f833a800640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c1f5220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8334007e60 tx=0x7f833400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8332a00640 1 -- 172.21.15.16:0/2440400582 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8334014620 con 0x7f833c153af0 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8332a00640 1 -- 172.21.15.16:0/2440400582 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8334019070 con 0x7f833c153af0 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8332a00640 1 -- 172.21.15.16:0/2440400582 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8334014a00 con 0x7f833c153af0 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c1578a0 con 0x7f833c153af0 2024-04-26T20:22:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c0735d0 con 0x7f833c153af0 2024-04-26T20:22:24.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c077c20 con 0x7f833c153af0 2024-04-26T20:22:24.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.032+0000 7f8332a00640 1 -- 172.21.15.16:0/2440400582 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8334014ba0 con 0x7f833c153af0 2024-04-26T20:22:24.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.036+0000 7f8332a00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8318068380 0x7f831806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:22:24.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.036+0000 7f8332a00640 1 -- 172.21.15.16:0/2440400582 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f8334087830 con 0x7f833c153af0 2024-04-26T20:22:24.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.036+0000 7f8339e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8318068380 0x7f831806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:22:24.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.036+0000 7f8339e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8318068380 0x7f831806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f832c0b2000 tx=0x7f832c0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:22:24.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.040+0000 7f8332a00640 1 -- 172.21.15.16:0/2440400582 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8334011260 con 0x7f833c153af0 2024-04-26T20:22:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.256+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f833c0c8670 con 0x7f833c153af0 2024-04-26T20:22:24.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8332a00640 1 -- 172.21.15.16:0/2440400582 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6883 (secure 0 0 0) 0x7f8334057880 con 0x7f833c153af0 2024-04-26T20:22:24.260 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:22:24.261 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5538,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3312742738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":3312742738},{"type":"v1","addr":"172.21.15.16:6837","nonce":3312742738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:19.199857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":18,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5391,"qdb_cluster":[5391,5127,4970]},"id":1}]} 2024-04-26T20:22:24.261 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-04-26T20:22:24.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8318068380 msgr2=0x7f831806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:24.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8318068380 0x7f831806a840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f832c0b2000 tx=0x7f832c0aa070 comp rx=0 tx=0).stop 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 msgr2=0x7f833c1f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c1f5220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8334007e60 tx=0x7f833400e4b0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 shutdown_connections 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8318068380 0x7f831806a840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f833c153af0 0x7f833c1f5220 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c0c9720 0x7f833c15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 --2- 172.21.15.16:0/2440400582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f833c0c7b80 0x7f833c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 >> 172.21.15.16:0/2440400582 conn(0x7f833c06c380 msgr2=0x7f833c152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 shutdown_connections 2024-04-26T20:22:24.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:22:24.260+0000 7f8340e00640 1 -- 172.21.15.16:0/2440400582 wait complete. 2024-04-26T20:22:24.282 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2024-04-26T20:22:24.282 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 115 secs before thrashing 2024-04-26T20:22:25.261 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-04-26T20:22:25.260+0000 7f1df6e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T20:22:25.261 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-04-26T20:22:25.260+0000 7f1df6e00640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T20:22:25.261 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-04-26T20:22:25.260+0000 7f1df6e00640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T20:22:48.716 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:22:48.721 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:23:18.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:23:18.793 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:23:44.535 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T20:23:44.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T20:23:45.501 DEBUG:teuthology.parallel:result is None 2024-04-26T20:23:45.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T20:23:45.555 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T20:23:45.555 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-04-26T20:23:45.565 INFO:tasks.mds_thrash:joining mds_thrasher 2024-04-26T20:23:45.565 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 0 2024-04-26T20:23:45.565 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2024-04-26T20:23:45.566 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 4 2024-04-26T20:23:45.566 INFO:tasks.mds_thrash:done joining 2024-04-26T20:23:45.566 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T20:23:45.573 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T20:23:45.573 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:23:45.574 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:23:45.589 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T20:23:45.589 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T20:23:45.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:23:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.835+0000 7fcdddc00640 1 Processor -- start 2024-04-26T20:23:45.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.835+0000 7fcdddc00640 1 -- start start 2024-04-26T20:23:45.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdddc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcdd8153af0 0x7fcdd815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdddc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdd80c9720 0x7fcdd80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdddc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd80c9d90 con 0x7fcdd80c7b80 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdddc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd80ca630 con 0x7fcdd80c9720 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdddc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd80ca070 con 0x7fcdd8153af0 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdd80c9720 0x7fcdd80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdd80c9720 0x7fcdd80c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44738/0 (socket says 172.21.15.16:44738) 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 -- 172.21.15.16:0/4282245885 learned_addr learned my addr 172.21.15.16:0/4282245885 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd6a00640 1 --2- 172.21.15.16:0/4282245885 >> v2:172.21.15.192:3300/0 conn(0x7fcdd8153af0 0x7fcdd815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 -- 172.21.15.16:0/4282245885 >> v2:172.21.15.192:3300/0 conn(0x7fcdd8153af0 msgr2=0x7fcdd815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 --2- 172.21.15.16:0/4282245885 >> v2:172.21.15.192:3300/0 conn(0x7fcdd8153af0 0x7fcdd815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 -- 172.21.15.16:0/4282245885 >> v1:172.21.15.192:6789/0 conn(0x7fcdd80c7b80 legacy=0x7fcdd80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:45.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 -- 172.21.15.16:0/4282245885 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd80ca350 con 0x7fcdd80c9720 2024-04-26T20:23:45.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.839+0000 7fcdd7400640 1 --2- 172.21.15.16:0/4282245885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c9720 0x7fcdd80c7f80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80745d0 tx=0x7fcdd001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4dcd9baab4415b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:45.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdd6000640 1 -- 172.21.15.16:0/4282245885 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00b4070 con 0x7fcdd80c9720 2024-04-26T20:23:45.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdd6000640 1 -- 172.21.15.16:0/4282245885 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd00af400 con 0x7fcdd80c9720 2024-04-26T20:23:45.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdd6000640 1 -- 172.21.15.16:0/4282245885 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00af7d0 con 0x7fcdd80c9720 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- 172.21.15.16:0/4282245885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c9720 msgr2=0x7fcdd80c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 --2- 172.21.15.16:0/4282245885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c9720 0x7fcdd80c7f80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80745d0 tx=0x7fcdd001f1e0 comp rx=0 tx=0).stop 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- 172.21.15.16:0/4282245885 shutdown_connections 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 --2- 172.21.15.16:0/4282245885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c9720 0x7fcdd80c7f80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 --2- 172.21.15.16:0/4282245885 >> v2:172.21.15.192:3300/0 conn(0x7fcdd8153af0 0x7fcdd815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- 172.21.15.16:0/4282245885 >> 172.21.15.16:0/4282245885 conn(0x7fcdd806c380 msgr2=0x7fcdd806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- 172.21.15.16:0/4282245885 shutdown_connections 2024-04-26T20:23:45.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- 172.21.15.16:0/4282245885 wait complete. 2024-04-26T20:23:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 Processor -- start 2024-04-26T20:23:45.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- start start 2024-04-26T20:23:45.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c7b80 0x7fcdd8159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:45.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd80c9720 0x7fcdd814a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:45.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdd8153af0 0x7fcdd814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:45.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd8153ed0 con 0x7fcdd80c7b80 2024-04-26T20:23:45.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd815d290 con 0x7fcdd8153af0 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdddc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd8154050 con 0x7fcdd80c9720 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdd6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c7b80 0x7fcdd8159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdd6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c7b80 0x7fcdd8159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44748/0 (socket says 172.21.15.16:44748) 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdd6a00640 1 -- 172.21.15.16:0/1211384908 learned_addr learned my addr 172.21.15.16:0/1211384908 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdd7400640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdd8153af0 0x7fcdd814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.843+0000 7fcdcfe00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd80c9720 0x7fcdd814a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdd6a00640 1 -- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd80c9720 msgr2=0x7fcdd814a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdd6a00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd80c9720 0x7fcdd814a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdd6a00640 1 -- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdd8153af0 msgr2=0x7fcdd814f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdd6a00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdd8153af0 0x7fcdd814f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdd6a00640 1 -- 172.21.15.16:0/1211384908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd8157e00 con 0x7fcdd80c7b80 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdd6a00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c7b80 0x7fcdd8159420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800d620 tx=0x7fcdc800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:45.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdcea00640 1 -- 172.21.15.16:0/1211384908 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800b620 con 0x7fcdd80c7b80 2024-04-26T20:23:45.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdcea00640 1 -- 172.21.15.16:0/1211384908 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8019070 con 0x7fcdd80c7b80 2024-04-26T20:23:45.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdcea00640 1 -- 172.21.15.16:0/1211384908 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800b9e0 con 0x7fcdd80c7b80 2024-04-26T20:23:45.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd8150a90 con 0x7fcdd80c7b80 2024-04-26T20:23:45.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd8151160 con 0x7fcdd80c7b80 2024-04-26T20:23:45.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd8077c20 con 0x7fcdd80c7b80 2024-04-26T20:23:45.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdcea00640 1 -- 172.21.15.16:0/1211384908 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcdc800bb80 con 0x7fcdd80c7b80 2024-04-26T20:23:45.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdcea00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcdb4068380 0x7fcdb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:45.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdcea00640 1 -- 172.21.15.16:0/1211384908 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fcdc80873a0 con 0x7fcdd80c7b80 2024-04-26T20:23:45.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.847+0000 7fcdcfe00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcdb4068380 0x7fcdb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:45.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.851+0000 7fcdcfe00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcdb4068380 0x7fcdb406a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80c3800 tx=0x7fcdc0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:45.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:45.851+0000 7fcdcea00640 1 -- 172.21.15.16:0/1211384908 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcdc8057360 con 0x7fcdd80c7b80 2024-04-26T20:23:46.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdd814e110 con 0x7fcdd80c7b80 2024-04-26T20:23:46.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdcea00640 1 -- 172.21.15.16:0/1211384908 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+19436 (secure 0 0 0) 0x7fcdc8056c60 con 0x7fcdd80c7b80 2024-04-26T20:23:46.021 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:23:46.022 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:21:50.873943+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6835/1962586875":"2024-04-27T20:21:50.873892+0000","172.21.15.16:6836/1882507975":"2024-04-27T20:20:50.864042+0000","172.21.15.192:6838/2295577139":"2024-04-27T20:19:00.847936+0000","172.21.15.192:6836/2295577139":"2024-04-27T20:19:00.847936+0000","172.21.15.16:6837/1962586875":"2024-04-27T20:21:50.873892+0000","172.21.15.16:6833/3670477050":"2024-04-27T20:17:00.827028+0000","172.21.15.16:6834/1882507975":"2024-04-27T20:20:50.864042+0000","172.21.15.16:6832/3670477050":"2024-04-27T20:17:00.827028+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:23:46.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcdb4068380 msgr2=0x7fcdb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcdb4068380 0x7fcdb406a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80c3800 tx=0x7fcdc0009040 comp rx=0 tx=0).stop 2024-04-26T20:23:46.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c7b80 msgr2=0x7fcdd8159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c7b80 0x7fcdd8159420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800d620 tx=0x7fcdc800dae0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 shutdown_connections 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fcdb4068380 0x7fcdb406a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdd8153af0 0x7fcdd814f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdd80c9720 0x7fcdd814a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 --2- 172.21.15.16:0/1211384908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd80c7b80 0x7fcdd8159420 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 >> 172.21.15.16:0/1211384908 conn(0x7fcdd806c380 msgr2=0x7fcdd806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 shutdown_connections 2024-04-26T20:23:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.019+0000 7fcdddc00640 1 -- 172.21.15.16:0/1211384908 wait complete. 2024-04-26T20:23:46.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T20:14:06.995236+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T20:14:11.465088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T20:14:12.802391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-26T20:14:16.488022+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-26T20:23:46.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T20:23:46.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.183+0000 7f872ec00640 1 Processor -- start 2024-04-26T20:23:46.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872ec00640 1 -- start start 2024-04-26T20:23:46.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872ec00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 0x7f87280cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872ec00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872815f410 con 0x7f87280cabe0 2024-04-26T20:23:46.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872ec00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872815f6f0 con 0x7f872815bf20 2024-04-26T20:23:46.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872ec00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f872815f9d0 con 0x7f8728155f80 2024-04-26T20:23:46.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f871f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f87280cabe0 0x7f87280ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38352/0 (socket says 172.21.15.16:38352) 2024-04-26T20:23:46.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f871f400640 1 -- 172.21.15.16:0/3529084571 learned_addr learned my addr 172.21.15.16:0/3529084571 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:46.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727e00640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 0x7f87280cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258313938 0 0) 0x7f872815f410 con 0x7f87280cabe0 2024-04-26T20:23:46.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f870c003530 con 0x7f87280cabe0 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516583966 0 0) 0x7f872815f6f0 con 0x7f872815bf20 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f872815f410 con 0x7f872815bf20 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2297689705 0 0) 0x7f870c003530 con 0x7f87280cabe0 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 msgr2=0x7f87280cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 0x7f87280cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 >> v1:172.21.15.192:6789/0 conn(0x7f872815bf20 legacy=0x7f872815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872815fcb0 con 0x7f87280cabe0 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f8710001680 con 0x7f87280cabe0 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 >> v1:172.21.15.16:6789/0 conn(0x7f87280cabe0 legacy=0x7f87280ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 0x7f870c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c0040e0 0x7f870c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f870c004d50 0x7f870c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f872815f9d0 con 0x7f870c004d50 2024-04-26T20:23:46.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f870c00bab0 con 0x7f870c0040e0 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f870c00bcb0 con 0x7f8728155f80 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f8727e00640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 0x7f870c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872cc00640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f870c004d50 0x7f870c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f871f400640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c0040e0 0x7f870c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872cc00640 1 -- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 msgr2=0x7f870c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872cc00640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728155f80 0x7f870c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872cc00640 1 -- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c0040e0 msgr2=0x7f870c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872cc00640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c0040e0 0x7f870c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f872cc00640 1 -- 172.21.15.16:0/3529084571 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c003530 con 0x7f870c004d50 2024-04-26T20:23:46.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.187+0000 7f871f400640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c0040e0 0x7f870c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:46.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872cc00640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f870c004d50 0x7f870c0051d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f87200018d0 tx=0x7f872001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6b71185bf09730 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87200af070 con 0x7f870c004d50 2024-04-26T20:23:46.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87200052f0 con 0x7f870c004d50 2024-04-26T20:23:46.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f8727400640 1 -- 172.21.15.16:0/3529084571 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720001520 con 0x7f870c004d50 2024-04-26T20:23:46.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872ec00640 1 -- 172.21.15.16:0/3529084571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f870c004d50 msgr2=0x7f870c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872ec00640 1 --2- 172.21.15.16:0/3529084571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f870c004d50 0x7f870c0051d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f87200018d0 tx=0x7f872001c580 comp rx=0 tx=0).stop 2024-04-26T20:23:46.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872cc00640 1 -- 172.21.15.16:0/3529084571 reap_dead start 2024-04-26T20:23:46.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872ec00640 1 -- 172.21.15.16:0/3529084571 shutdown_connections 2024-04-26T20:23:46.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872ec00640 1 -- 172.21.15.16:0/3529084571 >> 172.21.15.16:0/3529084571 conn(0x7f872806c380 msgr2=0x7f872806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:46.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872ec00640 1 -- 172.21.15.16:0/3529084571 shutdown_connections 2024-04-26T20:23:46.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.191+0000 7f872ec00640 1 -- 172.21.15.16:0/3529084571 wait complete. 2024-04-26T20:23:46.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 Processor -- start 2024-04-26T20:23:46.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 -- start start 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c004d50 0x7f872815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f872815ead0 0x7f87280c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728156670 0x7f87280c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8728156360 con 0x7f872815ead0 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87280cc7a0 con 0x7f870c004d50 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f87280c8b50 con 0x7f8728156670 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f872815ead0 0x7f87280c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f872815ead0 0x7f87280c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44758/0 (socket says 172.21.15.16:44758) 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 -- 172.21.15.16:0/193328439 learned_addr learned my addr 172.21.15.16:0/193328439 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872cc00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728156670 0x7f87280c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f8727e00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c004d50 0x7f872815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 -- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728156670 msgr2=0x7f87280c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728156670 0x7f87280c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 -- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c004d50 msgr2=0x7f872815b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c004d50 0x7f872815b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 -- 172.21.15.16:0/193328439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87280c8d80 con 0x7f872815ead0 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f8727e00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c004d50 0x7f872815b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:46.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f871f400640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f872815ead0 0x7f87280c7f30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f871000e8b0 tx=0x7f871000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f8724c00640 1 -- 172.21.15.16:0/193328439 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871000c8d0 con 0x7f872815ead0 2024-04-26T20:23:46.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f8724c00640 1 -- 172.21.15.16:0/193328439 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8710018070 con 0x7f872815ead0 2024-04-26T20:23:46.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f8724c00640 1 -- 172.21.15.16:0/193328439 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871000cc70 con 0x7f872815ead0 2024-04-26T20:23:46.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87280c9060 con 0x7f872815ead0 2024-04-26T20:23:46.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87280c9620 con 0x7f872815ead0 2024-04-26T20:23:46.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.195+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87280c74e0 con 0x7f872815ead0 2024-04-26T20:23:46.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.199+0000 7f8724c00640 1 -- 172.21.15.16:0/193328439 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f871001d460 con 0x7f872815ead0 2024-04-26T20:23:46.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.199+0000 7f8724c00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8704068380 0x7f870406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.199+0000 7f8724c00640 1 -- 172.21.15.16:0/193328439 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f8710086ed0 con 0x7f872815ead0 2024-04-26T20:23:46.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.199+0000 7f8727e00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8704068380 0x7f870406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.199+0000 7f8727e00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8704068380 0x7f870406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87180074d0 tx=0x7f871800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.203+0000 7f8724c00640 1 -- 172.21.15.16:0/193328439 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8710056f20 con 0x7f872815ead0 2024-04-26T20:23:46.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8728077c20 con 0x7f872815ead0 2024-04-26T20:23:46.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f8724c00640 1 -- 172.21.15.16:0/193328439 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7f8710056820 con 0x7f872815ead0 2024-04-26T20:23:46.373 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8704068380 msgr2=0x7f870406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8704068380 0x7f870406a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87180074d0 tx=0x7f871800b040 comp rx=0 tx=0).stop 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f872815ead0 msgr2=0x7f87280c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f872815ead0 0x7f87280c7f30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f871000e8b0 tx=0x7f871000ed70 comp rx=0 tx=0).stop 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 shutdown_connections 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8704068380 0x7f870406a840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8728156670 0x7f87280c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f872815ead0 0x7f87280c7f30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 --2- 172.21.15.16:0/193328439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f870c004d50 0x7f872815b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 >> 172.21.15.16:0/193328439 conn(0x7f872806c380 msgr2=0x7f872814ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:46.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 shutdown_connections 2024-04-26T20:23:46.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.371+0000 7f872ec00640 1 -- 172.21.15.16:0/193328439 wait complete. 2024-04-26T20:23:46.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T20:23:46.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f3b800640 1 Processor -- start 2024-04-26T20:23:46.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f3b800640 1 -- start start 2024-04-26T20:23:46.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f3b800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0f34153eb0 0x7f0f3415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f3b800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f340c96a0 con 0x7f0f3406ff50 2024-04-26T20:23:46.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f3b800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f340c9980 con 0x7f0f3406f460 2024-04-26T20:23:46.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f3b800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3415ac00 con 0x7f0f34153eb0 2024-04-26T20:23:46.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f2be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0f34153eb0 0x7f0f3415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f39800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0f3406ff50 0x7f0f340c5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38364/0 (socket says 172.21.15.16:38364) 2024-04-26T20:23:46.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f39800640 1 -- 172.21.15.16:0/3776502959 learned_addr learned my addr 172.21.15.16:0/3776502959 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:46.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f2be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0f34153eb0 0x7f0f3415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44768/0 (socket says 172.21.15.16:44768) 2024-04-26T20:23:46.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f2be00640 1 -- 172.21.15.16:0/3776502959 >> v1:172.21.15.192:6789/0 conn(0x7f0f3406f460 legacy=0x7f0f3406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f2be00640 1 -- 172.21.15.16:0/3776502959 >> v1:172.21.15.16:6789/0 conn(0x7f0f3406ff50 legacy=0x7f0f340c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.535+0000 7f0f2be00640 1 -- 172.21.15.16:0/3776502959 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f34070610 con 0x7f0f34153eb0 2024-04-26T20:23:46.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f2be00640 1 --2- 172.21.15.16:0/3776502959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f34153eb0 0x7f0f3415a6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0097c0 tx=0x7f0f1c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc79f8a56596661 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f33e00640 1 -- 172.21.15.16:0/3776502959 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0b5070 con 0x7f0f34153eb0 2024-04-26T20:23:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f33e00640 1 -- 172.21.15.16:0/3776502959 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c0a8990 con 0x7f0f34153eb0 2024-04-26T20:23:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f33e00640 1 -- 172.21.15.16:0/3776502959 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0a8d60 con 0x7f0f34153eb0 2024-04-26T20:23:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f3b800640 1 -- 172.21.15.16:0/3776502959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f34153eb0 msgr2=0x7f0f3415a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f3b800640 1 --2- 172.21.15.16:0/3776502959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f34153eb0 0x7f0f3415a6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0097c0 tx=0x7f0f1c01ec90 comp rx=0 tx=0).stop 2024-04-26T20:23:46.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f3b800640 1 -- 172.21.15.16:0/3776502959 shutdown_connections 2024-04-26T20:23:46.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f3b800640 1 --2- 172.21.15.16:0/3776502959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f34153eb0 0x7f0f3415a6c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f3b800640 1 -- 172.21.15.16:0/3776502959 >> 172.21.15.16:0/3776502959 conn(0x7f0f340c9d10 msgr2=0x7f0f340ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:46.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f3b800640 1 -- 172.21.15.16:0/3776502959 shutdown_connections 2024-04-26T20:23:46.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.539+0000 7f0f3b800640 1 -- 172.21.15.16:0/3776502959 wait complete. 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 Processor -- start 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 -- start start 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f3406f460 0x7f0f341506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f3406ff50 0x7f0f341f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34159a60 0x7f0f341f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f340c4d70 con 0x7f0f3406f460 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0f340c5120 con 0x7f0f34159a60 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f3b800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0f340c4ef0 con 0x7f0f3406ff50 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f3406f460 0x7f0f341506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f3406f460 0x7f0f341506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44784/0 (socket says 172.21.15.16:44784) 2024-04-26T20:23:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 -- 172.21.15.16:0/82522419 learned_addr learned my addr 172.21.15.16:0/82522419 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f2be00640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f3406ff50 0x7f0f341f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f39800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34159a60 0x7f0f341f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 -- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f3406ff50 msgr2=0x7f0f341f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f3406ff50 0x7f0f341f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 -- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34159a60 msgr2=0x7f0f341f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34159a60 0x7f0f341f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 -- 172.21.15.16:0/82522419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f34073f10 con 0x7f0f3406f460 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f39800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34159a60 0x7f0f341f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.543+0000 7f0f38e00640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f3406f460 0x7f0f341506a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c420 tx=0x7f0f2400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f31600640 1 -- 172.21.15.16:0/82522419 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f240052d0 con 0x7f0f3406f460 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f31600640 1 -- 172.21.15.16:0/82522419 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f24005470 con 0x7f0f3406f460 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f341f4cc0 con 0x7f0f3406f460 2024-04-26T20:23:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f31600640 1 -- 172.21.15.16:0/82522419 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24007260 con 0x7f0f3406f460 2024-04-26T20:23:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f341f5280 con 0x7f0f3406f460 2024-04-26T20:23:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f34077c20 con 0x7f0f3406f460 2024-04-26T20:23:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f31600640 1 -- 172.21.15.16:0/82522419 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f24007400 con 0x7f0f3406f460 2024-04-26T20:23:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f31600640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0f100683b0 0x7f0f1006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.547+0000 7f0f31600640 1 -- 172.21.15.16:0/82522419 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f0f24086370 con 0x7f0f3406f460 2024-04-26T20:23:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.551+0000 7f0f2be00640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0f100683b0 0x7f0f1006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.551+0000 7f0f2be00640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0f100683b0 0x7f0f1006a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0b2000 tx=0x7f0f1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.551+0000 7f0f31600640 1 -- 172.21.15.16:0/82522419 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0f24055ce0 con 0x7f0f3406f460 2024-04-26T20:23:46.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.719+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0f34070c20 con 0x7f0f3406f460 2024-04-26T20:23:46.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.719+0000 7f0f31600640 1 -- 172.21.15.16:0/82522419 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) ==== 104+0+11 (secure 0 0 0) 0x7f0f24059fe0 con 0x7f0f3406f460 2024-04-26T20:23:46.722 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:23:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0f100683b0 msgr2=0x7f0f1006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0f100683b0 0x7f0f1006a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0b2000 tx=0x7f0f1c008040 comp rx=0 tx=0).stop 2024-04-26T20:23:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f3406f460 msgr2=0x7f0f341506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f3406f460 0x7f0f341506a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c420 tx=0x7f0f2400c8e0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 shutdown_connections 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0f100683b0 0x7f0f1006a870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34159a60 0x7f0f341f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f3406ff50 0x7f0f341f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 --2- 172.21.15.16:0/82522419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f3406f460 0x7f0f341506a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 >> 172.21.15.16:0/82522419 conn(0x7f0f340c9d10 msgr2=0x7f0f341528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 shutdown_connections 2024-04-26T20:23:46.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.723+0000 7f0f3b800640 1 -- 172.21.15.16:0/82522419 wait complete. 2024-04-26T20:23:46.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T20:23:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f26a00640 1 Processor -- start 2024-04-26T20:23:46.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f26a00640 1 -- start start 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f26a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4f20153eb0 0x7f4f2015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f26a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006ff50 0x7f4f200c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f26a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f200c96a0 con 0x7f4f2006f460 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f26a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2015ac00 con 0x7f4f20153eb0 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f26a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4f200c9980 con 0x7f4f2006ff50 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f1fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4f2006f460 0x7f4f2006f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38370/0 (socket says 172.21.15.16:38370) 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f1fe00640 1 -- 172.21.15.16:0/118557127 learned_addr learned my addr 172.21.15.16:0/118557127 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:46.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f24a00640 1 --2- 172.21.15.16:0/118557127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006ff50 0x7f4f200c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f17400640 1 --2- 172.21.15.16:0/118557127 >> v2:172.21.15.192:3300/0 conn(0x7f4f20153eb0 0x7f4f2015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f1f400640 1 -- 172.21.15.16:0/118557127 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165958655 0 0) 0x7f4f200c96a0 con 0x7f4f2006f460 2024-04-26T20:23:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f1f400640 1 -- 172.21.15.16:0/118557127 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f04003530 con 0x7f4f2006f460 2024-04-26T20:23:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f24a00640 1 -- 172.21.15.16:0/118557127 >> v2:172.21.15.192:3300/0 conn(0x7f4f20153eb0 msgr2=0x7f4f2015a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f24a00640 1 --2- 172.21.15.16:0/118557127 >> v2:172.21.15.192:3300/0 conn(0x7f4f20153eb0 0x7f4f2015a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f24a00640 1 -- 172.21.15.16:0/118557127 >> v1:172.21.15.16:6789/0 conn(0x7f4f2006f460 legacy=0x7f4f2006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f1f400640 1 -- 172.21.15.16:0/118557127 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4233863836 0 0) 0x7f4f04003530 con 0x7f4f2006f460 2024-04-26T20:23:46.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.887+0000 7f4f24a00640 1 -- 172.21.15.16:0/118557127 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f20070610 con 0x7f4f2006ff50 2024-04-26T20:23:46.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f24a00640 1 --2- 172.21.15.16:0/118557127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006ff50 0x7f4f200c5640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009d90 tx=0x7f4f1801f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c3261a32ea0017 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f1f400640 1 -- 172.21.15.16:0/118557127 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f180b5070 con 0x7f4f2006ff50 2024-04-26T20:23:46.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f1f400640 1 -- 172.21.15.16:0/118557127 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f180a8bd0 con 0x7f4f2006ff50 2024-04-26T20:23:46.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f1f400640 1 -- 172.21.15.16:0/118557127 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10001680 con 0x7f4f2006ff50 2024-04-26T20:23:46.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 -- 172.21.15.16:0/118557127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006ff50 msgr2=0x7f4f200c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 --2- 172.21.15.16:0/118557127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006ff50 0x7f4f200c5640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009d90 tx=0x7f4f1801f080 comp rx=0 tx=0).stop 2024-04-26T20:23:46.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 -- 172.21.15.16:0/118557127 shutdown_connections 2024-04-26T20:23:46.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 --2- 172.21.15.16:0/118557127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006ff50 0x7f4f200c5640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 --2- 172.21.15.16:0/118557127 >> v2:172.21.15.192:3300/0 conn(0x7f4f20153eb0 0x7f4f2015a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 -- 172.21.15.16:0/118557127 >> 172.21.15.16:0/118557127 conn(0x7f4f200c9d10 msgr2=0x7f4f200ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:46.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 -- 172.21.15.16:0/118557127 shutdown_connections 2024-04-26T20:23:46.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.891+0000 7f4f26a00640 1 -- 172.21.15.16:0/118557127 wait complete. 2024-04-26T20:23:46.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 Processor -- start 2024-04-26T20:23:46.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 -- start start 2024-04-26T20:23:46.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006f460 0x7f4f2014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f2006ff50 0x7f4f201f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f2014c460 0x7f4f201f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200c4d70 con 0x7f4f2014c460 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f200c5120 con 0x7f4f2006ff50 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4f200c4ef0 con 0x7f4f2006f460 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f2014c460 0x7f4f201f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f2014c460 0x7f4f201f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44798/0 (socket says 172.21.15.16:44798) 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 -- 172.21.15.16:0/780562020 learned_addr learned my addr 172.21.15.16:0/780562020 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f17400640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f2006ff50 0x7f4f201f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f1fe00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006f460 0x7f4f2014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 -- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006f460 msgr2=0x7f4f2014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006f460 0x7f4f2014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 -- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f2006ff50 msgr2=0x7f4f201f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f2006ff50 0x7f4f201f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:46.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 -- 172.21.15.16:0/780562020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2014c9a0 con 0x7f4f2014c460 2024-04-26T20:23:46.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f24a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f2014c460 0x7f4f201f30b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4f1801f920 tx=0x7f4f1801be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f1cc00640 1 -- 172.21.15.16:0/780562020 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f180b5050 con 0x7f4f2014c460 2024-04-26T20:23:46.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f1cc00640 1 -- 172.21.15.16:0/780562020 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f180c1070 con 0x7f4f2014c460 2024-04-26T20:23:46.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2014cc80 con 0x7f4f2014c460 2024-04-26T20:23:46.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f1cc00640 1 -- 172.21.15.16:0/780562020 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18009450 con 0x7f4f2014c460 2024-04-26T20:23:46.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.895+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f201e31b0 con 0x7f4f2014c460 2024-04-26T20:23:46.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.899+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f201e37c0 con 0x7f4f2014c460 2024-04-26T20:23:46.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.899+0000 7f4f1cc00640 1 -- 172.21.15.16:0/780562020 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f180bc690 con 0x7f4f2014c460 2024-04-26T20:23:46.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.899+0000 7f4f1cc00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4efc068380 0x7f4efc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:46.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.899+0000 7f4f1cc00640 1 -- 172.21.15.16:0/780562020 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f4f18125790 con 0x7f4f2014c460 2024-04-26T20:23:46.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.899+0000 7f4f1fe00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4efc068380 0x7f4efc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:46.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.899+0000 7f4f1fe00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4efc068380 0x7f4efc06a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f100013d0 tx=0x7f4f10001360 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:46.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:46.903+0000 7f4f1cc00640 1 -- 172.21.15.16:0/780562020 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f18018be0 con 0x7f4f2014c460 2024-04-26T20:23:47.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.071+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f20077c20 con 0x7f4f2014c460 2024-04-26T20:23:47.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.071+0000 7f4f1cc00640 1 -- 172.21.15.16:0/780562020 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) ==== 100+0+11 (secure 0 0 0) 0x7f4f180f5110 con 0x7f4f2014c460 2024-04-26T20:23:47.075 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4efc068380 msgr2=0x7f4efc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4efc068380 0x7f4efc06a840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f100013d0 tx=0x7f4f10001360 comp rx=0 tx=0).stop 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f2014c460 msgr2=0x7f4f201f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f2014c460 0x7f4f201f30b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4f1801f920 tx=0x7f4f1801be20 comp rx=0 tx=0).stop 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 shutdown_connections 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4efc068380 0x7f4efc06a840 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f2014c460 0x7f4f201f30b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f2006ff50 0x7f4f201f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 --2- 172.21.15.16:0/780562020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f2006f460 0x7f4f2014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 >> 172.21.15.16:0/780562020 conn(0x7f4f200c9d10 msgr2=0x7f4f20152730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:47.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 shutdown_connections 2024-04-26T20:23:47.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.075+0000 7f4f26a00640 1 -- 172.21.15.16:0/780562020 wait complete. 2024-04-26T20:23:47.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-26T20:23:47.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc048c00640 1 Processor -- start 2024-04-26T20:23:47.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc048c00640 1 -- start start 2024-04-26T20:23:47.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc048c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc044071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc048c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc0440c9520 0x7fc044166860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc048c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0440c8e50 con 0x7fc044070da0 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc048c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fc044160290 con 0x7fc0440c9520 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc048c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc0440c9110 con 0x7fc04415c770 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc041e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc044070da0 0x7fc04415c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38376/0 (socket says 172.21.15.16:38376) 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc041e00640 1 -- 172.21.15.16:0/2866890762 learned_addr learned my addr 172.21.15.16:0/2866890762 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc042800640 1 --2- 172.21.15.16:0/2866890762 >> v2:172.21.15.192:3300/0 conn(0x7fc0440c9520 0x7fc044166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc039400640 1 --2- 172.21.15.16:0/2866890762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc044071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc041400640 1 -- 172.21.15.16:0/2866890762 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701320951 0 0) 0x7fc0440c8e50 con 0x7fc044070da0 2024-04-26T20:23:47.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc041400640 1 -- 172.21.15.16:0/2866890762 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc028003530 con 0x7fc044070da0 2024-04-26T20:23:47.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc039400640 1 -- 172.21.15.16:0/2866890762 >> v2:172.21.15.192:3300/0 conn(0x7fc0440c9520 msgr2=0x7fc044166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:47.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc039400640 1 --2- 172.21.15.16:0/2866890762 >> v2:172.21.15.192:3300/0 conn(0x7fc0440c9520 0x7fc044166860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc039400640 1 -- 172.21.15.16:0/2866890762 >> v1:172.21.15.16:6789/0 conn(0x7fc044070da0 legacy=0x7fc04415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc041400640 1 -- 172.21.15.16:0/2866890762 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1659144837 0 0) 0x7fc028003530 con 0x7fc044070da0 2024-04-26T20:23:47.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.239+0000 7fc039400640 1 -- 172.21.15.16:0/2866890762 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0440c9d70 con 0x7fc04415c770 2024-04-26T20:23:47.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.243+0000 7fc039400640 1 --2- 172.21.15.16:0/2866890762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc044071180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0097c0 tx=0x7fc02c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b20aed691109f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:47.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc041400640 1 -- 172.21.15.16:0/2866890762 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0b0070 con 0x7fc04415c770 2024-04-26T20:23:47.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc041400640 1 -- 172.21.15.16:0/2866890762 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c0ab400 con 0x7fc04415c770 2024-04-26T20:23:47.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc041400640 1 -- 172.21.15.16:0/2866890762 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034001680 con 0x7fc04415c770 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 -- 172.21.15.16:0/2866890762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 msgr2=0x7fc044071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 --2- 172.21.15.16:0/2866890762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc044071180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0097c0 tx=0x7fc02c01c3c0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 -- 172.21.15.16:0/2866890762 shutdown_connections 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 --2- 172.21.15.16:0/2866890762 >> v2:172.21.15.192:3300/0 conn(0x7fc0440c9520 0x7fc044166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 --2- 172.21.15.16:0/2866890762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc044071180 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 -- 172.21.15.16:0/2866890762 >> 172.21.15.16:0/2866890762 conn(0x7fc0440ce2c0 msgr2=0x7fc0440ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 -- 172.21.15.16:0/2866890762 shutdown_connections 2024-04-26T20:23:47.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.247+0000 7fc048c00640 1 -- 172.21.15.16:0/2866890762 wait complete. 2024-04-26T20:23:47.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 Processor -- start 2024-04-26T20:23:47.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 -- start start 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc044070da0 0x7fc0441f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0440c9520 0x7fc04414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc04414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc044169950 con 0x7fc0440c9520 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc0441697d0 con 0x7fc044070da0 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc044169ad0 con 0x7fc04415c770 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0440c9520 0x7fc04414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0440c9520 0x7fc04414a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44810/0 (socket says 172.21.15.16:44810) 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 -- 172.21.15.16:0/3403535003 learned_addr learned my addr 172.21.15.16:0/3403535003 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc041e00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc044070da0 0x7fc0441f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc042800640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc04414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 -- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 msgr2=0x7fc04414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc04414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 -- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc044070da0 msgr2=0x7fc0441f9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc044070da0 0x7fc0441f9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 -- 172.21.15.16:0/3403535003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0441f99c0 con 0x7fc0440c9520 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc041e00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc044070da0 0x7fc0441f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc039400640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0440c9520 0x7fc04414a930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc02c000c10 tx=0x7fc02c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc03aa00640 1 -- 172.21.15.16:0/3403535003 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0b0040 con 0x7fc0440c9520 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc03aa00640 1 -- 172.21.15.16:0/3403535003 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c003620 con 0x7fc0440c9520 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc03aa00640 1 -- 172.21.15.16:0/3403535003 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0039d0 con 0x7fc0440c9520 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04414d810 con 0x7fc0440c9520 2024-04-26T20:23:47.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.251+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0440c67c0 con 0x7fc0440c9520 2024-04-26T20:23:47.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.255+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc044077c20 con 0x7fc0440c9520 2024-04-26T20:23:47.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.255+0000 7fc03aa00640 1 -- 172.21.15.16:0/3403535003 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc02c0bd020 con 0x7fc0440c9520 2024-04-26T20:23:47.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.255+0000 7fc03aa00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc0200683b0 0x7fc02006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.255+0000 7fc03aa00640 1 -- 172.21.15.16:0/3403535003 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fc02c120840 con 0x7fc0440c9520 2024-04-26T20:23:47.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.255+0000 7fc041e00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc0200683b0 0x7fc02006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.255+0000 7fc041e00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc0200683b0 0x7fc02006a870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc034007af0 tx=0x7fc034009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:47.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.259+0000 7fc03aa00640 1 -- 172.21.15.16:0/3403535003 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc02c015fb0 con 0x7fc0440c9520 2024-04-26T20:23:47.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.423+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc0440ceb90 con 0x7fc0440c9520 2024-04-26T20:23:47.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.423+0000 7fc03aa00640 1 -- 172.21.15.16:0/3403535003 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) ==== 103+0+11 (secure 0 0 0) 0x7fc02c0f0800 con 0x7fc0440c9520 2024-04-26T20:23:47.426 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T20:23:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc0200683b0 msgr2=0x7fc02006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc0200683b0 0x7fc02006a870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc034007af0 tx=0x7fc034009040 comp rx=0 tx=0).stop 2024-04-26T20:23:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0440c9520 msgr2=0x7fc04414a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0440c9520 0x7fc04414a930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc02c000c10 tx=0x7fc02c019160 comp rx=0 tx=0).stop 2024-04-26T20:23:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 shutdown_connections 2024-04-26T20:23:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc0200683b0 0x7fc02006a870 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04415c770 0x7fc04414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0440c9520 0x7fc04414a930 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 --2- 172.21.15.16:0/3403535003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc044070da0 0x7fc0441f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 >> 172.21.15.16:0/3403535003 conn(0x7fc0440ce2c0 msgr2=0x7fc0440718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 shutdown_connections 2024-04-26T20:23:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.427+0000 7fc048c00640 1 -- 172.21.15.16:0/3403535003 wait complete. 2024-04-26T20:23:47.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T20:23:47.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.587+0000 7f6482400640 1 Processor -- start 2024-04-26T20:23:47.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.587+0000 7f6482400640 1 -- start start 2024-04-26T20:23:47.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f6482400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c159650 0x7f647c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f6482400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f647c06d490 0x7f647c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f6482400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c0ca520 con 0x7f647c0ccd30 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f6482400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f647c0cb0e0 con 0x7f647c06d490 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f6482400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0c9f60 con 0x7f647c159650 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f6473e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f647c0ccd30 0x7f647c072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38386/0 (socket says 172.21.15.16:38386) 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f6473e00640 1 -- 172.21.15.16:0/2877268914 learned_addr learned my addr 172.21.15.16:0/2877268914 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647b400640 1 --2- 172.21.15.16:0/2877268914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c159650 0x7f647c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647be00640 1 --2- 172.21.15.16:0/2877268914 >> v2:172.21.15.192:3300/0 conn(0x7f647c06d490 0x7f647c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647aa00640 1 -- 172.21.15.16:0/2877268914 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649841307 0 0) 0x7f647c0ca520 con 0x7f647c0ccd30 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647aa00640 1 -- 172.21.15.16:0/2877268914 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6460003530 con 0x7f647c0ccd30 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647b400640 1 -- 172.21.15.16:0/2877268914 >> v2:172.21.15.192:3300/0 conn(0x7f647c06d490 msgr2=0x7f647c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647b400640 1 --2- 172.21.15.16:0/2877268914 >> v2:172.21.15.192:3300/0 conn(0x7f647c06d490 0x7f647c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647b400640 1 -- 172.21.15.16:0/2877268914 >> v1:172.21.15.16:6789/0 conn(0x7f647c0ccd30 legacy=0x7f647c072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.591+0000 7f647b400640 1 -- 172.21.15.16:0/2877268914 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0ca240 con 0x7f647c159650 2024-04-26T20:23:47.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f647b400640 1 --2- 172.21.15.16:0/2877268914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c159650 0x7f647c0cb980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097c0 tx=0x7f646c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35164f8fc372bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:47.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f647aa00640 1 -- 172.21.15.16:0/2877268914 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0b1070 con 0x7f647c159650 2024-04-26T20:23:47.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f647aa00640 1 -- 172.21.15.16:0/2877268914 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c0ac410 con 0x7f647c159650 2024-04-26T20:23:47.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f647aa00640 1 -- 172.21.15.16:0/2877268914 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0ac7c0 con 0x7f647c159650 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 -- 172.21.15.16:0/2877268914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c159650 msgr2=0x7f647c0cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 --2- 172.21.15.16:0/2877268914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c159650 0x7f647c0cb980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097c0 tx=0x7f646c01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 -- 172.21.15.16:0/2877268914 shutdown_connections 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 --2- 172.21.15.16:0/2877268914 >> v2:172.21.15.192:3300/0 conn(0x7f647c06d490 0x7f647c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 --2- 172.21.15.16:0/2877268914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c159650 0x7f647c0cb980 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 -- 172.21.15.16:0/2877268914 >> 172.21.15.16:0/2877268914 conn(0x7f647c0704d0 msgr2=0x7f647c0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 -- 172.21.15.16:0/2877268914 shutdown_connections 2024-04-26T20:23:47.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 -- 172.21.15.16:0/2877268914 wait complete. 2024-04-26T20:23:47.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 Processor -- start 2024-04-26T20:23:47.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.595+0000 7f6482400640 1 -- start start 2024-04-26T20:23:47.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c06d490 0x7f647c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f647c0ccd30 0x7f647c1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c159650 0x7f647c159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f647c072af0 con 0x7f647c159650 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f647c072970 con 0x7f647c0ccd30 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f647c168fa0 con 0x7f647c06d490 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c159650 0x7f647c159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c159650 0x7f647c159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44818/0 (socket says 172.21.15.16:44818) 2024-04-26T20:23:47.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 -- 172.21.15.16:0/1058848609 learned_addr learned my addr 172.21.15.16:0/1058848609 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647b400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c06d490 0x7f647c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6473e00640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f647c0ccd30 0x7f647c1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 -- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c06d490 msgr2=0x7f647c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c06d490 0x7f647c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 -- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f647c0ccd30 msgr2=0x7f647c1f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f647c0ccd30 0x7f647c1f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 -- 172.21.15.16:0/1058848609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c157e50 con 0x7f647c159650 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6473e00640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f647c0ccd30 0x7f647c1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f647be00640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c159650 0x7f647c159d50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6474009cb0 tx=0x7f647400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6473400640 1 -- 172.21.15.16:0/1058848609 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474018020 con 0x7f647c159650 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6473400640 1 -- 172.21.15.16:0/1058848609 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474014480 con 0x7f647c159650 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6473400640 1 -- 172.21.15.16:0/1058848609 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474014870 con 0x7f647c159650 2024-04-26T20:23:47.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c15bbd0 con 0x7f647c159650 2024-04-26T20:23:47.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c157370 con 0x7f647c159650 2024-04-26T20:23:47.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c077c20 con 0x7f647c159650 2024-04-26T20:23:47.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.599+0000 7f6473400640 1 -- 172.21.15.16:0/1058848609 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f647401b020 con 0x7f647c159650 2024-04-26T20:23:47.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.603+0000 7f6473400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6458068380 0x7f645806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:47.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.603+0000 7f6473400640 1 -- 172.21.15.16:0/1058848609 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f6474087d50 con 0x7f647c159650 2024-04-26T20:23:47.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.603+0000 7f647b400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6458068380 0x7f645806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:47.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.603+0000 7f647b400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6458068380 0x7f645806a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f646c0ae000 tx=0x7f646c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:47.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.607+0000 7f6473400640 1 -- 172.21.15.16:0/1058848609 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6474022020 con 0x7f647c159650 2024-04-26T20:23:47.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.783+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f647c156dd0 con 0x7f647c159650 2024-04-26T20:23:47.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.783+0000 7f6473400640 1 -- 172.21.15.16:0/1058848609 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v31) ==== 80+0+490 (secure 0 0 0) 0x7f6474010040 con 0x7f647c159650 2024-04-26T20:23:47.788 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6835/1962586875 2024-04-27T20:21:50.873892+0000 2024-04-26T20:23:47.788 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6836/1882507975 2024-04-27T20:20:50.864042+0000 2024-04-26T20:23:47.788 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.192:6838/2295577139 2024-04-27T20:19:00.847936+0000 2024-04-26T20:23:47.788 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.192:6836/2295577139 2024-04-27T20:19:00.847936+0000 2024-04-26T20:23:47.788 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6837/1962586875 2024-04-27T20:21:50.873892+0000 2024-04-26T20:23:47.788 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6833/3670477050 2024-04-27T20:17:00.827028+0000 2024-04-26T20:23:47.789 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6834/1882507975 2024-04-27T20:20:50.864042+0000 2024-04-26T20:23:47.789 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6832/3670477050 2024-04-27T20:17:00.827028+0000 2024-04-26T20:23:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:listed 8 entries 2024-04-26T20:23:47.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6458068380 msgr2=0x7f645806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6458068380 0x7f645806a840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f646c0ae000 tx=0x7f646c008040 comp rx=0 tx=0).stop 2024-04-26T20:23:47.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c159650 msgr2=0x7f647c159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:47.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c159650 0x7f647c159d50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6474009cb0 tx=0x7f647400c490 comp rx=0 tx=0).stop 2024-04-26T20:23:47.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 shutdown_connections 2024-04-26T20:23:47.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6458068380 0x7f645806a840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c159650 0x7f647c159d50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f647c0ccd30 0x7f647c1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 --2- 172.21.15.16:0/1058848609 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647c06d490 0x7f647c15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:47.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 >> 172.21.15.16:0/1058848609 conn(0x7f647c0704d0 msgr2=0x7f647c0708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:47.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 shutdown_connections 2024-04-26T20:23:47.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:47.787+0000 7f6482400640 1 -- 172.21.15.16:0/1058848609 wait complete. 2024-04-26T20:23:47.809 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T20:23:47.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:23:47.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T20:23:47.854 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:23:47.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:23:47.854 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T20:23:47.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:23:47.904 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T20:23:47.955 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T20:23:47.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:23:47.956 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T20:23:48.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T20:23:48.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-26T20:23:48.194 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T20:23:48.203 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T20:23:48.204 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:23:48.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.343+0000 7f9f0da00640 1 Processor -- start 2024-04-26T20:23:48.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.343+0000 7f9f0da00640 1 -- start start 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f0da00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f080c9720 0x7f9f080c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f0da00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f080c9d90 con 0x7f9f080c7b80 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f0da00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f080ca070 con 0x7f9f08153af0 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f0da00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9f0815dec0 con 0x7f9f080c9720 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f07400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f080c9720 0x7f9f080c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f06000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9f080c7b80 0x7f9f080c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38396/0 (socket says 172.21.15.16:38396) 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f06000640 1 -- 172.21.15.16:0/1229146690 learned_addr learned my addr 172.21.15.16:0/1229146690 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f07400640 1 -- 172.21.15.16:0/1229146690 >> v1:172.21.15.192:6789/0 conn(0x7f9f08153af0 legacy=0x7f9f0815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f07400640 1 -- 172.21.15.16:0/1229146690 >> v1:172.21.15.16:6789/0 conn(0x7f9f080c7b80 legacy=0x7f9f080c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f07400640 1 -- 172.21.15.16:0/1229146690 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f080ca350 con 0x7f9f080c9720 2024-04-26T20:23:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.347+0000 7f9f05600640 1 -- 172.21.15.16:0/1229146690 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408084587 0 0) 0x7f9f080c9d90 con 0x7f9f080c7b80 2024-04-26T20:23:48.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f07400640 1 --2- 172.21.15.16:0/1229146690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f080c7f80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009d90 tx=0x7f9f0001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f90c13992baa5ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:48.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f05600640 1 -- 172.21.15.16:0/1229146690 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f000b4070 con 0x7f9f080c9720 2024-04-26T20:23:48.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f05600640 1 -- 172.21.15.16:0/1229146690 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000af600 con 0x7f9f080c9720 2024-04-26T20:23:48.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f05600640 1 -- 172.21.15.16:0/1229146690 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f000af9d0 con 0x7f9f080c9720 2024-04-26T20:23:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- 172.21.15.16:0/1229146690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 msgr2=0x7f9f080c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 --2- 172.21.15.16:0/1229146690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f080c7f80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009d90 tx=0x7f9f0001f150 comp rx=0 tx=0).stop 2024-04-26T20:23:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- 172.21.15.16:0/1229146690 shutdown_connections 2024-04-26T20:23:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 --2- 172.21.15.16:0/1229146690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f080c7f80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- 172.21.15.16:0/1229146690 >> 172.21.15.16:0/1229146690 conn(0x7f9f0806c380 msgr2=0x7f9f0806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- 172.21.15.16:0/1229146690 shutdown_connections 2024-04-26T20:23:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- 172.21.15.16:0/1229146690 wait complete. 2024-04-26T20:23:48.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 Processor -- start 2024-04-26T20:23:48.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- start start 2024-04-26T20:23:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f080c7b80 0x7f9f08159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f0806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f08153af0 0x7f9f0814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0815d290 con 0x7f9f080c9720 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9f080ca630 con 0x7f9f08153af0 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f0da00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9f08153ed0 con 0x7f9f080c7b80 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f06000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f0806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f06000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f0806fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44840/0 (socket says 172.21.15.16:44840) 2024-04-26T20:23:48.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f06000640 1 -- 172.21.15.16:0/4180872877 learned_addr learned my addr 172.21.15.16:0/4180872877 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.351+0000 7f9f07400640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f08153af0 0x7f9f0814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f06a00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f080c7b80 0x7f9f08159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f06000640 1 -- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f080c7b80 msgr2=0x7f9f08159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f06000640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f080c7b80 0x7f9f08159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f06000640 1 -- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f08153af0 msgr2=0x7f9f0814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f06000640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f08153af0 0x7f9f0814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f06000640 1 -- 172.21.15.16:0/4180872877 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f08072540 con 0x7f9f080c9720 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f06000640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f0806fda0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400c410 tx=0x7f9ef400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9efea00640 1 -- 172.21.15.16:0/4180872877 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40074e0 con 0x7f9f080c9720 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9efea00640 1 -- 172.21.15.16:0/4180872877 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef40047f0 con 0x7f9f080c9720 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0814a460 con 0x7f9f080c9720 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9efea00640 1 -- 172.21.15.16:0/4180872877 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4007680 con 0x7f9f080c9720 2024-04-26T20:23:48.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0814a700 con 0x7f9f080c9720 2024-04-26T20:23:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f08077c20 con 0x7f9f080c9720 2024-04-26T20:23:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9efea00640 1 -- 172.21.15.16:0/4180872877 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ef4011070 con 0x7f9f080c9720 2024-04-26T20:23:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9efea00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ee8068380 0x7f9ee806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.355+0000 7f9efea00640 1 -- 172.21.15.16:0/4180872877 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f9ef4086b80 con 0x7f9f080c9720 2024-04-26T20:23:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.359+0000 7f9f06a00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ee8068380 0x7f9ee806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.359+0000 7f9f06a00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ee8068380 0x7f9ee806a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8000f70 tx=0x7f9ef8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:48.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.359+0000 7f9efea00640 1 -- 172.21.15.16:0/4180872877 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9f08072540 con 0x7f9f080c9720 2024-04-26T20:23:48.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.543+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f08151680 con 0x7f9ee8068380 2024-04-26T20:23:48.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.567+0000 7f9efea00640 1 -- 172.21.15.16:0/4180872877 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335439 (secure 0 0 0) 0x7f9ef8001370 con 0x7f9ee8068380 2024-04-26T20:23:48.574 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:23:48.576 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:23:48.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ee8068380 msgr2=0x7f9ee806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ee8068380 0x7f9ee806a840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8000f70 tx=0x7f9ef8009040 comp rx=0 tx=0).stop 2024-04-26T20:23:48.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 msgr2=0x7f9f0806fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f0806fda0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400c410 tx=0x7f9ef400c8d0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 shutdown_connections 2024-04-26T20:23:48.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f9ee8068380 0x7f9ee806a840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f08153af0 0x7f9f0814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f080c9720 0x7f9f0806fda0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 --2- 172.21.15.16:0/4180872877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f080c7b80 0x7f9f08159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 >> 172.21.15.16:0/4180872877 conn(0x7f9f0806c380 msgr2=0x7f9f0815be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:48.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 shutdown_connections 2024-04-26T20:23:48.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.571+0000 7f9f0da00640 1 -- 172.21.15.16:0/4180872877 wait complete. 2024-04-26T20:23:48.594 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-04-26T20:23:47.192522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":144507345,"num_objects":349,"num_object_clones":0,"num_object_copies":1204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":1875,"num_read_kb":3686707,"num_write":31266,"num_write_kb":4364755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45983,"ondisk_log_size":45983,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":705352,"kb_used_data":103496,"kb_used_omap":12,"kb_used_meta":601779,"kb_avail":754269368,"statfs":{"total":773094113280,"available":772371832832,"internally_reserved":0,"allocated":105979904,"data_stored":293835746,"data_compressed":43634921,"data_compressed_allocated":57049088,"data_compressed_original":246579200,"omap_allocated":12752,"internal_metadata":616222256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1807848,"num_objects":-387,"num_object_clones":0,"num_object_copies":-1540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-387,"num_whiteouts":0,"num_read":6,"num_read_kb":47,"num_write":478,"num_write_kb":2040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004680"},"pg_stats":[{"pgid":"2.1f","version":"31'137","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.621292+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:23:37.621292+0000","last_peered":"2024-04-26T20:23:37.621292+0000","last_clean":"2024-04-26T20:23:37.621292+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:23:37.621292+0000","last_undegraded":"2024-04-26T20:23:37.621292+0000","last_fullsized":"2024-04-26T20:23:37.621292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":4124,"num_write":97,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'186","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.903553+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:23:37.903553+0000","last_peered":"2024-04-26T20:23:37.903553+0000","last_clean":"2024-04-26T20:23:37.903553+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:23:37.903553+0000","last_undegraded":"2024-04-26T20:23:37.903553+0000","last_fullsized":"2024-04-26T20:23:37.903553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'813","reported_seq":883,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.913655+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:23:37.913655+0000","last_peered":"2024-04-26T20:23:37.913655+0000","last_clean":"2024-04-26T20:23:37.913655+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:23:37.913655+0000","last_undegraded":"2024-04-26T20:23:37.913655+0000","last_fullsized":"2024-04-26T20:23:37.913655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33714,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":127167,"num_write":785,"num_write_kb":160617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'67","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.544019+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:23:34.544019+0000","last_peered":"2024-04-26T20:23:34.544019+0000","last_clean":"2024-04-26T20:23:34.544019+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:23:34.544019+0000","last_undegraded":"2024-04-26T20:23:34.544019+0000","last_fullsized":"2024-04-26T20:23:34.544019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":16,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'176","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.865834+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:23:37.865834+0000","last_peered":"2024-04-26T20:23:37.865834+0000","last_clean":"2024-04-26T20:23:37.865834+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:23:37.865834+0000","last_undegraded":"2024-04-26T20:23:37.865834+0000","last_fullsized":"2024-04-26T20:23:37.865834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'772","reported_seq":837,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.662427+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:23:37.662427+0000","last_peered":"2024-04-26T20:23:37.662427+0000","last_clean":"2024-04-26T20:23:37.662427+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:23:37.662427+0000","last_undegraded":"2024-04-26T20:23:37.662427+0000","last_fullsized":"2024-04-26T20:23:37.662427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348049,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":36,"num_read_kb":94315,"num_write":737,"num_write_kb":130983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'208","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.527799+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:23:37.527799+0000","last_peered":"2024-04-26T20:23:37.527799+0000","last_clean":"2024-04-26T20:23:37.527799+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:23:37.527799+0000","last_undegraded":"2024-04-26T20:23:37.527799+0000","last_fullsized":"2024-04-26T20:23:37.527799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12305,"num_write":138,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'171","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.711345+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:23:37.711345+0000","last_peered":"2024-04-26T20:23:37.711345+0000","last_clean":"2024-04-26T20:23:37.711345+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:23:37.711345+0000","last_undegraded":"2024-04-26T20:23:37.711345+0000","last_fullsized":"2024-04-26T20:23:37.711345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'756","reported_seq":821,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.831188+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:23:37.831188+0000","last_peered":"2024-04-26T20:23:37.831188+0000","last_clean":"2024-04-26T20:23:37.831188+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:23:37.831188+0000","last_undegraded":"2024-04-26T20:23:37.831188+0000","last_fullsized":"2024-04-26T20:23:37.831188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38560,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":92426,"num_write":721,"num_write_kb":119140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'163","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.475252+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:23:34.475252+0000","last_peered":"2024-04-26T20:23:34.475252+0000","last_clean":"2024-04-26T20:23:34.475252+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:23:34.475252+0000","last_undegraded":"2024-04-26T20:23:34.475252+0000","last_fullsized":"2024-04-26T20:23:34.475252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":110,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'172","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.714776+0000","last_change":"2024-04-26T20:15:02.201407+0000","last_active":"2024-04-26T20:23:34.714776+0000","last_peered":"2024-04-26T20:23:34.714776+0000","last_clean":"2024-04-26T20:23:34.714776+0000","last_became_active":"2024-04-26T20:15:02.201092+0000","last_became_peered":"2024-04-26T20:15:02.201092+0000","last_unstale":"2024-04-26T20:23:34.714776+0000","last_undegraded":"2024-04-26T20:23:34.714776+0000","last_fullsized":"2024-04-26T20:23:34.714776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:14.070151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'803","reported_seq":869,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.920525+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:23:37.920525+0000","last_peered":"2024-04-26T20:23:37.920525+0000","last_clean":"2024-04-26T20:23:37.920525+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:23:37.920525+0000","last_undegraded":"2024-04-26T20:23:37.920525+0000","last_fullsized":"2024-04-26T20:23:37.920525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8013,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":115919,"num_write":771,"num_write_kb":110976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'205","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.687804+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:23:37.687804+0000","last_peered":"2024-04-26T20:23:37.687804+0000","last_clean":"2024-04-26T20:23:37.687804+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:23:37.687804+0000","last_undegraded":"2024-04-26T20:23:37.687804+0000","last_fullsized":"2024-04-26T20:23:37.687804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'161","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.604403+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:23:37.604403+0000","last_peered":"2024-04-26T20:23:37.604403+0000","last_clean":"2024-04-26T20:23:37.604403+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:23:37.604403+0000","last_undegraded":"2024-04-26T20:23:37.604403+0000","last_fullsized":"2024-04-26T20:23:37.604403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":106,"num_write_kb":8336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'785","reported_seq":852,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.869048+0000","last_change":"2024-04-26T20:15:02.208844+0000","last_active":"2024-04-26T20:23:37.869048+0000","last_peered":"2024-04-26T20:23:37.869048+0000","last_clean":"2024-04-26T20:23:37.869048+0000","last_became_active":"2024-04-26T20:15:02.207782+0000","last_became_peered":"2024-04-26T20:15:02.207782+0000","last_unstale":"2024-04-26T20:23:37.869048+0000","last_undegraded":"2024-04-26T20:23:37.869048+0000","last_fullsized":"2024-04-26T20:23:37.869048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14061,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":86223,"num_write":741,"num_write_kb":106297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'203","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.583443+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:23:37.583443+0000","last_peered":"2024-04-26T20:23:37.583443+0000","last_clean":"2024-04-26T20:23:37.583443+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:23:37.583443+0000","last_undegraded":"2024-04-26T20:23:37.583443+0000","last_fullsized":"2024-04-26T20:23:37.583443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'166","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.525300+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:23:30.525300+0000","last_peered":"2024-04-26T20:23:30.525300+0000","last_clean":"2024-04-26T20:23:30.525300+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:23:30.525300+0000","last_undegraded":"2024-04-26T20:23:30.525300+0000","last_fullsized":"2024-04-26T20:23:30.525300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4098,"num_write":113,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'843","reported_seq":898,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.892297+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:23:37.892297+0000","last_peered":"2024-04-26T20:23:37.892297+0000","last_clean":"2024-04-26T20:23:37.892297+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:23:37.892297+0000","last_undegraded":"2024-04-26T20:23:37.892297+0000","last_fullsized":"2024-04-26T20:23:37.892297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28079,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":76471,"num_write":801,"num_write_kb":93343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.910809+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:23:37.910809+0000","last_peered":"2024-04-26T20:23:37.910809+0000","last_clean":"2024-04-26T20:23:37.910809+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:23:37.910809+0000","last_undegraded":"2024-04-26T20:23:37.910809+0000","last_fullsized":"2024-04-26T20:23:37.910809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'60","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.686993+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:23:34.686993+0000","last_peered":"2024-04-26T20:23:34.686993+0000","last_clean":"2024-04-26T20:23:34.686993+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:23:34.686993+0000","last_undegraded":"2024-04-26T20:23:34.686993+0000","last_fullsized":"2024-04-26T20:23:34.686993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'782","reported_seq":860,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.893685+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:23:37.893685+0000","last_peered":"2024-04-26T20:23:37.893685+0000","last_clean":"2024-04-26T20:23:37.893685+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:23:37.893685+0000","last_undegraded":"2024-04-26T20:23:37.893685+0000","last_fullsized":"2024-04-26T20:23:37.893685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88606,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":48,"num_read_kb":121482,"num_write":747,"num_write_kb":114987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'211","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.652526+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:23:37.652526+0000","last_peered":"2024-04-26T20:23:37.652526+0000","last_clean":"2024-04-26T20:23:37.652526+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:23:37.652526+0000","last_undegraded":"2024-04-26T20:23:37.652526+0000","last_fullsized":"2024-04-26T20:23:37.652526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'441","reported_seq":482,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.545252+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:23:37.545252+0000","last_peered":"2024-04-26T20:23:37.545252+0000","last_clean":"2024-04-26T20:23:37.545252+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:23:37.545252+0000","last_undegraded":"2024-04-26T20:23:37.545252+0000","last_fullsized":"2024-04-26T20:23:37.545252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":388,"num_write_kb":4324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'726","reported_seq":784,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.849256+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:23:37.849256+0000","last_peered":"2024-04-26T20:23:37.849256+0000","last_clean":"2024-04-26T20:23:37.849256+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:23:37.849256+0000","last_undegraded":"2024-04-26T20:23:37.849256+0000","last_fullsized":"2024-04-26T20:23:37.849256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61038,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":28,"num_read_kb":100836,"num_write":680,"num_write_kb":105101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'206","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.700747+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:23:37.700747+0000","last_peered":"2024-04-26T20:23:37.700747+0000","last_clean":"2024-04-26T20:23:37.700747+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:23:37.700747+0000","last_undegraded":"2024-04-26T20:23:37.700747+0000","last_fullsized":"2024-04-26T20:23:37.700747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'62","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.874273+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:23:37.874273+0000","last_peered":"2024-04-26T20:23:37.874273+0000","last_clean":"2024-04-26T20:23:37.874273+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:23:37.874273+0000","last_undegraded":"2024-04-26T20:23:37.874273+0000","last_fullsized":"2024-04-26T20:23:37.874273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'822","reported_seq":916,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:38.203764+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:23:38.203764+0000","last_peered":"2024-04-26T20:23:38.203764+0000","last_clean":"2024-04-26T20:23:38.203764+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:23:38.203764+0000","last_undegraded":"2024-04-26T20:23:38.203764+0000","last_fullsized":"2024-04-26T20:23:38.203764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61621,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":203084,"num_write":786,"num_write_kb":205909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'170","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.869475+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:23:37.869475+0000","last_peered":"2024-04-26T20:23:37.869475+0000","last_clean":"2024-04-26T20:23:37.869475+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:23:37.869475+0000","last_undegraded":"2024-04-26T20:23:37.869475+0000","last_fullsized":"2024-04-26T20:23:37.869475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'394","reported_seq":437,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:38.273741+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:23:38.273741+0000","last_peered":"2024-04-26T20:23:38.273741+0000","last_clean":"2024-04-26T20:23:38.273741+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:23:38.273741+0000","last_undegraded":"2024-04-26T20:23:38.273741+0000","last_fullsized":"2024-04-26T20:23:38.273741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":830,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'784","reported_seq":834,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.698472+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:23:37.698472+0000","last_peered":"2024-04-26T20:23:37.698472+0000","last_clean":"2024-04-26T20:23:37.698472+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:23:37.698472+0000","last_undegraded":"2024-04-26T20:23:37.698472+0000","last_fullsized":"2024-04-26T20:23:37.698472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26923,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":65331,"num_write":751,"num_write_kb":82709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'190","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.876495+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:23:37.876495+0000","last_peered":"2024-04-26T20:23:37.876495+0000","last_clean":"2024-04-26T20:23:37.876495+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:23:37.876495+0000","last_undegraded":"2024-04-26T20:23:37.876495+0000","last_fullsized":"2024-04-26T20:23:37.876495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'198","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.619819+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:23:34.619819+0000","last_peered":"2024-04-26T20:23:34.619819+0000","last_clean":"2024-04-26T20:23:34.619819+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:23:34.619819+0000","last_undegraded":"2024-04-26T20:23:34.619819+0000","last_fullsized":"2024-04-26T20:23:34.619819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":138,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'753","reported_seq":810,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.902643+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:23:37.902643+0000","last_peered":"2024-04-26T20:23:37.902643+0000","last_clean":"2024-04-26T20:23:37.902643+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:23:37.902643+0000","last_undegraded":"2024-04-26T20:23:37.902643+0000","last_fullsized":"2024-04-26T20:23:37.902643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40905,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":72924,"num_write":711,"num_write_kb":105217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'200","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.888710+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:23:37.888710+0000","last_peered":"2024-04-26T20:23:37.888710+0000","last_clean":"2024-04-26T20:23:37.888710+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:23:37.888710+0000","last_undegraded":"2024-04-26T20:23:37.888710+0000","last_fullsized":"2024-04-26T20:23:37.888710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'56","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.571100+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:23:37.571100+0000","last_peered":"2024-04-26T20:23:37.571100+0000","last_clean":"2024-04-26T20:23:37.571100+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:23:37.571100+0000","last_undegraded":"2024-04-26T20:23:37.571100+0000","last_fullsized":"2024-04-26T20:23:37.571100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'779","reported_seq":832,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.712170+0000","last_change":"2024-04-26T20:15:02.206054+0000","last_active":"2024-04-26T20:23:37.712170+0000","last_peered":"2024-04-26T20:23:37.712170+0000","last_clean":"2024-04-26T20:23:37.712170+0000","last_became_active":"2024-04-26T20:15:02.205610+0000","last_became_peered":"2024-04-26T20:15:02.205610+0000","last_unstale":"2024-04-26T20:23:37.712170+0000","last_undegraded":"2024-04-26T20:23:37.712170+0000","last_fullsized":"2024-04-26T20:23:37.712170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:16.507443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36509,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":29,"num_read_kb":101392,"num_write":750,"num_write_kb":117505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'189","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.468951+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:23:42.468951+0000","last_peered":"2024-04-26T20:23:42.468951+0000","last_clean":"2024-04-26T20:23:42.468951+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:23:42.468951+0000","last_undegraded":"2024-04-26T20:23:42.468951+0000","last_fullsized":"2024-04-26T20:23:42.468951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'623","reported_seq":662,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.690568+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:23:22.690568+0000","last_peered":"2024-04-26T20:23:22.690568+0000","last_clean":"2024-04-26T20:23:22.690568+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:23:22.690568+0000","last_undegraded":"2024-04-26T20:23:22.690568+0000","last_fullsized":"2024-04-26T20:23:22.690568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":569,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'760","reported_seq":839,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.889001+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:23:37.889001+0000","last_peered":"2024-04-26T20:23:37.889001+0000","last_clean":"2024-04-26T20:23:37.889001+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:23:37.889001+0000","last_undegraded":"2024-04-26T20:23:37.889001+0000","last_fullsized":"2024-04-26T20:23:37.889001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19472,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":139574,"num_write":727,"num_write_kb":123608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'200","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.628476+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:23:37.628476+0000","last_peered":"2024-04-26T20:23:37.628476+0000","last_clean":"2024-04-26T20:23:37.628476+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:23:37.628476+0000","last_undegraded":"2024-04-26T20:23:37.628476+0000","last_fullsized":"2024-04-26T20:23:37.628476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'356","reported_seq":684,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.552239+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:23:37.552239+0000","last_peered":"2024-04-26T20:23:37.552239+0000","last_clean":"2024-04-26T20:23:37.552239+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:23:37.552239+0000","last_undegraded":"2024-04-26T20:23:37.552239+0000","last_fullsized":"2024-04-26T20:23:37.552239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1518911,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":298,"num_read_kb":1687,"num_write":293,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'745","reported_seq":798,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.895974+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:23:37.895974+0000","last_peered":"2024-04-26T20:23:37.895974+0000","last_clean":"2024-04-26T20:23:37.895974+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:23:37.895974+0000","last_undegraded":"2024-04-26T20:23:37.895974+0000","last_fullsized":"2024-04-26T20:23:37.895974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":61996,"num_write":716,"num_write_kb":88897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'186","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.584386+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:23:37.584386+0000","last_peered":"2024-04-26T20:23:37.584386+0000","last_clean":"2024-04-26T20:23:37.584386+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:23:37.584386+0000","last_undegraded":"2024-04-26T20:23:37.584386+0000","last_fullsized":"2024-04-26T20:23:37.584386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'271","reported_seq":316,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.482482+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:23:30.482482+0000","last_peered":"2024-04-26T20:23:30.482482+0000","last_clean":"2024-04-26T20:23:30.482482+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:23:30.482482+0000","last_undegraded":"2024-04-26T20:23:30.482482+0000","last_fullsized":"2024-04-26T20:23:30.482482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":213,"num_write_kb":8309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'870","reported_seq":932,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.864273+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:23:37.864273+0000","last_peered":"2024-04-26T20:23:37.864273+0000","last_clean":"2024-04-26T20:23:37.864273+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:23:37.864273+0000","last_undegraded":"2024-04-26T20:23:37.864273+0000","last_fullsized":"2024-04-26T20:23:37.864273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118312,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":32,"num_read_kb":98068,"num_write":834,"num_write_kb":148105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'181","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.587614+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:23:37.587614+0000","last_peered":"2024-04-26T20:23:37.587614+0000","last_clean":"2024-04-26T20:23:37.587614+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:23:37.587614+0000","last_undegraded":"2024-04-26T20:23:37.587614+0000","last_fullsized":"2024-04-26T20:23:37.587614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'78","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:32.557547+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:23:32.557547+0000","last_peered":"2024-04-26T20:23:32.557547+0000","last_clean":"2024-04-26T20:23:32.557547+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:23:32.557547+0000","last_undegraded":"2024-04-26T20:23:32.557547+0000","last_fullsized":"2024-04-26T20:23:32.557547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":13,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:21:52.220087+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:21:52.220087+0000","last_peered":"2024-04-26T20:21:52.220087+0000","last_clean":"2024-04-26T20:21:52.220087+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:21:52.220087+0000","last_undegraded":"2024-04-26T20:21:52.220087+0000","last_fullsized":"2024-04-26T20:21:52.220087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'767","reported_seq":826,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.922859+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:23:37.922859+0000","last_peered":"2024-04-26T20:23:37.922859+0000","last_clean":"2024-04-26T20:23:37.922859+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:23:37.922859+0000","last_undegraded":"2024-04-26T20:23:37.922859+0000","last_fullsized":"2024-04-26T20:23:37.922859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":30,"num_read_kb":82002,"num_write":736,"num_write_kb":109731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.719573+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:23:37.719573+0000","last_peered":"2024-04-26T20:23:37.719573+0000","last_clean":"2024-04-26T20:23:37.719573+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:23:37.719573+0000","last_undegraded":"2024-04-26T20:23:37.719573+0000","last_fullsized":"2024-04-26T20:23:37.719573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'67","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:28.510575+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:23:28.510575+0000","last_peered":"2024-04-26T20:23:28.510575+0000","last_clean":"2024-04-26T20:23:28.510575+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:23:28.510575+0000","last_undegraded":"2024-04-26T20:23:28.510575+0000","last_fullsized":"2024-04-26T20:23:28.510575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'848","reported_seq":928,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.690463+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:23:37.690463+0000","last_peered":"2024-04-26T20:23:37.690463+0000","last_clean":"2024-04-26T20:23:37.690463+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:23:37.690463+0000","last_undegraded":"2024-04-26T20:23:37.690463+0000","last_fullsized":"2024-04-26T20:23:37.690463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77273,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":152120,"num_write":808,"num_write_kb":168870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.660405+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:23:37.660405+0000","last_peered":"2024-04-26T20:23:37.660405+0000","last_clean":"2024-04-26T20:23:37.660405+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:23:37.660405+0000","last_undegraded":"2024-04-26T20:23:37.660405+0000","last_fullsized":"2024-04-26T20:23:37.660405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'562","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.702386+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:23:34.702386+0000","last_peered":"2024-04-26T20:23:34.702386+0000","last_clean":"2024-04-26T20:23:34.702386+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:23:34.702386+0000","last_undegraded":"2024-04-26T20:23:34.702386+0000","last_fullsized":"2024-04-26T20:23:34.702386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":503,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'810","reported_seq":889,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.664114+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:23:37.664114+0000","last_peered":"2024-04-26T20:23:37.664114+0000","last_clean":"2024-04-26T20:23:37.664114+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:23:37.664114+0000","last_undegraded":"2024-04-26T20:23:37.664114+0000","last_fullsized":"2024-04-26T20:23:37.664114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94795,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":135112,"num_write":777,"num_write_kb":135635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'187","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.896616+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:23:37.896616+0000","last_peered":"2024-04-26T20:23:37.896616+0000","last_clean":"2024-04-26T20:23:37.896616+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:23:37.896616+0000","last_undegraded":"2024-04-26T20:23:37.896616+0000","last_fullsized":"2024-04-26T20:23:37.896616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'280","reported_seq":320,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.479572+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:23:30.479572+0000","last_peered":"2024-04-26T20:23:30.479572+0000","last_clean":"2024-04-26T20:23:30.479572+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:23:30.479572+0000","last_undegraded":"2024-04-26T20:23:30.479572+0000","last_fullsized":"2024-04-26T20:23:30.479572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":224,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'840","reported_seq":913,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.901896+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:23:37.901896+0000","last_peered":"2024-04-26T20:23:37.901896+0000","last_clean":"2024-04-26T20:23:37.901896+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:23:37.901896+0000","last_undegraded":"2024-04-26T20:23:37.901896+0000","last_fullsized":"2024-04-26T20:23:37.901896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54703,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":124531,"num_write":803,"num_write_kb":151625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'170","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.670178+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:23:37.670178+0000","last_peered":"2024-04-26T20:23:37.670178+0000","last_clean":"2024-04-26T20:23:37.670178+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:23:37.670178+0000","last_undegraded":"2024-04-26T20:23:37.670178+0000","last_fullsized":"2024-04-26T20:23:37.670178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'209","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.517341+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:23:30.517341+0000","last_peered":"2024-04-26T20:23:30.517341+0000","last_clean":"2024-04-26T20:23:30.517341+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:23:30.517341+0000","last_undegraded":"2024-04-26T20:23:30.517341+0000","last_fullsized":"2024-04-26T20:23:30.517341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":4101,"num_write":169,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'858","reported_seq":933,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.902492+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:23:37.902492+0000","last_peered":"2024-04-26T20:23:37.902492+0000","last_clean":"2024-04-26T20:23:37.902492+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:23:37.902492+0000","last_undegraded":"2024-04-26T20:23:37.902492+0000","last_fullsized":"2024-04-26T20:23:37.902492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36343,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":151765,"num_write":823,"num_write_kb":200590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'224","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.586093+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:23:37.586093+0000","last_peered":"2024-04-26T20:23:37.586093+0000","last_clean":"2024-04-26T20:23:37.586093+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:23:37.586093+0000","last_undegraded":"2024-04-26T20:23:37.586093+0000","last_fullsized":"2024-04-26T20:23:37.586093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'325","reported_seq":377,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:39.241704+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:23:39.241704+0000","last_peered":"2024-04-26T20:23:39.241704+0000","last_clean":"2024-04-26T20:23:39.241704+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:23:39.241704+0000","last_undegraded":"2024-04-26T20:23:39.241704+0000","last_fullsized":"2024-04-26T20:23:39.241704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6148913,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":277,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'788","reported_seq":849,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.673817+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:23:37.673817+0000","last_peered":"2024-04-26T20:23:37.673817+0000","last_clean":"2024-04-26T20:23:37.673817+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:23:37.673817+0000","last_undegraded":"2024-04-26T20:23:37.673817+0000","last_fullsized":"2024-04-26T20:23:37.673817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84285,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":112649,"num_write":760,"num_write_kb":135273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'208","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.834091+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:23:37.834091+0000","last_peered":"2024-04-26T20:23:37.834091+0000","last_clean":"2024-04-26T20:23:37.834091+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:23:37.834091+0000","last_undegraded":"2024-04-26T20:23:37.834091+0000","last_fullsized":"2024-04-26T20:23:37.834091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'69","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.596031+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:23:30.596031+0000","last_peered":"2024-04-26T20:23:30.596031+0000","last_clean":"2024-04-26T20:23:30.596031+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:23:30.596031+0000","last_undegraded":"2024-04-26T20:23:30.596031+0000","last_fullsized":"2024-04-26T20:23:30.596031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'764","reported_seq":821,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.835103+0000","last_change":"2024-04-26T20:15:02.257901+0000","last_active":"2024-04-26T20:23:37.835103+0000","last_peered":"2024-04-26T20:23:37.835103+0000","last_clean":"2024-04-26T20:23:37.835103+0000","last_became_active":"2024-04-26T20:15:02.257484+0000","last_became_peered":"2024-04-26T20:15:02.257484+0000","last_unstale":"2024-04-26T20:23:37.835103+0000","last_undegraded":"2024-04-26T20:23:37.835103+0000","last_fullsized":"2024-04-26T20:23:37.835103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:35.589446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40157,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":40921,"num_write":727,"num_write_kb":85912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'189","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.470048+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:23:37.470048+0000","last_peered":"2024-04-26T20:23:37.470048+0000","last_clean":"2024-04-26T20:23:37.470048+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:23:37.470048+0000","last_undegraded":"2024-04-26T20:23:37.470048+0000","last_fullsized":"2024-04-26T20:23:37.470048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'62","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.554023+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:23:37.554023+0000","last_peered":"2024-04-26T20:23:37.554023+0000","last_clean":"2024-04-26T20:23:37.554023+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:23:37.554023+0000","last_undegraded":"2024-04-26T20:23:37.554023+0000","last_fullsized":"2024-04-26T20:23:37.554023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":20,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'701","reported_seq":763,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.621176+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:23:37.621176+0000","last_peered":"2024-04-26T20:23:37.621176+0000","last_clean":"2024-04-26T20:23:37.621176+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:23:37.621176+0000","last_undegraded":"2024-04-26T20:23:37.621176+0000","last_fullsized":"2024-04-26T20:23:37.621176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64327,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":32,"num_read_kb":103743,"num_write":673,"num_write_kb":106165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'197","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.447643+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:23:37.447643+0000","last_peered":"2024-04-26T20:23:37.447643+0000","last_clean":"2024-04-26T20:23:37.447643+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:23:37.447643+0000","last_undegraded":"2024-04-26T20:23:37.447643+0000","last_fullsized":"2024-04-26T20:23:37.447643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'630","reported_seq":678,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.447673+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:23:37.447673+0000","last_peered":"2024-04-26T20:23:37.447673+0000","last_clean":"2024-04-26T20:23:37.447673+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:23:37.447673+0000","last_undegraded":"2024-04-26T20:23:37.447673+0000","last_fullsized":"2024-04-26T20:23:37.447673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":8218,"num_write":576,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'713","reported_seq":761,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.713609+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:23:37.713609+0000","last_peered":"2024-04-26T20:23:37.713609+0000","last_clean":"2024-04-26T20:23:37.713609+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:23:37.713609+0000","last_undegraded":"2024-04-26T20:23:37.713609+0000","last_fullsized":"2024-04-26T20:23:37.713609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37145,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":19,"num_read_kb":67432,"num_write":682,"num_write_kb":88740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.482900+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:23:37.482900+0000","last_peered":"2024-04-26T20:23:37.482900+0000","last_clean":"2024-04-26T20:23:37.482900+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:23:37.482900+0000","last_undegraded":"2024-04-26T20:23:37.482900+0000","last_fullsized":"2024-04-26T20:23:37.482900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'416","reported_seq":461,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.589389+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:23:34.589389+0000","last_peered":"2024-04-26T20:23:34.589389+0000","last_clean":"2024-04-26T20:23:34.589389+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:23:34.589389+0000","last_undegraded":"2024-04-26T20:23:34.589389+0000","last_fullsized":"2024-04-26T20:23:34.589389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":8203,"num_write":362,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'816","reported_seq":879,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.496645+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:23:42.496645+0000","last_peered":"2024-04-26T20:23:42.496645+0000","last_clean":"2024-04-26T20:23:42.496645+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:23:42.496645+0000","last_undegraded":"2024-04-26T20:23:42.496645+0000","last_fullsized":"2024-04-26T20:23:42.496645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267789,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":34,"num_read_kb":109998,"num_write":775,"num_write_kb":139293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'181","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.595671+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:23:34.595671+0000","last_peered":"2024-04-26T20:23:34.595671+0000","last_clean":"2024-04-26T20:23:34.595671+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:23:34.595671+0000","last_undegraded":"2024-04-26T20:23:34.595671+0000","last_fullsized":"2024-04-26T20:23:34.595671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'400","reported_seq":440,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:35.488740+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:23:35.488740+0000","last_peered":"2024-04-26T20:23:35.488740+0000","last_clean":"2024-04-26T20:23:35.488740+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:23:35.488740+0000","last_undegraded":"2024-04-26T20:23:35.488740+0000","last_fullsized":"2024-04-26T20:23:35.488740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":351,"num_write_kb":4641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'783","reported_seq":850,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.899674+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:23:37.899674+0000","last_peered":"2024-04-26T20:23:37.899674+0000","last_clean":"2024-04-26T20:23:37.899674+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:23:37.899674+0000","last_undegraded":"2024-04-26T20:23:37.899674+0000","last_fullsized":"2024-04-26T20:23:37.899674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13175,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":119092,"num_write":735,"num_write_kb":148060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.523187+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:23:37.523187+0000","last_peered":"2024-04-26T20:23:37.523187+0000","last_clean":"2024-04-26T20:23:37.523187+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:23:37.523187+0000","last_undegraded":"2024-04-26T20:23:37.523187+0000","last_fullsized":"2024-04-26T20:23:37.523187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'110","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.765707+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:23:22.765707+0000","last_peered":"2024-04-26T20:23:22.765707+0000","last_clean":"2024-04-26T20:23:22.765707+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:23:22.765707+0000","last_undegraded":"2024-04-26T20:23:22.765707+0000","last_fullsized":"2024-04-26T20:23:22.765707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":58,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'861","reported_seq":933,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.926066+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:23:37.926066+0000","last_peered":"2024-04-26T20:23:37.926066+0000","last_clean":"2024-04-26T20:23:37.926066+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:23:37.926066+0000","last_undegraded":"2024-04-26T20:23:37.926066+0000","last_fullsized":"2024-04-26T20:23:37.926066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43107,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":142355,"num_write":817,"num_write_kb":159668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'210","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.610220+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:23:34.610220+0000","last_peered":"2024-04-26T20:23:34.610220+0000","last_clean":"2024-04-26T20:23:34.610220+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:23:34.610220+0000","last_undegraded":"2024-04-26T20:23:34.610220+0000","last_fullsized":"2024-04-26T20:23:34.610220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'66","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.644970+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:23:22.644970+0000","last_peered":"2024-04-26T20:23:22.644970+0000","last_clean":"2024-04-26T20:23:22.644970+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:23:22.644970+0000","last_undegraded":"2024-04-26T20:23:22.644970+0000","last_fullsized":"2024-04-26T20:23:22.644970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'919","reported_seq":1027,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.488709+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:23:42.488709+0000","last_peered":"2024-04-26T20:23:42.488709+0000","last_clean":"2024-04-26T20:23:42.488709+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:23:42.488709+0000","last_undegraded":"2024-04-26T20:23:42.488709+0000","last_fullsized":"2024-04-26T20:23:42.488709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62636,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":239056,"num_write":892,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'778","reported_seq":838,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.904923+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:23:37.904923+0000","last_peered":"2024-04-26T20:23:37.904923+0000","last_clean":"2024-04-26T20:23:37.904923+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:23:37.904923+0000","last_undegraded":"2024-04-26T20:23:37.904923+0000","last_fullsized":"2024-04-26T20:23:37.904923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47881,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":94596,"num_write":738,"num_write_kb":94412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'197","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.910194+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:23:37.910194+0000","last_peered":"2024-04-26T20:23:37.910194+0000","last_clean":"2024-04-26T20:23:37.910194+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:23:37.910194+0000","last_undegraded":"2024-04-26T20:23:37.910194+0000","last_fullsized":"2024-04-26T20:23:37.910194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'800","reported_seq":838,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.463636+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:23:30.463636+0000","last_peered":"2024-04-26T20:23:30.463636+0000","last_clean":"2024-04-26T20:23:30.463636+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:23:30.463636+0000","last_undegraded":"2024-04-26T20:23:30.463636+0000","last_fullsized":"2024-04-26T20:23:30.463636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":733,"num_write_kb":8579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'771","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.873154+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:23:37.873154+0000","last_peered":"2024-04-26T20:23:37.873154+0000","last_clean":"2024-04-26T20:23:37.873154+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:23:37.873154+0000","last_undegraded":"2024-04-26T20:23:37.873154+0000","last_fullsized":"2024-04-26T20:23:37.873154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13708,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":124481,"num_write":739,"num_write_kb":150909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'209","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.518721+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:23:37.518721+0000","last_peered":"2024-04-26T20:23:37.518721+0000","last_clean":"2024-04-26T20:23:37.518721+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:23:37.518721+0000","last_undegraded":"2024-04-26T20:23:37.518721+0000","last_fullsized":"2024-04-26T20:23:37.518721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'108","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.511049+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:23:34.511049+0000","last_peered":"2024-04-26T20:23:34.511049+0000","last_clean":"2024-04-26T20:23:34.511049+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:23:34.511049+0000","last_undegraded":"2024-04-26T20:23:34.511049+0000","last_fullsized":"2024-04-26T20:23:34.511049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":58,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'495","reported_seq":540,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.512132+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:23:34.512132+0000","last_peered":"2024-04-26T20:23:34.512132+0000","last_clean":"2024-04-26T20:23:34.512132+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:23:34.512132+0000","last_undegraded":"2024-04-26T20:23:34.512132+0000","last_fullsized":"2024-04-26T20:23:34.512132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10061,"num_write":440,"num_write_kb":12524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'161","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.584585+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:23:37.584585+0000","last_peered":"2024-04-26T20:23:37.584585+0000","last_clean":"2024-04-26T20:23:37.584585+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:23:37.584585+0000","last_undegraded":"2024-04-26T20:23:37.584585+0000","last_fullsized":"2024-04-26T20:23:37.584585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'735","reported_seq":790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.918533+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:23:37.918533+0000","last_peered":"2024-04-26T20:23:37.918533+0000","last_clean":"2024-04-26T20:23:37.918533+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:23:37.918533+0000","last_undegraded":"2024-04-26T20:23:37.918533+0000","last_fullsized":"2024-04-26T20:23:37.918533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52589,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":82664,"num_write":702,"num_write_kb":110622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'167","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:28.365031+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:23:28.365031+0000","last_peered":"2024-04-26T20:23:28.365031+0000","last_clean":"2024-04-26T20:23:28.365031+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:23:28.365031+0000","last_undegraded":"2024-04-26T20:23:28.365031+0000","last_fullsized":"2024-04-26T20:23:28.365031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195300,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":104,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'198","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.856689+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:23:37.856689+0000","last_peered":"2024-04-26T20:23:37.856689+0000","last_clean":"2024-04-26T20:23:37.856689+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:23:37.856689+0000","last_undegraded":"2024-04-26T20:23:37.856689+0000","last_fullsized":"2024-04-26T20:23:37.856689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'734","reported_seq":799,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.482274+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:23:42.482274+0000","last_peered":"2024-04-26T20:23:42.482274+0000","last_clean":"2024-04-26T20:23:42.482274+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:23:42.482274+0000","last_undegraded":"2024-04-26T20:23:42.482274+0000","last_fullsized":"2024-04-26T20:23:42.482274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61197,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":120190,"num_write":695,"num_write_kb":135097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'202","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.698257+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:23:37.698257+0000","last_peered":"2024-04-26T20:23:37.698257+0000","last_clean":"2024-04-26T20:23:37.698257+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:23:37.698257+0000","last_undegraded":"2024-04-26T20:23:37.698257+0000","last_fullsized":"2024-04-26T20:23:37.698257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.536207+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:23:37.536207+0000","last_peered":"2024-04-26T20:23:37.536207+0000","last_clean":"2024-04-26T20:23:37.536207+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:23:37.536207+0000","last_undegraded":"2024-04-26T20:23:37.536207+0000","last_fullsized":"2024-04-26T20:23:37.536207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'220","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.660387+0000","last_change":"2024-04-26T20:15:02.206712+0000","last_active":"2024-04-26T20:23:37.660387+0000","last_peered":"2024-04-26T20:23:37.660387+0000","last_clean":"2024-04-26T20:23:37.660387+0000","last_became_active":"2024-04-26T20:15:02.205525+0000","last_became_peered":"2024-04-26T20:15:02.205525+0000","last_unstale":"2024-04-26T20:23:37.660387+0000","last_undegraded":"2024-04-26T20:23:37.660387+0000","last_fullsized":"2024-04-26T20:23:37.660387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:45.077649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.543621+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:23:37.543621+0000","last_peered":"2024-04-26T20:23:37.543621+0000","last_clean":"2024-04-26T20:23:37.543621+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:23:37.543621+0000","last_undegraded":"2024-04-26T20:23:37.543621+0000","last_fullsized":"2024-04-26T20:23:37.543621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'184","reported_seq":220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.849536+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:23:37.849536+0000","last_peered":"2024-04-26T20:23:37.849536+0000","last_clean":"2024-04-26T20:23:37.849536+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:23:37.849536+0000","last_undegraded":"2024-04-26T20:23:37.849536+0000","last_fullsized":"2024-04-26T20:23:37.849536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'189","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.863510+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:23:37.863510+0000","last_peered":"2024-04-26T20:23:37.863510+0000","last_clean":"2024-04-26T20:23:37.863510+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:23:37.863510+0000","last_undegraded":"2024-04-26T20:23:37.863510+0000","last_fullsized":"2024-04-26T20:23:37.863510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'220","reported_seq":256,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.709523+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:23:37.709523+0000","last_peered":"2024-04-26T20:23:37.709523+0000","last_clean":"2024-04-26T20:23:37.709523+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:23:37.709523+0000","last_undegraded":"2024-04-26T20:23:37.709523+0000","last_fullsized":"2024-04-26T20:23:37.709523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'197","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.896571+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:23:37.896571+0000","last_peered":"2024-04-26T20:23:37.896571+0000","last_clean":"2024-04-26T20:23:37.896571+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:23:37.896571+0000","last_undegraded":"2024-04-26T20:23:37.896571+0000","last_fullsized":"2024-04-26T20:23:37.896571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.702805+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:23:37.702805+0000","last_peered":"2024-04-26T20:23:37.702805+0000","last_clean":"2024-04-26T20:23:37.702805+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:23:37.702805+0000","last_undegraded":"2024-04-26T20:23:37.702805+0000","last_fullsized":"2024-04-26T20:23:37.702805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'199","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.552939+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:23:37.552939+0000","last_peered":"2024-04-26T20:23:37.552939+0000","last_clean":"2024-04-26T20:23:37.552939+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:23:37.552939+0000","last_undegraded":"2024-04-26T20:23:37.552939+0000","last_fullsized":"2024-04-26T20:23:37.552939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'199","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.590786+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:23:30.590786+0000","last_peered":"2024-04-26T20:23:30.590786+0000","last_clean":"2024-04-26T20:23:30.590786+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:23:30.590786+0000","last_undegraded":"2024-04-26T20:23:30.590786+0000","last_fullsized":"2024-04-26T20:23:30.590786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'195","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.661552+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:23:37.661552+0000","last_peered":"2024-04-26T20:23:37.661552+0000","last_clean":"2024-04-26T20:23:37.661552+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:23:37.661552+0000","last_undegraded":"2024-04-26T20:23:37.661552+0000","last_fullsized":"2024-04-26T20:23:37.661552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'211","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.708560+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:23:37.708560+0000","last_peered":"2024-04-26T20:23:37.708560+0000","last_clean":"2024-04-26T20:23:37.708560+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:23:37.708560+0000","last_undegraded":"2024-04-26T20:23:37.708560+0000","last_fullsized":"2024-04-26T20:23:37.708560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'193","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.862211+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:23:37.862211+0000","last_peered":"2024-04-26T20:23:37.862211+0000","last_clean":"2024-04-26T20:23:37.862211+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:23:37.862211+0000","last_undegraded":"2024-04-26T20:23:37.862211+0000","last_fullsized":"2024-04-26T20:23:37.862211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'187","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.842955+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:23:37.842955+0000","last_peered":"2024-04-26T20:23:37.842955+0000","last_clean":"2024-04-26T20:23:37.842955+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:23:37.842955+0000","last_undegraded":"2024-04-26T20:23:37.842955+0000","last_fullsized":"2024-04-26T20:23:37.842955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'195","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.660715+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:23:37.660715+0000","last_peered":"2024-04-26T20:23:37.660715+0000","last_clean":"2024-04-26T20:23:37.660715+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:23:37.660715+0000","last_undegraded":"2024-04-26T20:23:37.660715+0000","last_fullsized":"2024-04-26T20:23:37.660715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.648204+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:23:37.648204+0000","last_peered":"2024-04-26T20:23:37.648204+0000","last_clean":"2024-04-26T20:23:37.648204+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:23:37.648204+0000","last_undegraded":"2024-04-26T20:23:37.648204+0000","last_fullsized":"2024-04-26T20:23:37.648204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'202","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.556745+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:23:37.556745+0000","last_peered":"2024-04-26T20:23:37.556745+0000","last_clean":"2024-04-26T20:23:37.556745+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:23:37.556745+0000","last_undegraded":"2024-04-26T20:23:37.556745+0000","last_fullsized":"2024-04-26T20:23:37.556745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.908914+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:23:37.908914+0000","last_peered":"2024-04-26T20:23:37.908914+0000","last_clean":"2024-04-26T20:23:37.908914+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:23:37.908914+0000","last_undegraded":"2024-04-26T20:23:37.908914+0000","last_fullsized":"2024-04-26T20:23:37.908914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'184","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.708985+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:23:34.708985+0000","last_peered":"2024-04-26T20:23:34.708985+0000","last_clean":"2024-04-26T20:23:34.708985+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:23:34.708985+0000","last_undegraded":"2024-04-26T20:23:34.708985+0000","last_fullsized":"2024-04-26T20:23:34.708985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'164","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.617105+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:23:37.617105+0000","last_peered":"2024-04-26T20:23:37.617105+0000","last_clean":"2024-04-26T20:23:37.617105+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:23:37.617105+0000","last_undegraded":"2024-04-26T20:23:37.617105+0000","last_fullsized":"2024-04-26T20:23:37.617105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'172","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.714364+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:23:37.714364+0000","last_peered":"2024-04-26T20:23:37.714364+0000","last_clean":"2024-04-26T20:23:37.714364+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:23:37.714364+0000","last_undegraded":"2024-04-26T20:23:37.714364+0000","last_fullsized":"2024-04-26T20:23:37.714364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'183","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.674186+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:23:37.674186+0000","last_peered":"2024-04-26T20:23:37.674186+0000","last_clean":"2024-04-26T20:23:37.674186+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:23:37.674186+0000","last_undegraded":"2024-04-26T20:23:37.674186+0000","last_fullsized":"2024-04-26T20:23:37.674186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'197","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.835426+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:23:37.835426+0000","last_peered":"2024-04-26T20:23:37.835426+0000","last_clean":"2024-04-26T20:23:37.835426+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:23:37.835426+0000","last_undegraded":"2024-04-26T20:23:37.835426+0000","last_fullsized":"2024-04-26T20:23:37.835426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'171","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.657705+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:23:37.657705+0000","last_peered":"2024-04-26T20:23:37.657705+0000","last_clean":"2024-04-26T20:23:37.657705+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:23:37.657705+0000","last_undegraded":"2024-04-26T20:23:37.657705+0000","last_fullsized":"2024-04-26T20:23:37.657705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'196","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.549605+0000","last_change":"2024-04-26T20:15:02.200465+0000","last_active":"2024-04-26T20:23:30.549605+0000","last_peered":"2024-04-26T20:23:30.549605+0000","last_clean":"2024-04-26T20:23:30.549605+0000","last_became_active":"2024-04-26T20:15:02.200094+0000","last_became_peered":"2024-04-26T20:15:02.200094+0000","last_unstale":"2024-04-26T20:23:30.549605+0000","last_undegraded":"2024-04-26T20:23:30.549605+0000","last_fullsized":"2024-04-26T20:23:30.549605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:04.049772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'183","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.637073+0000","last_change":"2024-04-26T20:15:02.201696+0000","last_active":"2024-04-26T20:23:37.637073+0000","last_peered":"2024-04-26T20:23:37.637073+0000","last_clean":"2024-04-26T20:23:37.637073+0000","last_became_active":"2024-04-26T20:15:02.201216+0000","last_became_peered":"2024-04-26T20:15:02.201216+0000","last_unstale":"2024-04-26T20:23:37.637073+0000","last_undegraded":"2024-04-26T20:23:37.637073+0000","last_fullsized":"2024-04-26T20:23:37.637073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:55.081488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'204","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.556875+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:23:37.556875+0000","last_peered":"2024-04-26T20:23:37.556875+0000","last_clean":"2024-04-26T20:23:37.556875+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:23:37.556875+0000","last_undegraded":"2024-04-26T20:23:37.556875+0000","last_fullsized":"2024-04-26T20:23:37.556875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'187","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.673622+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:23:37.673622+0000","last_peered":"2024-04-26T20:23:37.673622+0000","last_clean":"2024-04-26T20:23:37.673622+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:23:37.673622+0000","last_undegraded":"2024-04-26T20:23:37.673622+0000","last_fullsized":"2024-04-26T20:23:37.673622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'183","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.519100+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:23:37.519100+0000","last_peered":"2024-04-26T20:23:37.519100+0000","last_clean":"2024-04-26T20:23:37.519100+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:23:37.519100+0000","last_undegraded":"2024-04-26T20:23:37.519100+0000","last_fullsized":"2024-04-26T20:23:37.519100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'205","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.894986+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:23:37.894986+0000","last_peered":"2024-04-26T20:23:37.894986+0000","last_clean":"2024-04-26T20:23:37.894986+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:23:37.894986+0000","last_undegraded":"2024-04-26T20:23:37.894986+0000","last_fullsized":"2024-04-26T20:23:37.894986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'204","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.671162+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:23:37.671162+0000","last_peered":"2024-04-26T20:23:37.671162+0000","last_clean":"2024-04-26T20:23:37.671162+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:23:37.671162+0000","last_undegraded":"2024-04-26T20:23:37.671162+0000","last_fullsized":"2024-04-26T20:23:37.671162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2026971,"num_objects":253,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":253,"num_whiteouts":0,"num_read":1174,"num_read_kb":3559915,"num_write":24140,"num_write_kb":4217550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6049792,"data_stored":7057408,"data_compressed":884067,"data_compressed_allocated":1118208,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},"log_size":25279,"ondisk_log_size":25279,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12380,"ondisk_log_size":12380,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":141890006,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":585,"num_read_kb":126692,"num_write":6967,"num_write_kb":144789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96514048,"data_stored":283791191,"data_compressed":42615546,"data_compressed_allocated":55754752,"data_compressed_original":243187712,"omap_allocated":0,"internal_metadata":0},"log_size":8207,"ondisk_log_size":8207,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542262,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86412,"kb_used_data":14980,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285428,"statfs":{"total":96636764160,"available":96548278272,"internally_reserved":0,"allocated":15339520,"data_stored":51832178,"data_compressed":7706125,"data_compressed_allocated":9986048,"data_compressed_original":46690304,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542263,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88836,"kb_used_data":13244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94283004,"statfs":{"total":96636764160,"available":96545796096,"internally_reserved":0,"allocated":13561856,"data_stored":47391230,"data_compressed":7360459,"data_compressed_allocated":9203712,"data_compressed_original":43237376,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542263,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79628,"kb_used_data":12356,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292212,"statfs":{"total":96636764160,"available":96555225088,"internally_reserved":0,"allocated":12652544,"data_stored":30163482,"data_compressed":4259202,"data_compressed_allocated":5746688,"data_compressed_original":23465984,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542262,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107724,"kb_used_data":18308,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264116,"statfs":{"total":96636764160,"available":96526454784,"internally_reserved":0,"allocated":18747392,"data_stored":47247234,"data_compressed":6940303,"data_compressed_allocated":9154560,"data_compressed_original":37859328,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542262,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87556,"kb_used_data":11964,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94284284,"statfs":{"total":96636764160,"available":96547106816,"internally_reserved":0,"allocated":12251136,"data_stored":36524155,"data_compressed":5640669,"data_compressed_allocated":7163904,"data_compressed_original":31645696,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542261,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55408,"kb_used_data":6184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316432,"statfs":{"total":96636764160,"available":96580026368,"internally_reserved":0,"allocated":6332416,"data_stored":12681899,"data_compressed":1714966,"data_compressed_allocated":2441216,"data_compressed_original":9003008,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542262,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108504,"kb_used_data":14928,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263336,"statfs":{"total":96636764160,"available":96525656064,"internally_reserved":0,"allocated":15286272,"data_stored":37025348,"data_compressed":5510164,"data_compressed_allocated":7434240,"data_compressed_original":29388800,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542261,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91284,"kb_used_data":11532,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94280556,"statfs":{"total":96636764160,"available":96543289344,"internally_reserved":0,"allocated":11808768,"data_stored":30970220,"data_compressed":4503033,"data_compressed_allocated":5918720,"data_compressed_original":25288704,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":29360788,"data_compressed":4405923,"data_compressed_allocated":5791744,"data_compressed_original":24539136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13811712,"data_stored":35509873,"data_compressed":5276194,"data_compressed_allocated":7143424,"data_compressed_original":28868608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5312512,"data_stored":11862744,"data_compressed":1673651,"data_compressed_allocated":2387968,"data_compressed_original":8962048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10784768,"data_stored":35086190,"data_compressed":5451181,"data_compressed_allocated":6914048,"data_compressed_original":31236096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17629184,"data_stored":46138058,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11788288,"data_stored":29361506,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12312576,"data_stored":46138694,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":50333338,"data_compressed":7629580,"data_compressed_allocated":9871360,"data_compressed_original":45977600,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":778240,"data_stored":872448,"data_compressed":63658,"data_compressed_allocated":81920,"data_compressed_original":176128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":884736,"data_stored":1085440,"data_compressed":198121,"data_compressed_allocated":245760,"data_compressed_original":446464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":704512,"data_stored":745472,"data_compressed":53467,"data_compressed_allocated":65536,"data_compressed_original":106496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":843776,"data_stored":962560,"data_compressed":159256,"data_compressed_allocated":212992,"data_compressed_original":331776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":892928,"data_compressed":129847,"data_compressed_allocated":159744,"data_compressed_original":323584,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":655360,"data_compressed":89298,"data_compressed_allocated":110592,"data_compressed_original":237568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":888832,"data_stored":1081344,"data_compressed":147327,"data_compressed_allocated":172032,"data_compressed_original":364544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":692224,"data_stored":761856,"data_compressed":43093,"data_compressed_allocated":69632,"data_compressed_original":139264,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:23:48.600 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:23:48.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.771+0000 7fb78ca00640 1 Processor -- start 2024-04-26T20:23:48.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.771+0000 7fb78ca00640 1 -- start start 2024-04-26T20:23:48.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb78ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb788072d70 0x7fb7880731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb78ca00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb788152fa0 con 0x7fb7880c9b60 2024-04-26T20:23:48.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb78ca00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb788073700 con 0x7fb788152bc0 2024-04-26T20:23:48.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb78ca00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fb788159790 con 0x7fb788072d70 2024-04-26T20:23:48.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb786800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb7880c9b60 0x7fb7880c9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38410/0 (socket says 172.21.15.16:38410) 2024-04-26T20:23:48.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb786800640 1 -- 172.21.15.16:0/4189648499 learned_addr learned my addr 172.21.15.16:0/4189648499 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:48.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb785400640 1 --2- 172.21.15.16:0/4189648499 >> v2:172.21.15.192:3300/0 conn(0x7fb788072d70 0x7fb7880731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb784a00640 1 -- 172.21.15.16:0/4189648499 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619837717 0 0) 0x7fb788152fa0 con 0x7fb7880c9b60 2024-04-26T20:23:48.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb784a00640 1 -- 172.21.15.16:0/4189648499 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb76c003530 con 0x7fb7880c9b60 2024-04-26T20:23:48.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb785400640 1 -- 172.21.15.16:0/4189648499 >> v1:172.21.15.192:6789/0 conn(0x7fb788152bc0 legacy=0x7fb7880c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb785400640 1 -- 172.21.15.16:0/4189648499 >> v1:172.21.15.16:6789/0 conn(0x7fb7880c9b60 legacy=0x7fb7880c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb784a00640 1 -- 172.21.15.16:0/4189648499 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 248068552 0 0) 0x7fb76c003530 con 0x7fb7880c9b60 2024-04-26T20:23:48.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.775+0000 7fb785400640 1 -- 172.21.15.16:0/4189648499 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb788158930 con 0x7fb788072d70 2024-04-26T20:23:48.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb785400640 1 --2- 172.21.15.16:0/4189648499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788072d70 0x7fb7880731c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7740097c0 tx=0x7fb77401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b2dddf493d747d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:48.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb784a00640 1 -- 172.21.15.16:0/4189648499 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740b5070 con 0x7fb788072d70 2024-04-26T20:23:48.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb784a00640 1 -- 172.21.15.16:0/4189648499 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7740a8630 con 0x7fb788072d70 2024-04-26T20:23:48.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb784a00640 1 -- 172.21.15.16:0/4189648499 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780001a00 con 0x7fb788072d70 2024-04-26T20:23:48.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 -- 172.21.15.16:0/4189648499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788072d70 msgr2=0x7fb7880731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 --2- 172.21.15.16:0/4189648499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788072d70 0x7fb7880731c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7740097c0 tx=0x7fb77401ebb0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 -- 172.21.15.16:0/4189648499 shutdown_connections 2024-04-26T20:23:48.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 --2- 172.21.15.16:0/4189648499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb788072d70 0x7fb7880731c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 -- 172.21.15.16:0/4189648499 >> 172.21.15.16:0/4189648499 conn(0x7fb78806c380 msgr2=0x7fb78806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:48.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 -- 172.21.15.16:0/4189648499 shutdown_connections 2024-04-26T20:23:48.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 -- 172.21.15.16:0/4189648499 wait complete. 2024-04-26T20:23:48.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 Processor -- start 2024-04-26T20:23:48.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.779+0000 7fb78ca00640 1 -- start start 2024-04-26T20:23:48.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb788072d70 0x7fb788156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7880c9b60 0x7fb7880cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb788152bc0 0x7fb7880cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881591d0 con 0x7fb788152bc0 2024-04-26T20:23:48.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb788158ef0 con 0x7fb7880c9b60 2024-04-26T20:23:48.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb7881594b0 con 0x7fb788072d70 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb788152bc0 0x7fb7880cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb788152bc0 0x7fb7880cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44852/0 (socket says 172.21.15.16:44852) 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 -- 172.21.15.16:0/1892249185 learned_addr learned my addr 172.21.15.16:0/1892249185 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb785400640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7880c9b60 0x7fb7880cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb785e00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb788072d70 0x7fb788156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 -- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb788072d70 msgr2=0x7fb788156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb788072d70 0x7fb788156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 -- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7880c9b60 msgr2=0x7fb7880cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7880c9b60 0x7fb7880cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 -- 172.21.15.16:0/1892249185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7881f5b40 con 0x7fb788152bc0 2024-04-26T20:23:48.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb786800640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb788152bc0 0x7fb7880cbed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7800018d0 tx=0x7fb78000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:48.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb77e000640 1 -- 172.21.15.16:0/1892249185 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780012400 con 0x7fb788152bc0 2024-04-26T20:23:48.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb77e000640 1 -- 172.21.15.16:0/1892249185 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7800125c0 con 0x7fb788152bc0 2024-04-26T20:23:48.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7881f1a70 con 0x7fb788152bc0 2024-04-26T20:23:48.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb77e000640 1 -- 172.21.15.16:0/1892249185 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7800129b0 con 0x7fb788152bc0 2024-04-26T20:23:48.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7881f2030 con 0x7fb788152bc0 2024-04-26T20:23:48.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.783+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb788077c20 con 0x7fb788152bc0 2024-04-26T20:23:48.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.787+0000 7fb77e000640 1 -- 172.21.15.16:0/1892249185 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb780012b50 con 0x7fb788152bc0 2024-04-26T20:23:48.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.787+0000 7fb77e000640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb768068380 0x7fb76806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:48.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.787+0000 7fb77e000640 1 -- 172.21.15.16:0/1892249185 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fb780087810 con 0x7fb788152bc0 2024-04-26T20:23:48.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.787+0000 7fb785e00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb768068380 0x7fb76806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:48.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.787+0000 7fb785e00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb768068380 0x7fb76806a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb778000f70 tx=0x7fb778009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:48.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.791+0000 7fb77e000640 1 -- 172.21.15.16:0/1892249185 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb780057800 con 0x7fb788152bc0 2024-04-26T20:23:48.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:23:48.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:23:48.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.955+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb78814ff20 con 0x7fb768068380 2024-04-26T20:23:48.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.975+0000 7fb77e000640 1 -- 172.21.15.16:0/1892249185 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335439 (secure 0 0 0) 0x7fb78814ff20 con 0x7fb768068380 2024-04-26T20:23:48.983 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:23:48.984 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:23:48.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb768068380 msgr2=0x7fb76806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb768068380 0x7fb76806a840 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb778000f70 tx=0x7fb778009040 comp rx=0 tx=0).stop 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb788152bc0 msgr2=0x7fb7880cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb788152bc0 0x7fb7880cbed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7800018d0 tx=0x7fb78000a430 comp rx=0 tx=0).stop 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 shutdown_connections 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb768068380 0x7fb76806a840 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb788152bc0 0x7fb7880cbed0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7880c9b60 0x7fb7880cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 --2- 172.21.15.16:0/1892249185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb788072d70 0x7fb788156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 >> 172.21.15.16:0/1892249185 conn(0x7fb78806c380 msgr2=0x7fb7880c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 shutdown_connections 2024-04-26T20:23:48.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:48.979+0000 7fb78ca00640 1 -- 172.21.15.16:0/1892249185 wait complete. 2024-04-26T20:23:49.004 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-04-26T20:23:47.192522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":144507345,"num_objects":349,"num_object_clones":0,"num_object_copies":1204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":1875,"num_read_kb":3686707,"num_write":31266,"num_write_kb":4364755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45983,"ondisk_log_size":45983,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":705352,"kb_used_data":103496,"kb_used_omap":12,"kb_used_meta":601779,"kb_avail":754269368,"statfs":{"total":773094113280,"available":772371832832,"internally_reserved":0,"allocated":105979904,"data_stored":293835746,"data_compressed":43634921,"data_compressed_allocated":57049088,"data_compressed_original":246579200,"omap_allocated":12752,"internal_metadata":616222256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1807848,"num_objects":-387,"num_object_clones":0,"num_object_copies":-1540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-387,"num_whiteouts":0,"num_read":6,"num_read_kb":47,"num_write":478,"num_write_kb":2040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004680"},"pg_stats":[{"pgid":"2.1f","version":"31'137","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.621292+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:23:37.621292+0000","last_peered":"2024-04-26T20:23:37.621292+0000","last_clean":"2024-04-26T20:23:37.621292+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:23:37.621292+0000","last_undegraded":"2024-04-26T20:23:37.621292+0000","last_fullsized":"2024-04-26T20:23:37.621292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":4124,"num_write":97,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'186","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.903553+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:23:37.903553+0000","last_peered":"2024-04-26T20:23:37.903553+0000","last_clean":"2024-04-26T20:23:37.903553+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:23:37.903553+0000","last_undegraded":"2024-04-26T20:23:37.903553+0000","last_fullsized":"2024-04-26T20:23:37.903553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'813","reported_seq":883,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.913655+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:23:37.913655+0000","last_peered":"2024-04-26T20:23:37.913655+0000","last_clean":"2024-04-26T20:23:37.913655+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:23:37.913655+0000","last_undegraded":"2024-04-26T20:23:37.913655+0000","last_fullsized":"2024-04-26T20:23:37.913655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33714,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":127167,"num_write":785,"num_write_kb":160617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'67","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.544019+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:23:34.544019+0000","last_peered":"2024-04-26T20:23:34.544019+0000","last_clean":"2024-04-26T20:23:34.544019+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:23:34.544019+0000","last_undegraded":"2024-04-26T20:23:34.544019+0000","last_fullsized":"2024-04-26T20:23:34.544019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":16,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'176","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.865834+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:23:37.865834+0000","last_peered":"2024-04-26T20:23:37.865834+0000","last_clean":"2024-04-26T20:23:37.865834+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:23:37.865834+0000","last_undegraded":"2024-04-26T20:23:37.865834+0000","last_fullsized":"2024-04-26T20:23:37.865834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'772","reported_seq":837,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.662427+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:23:37.662427+0000","last_peered":"2024-04-26T20:23:37.662427+0000","last_clean":"2024-04-26T20:23:37.662427+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:23:37.662427+0000","last_undegraded":"2024-04-26T20:23:37.662427+0000","last_fullsized":"2024-04-26T20:23:37.662427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":348049,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":36,"num_read_kb":94315,"num_write":737,"num_write_kb":130983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'208","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.527799+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:23:37.527799+0000","last_peered":"2024-04-26T20:23:37.527799+0000","last_clean":"2024-04-26T20:23:37.527799+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:23:37.527799+0000","last_undegraded":"2024-04-26T20:23:37.527799+0000","last_fullsized":"2024-04-26T20:23:37.527799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12305,"num_write":138,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'171","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.711345+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:23:37.711345+0000","last_peered":"2024-04-26T20:23:37.711345+0000","last_clean":"2024-04-26T20:23:37.711345+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:23:37.711345+0000","last_undegraded":"2024-04-26T20:23:37.711345+0000","last_fullsized":"2024-04-26T20:23:37.711345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'756","reported_seq":821,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.831188+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:23:37.831188+0000","last_peered":"2024-04-26T20:23:37.831188+0000","last_clean":"2024-04-26T20:23:37.831188+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:23:37.831188+0000","last_undegraded":"2024-04-26T20:23:37.831188+0000","last_fullsized":"2024-04-26T20:23:37.831188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38560,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":92426,"num_write":721,"num_write_kb":119140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'163","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.475252+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:23:34.475252+0000","last_peered":"2024-04-26T20:23:34.475252+0000","last_clean":"2024-04-26T20:23:34.475252+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:23:34.475252+0000","last_undegraded":"2024-04-26T20:23:34.475252+0000","last_fullsized":"2024-04-26T20:23:34.475252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":110,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'172","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.714776+0000","last_change":"2024-04-26T20:15:02.201407+0000","last_active":"2024-04-26T20:23:34.714776+0000","last_peered":"2024-04-26T20:23:34.714776+0000","last_clean":"2024-04-26T20:23:34.714776+0000","last_became_active":"2024-04-26T20:15:02.201092+0000","last_became_peered":"2024-04-26T20:15:02.201092+0000","last_unstale":"2024-04-26T20:23:34.714776+0000","last_undegraded":"2024-04-26T20:23:34.714776+0000","last_fullsized":"2024-04-26T20:23:34.714776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:14.070151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'803","reported_seq":869,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.920525+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:23:37.920525+0000","last_peered":"2024-04-26T20:23:37.920525+0000","last_clean":"2024-04-26T20:23:37.920525+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:23:37.920525+0000","last_undegraded":"2024-04-26T20:23:37.920525+0000","last_fullsized":"2024-04-26T20:23:37.920525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8013,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":115919,"num_write":771,"num_write_kb":110976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'205","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.687804+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:23:37.687804+0000","last_peered":"2024-04-26T20:23:37.687804+0000","last_clean":"2024-04-26T20:23:37.687804+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:23:37.687804+0000","last_undegraded":"2024-04-26T20:23:37.687804+0000","last_fullsized":"2024-04-26T20:23:37.687804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'161","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.604403+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:23:37.604403+0000","last_peered":"2024-04-26T20:23:37.604403+0000","last_clean":"2024-04-26T20:23:37.604403+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:23:37.604403+0000","last_undegraded":"2024-04-26T20:23:37.604403+0000","last_fullsized":"2024-04-26T20:23:37.604403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":106,"num_write_kb":8336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'785","reported_seq":852,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.869048+0000","last_change":"2024-04-26T20:15:02.208844+0000","last_active":"2024-04-26T20:23:37.869048+0000","last_peered":"2024-04-26T20:23:37.869048+0000","last_clean":"2024-04-26T20:23:37.869048+0000","last_became_active":"2024-04-26T20:15:02.207782+0000","last_became_peered":"2024-04-26T20:15:02.207782+0000","last_unstale":"2024-04-26T20:23:37.869048+0000","last_undegraded":"2024-04-26T20:23:37.869048+0000","last_fullsized":"2024-04-26T20:23:37.869048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14061,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":86223,"num_write":741,"num_write_kb":106297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'203","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.583443+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:23:37.583443+0000","last_peered":"2024-04-26T20:23:37.583443+0000","last_clean":"2024-04-26T20:23:37.583443+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:23:37.583443+0000","last_undegraded":"2024-04-26T20:23:37.583443+0000","last_fullsized":"2024-04-26T20:23:37.583443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'166","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.525300+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:23:30.525300+0000","last_peered":"2024-04-26T20:23:30.525300+0000","last_clean":"2024-04-26T20:23:30.525300+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:23:30.525300+0000","last_undegraded":"2024-04-26T20:23:30.525300+0000","last_fullsized":"2024-04-26T20:23:30.525300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4098,"num_write":113,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'843","reported_seq":898,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.892297+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:23:37.892297+0000","last_peered":"2024-04-26T20:23:37.892297+0000","last_clean":"2024-04-26T20:23:37.892297+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:23:37.892297+0000","last_undegraded":"2024-04-26T20:23:37.892297+0000","last_fullsized":"2024-04-26T20:23:37.892297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28079,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":76471,"num_write":801,"num_write_kb":93343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.910809+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:23:37.910809+0000","last_peered":"2024-04-26T20:23:37.910809+0000","last_clean":"2024-04-26T20:23:37.910809+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:23:37.910809+0000","last_undegraded":"2024-04-26T20:23:37.910809+0000","last_fullsized":"2024-04-26T20:23:37.910809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'60","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.686993+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:23:34.686993+0000","last_peered":"2024-04-26T20:23:34.686993+0000","last_clean":"2024-04-26T20:23:34.686993+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:23:34.686993+0000","last_undegraded":"2024-04-26T20:23:34.686993+0000","last_fullsized":"2024-04-26T20:23:34.686993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'782","reported_seq":860,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.893685+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:23:37.893685+0000","last_peered":"2024-04-26T20:23:37.893685+0000","last_clean":"2024-04-26T20:23:37.893685+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:23:37.893685+0000","last_undegraded":"2024-04-26T20:23:37.893685+0000","last_fullsized":"2024-04-26T20:23:37.893685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88606,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":48,"num_read_kb":121482,"num_write":747,"num_write_kb":114987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'211","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.652526+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:23:37.652526+0000","last_peered":"2024-04-26T20:23:37.652526+0000","last_clean":"2024-04-26T20:23:37.652526+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:23:37.652526+0000","last_undegraded":"2024-04-26T20:23:37.652526+0000","last_fullsized":"2024-04-26T20:23:37.652526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'441","reported_seq":482,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.545252+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:23:37.545252+0000","last_peered":"2024-04-26T20:23:37.545252+0000","last_clean":"2024-04-26T20:23:37.545252+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:23:37.545252+0000","last_undegraded":"2024-04-26T20:23:37.545252+0000","last_fullsized":"2024-04-26T20:23:37.545252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":388,"num_write_kb":4324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'726","reported_seq":784,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.849256+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:23:37.849256+0000","last_peered":"2024-04-26T20:23:37.849256+0000","last_clean":"2024-04-26T20:23:37.849256+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:23:37.849256+0000","last_undegraded":"2024-04-26T20:23:37.849256+0000","last_fullsized":"2024-04-26T20:23:37.849256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61038,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":28,"num_read_kb":100836,"num_write":680,"num_write_kb":105101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'206","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.700747+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:23:37.700747+0000","last_peered":"2024-04-26T20:23:37.700747+0000","last_clean":"2024-04-26T20:23:37.700747+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:23:37.700747+0000","last_undegraded":"2024-04-26T20:23:37.700747+0000","last_fullsized":"2024-04-26T20:23:37.700747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'62","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.874273+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:23:37.874273+0000","last_peered":"2024-04-26T20:23:37.874273+0000","last_clean":"2024-04-26T20:23:37.874273+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:23:37.874273+0000","last_undegraded":"2024-04-26T20:23:37.874273+0000","last_fullsized":"2024-04-26T20:23:37.874273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'822","reported_seq":916,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:38.203764+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:23:38.203764+0000","last_peered":"2024-04-26T20:23:38.203764+0000","last_clean":"2024-04-26T20:23:38.203764+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:23:38.203764+0000","last_undegraded":"2024-04-26T20:23:38.203764+0000","last_fullsized":"2024-04-26T20:23:38.203764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61621,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":203084,"num_write":786,"num_write_kb":205909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'170","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.869475+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:23:37.869475+0000","last_peered":"2024-04-26T20:23:37.869475+0000","last_clean":"2024-04-26T20:23:37.869475+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:23:37.869475+0000","last_undegraded":"2024-04-26T20:23:37.869475+0000","last_fullsized":"2024-04-26T20:23:37.869475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'394","reported_seq":437,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:38.273741+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:23:38.273741+0000","last_peered":"2024-04-26T20:23:38.273741+0000","last_clean":"2024-04-26T20:23:38.273741+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:23:38.273741+0000","last_undegraded":"2024-04-26T20:23:38.273741+0000","last_fullsized":"2024-04-26T20:23:38.273741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":830,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'784","reported_seq":834,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.698472+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:23:37.698472+0000","last_peered":"2024-04-26T20:23:37.698472+0000","last_clean":"2024-04-26T20:23:37.698472+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:23:37.698472+0000","last_undegraded":"2024-04-26T20:23:37.698472+0000","last_fullsized":"2024-04-26T20:23:37.698472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26923,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":65331,"num_write":751,"num_write_kb":82709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'190","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.876495+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:23:37.876495+0000","last_peered":"2024-04-26T20:23:37.876495+0000","last_clean":"2024-04-26T20:23:37.876495+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:23:37.876495+0000","last_undegraded":"2024-04-26T20:23:37.876495+0000","last_fullsized":"2024-04-26T20:23:37.876495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'198","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.619819+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:23:34.619819+0000","last_peered":"2024-04-26T20:23:34.619819+0000","last_clean":"2024-04-26T20:23:34.619819+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:23:34.619819+0000","last_undegraded":"2024-04-26T20:23:34.619819+0000","last_fullsized":"2024-04-26T20:23:34.619819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":138,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'753","reported_seq":810,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.902643+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:23:37.902643+0000","last_peered":"2024-04-26T20:23:37.902643+0000","last_clean":"2024-04-26T20:23:37.902643+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:23:37.902643+0000","last_undegraded":"2024-04-26T20:23:37.902643+0000","last_fullsized":"2024-04-26T20:23:37.902643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40905,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":72924,"num_write":711,"num_write_kb":105217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'200","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.888710+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:23:37.888710+0000","last_peered":"2024-04-26T20:23:37.888710+0000","last_clean":"2024-04-26T20:23:37.888710+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:23:37.888710+0000","last_undegraded":"2024-04-26T20:23:37.888710+0000","last_fullsized":"2024-04-26T20:23:37.888710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'56","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.571100+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:23:37.571100+0000","last_peered":"2024-04-26T20:23:37.571100+0000","last_clean":"2024-04-26T20:23:37.571100+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:23:37.571100+0000","last_undegraded":"2024-04-26T20:23:37.571100+0000","last_fullsized":"2024-04-26T20:23:37.571100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'779","reported_seq":832,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.712170+0000","last_change":"2024-04-26T20:15:02.206054+0000","last_active":"2024-04-26T20:23:37.712170+0000","last_peered":"2024-04-26T20:23:37.712170+0000","last_clean":"2024-04-26T20:23:37.712170+0000","last_became_active":"2024-04-26T20:15:02.205610+0000","last_became_peered":"2024-04-26T20:15:02.205610+0000","last_unstale":"2024-04-26T20:23:37.712170+0000","last_undegraded":"2024-04-26T20:23:37.712170+0000","last_fullsized":"2024-04-26T20:23:37.712170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:16.507443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36509,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":29,"num_read_kb":101392,"num_write":750,"num_write_kb":117505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'189","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.468951+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:23:42.468951+0000","last_peered":"2024-04-26T20:23:42.468951+0000","last_clean":"2024-04-26T20:23:42.468951+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:23:42.468951+0000","last_undegraded":"2024-04-26T20:23:42.468951+0000","last_fullsized":"2024-04-26T20:23:42.468951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'623","reported_seq":662,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.690568+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:23:22.690568+0000","last_peered":"2024-04-26T20:23:22.690568+0000","last_clean":"2024-04-26T20:23:22.690568+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:23:22.690568+0000","last_undegraded":"2024-04-26T20:23:22.690568+0000","last_fullsized":"2024-04-26T20:23:22.690568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":569,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'760","reported_seq":839,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.889001+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:23:37.889001+0000","last_peered":"2024-04-26T20:23:37.889001+0000","last_clean":"2024-04-26T20:23:37.889001+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:23:37.889001+0000","last_undegraded":"2024-04-26T20:23:37.889001+0000","last_fullsized":"2024-04-26T20:23:37.889001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19472,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":139574,"num_write":727,"num_write_kb":123608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'200","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.628476+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:23:37.628476+0000","last_peered":"2024-04-26T20:23:37.628476+0000","last_clean":"2024-04-26T20:23:37.628476+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:23:37.628476+0000","last_undegraded":"2024-04-26T20:23:37.628476+0000","last_fullsized":"2024-04-26T20:23:37.628476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'356","reported_seq":684,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.552239+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:23:37.552239+0000","last_peered":"2024-04-26T20:23:37.552239+0000","last_clean":"2024-04-26T20:23:37.552239+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:23:37.552239+0000","last_undegraded":"2024-04-26T20:23:37.552239+0000","last_fullsized":"2024-04-26T20:23:37.552239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1518911,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":298,"num_read_kb":1687,"num_write":293,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'745","reported_seq":798,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.895974+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:23:37.895974+0000","last_peered":"2024-04-26T20:23:37.895974+0000","last_clean":"2024-04-26T20:23:37.895974+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:23:37.895974+0000","last_undegraded":"2024-04-26T20:23:37.895974+0000","last_fullsized":"2024-04-26T20:23:37.895974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":61996,"num_write":716,"num_write_kb":88897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'186","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.584386+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:23:37.584386+0000","last_peered":"2024-04-26T20:23:37.584386+0000","last_clean":"2024-04-26T20:23:37.584386+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:23:37.584386+0000","last_undegraded":"2024-04-26T20:23:37.584386+0000","last_fullsized":"2024-04-26T20:23:37.584386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'271","reported_seq":316,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.482482+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:23:30.482482+0000","last_peered":"2024-04-26T20:23:30.482482+0000","last_clean":"2024-04-26T20:23:30.482482+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:23:30.482482+0000","last_undegraded":"2024-04-26T20:23:30.482482+0000","last_fullsized":"2024-04-26T20:23:30.482482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":213,"num_write_kb":8309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'870","reported_seq":932,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.864273+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:23:37.864273+0000","last_peered":"2024-04-26T20:23:37.864273+0000","last_clean":"2024-04-26T20:23:37.864273+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:23:37.864273+0000","last_undegraded":"2024-04-26T20:23:37.864273+0000","last_fullsized":"2024-04-26T20:23:37.864273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118312,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":32,"num_read_kb":98068,"num_write":834,"num_write_kb":148105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'181","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.587614+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:23:37.587614+0000","last_peered":"2024-04-26T20:23:37.587614+0000","last_clean":"2024-04-26T20:23:37.587614+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:23:37.587614+0000","last_undegraded":"2024-04-26T20:23:37.587614+0000","last_fullsized":"2024-04-26T20:23:37.587614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'78","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:32.557547+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:23:32.557547+0000","last_peered":"2024-04-26T20:23:32.557547+0000","last_clean":"2024-04-26T20:23:32.557547+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:23:32.557547+0000","last_undegraded":"2024-04-26T20:23:32.557547+0000","last_fullsized":"2024-04-26T20:23:32.557547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":13,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:21:52.220087+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:21:52.220087+0000","last_peered":"2024-04-26T20:21:52.220087+0000","last_clean":"2024-04-26T20:21:52.220087+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:21:52.220087+0000","last_undegraded":"2024-04-26T20:21:52.220087+0000","last_fullsized":"2024-04-26T20:21:52.220087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'767","reported_seq":826,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.922859+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:23:37.922859+0000","last_peered":"2024-04-26T20:23:37.922859+0000","last_clean":"2024-04-26T20:23:37.922859+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:23:37.922859+0000","last_undegraded":"2024-04-26T20:23:37.922859+0000","last_fullsized":"2024-04-26T20:23:37.922859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":30,"num_read_kb":82002,"num_write":736,"num_write_kb":109731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.719573+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:23:37.719573+0000","last_peered":"2024-04-26T20:23:37.719573+0000","last_clean":"2024-04-26T20:23:37.719573+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:23:37.719573+0000","last_undegraded":"2024-04-26T20:23:37.719573+0000","last_fullsized":"2024-04-26T20:23:37.719573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'67","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:28.510575+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:23:28.510575+0000","last_peered":"2024-04-26T20:23:28.510575+0000","last_clean":"2024-04-26T20:23:28.510575+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:23:28.510575+0000","last_undegraded":"2024-04-26T20:23:28.510575+0000","last_fullsized":"2024-04-26T20:23:28.510575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'848","reported_seq":928,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.690463+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:23:37.690463+0000","last_peered":"2024-04-26T20:23:37.690463+0000","last_clean":"2024-04-26T20:23:37.690463+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:23:37.690463+0000","last_undegraded":"2024-04-26T20:23:37.690463+0000","last_fullsized":"2024-04-26T20:23:37.690463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77273,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":152120,"num_write":808,"num_write_kb":168870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.660405+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:23:37.660405+0000","last_peered":"2024-04-26T20:23:37.660405+0000","last_clean":"2024-04-26T20:23:37.660405+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:23:37.660405+0000","last_undegraded":"2024-04-26T20:23:37.660405+0000","last_fullsized":"2024-04-26T20:23:37.660405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'562","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.702386+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:23:34.702386+0000","last_peered":"2024-04-26T20:23:34.702386+0000","last_clean":"2024-04-26T20:23:34.702386+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:23:34.702386+0000","last_undegraded":"2024-04-26T20:23:34.702386+0000","last_fullsized":"2024-04-26T20:23:34.702386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":503,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'810","reported_seq":889,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.664114+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:23:37.664114+0000","last_peered":"2024-04-26T20:23:37.664114+0000","last_clean":"2024-04-26T20:23:37.664114+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:23:37.664114+0000","last_undegraded":"2024-04-26T20:23:37.664114+0000","last_fullsized":"2024-04-26T20:23:37.664114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94795,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":135112,"num_write":777,"num_write_kb":135635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'187","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.896616+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:23:37.896616+0000","last_peered":"2024-04-26T20:23:37.896616+0000","last_clean":"2024-04-26T20:23:37.896616+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:23:37.896616+0000","last_undegraded":"2024-04-26T20:23:37.896616+0000","last_fullsized":"2024-04-26T20:23:37.896616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'280","reported_seq":320,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.479572+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:23:30.479572+0000","last_peered":"2024-04-26T20:23:30.479572+0000","last_clean":"2024-04-26T20:23:30.479572+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:23:30.479572+0000","last_undegraded":"2024-04-26T20:23:30.479572+0000","last_fullsized":"2024-04-26T20:23:30.479572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":224,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'840","reported_seq":913,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.901896+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:23:37.901896+0000","last_peered":"2024-04-26T20:23:37.901896+0000","last_clean":"2024-04-26T20:23:37.901896+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:23:37.901896+0000","last_undegraded":"2024-04-26T20:23:37.901896+0000","last_fullsized":"2024-04-26T20:23:37.901896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54703,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":124531,"num_write":803,"num_write_kb":151625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'170","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.670178+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:23:37.670178+0000","last_peered":"2024-04-26T20:23:37.670178+0000","last_clean":"2024-04-26T20:23:37.670178+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:23:37.670178+0000","last_undegraded":"2024-04-26T20:23:37.670178+0000","last_fullsized":"2024-04-26T20:23:37.670178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'209","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.517341+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:23:30.517341+0000","last_peered":"2024-04-26T20:23:30.517341+0000","last_clean":"2024-04-26T20:23:30.517341+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:23:30.517341+0000","last_undegraded":"2024-04-26T20:23:30.517341+0000","last_fullsized":"2024-04-26T20:23:30.517341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":4101,"num_write":169,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'858","reported_seq":933,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.902492+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:23:37.902492+0000","last_peered":"2024-04-26T20:23:37.902492+0000","last_clean":"2024-04-26T20:23:37.902492+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:23:37.902492+0000","last_undegraded":"2024-04-26T20:23:37.902492+0000","last_fullsized":"2024-04-26T20:23:37.902492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36343,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":151765,"num_write":823,"num_write_kb":200590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'224","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.586093+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:23:37.586093+0000","last_peered":"2024-04-26T20:23:37.586093+0000","last_clean":"2024-04-26T20:23:37.586093+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:23:37.586093+0000","last_undegraded":"2024-04-26T20:23:37.586093+0000","last_fullsized":"2024-04-26T20:23:37.586093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'325","reported_seq":377,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:39.241704+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:23:39.241704+0000","last_peered":"2024-04-26T20:23:39.241704+0000","last_clean":"2024-04-26T20:23:39.241704+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:23:39.241704+0000","last_undegraded":"2024-04-26T20:23:39.241704+0000","last_fullsized":"2024-04-26T20:23:39.241704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6148913,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":277,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'788","reported_seq":849,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.673817+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:23:37.673817+0000","last_peered":"2024-04-26T20:23:37.673817+0000","last_clean":"2024-04-26T20:23:37.673817+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:23:37.673817+0000","last_undegraded":"2024-04-26T20:23:37.673817+0000","last_fullsized":"2024-04-26T20:23:37.673817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84285,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":112649,"num_write":760,"num_write_kb":135273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'208","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.834091+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:23:37.834091+0000","last_peered":"2024-04-26T20:23:37.834091+0000","last_clean":"2024-04-26T20:23:37.834091+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:23:37.834091+0000","last_undegraded":"2024-04-26T20:23:37.834091+0000","last_fullsized":"2024-04-26T20:23:37.834091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'69","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.596031+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:23:30.596031+0000","last_peered":"2024-04-26T20:23:30.596031+0000","last_clean":"2024-04-26T20:23:30.596031+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:23:30.596031+0000","last_undegraded":"2024-04-26T20:23:30.596031+0000","last_fullsized":"2024-04-26T20:23:30.596031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'764","reported_seq":821,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.835103+0000","last_change":"2024-04-26T20:15:02.257901+0000","last_active":"2024-04-26T20:23:37.835103+0000","last_peered":"2024-04-26T20:23:37.835103+0000","last_clean":"2024-04-26T20:23:37.835103+0000","last_became_active":"2024-04-26T20:15:02.257484+0000","last_became_peered":"2024-04-26T20:15:02.257484+0000","last_unstale":"2024-04-26T20:23:37.835103+0000","last_undegraded":"2024-04-26T20:23:37.835103+0000","last_fullsized":"2024-04-26T20:23:37.835103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:35.589446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40157,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":40921,"num_write":727,"num_write_kb":85912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'189","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.470048+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:23:37.470048+0000","last_peered":"2024-04-26T20:23:37.470048+0000","last_clean":"2024-04-26T20:23:37.470048+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:23:37.470048+0000","last_undegraded":"2024-04-26T20:23:37.470048+0000","last_fullsized":"2024-04-26T20:23:37.470048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'62","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.554023+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:23:37.554023+0000","last_peered":"2024-04-26T20:23:37.554023+0000","last_clean":"2024-04-26T20:23:37.554023+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:23:37.554023+0000","last_undegraded":"2024-04-26T20:23:37.554023+0000","last_fullsized":"2024-04-26T20:23:37.554023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":20,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'701","reported_seq":763,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.621176+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:23:37.621176+0000","last_peered":"2024-04-26T20:23:37.621176+0000","last_clean":"2024-04-26T20:23:37.621176+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:23:37.621176+0000","last_undegraded":"2024-04-26T20:23:37.621176+0000","last_fullsized":"2024-04-26T20:23:37.621176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64327,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":32,"num_read_kb":103743,"num_write":673,"num_write_kb":106165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'197","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.447643+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:23:37.447643+0000","last_peered":"2024-04-26T20:23:37.447643+0000","last_clean":"2024-04-26T20:23:37.447643+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:23:37.447643+0000","last_undegraded":"2024-04-26T20:23:37.447643+0000","last_fullsized":"2024-04-26T20:23:37.447643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'630","reported_seq":678,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.447673+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:23:37.447673+0000","last_peered":"2024-04-26T20:23:37.447673+0000","last_clean":"2024-04-26T20:23:37.447673+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:23:37.447673+0000","last_undegraded":"2024-04-26T20:23:37.447673+0000","last_fullsized":"2024-04-26T20:23:37.447673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":8218,"num_write":576,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'713","reported_seq":761,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.713609+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:23:37.713609+0000","last_peered":"2024-04-26T20:23:37.713609+0000","last_clean":"2024-04-26T20:23:37.713609+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:23:37.713609+0000","last_undegraded":"2024-04-26T20:23:37.713609+0000","last_fullsized":"2024-04-26T20:23:37.713609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37145,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":19,"num_read_kb":67432,"num_write":682,"num_write_kb":88740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.482900+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:23:37.482900+0000","last_peered":"2024-04-26T20:23:37.482900+0000","last_clean":"2024-04-26T20:23:37.482900+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:23:37.482900+0000","last_undegraded":"2024-04-26T20:23:37.482900+0000","last_fullsized":"2024-04-26T20:23:37.482900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'416","reported_seq":461,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.589389+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:23:34.589389+0000","last_peered":"2024-04-26T20:23:34.589389+0000","last_clean":"2024-04-26T20:23:34.589389+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:23:34.589389+0000","last_undegraded":"2024-04-26T20:23:34.589389+0000","last_fullsized":"2024-04-26T20:23:34.589389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":8203,"num_write":362,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'816","reported_seq":879,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.496645+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:23:42.496645+0000","last_peered":"2024-04-26T20:23:42.496645+0000","last_clean":"2024-04-26T20:23:42.496645+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:23:42.496645+0000","last_undegraded":"2024-04-26T20:23:42.496645+0000","last_fullsized":"2024-04-26T20:23:42.496645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267789,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":34,"num_read_kb":109998,"num_write":775,"num_write_kb":139293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'181","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.595671+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:23:34.595671+0000","last_peered":"2024-04-26T20:23:34.595671+0000","last_clean":"2024-04-26T20:23:34.595671+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:23:34.595671+0000","last_undegraded":"2024-04-26T20:23:34.595671+0000","last_fullsized":"2024-04-26T20:23:34.595671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'400","reported_seq":440,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:35.488740+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:23:35.488740+0000","last_peered":"2024-04-26T20:23:35.488740+0000","last_clean":"2024-04-26T20:23:35.488740+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:23:35.488740+0000","last_undegraded":"2024-04-26T20:23:35.488740+0000","last_fullsized":"2024-04-26T20:23:35.488740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":351,"num_write_kb":4641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'783","reported_seq":850,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.899674+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:23:37.899674+0000","last_peered":"2024-04-26T20:23:37.899674+0000","last_clean":"2024-04-26T20:23:37.899674+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:23:37.899674+0000","last_undegraded":"2024-04-26T20:23:37.899674+0000","last_fullsized":"2024-04-26T20:23:37.899674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13175,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":119092,"num_write":735,"num_write_kb":148060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.523187+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:23:37.523187+0000","last_peered":"2024-04-26T20:23:37.523187+0000","last_clean":"2024-04-26T20:23:37.523187+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:23:37.523187+0000","last_undegraded":"2024-04-26T20:23:37.523187+0000","last_fullsized":"2024-04-26T20:23:37.523187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'110","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.765707+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:23:22.765707+0000","last_peered":"2024-04-26T20:23:22.765707+0000","last_clean":"2024-04-26T20:23:22.765707+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:23:22.765707+0000","last_undegraded":"2024-04-26T20:23:22.765707+0000","last_fullsized":"2024-04-26T20:23:22.765707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":58,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'861","reported_seq":933,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.926066+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:23:37.926066+0000","last_peered":"2024-04-26T20:23:37.926066+0000","last_clean":"2024-04-26T20:23:37.926066+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:23:37.926066+0000","last_undegraded":"2024-04-26T20:23:37.926066+0000","last_fullsized":"2024-04-26T20:23:37.926066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43107,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":142355,"num_write":817,"num_write_kb":159668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'210","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.610220+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:23:34.610220+0000","last_peered":"2024-04-26T20:23:34.610220+0000","last_clean":"2024-04-26T20:23:34.610220+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:23:34.610220+0000","last_undegraded":"2024-04-26T20:23:34.610220+0000","last_fullsized":"2024-04-26T20:23:34.610220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'66","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.644970+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:23:22.644970+0000","last_peered":"2024-04-26T20:23:22.644970+0000","last_clean":"2024-04-26T20:23:22.644970+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:23:22.644970+0000","last_undegraded":"2024-04-26T20:23:22.644970+0000","last_fullsized":"2024-04-26T20:23:22.644970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'919","reported_seq":1027,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.488709+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:23:42.488709+0000","last_peered":"2024-04-26T20:23:42.488709+0000","last_clean":"2024-04-26T20:23:42.488709+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:23:42.488709+0000","last_undegraded":"2024-04-26T20:23:42.488709+0000","last_fullsized":"2024-04-26T20:23:42.488709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62636,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":239056,"num_write":892,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'778","reported_seq":838,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.904923+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:23:37.904923+0000","last_peered":"2024-04-26T20:23:37.904923+0000","last_clean":"2024-04-26T20:23:37.904923+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:23:37.904923+0000","last_undegraded":"2024-04-26T20:23:37.904923+0000","last_fullsized":"2024-04-26T20:23:37.904923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47881,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":94596,"num_write":738,"num_write_kb":94412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'197","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.910194+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:23:37.910194+0000","last_peered":"2024-04-26T20:23:37.910194+0000","last_clean":"2024-04-26T20:23:37.910194+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:23:37.910194+0000","last_undegraded":"2024-04-26T20:23:37.910194+0000","last_fullsized":"2024-04-26T20:23:37.910194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'800","reported_seq":838,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.463636+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:23:30.463636+0000","last_peered":"2024-04-26T20:23:30.463636+0000","last_clean":"2024-04-26T20:23:30.463636+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:23:30.463636+0000","last_undegraded":"2024-04-26T20:23:30.463636+0000","last_fullsized":"2024-04-26T20:23:30.463636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":733,"num_write_kb":8579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'771","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.873154+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:23:37.873154+0000","last_peered":"2024-04-26T20:23:37.873154+0000","last_clean":"2024-04-26T20:23:37.873154+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:23:37.873154+0000","last_undegraded":"2024-04-26T20:23:37.873154+0000","last_fullsized":"2024-04-26T20:23:37.873154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13708,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":124481,"num_write":739,"num_write_kb":150909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'209","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.518721+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:23:37.518721+0000","last_peered":"2024-04-26T20:23:37.518721+0000","last_clean":"2024-04-26T20:23:37.518721+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:23:37.518721+0000","last_undegraded":"2024-04-26T20:23:37.518721+0000","last_fullsized":"2024-04-26T20:23:37.518721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'108","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.511049+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:23:34.511049+0000","last_peered":"2024-04-26T20:23:34.511049+0000","last_clean":"2024-04-26T20:23:34.511049+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:23:34.511049+0000","last_undegraded":"2024-04-26T20:23:34.511049+0000","last_fullsized":"2024-04-26T20:23:34.511049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":58,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'495","reported_seq":540,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.512132+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:23:34.512132+0000","last_peered":"2024-04-26T20:23:34.512132+0000","last_clean":"2024-04-26T20:23:34.512132+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:23:34.512132+0000","last_undegraded":"2024-04-26T20:23:34.512132+0000","last_fullsized":"2024-04-26T20:23:34.512132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10061,"num_write":440,"num_write_kb":12524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'161","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.584585+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:23:37.584585+0000","last_peered":"2024-04-26T20:23:37.584585+0000","last_clean":"2024-04-26T20:23:37.584585+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:23:37.584585+0000","last_undegraded":"2024-04-26T20:23:37.584585+0000","last_fullsized":"2024-04-26T20:23:37.584585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'735","reported_seq":790,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.918533+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:23:37.918533+0000","last_peered":"2024-04-26T20:23:37.918533+0000","last_clean":"2024-04-26T20:23:37.918533+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:23:37.918533+0000","last_undegraded":"2024-04-26T20:23:37.918533+0000","last_fullsized":"2024-04-26T20:23:37.918533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52589,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":82664,"num_write":702,"num_write_kb":110622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'167","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:28.365031+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:23:28.365031+0000","last_peered":"2024-04-26T20:23:28.365031+0000","last_clean":"2024-04-26T20:23:28.365031+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:23:28.365031+0000","last_undegraded":"2024-04-26T20:23:28.365031+0000","last_fullsized":"2024-04-26T20:23:28.365031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195300,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":104,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'198","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.856689+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:23:37.856689+0000","last_peered":"2024-04-26T20:23:37.856689+0000","last_clean":"2024-04-26T20:23:37.856689+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:23:37.856689+0000","last_undegraded":"2024-04-26T20:23:37.856689+0000","last_fullsized":"2024-04-26T20:23:37.856689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'734","reported_seq":799,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.482274+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:23:42.482274+0000","last_peered":"2024-04-26T20:23:42.482274+0000","last_clean":"2024-04-26T20:23:42.482274+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:23:42.482274+0000","last_undegraded":"2024-04-26T20:23:42.482274+0000","last_fullsized":"2024-04-26T20:23:42.482274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61197,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":120190,"num_write":695,"num_write_kb":135097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'202","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.698257+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:23:37.698257+0000","last_peered":"2024-04-26T20:23:37.698257+0000","last_clean":"2024-04-26T20:23:37.698257+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:23:37.698257+0000","last_undegraded":"2024-04-26T20:23:37.698257+0000","last_fullsized":"2024-04-26T20:23:37.698257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.536207+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:23:37.536207+0000","last_peered":"2024-04-26T20:23:37.536207+0000","last_clean":"2024-04-26T20:23:37.536207+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:23:37.536207+0000","last_undegraded":"2024-04-26T20:23:37.536207+0000","last_fullsized":"2024-04-26T20:23:37.536207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'220","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.660387+0000","last_change":"2024-04-26T20:15:02.206712+0000","last_active":"2024-04-26T20:23:37.660387+0000","last_peered":"2024-04-26T20:23:37.660387+0000","last_clean":"2024-04-26T20:23:37.660387+0000","last_became_active":"2024-04-26T20:15:02.205525+0000","last_became_peered":"2024-04-26T20:15:02.205525+0000","last_unstale":"2024-04-26T20:23:37.660387+0000","last_undegraded":"2024-04-26T20:23:37.660387+0000","last_fullsized":"2024-04-26T20:23:37.660387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:45.077649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.543621+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:23:37.543621+0000","last_peered":"2024-04-26T20:23:37.543621+0000","last_clean":"2024-04-26T20:23:37.543621+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:23:37.543621+0000","last_undegraded":"2024-04-26T20:23:37.543621+0000","last_fullsized":"2024-04-26T20:23:37.543621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'184","reported_seq":220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.849536+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:23:37.849536+0000","last_peered":"2024-04-26T20:23:37.849536+0000","last_clean":"2024-04-26T20:23:37.849536+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:23:37.849536+0000","last_undegraded":"2024-04-26T20:23:37.849536+0000","last_fullsized":"2024-04-26T20:23:37.849536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'189","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.863510+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:23:37.863510+0000","last_peered":"2024-04-26T20:23:37.863510+0000","last_clean":"2024-04-26T20:23:37.863510+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:23:37.863510+0000","last_undegraded":"2024-04-26T20:23:37.863510+0000","last_fullsized":"2024-04-26T20:23:37.863510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'220","reported_seq":256,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.709523+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:23:37.709523+0000","last_peered":"2024-04-26T20:23:37.709523+0000","last_clean":"2024-04-26T20:23:37.709523+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:23:37.709523+0000","last_undegraded":"2024-04-26T20:23:37.709523+0000","last_fullsized":"2024-04-26T20:23:37.709523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'197","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.896571+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:23:37.896571+0000","last_peered":"2024-04-26T20:23:37.896571+0000","last_clean":"2024-04-26T20:23:37.896571+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:23:37.896571+0000","last_undegraded":"2024-04-26T20:23:37.896571+0000","last_fullsized":"2024-04-26T20:23:37.896571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.702805+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:23:37.702805+0000","last_peered":"2024-04-26T20:23:37.702805+0000","last_clean":"2024-04-26T20:23:37.702805+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:23:37.702805+0000","last_undegraded":"2024-04-26T20:23:37.702805+0000","last_fullsized":"2024-04-26T20:23:37.702805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'199","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.552939+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:23:37.552939+0000","last_peered":"2024-04-26T20:23:37.552939+0000","last_clean":"2024-04-26T20:23:37.552939+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:23:37.552939+0000","last_undegraded":"2024-04-26T20:23:37.552939+0000","last_fullsized":"2024-04-26T20:23:37.552939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'199","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.590786+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:23:30.590786+0000","last_peered":"2024-04-26T20:23:30.590786+0000","last_clean":"2024-04-26T20:23:30.590786+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:23:30.590786+0000","last_undegraded":"2024-04-26T20:23:30.590786+0000","last_fullsized":"2024-04-26T20:23:30.590786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'195","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.661552+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:23:37.661552+0000","last_peered":"2024-04-26T20:23:37.661552+0000","last_clean":"2024-04-26T20:23:37.661552+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:23:37.661552+0000","last_undegraded":"2024-04-26T20:23:37.661552+0000","last_fullsized":"2024-04-26T20:23:37.661552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'211","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.708560+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:23:37.708560+0000","last_peered":"2024-04-26T20:23:37.708560+0000","last_clean":"2024-04-26T20:23:37.708560+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:23:37.708560+0000","last_undegraded":"2024-04-26T20:23:37.708560+0000","last_fullsized":"2024-04-26T20:23:37.708560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'193","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.862211+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:23:37.862211+0000","last_peered":"2024-04-26T20:23:37.862211+0000","last_clean":"2024-04-26T20:23:37.862211+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:23:37.862211+0000","last_undegraded":"2024-04-26T20:23:37.862211+0000","last_fullsized":"2024-04-26T20:23:37.862211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'187","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.842955+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:23:37.842955+0000","last_peered":"2024-04-26T20:23:37.842955+0000","last_clean":"2024-04-26T20:23:37.842955+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:23:37.842955+0000","last_undegraded":"2024-04-26T20:23:37.842955+0000","last_fullsized":"2024-04-26T20:23:37.842955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'195","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.660715+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:23:37.660715+0000","last_peered":"2024-04-26T20:23:37.660715+0000","last_clean":"2024-04-26T20:23:37.660715+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:23:37.660715+0000","last_undegraded":"2024-04-26T20:23:37.660715+0000","last_fullsized":"2024-04-26T20:23:37.660715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.648204+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:23:37.648204+0000","last_peered":"2024-04-26T20:23:37.648204+0000","last_clean":"2024-04-26T20:23:37.648204+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:23:37.648204+0000","last_undegraded":"2024-04-26T20:23:37.648204+0000","last_fullsized":"2024-04-26T20:23:37.648204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'202","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.556745+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:23:37.556745+0000","last_peered":"2024-04-26T20:23:37.556745+0000","last_clean":"2024-04-26T20:23:37.556745+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:23:37.556745+0000","last_undegraded":"2024-04-26T20:23:37.556745+0000","last_fullsized":"2024-04-26T20:23:37.556745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.908914+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:23:37.908914+0000","last_peered":"2024-04-26T20:23:37.908914+0000","last_clean":"2024-04-26T20:23:37.908914+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:23:37.908914+0000","last_undegraded":"2024-04-26T20:23:37.908914+0000","last_fullsized":"2024-04-26T20:23:37.908914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'184","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.708985+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:23:34.708985+0000","last_peered":"2024-04-26T20:23:34.708985+0000","last_clean":"2024-04-26T20:23:34.708985+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:23:34.708985+0000","last_undegraded":"2024-04-26T20:23:34.708985+0000","last_fullsized":"2024-04-26T20:23:34.708985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'164","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.617105+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:23:37.617105+0000","last_peered":"2024-04-26T20:23:37.617105+0000","last_clean":"2024-04-26T20:23:37.617105+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:23:37.617105+0000","last_undegraded":"2024-04-26T20:23:37.617105+0000","last_fullsized":"2024-04-26T20:23:37.617105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'172","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.714364+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:23:37.714364+0000","last_peered":"2024-04-26T20:23:37.714364+0000","last_clean":"2024-04-26T20:23:37.714364+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:23:37.714364+0000","last_undegraded":"2024-04-26T20:23:37.714364+0000","last_fullsized":"2024-04-26T20:23:37.714364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'183","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.674186+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:23:37.674186+0000","last_peered":"2024-04-26T20:23:37.674186+0000","last_clean":"2024-04-26T20:23:37.674186+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:23:37.674186+0000","last_undegraded":"2024-04-26T20:23:37.674186+0000","last_fullsized":"2024-04-26T20:23:37.674186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'197","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.835426+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:23:37.835426+0000","last_peered":"2024-04-26T20:23:37.835426+0000","last_clean":"2024-04-26T20:23:37.835426+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:23:37.835426+0000","last_undegraded":"2024-04-26T20:23:37.835426+0000","last_fullsized":"2024-04-26T20:23:37.835426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'171","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.657705+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:23:37.657705+0000","last_peered":"2024-04-26T20:23:37.657705+0000","last_clean":"2024-04-26T20:23:37.657705+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:23:37.657705+0000","last_undegraded":"2024-04-26T20:23:37.657705+0000","last_fullsized":"2024-04-26T20:23:37.657705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'196","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.549605+0000","last_change":"2024-04-26T20:15:02.200465+0000","last_active":"2024-04-26T20:23:30.549605+0000","last_peered":"2024-04-26T20:23:30.549605+0000","last_clean":"2024-04-26T20:23:30.549605+0000","last_became_active":"2024-04-26T20:15:02.200094+0000","last_became_peered":"2024-04-26T20:15:02.200094+0000","last_unstale":"2024-04-26T20:23:30.549605+0000","last_undegraded":"2024-04-26T20:23:30.549605+0000","last_fullsized":"2024-04-26T20:23:30.549605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:04.049772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'183","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.637073+0000","last_change":"2024-04-26T20:15:02.201696+0000","last_active":"2024-04-26T20:23:37.637073+0000","last_peered":"2024-04-26T20:23:37.637073+0000","last_clean":"2024-04-26T20:23:37.637073+0000","last_became_active":"2024-04-26T20:15:02.201216+0000","last_became_peered":"2024-04-26T20:15:02.201216+0000","last_unstale":"2024-04-26T20:23:37.637073+0000","last_undegraded":"2024-04-26T20:23:37.637073+0000","last_fullsized":"2024-04-26T20:23:37.637073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:55.081488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'204","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.556875+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:23:37.556875+0000","last_peered":"2024-04-26T20:23:37.556875+0000","last_clean":"2024-04-26T20:23:37.556875+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:23:37.556875+0000","last_undegraded":"2024-04-26T20:23:37.556875+0000","last_fullsized":"2024-04-26T20:23:37.556875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'187","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.673622+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:23:37.673622+0000","last_peered":"2024-04-26T20:23:37.673622+0000","last_clean":"2024-04-26T20:23:37.673622+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:23:37.673622+0000","last_undegraded":"2024-04-26T20:23:37.673622+0000","last_fullsized":"2024-04-26T20:23:37.673622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'183","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.519100+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:23:37.519100+0000","last_peered":"2024-04-26T20:23:37.519100+0000","last_clean":"2024-04-26T20:23:37.519100+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:23:37.519100+0000","last_undegraded":"2024-04-26T20:23:37.519100+0000","last_fullsized":"2024-04-26T20:23:37.519100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'205","reported_seq":241,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.894986+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:23:37.894986+0000","last_peered":"2024-04-26T20:23:37.894986+0000","last_clean":"2024-04-26T20:23:37.894986+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:23:37.894986+0000","last_undegraded":"2024-04-26T20:23:37.894986+0000","last_fullsized":"2024-04-26T20:23:37.894986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'204","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.671162+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:23:37.671162+0000","last_peered":"2024-04-26T20:23:37.671162+0000","last_clean":"2024-04-26T20:23:37.671162+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:23:37.671162+0000","last_undegraded":"2024-04-26T20:23:37.671162+0000","last_fullsized":"2024-04-26T20:23:37.671162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2026971,"num_objects":253,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":253,"num_whiteouts":0,"num_read":1174,"num_read_kb":3559915,"num_write":24140,"num_write_kb":4217550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6049792,"data_stored":7057408,"data_compressed":884067,"data_compressed_allocated":1118208,"data_compressed_original":2125824,"omap_allocated":0,"internal_metadata":0},"log_size":25279,"ondisk_log_size":25279,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12380,"ondisk_log_size":12380,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":141890006,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":585,"num_read_kb":126692,"num_write":6967,"num_write_kb":144789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96514048,"data_stored":283791191,"data_compressed":42615546,"data_compressed_allocated":55754752,"data_compressed_original":243187712,"omap_allocated":0,"internal_metadata":0},"log_size":8207,"ondisk_log_size":8207,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542262,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86412,"kb_used_data":14980,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285428,"statfs":{"total":96636764160,"available":96548278272,"internally_reserved":0,"allocated":15339520,"data_stored":51832178,"data_compressed":7706125,"data_compressed_allocated":9986048,"data_compressed_original":46690304,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542263,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88836,"kb_used_data":13244,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94283004,"statfs":{"total":96636764160,"available":96545796096,"internally_reserved":0,"allocated":13561856,"data_stored":47391230,"data_compressed":7360459,"data_compressed_allocated":9203712,"data_compressed_original":43237376,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542263,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79628,"kb_used_data":12356,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94292212,"statfs":{"total":96636764160,"available":96555225088,"internally_reserved":0,"allocated":12652544,"data_stored":30163482,"data_compressed":4259202,"data_compressed_allocated":5746688,"data_compressed_original":23465984,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542262,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107724,"kb_used_data":18308,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264116,"statfs":{"total":96636764160,"available":96526454784,"internally_reserved":0,"allocated":18747392,"data_stored":47247234,"data_compressed":6940303,"data_compressed_allocated":9154560,"data_compressed_original":37859328,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542262,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87556,"kb_used_data":11964,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94284284,"statfs":{"total":96636764160,"available":96547106816,"internally_reserved":0,"allocated":12251136,"data_stored":36524155,"data_compressed":5640669,"data_compressed_allocated":7163904,"data_compressed_original":31645696,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542261,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55408,"kb_used_data":6184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316432,"statfs":{"total":96636764160,"available":96580026368,"internally_reserved":0,"allocated":6332416,"data_stored":12681899,"data_compressed":1714966,"data_compressed_allocated":2441216,"data_compressed_original":9003008,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542262,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108504,"kb_used_data":14928,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263336,"statfs":{"total":96636764160,"available":96525656064,"internally_reserved":0,"allocated":15286272,"data_stored":37025348,"data_compressed":5510164,"data_compressed_allocated":7434240,"data_compressed_original":29388800,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542261,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91284,"kb_used_data":11532,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94280556,"statfs":{"total":96636764160,"available":96543289344,"internally_reserved":0,"allocated":11808768,"data_stored":30970220,"data_compressed":4503033,"data_compressed_allocated":5918720,"data_compressed_original":25288704,"omap_allocated":1595,"internal_metadata":81656261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":29360788,"data_compressed":4405923,"data_compressed_allocated":5791744,"data_compressed_original":24539136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13811712,"data_stored":35509873,"data_compressed":5276194,"data_compressed_allocated":7143424,"data_compressed_original":28868608,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5312512,"data_stored":11862744,"data_compressed":1673651,"data_compressed_allocated":2387968,"data_compressed_original":8962048,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10784768,"data_stored":35086190,"data_compressed":5451181,"data_compressed_allocated":6914048,"data_compressed_original":31236096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17629184,"data_stored":46138058,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11788288,"data_stored":29361506,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12312576,"data_stored":46138694,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":50333338,"data_compressed":7629580,"data_compressed_allocated":9871360,"data_compressed_original":45977600,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":778240,"data_stored":872448,"data_compressed":63658,"data_compressed_allocated":81920,"data_compressed_original":176128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":884736,"data_stored":1085440,"data_compressed":198121,"data_compressed_allocated":245760,"data_compressed_original":446464,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":704512,"data_stored":745472,"data_compressed":53467,"data_compressed_allocated":65536,"data_compressed_original":106496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":843776,"data_stored":962560,"data_compressed":159256,"data_compressed_allocated":212992,"data_compressed_original":331776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":892928,"data_compressed":129847,"data_compressed_allocated":159744,"data_compressed_original":323584,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":655360,"data_compressed":89298,"data_compressed_allocated":110592,"data_compressed_original":237568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":888832,"data_stored":1081344,"data_compressed":147327,"data_compressed_allocated":172032,"data_compressed_original":364544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":692224,"data_stored":761856,"data_compressed":43093,"data_compressed_allocated":69632,"data_compressed_original":139264,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:23:49.009 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T20:23:49.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:23:49.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.187+0000 7ff15fa00640 1 Processor -- start 2024-04-26T20:23:49.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.187+0000 7ff15fa00640 1 -- start start 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15fa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff158151e70 0x7ff158073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15fa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158073ad0 0x7ff15815b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15fa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff15815bc50 0x7ff1580c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15fa00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff158074370 con 0x7ff158151e70 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15fa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7ff15815b260 con 0x7ff15815bc50 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15fa00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff15815c0a0 con 0x7ff158073ad0 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff158151e70 0x7ff158073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff158151e70 0x7ff158073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44856/0 (socket says 172.21.15.16:44856) 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 -- 172.21.15.16:0/544965878 learned_addr learned my addr 172.21.15.16:0/544965878 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15da00640 1 --2- 172.21.15.16:0/544965878 >> v2:172.21.15.192:3300/0 conn(0x7ff15815bc50 0x7ff1580c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff157e00640 1 --2- 172.21.15.16:0/544965878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158073ad0 0x7ff15815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 -- 172.21.15.16:0/544965878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158073ad0 msgr2=0x7ff15815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 --2- 172.21.15.16:0/544965878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158073ad0 0x7ff15815b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 -- 172.21.15.16:0/544965878 >> v2:172.21.15.192:3300/0 conn(0x7ff15815bc50 msgr2=0x7ff1580c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 --2- 172.21.15.16:0/544965878 >> v2:172.21.15.192:3300/0 conn(0x7ff15815bc50 0x7ff1580c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15d000640 1 -- 172.21.15.16:0/544965878 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff158157f80 con 0x7ff158151e70 2024-04-26T20:23:49.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.191+0000 7ff15da00640 1 --2- 172.21.15.16:0/544965878 >> v2:172.21.15.192:3300/0 conn(0x7ff15815bc50 0x7ff1580c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:49.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15d000640 1 --2- 172.21.15.16:0/544965878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff158151e70 0x7ff158073590 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff158155860 tx=0x7ff14c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d074c42702240e96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:49.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff157400640 1 -- 172.21.15.16:0/544965878 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0b5070 con 0x7ff158151e70 2024-04-26T20:23:49.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff157400640 1 -- 172.21.15.16:0/544965878 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14c0a89d0 con 0x7ff158151e70 2024-04-26T20:23:49.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff157400640 1 -- 172.21.15.16:0/544965878 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0a8da0 con 0x7ff158151e70 2024-04-26T20:23:49.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 -- 172.21.15.16:0/544965878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff158151e70 msgr2=0x7ff158073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 --2- 172.21.15.16:0/544965878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff158151e70 0x7ff158073590 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff158155860 tx=0x7ff14c01ed10 comp rx=0 tx=0).stop 2024-04-26T20:23:49.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 -- 172.21.15.16:0/544965878 shutdown_connections 2024-04-26T20:23:49.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 --2- 172.21.15.16:0/544965878 >> v2:172.21.15.192:3300/0 conn(0x7ff15815bc50 0x7ff1580c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 --2- 172.21.15.16:0/544965878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158073ad0 0x7ff15815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 --2- 172.21.15.16:0/544965878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff158151e70 0x7ff158073590 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 -- 172.21.15.16:0/544965878 >> 172.21.15.16:0/544965878 conn(0x7ff15806c380 msgr2=0x7ff15806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:49.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 -- 172.21.15.16:0/544965878 shutdown_connections 2024-04-26T20:23:49.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 -- 172.21.15.16:0/544965878 wait complete. 2024-04-26T20:23:49.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 Processor -- start 2024-04-26T20:23:49.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.195+0000 7ff15fa00640 1 -- start start 2024-04-26T20:23:49.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff158073ad0 0x7ff158145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158151e70 0x7ff15815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15815bc50 0x7ff158146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff158158820 con 0x7ff15815bc50 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff158158540 con 0x7ff158073ad0 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff158157c50 con 0x7ff158151e70 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15815bc50 0x7ff158146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15815bc50 0x7ff158146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44872/0 (socket says 172.21.15.16:44872) 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 -- 172.21.15.16:0/337367380 learned_addr learned my addr 172.21.15.16:0/337367380 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15d000640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff158073ad0 0x7ff158145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff157e00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158151e70 0x7ff15815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 -- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158151e70 msgr2=0x7ff15815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158151e70 0x7ff15815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 -- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff158073ad0 msgr2=0x7ff158145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff158073ad0 0x7ff158145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 -- 172.21.15.16:0/337367380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff158143e80 con 0x7ff15815bc50 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15da00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15815bc50 0x7ff158146630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff150007de0 tx=0x7ff15000d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff154c00640 1 -- 172.21.15.16:0/337367380 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15000dd40 con 0x7ff15815bc50 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff154c00640 1 -- 172.21.15.16:0/337367380 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1500039a0 con 0x7ff15815bc50 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff158144160 con 0x7ff15815bc50 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff154c00640 1 -- 172.21.15.16:0/337367380 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150003d50 con 0x7ff15815bc50 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff158144720 con 0x7ff15815bc50 2024-04-26T20:23:49.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158077c20 con 0x7ff15815bc50 2024-04-26T20:23:49.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.199+0000 7ff154c00640 1 -- 172.21.15.16:0/337367380 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff150012070 con 0x7ff15815bc50 2024-04-26T20:23:49.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.203+0000 7ff154c00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff1380683b0 0x7ff13806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.203+0000 7ff154c00640 1 -- 172.21.15.16:0/337367380 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7ff150086f40 con 0x7ff15815bc50 2024-04-26T20:23:49.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.203+0000 7ff15d000640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff1380683b0 0x7ff13806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.203+0000 7ff15d000640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff1380683b0 0x7ff13806a870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b2000 tx=0x7ff14c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:49.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.207+0000 7ff154c00640 1 -- 172.21.15.16:0/337367380 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff150057030 con 0x7ff15815bc50 2024-04-26T20:23:49.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.371+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1580c4940 con 0x7ff1380683b0 2024-04-26T20:23:49.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.395+0000 7ff154c00640 1 -- 172.21.15.16:0/337367380 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335205 (secure 0 0 0) 0x7ff1580c4940 con 0x7ff1380683b0 2024-04-26T20:23:49.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:23:49.407 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:23:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff1380683b0 msgr2=0x7ff13806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff1380683b0 0x7ff13806a870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b2000 tx=0x7ff14c009040 comp rx=0 tx=0).stop 2024-04-26T20:23:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15815bc50 msgr2=0x7ff158146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15815bc50 0x7ff158146630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff150007de0 tx=0x7ff15000d490 comp rx=0 tx=0).stop 2024-04-26T20:23:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 shutdown_connections 2024-04-26T20:23:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff1380683b0 0x7ff13806a870 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15815bc50 0x7ff158146630 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff158151e70 0x7ff15815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 --2- 172.21.15.16:0/337367380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff158073ad0 0x7ff158145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 >> 172.21.15.16:0/337367380 conn(0x7ff15806c380 msgr2=0x7ff158156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 shutdown_connections 2024-04-26T20:23:49.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.399+0000 7ff15fa00640 1 -- 172.21.15.16:0/337367380 wait complete. 2024-04-26T20:23:49.422 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-04-26T20:23:49.193131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":143359431,"num_objects":113,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":1881,"num_read_kb":3686740,"num_write":31542,"num_write_kb":4365534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46516,"ondisk_log_size":46516,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":687256,"kb_used_data":97880,"kb_used_omap":12,"kb_used_meta":589299,"kb_avail":754287464,"statfs":{"total":773094113280,"available":772390363136,"internally_reserved":0,"allocated":100229120,"data_stored":288108114,"data_compressed":42972754,"data_compressed_allocated":56221696,"data_compressed_original":245776384,"omap_allocated":12752,"internal_metadata":603442736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2955762,"num_objects":-623,"num_object_clones":0,"num_object_copies":-2484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-623,"num_whiteouts":0,"num_read":12,"num_read_kb":80,"num_write":754,"num_write_kb":2819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004647"},"pg_stats":[{"pgid":"2.1f","version":"31'137","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.621292+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:23:37.621292+0000","last_peered":"2024-04-26T20:23:37.621292+0000","last_clean":"2024-04-26T20:23:37.621292+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:23:37.621292+0000","last_undegraded":"2024-04-26T20:23:37.621292+0000","last_fullsized":"2024-04-26T20:23:37.621292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:33.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":4124,"num_write":97,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'191","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.629797+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:23:45.629797+0000","last_peered":"2024-04-26T20:23:45.629797+0000","last_clean":"2024-04-26T20:23:45.629797+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:23:45.629797+0000","last_undegraded":"2024-04-26T20:23:45.629797+0000","last_fullsized":"2024-04-26T20:23:45.629797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'819","reported_seq":889,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.642408+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:23:45.642408+0000","last_peered":"2024-04-26T20:23:45.642408+0000","last_clean":"2024-04-26T20:23:45.642408+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:23:45.642408+0000","last_undegraded":"2024-04-26T20:23:45.642408+0000","last_fullsized":"2024-04-26T20:23:45.642408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17992,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":127167,"num_write":791,"num_write_kb":160617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'67","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.544019+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:23:34.544019+0000","last_peered":"2024-04-26T20:23:34.544019+0000","last_clean":"2024-04-26T20:23:34.544019+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:23:34.544019+0000","last_undegraded":"2024-04-26T20:23:34.544019+0000","last_fullsized":"2024-04-26T20:23:34.544019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":16,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'178","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.541648+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:23:42.541648+0000","last_peered":"2024-04-26T20:23:42.541648+0000","last_clean":"2024-04-26T20:23:42.541648+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:23:42.541648+0000","last_undegraded":"2024-04-26T20:23:42.541648+0000","last_fullsized":"2024-04-26T20:23:42.541648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:17.416785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'782","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.640133+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:23:45.640133+0000","last_peered":"2024-04-26T20:23:45.640133+0000","last_clean":"2024-04-26T20:23:45.640133+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:23:45.640133+0000","last_undegraded":"2024-04-26T20:23:45.640133+0000","last_fullsized":"2024-04-26T20:23:45.640133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":94315,"num_write":747,"num_write_kb":130983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'211","reported_seq":254,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.589002+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:23:45.589002+0000","last_peered":"2024-04-26T20:23:45.589002+0000","last_clean":"2024-04-26T20:23:45.589002+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:23:45.589002+0000","last_undegraded":"2024-04-26T20:23:45.589002+0000","last_fullsized":"2024-04-26T20:23:45.589002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12305,"num_write":138,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'175","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.581786+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:23:42.581786+0000","last_peered":"2024-04-26T20:23:42.581786+0000","last_clean":"2024-04-26T20:23:42.581786+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:23:42.581786+0000","last_undegraded":"2024-04-26T20:23:42.581786+0000","last_fullsized":"2024-04-26T20:23:42.581786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'765","reported_seq":830,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.651865+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:23:45.651865+0000","last_peered":"2024-04-26T20:23:45.651865+0000","last_clean":"2024-04-26T20:23:45.651865+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:23:45.651865+0000","last_undegraded":"2024-04-26T20:23:45.651865+0000","last_fullsized":"2024-04-26T20:23:45.651865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":92426,"num_write":730,"num_write_kb":119140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'165","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.516574+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:23:42.516574+0000","last_peered":"2024-04-26T20:23:42.516574+0000","last_clean":"2024-04-26T20:23:42.516574+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:23:42.516574+0000","last_undegraded":"2024-04-26T20:23:42.516574+0000","last_fullsized":"2024-04-26T20:23:42.516574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":110,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'179","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.611520+0000","last_change":"2024-04-26T20:15:02.201407+0000","last_active":"2024-04-26T20:23:45.611520+0000","last_peered":"2024-04-26T20:23:45.611520+0000","last_clean":"2024-04-26T20:23:45.611520+0000","last_became_active":"2024-04-26T20:15:02.201092+0000","last_became_peered":"2024-04-26T20:15:02.201092+0000","last_unstale":"2024-04-26T20:23:45.611520+0000","last_undegraded":"2024-04-26T20:23:45.611520+0000","last_fullsized":"2024-04-26T20:23:45.611520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:14.070151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'807","reported_seq":873,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.643281+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:23:45.643281+0000","last_peered":"2024-04-26T20:23:45.643281+0000","last_clean":"2024-04-26T20:23:45.643281+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:23:45.643281+0000","last_undegraded":"2024-04-26T20:23:45.643281+0000","last_fullsized":"2024-04-26T20:23:45.643281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":115919,"num_write":775,"num_write_kb":110976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'211","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.604564+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:23:45.604564+0000","last_peered":"2024-04-26T20:23:45.604564+0000","last_clean":"2024-04-26T20:23:45.604564+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:23:45.604564+0000","last_undegraded":"2024-04-26T20:23:45.604564+0000","last_fullsized":"2024-04-26T20:23:45.604564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'161","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.604403+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:23:37.604403+0000","last_peered":"2024-04-26T20:23:37.604403+0000","last_clean":"2024-04-26T20:23:37.604403+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:23:37.604403+0000","last_undegraded":"2024-04-26T20:23:37.604403+0000","last_fullsized":"2024-04-26T20:23:37.604403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":106,"num_write_kb":8336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'790","reported_seq":857,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.594430+0000","last_change":"2024-04-26T20:15:02.208844+0000","last_active":"2024-04-26T20:23:45.594430+0000","last_peered":"2024-04-26T20:23:45.594430+0000","last_clean":"2024-04-26T20:23:45.594430+0000","last_became_active":"2024-04-26T20:15:02.207782+0000","last_became_peered":"2024-04-26T20:15:02.207782+0000","last_unstale":"2024-04-26T20:23:45.594430+0000","last_undegraded":"2024-04-26T20:23:45.594430+0000","last_fullsized":"2024-04-26T20:23:45.594430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":86223,"num_write":746,"num_write_kb":106297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'203","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.583443+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:23:37.583443+0000","last_peered":"2024-04-26T20:23:37.583443+0000","last_clean":"2024-04-26T20:23:37.583443+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:23:37.583443+0000","last_undegraded":"2024-04-26T20:23:37.583443+0000","last_fullsized":"2024-04-26T20:23:37.583443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'166","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.525300+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:23:30.525300+0000","last_peered":"2024-04-26T20:23:30.525300+0000","last_clean":"2024-04-26T20:23:30.525300+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:23:30.525300+0000","last_undegraded":"2024-04-26T20:23:30.525300+0000","last_fullsized":"2024-04-26T20:23:30.525300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:43.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4098,"num_write":113,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'845","reported_seq":901,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.546704+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:23:45.546704+0000","last_peered":"2024-04-26T20:23:45.546704+0000","last_clean":"2024-04-26T20:23:45.546704+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:23:45.546704+0000","last_undegraded":"2024-04-26T20:23:45.546704+0000","last_fullsized":"2024-04-26T20:23:45.546704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17976,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":76471,"num_write":803,"num_write_kb":93343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.910809+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:23:37.910809+0000","last_peered":"2024-04-26T20:23:37.910809+0000","last_clean":"2024-04-26T20:23:37.910809+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:23:37.910809+0000","last_undegraded":"2024-04-26T20:23:37.910809+0000","last_fullsized":"2024-04-26T20:23:37.910809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'60","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.686993+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:23:34.686993+0000","last_peered":"2024-04-26T20:23:34.686993+0000","last_clean":"2024-04-26T20:23:34.686993+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:23:34.686993+0000","last_undegraded":"2024-04-26T20:23:34.686993+0000","last_fullsized":"2024-04-26T20:23:34.686993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:46.305983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'793","reported_seq":871,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.670610+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:23:45.670610+0000","last_peered":"2024-04-26T20:23:45.670610+0000","last_clean":"2024-04-26T20:23:45.670610+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:23:45.670610+0000","last_undegraded":"2024-04-26T20:23:45.670610+0000","last_fullsized":"2024-04-26T20:23:45.670610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:48.710290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":121482,"num_write":758,"num_write_kb":114987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'218","reported_seq":254,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.650028+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:23:45.650028+0000","last_peered":"2024-04-26T20:23:45.650028+0000","last_clean":"2024-04-26T20:23:45.650028+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:23:45.650028+0000","last_undegraded":"2024-04-26T20:23:45.650028+0000","last_fullsized":"2024-04-26T20:23:45.650028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'442","reported_seq":483,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.556262+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:23:37.556262+0000","last_peered":"2024-04-26T20:23:37.556262+0000","last_clean":"2024-04-26T20:23:37.556262+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:23:37.556262+0000","last_undegraded":"2024-04-26T20:23:37.556262+0000","last_fullsized":"2024-04-26T20:23:37.556262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":388,"num_write_kb":4324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'736","reported_seq":794,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.700926+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:23:45.700926+0000","last_peered":"2024-04-26T20:23:45.700926+0000","last_clean":"2024-04-26T20:23:45.700926+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:23:45.700926+0000","last_undegraded":"2024-04-26T20:23:45.700926+0000","last_fullsized":"2024-04-26T20:23:45.700926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":863,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":100836,"num_write":690,"num_write_kb":105101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'215","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.704682+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:23:45.704682+0000","last_peered":"2024-04-26T20:23:45.704682+0000","last_clean":"2024-04-26T20:23:45.704682+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:23:45.704682+0000","last_undegraded":"2024-04-26T20:23:45.704682+0000","last_fullsized":"2024-04-26T20:23:45.704682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:25.251188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'62","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.874273+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:23:37.874273+0000","last_peered":"2024-04-26T20:23:37.874273+0000","last_clean":"2024-04-26T20:23:37.874273+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:23:37.874273+0000","last_undegraded":"2024-04-26T20:23:37.874273+0000","last_fullsized":"2024-04-26T20:23:37.874273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'832","reported_seq":926,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.671642+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:23:45.671642+0000","last_peered":"2024-04-26T20:23:45.671642+0000","last_clean":"2024-04-26T20:23:45.671642+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:23:45.671642+0000","last_undegraded":"2024-04-26T20:23:45.671642+0000","last_fullsized":"2024-04-26T20:23:45.671642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":203084,"num_write":796,"num_write_kb":205909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'171","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.876269+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:23:37.876269+0000","last_peered":"2024-04-26T20:23:37.876269+0000","last_clean":"2024-04-26T20:23:37.876269+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:23:37.876269+0000","last_undegraded":"2024-04-26T20:23:37.876269+0000","last_fullsized":"2024-04-26T20:23:37.876269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'400","reported_seq":443,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.617838+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:23:45.617838+0000","last_peered":"2024-04-26T20:23:45.617838+0000","last_clean":"2024-04-26T20:23:45.617838+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:23:45.617838+0000","last_undegraded":"2024-04-26T20:23:45.617838+0000","last_fullsized":"2024-04-26T20:23:45.617838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:48.795605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":840,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'787","reported_seq":837,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.600587+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:23:45.600587+0000","last_peered":"2024-04-26T20:23:45.600587+0000","last_clean":"2024-04-26T20:23:45.600587+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:23:45.600587+0000","last_undegraded":"2024-04-26T20:23:45.600587+0000","last_fullsized":"2024-04-26T20:23:45.600587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":65331,"num_write":754,"num_write_kb":82709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'193","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.614160+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:23:45.614160+0000","last_peered":"2024-04-26T20:23:45.614160+0000","last_clean":"2024-04-26T20:23:45.614160+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:23:45.614160+0000","last_undegraded":"2024-04-26T20:23:45.614160+0000","last_fullsized":"2024-04-26T20:23:45.614160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:05.900381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'199","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.535719+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:23:37.535719+0000","last_peered":"2024-04-26T20:23:37.535719+0000","last_clean":"2024-04-26T20:23:37.535719+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:23:37.535719+0000","last_undegraded":"2024-04-26T20:23:37.535719+0000","last_fullsized":"2024-04-26T20:23:37.535719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":138,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'760","reported_seq":817,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.624835+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:23:45.624835+0000","last_peered":"2024-04-26T20:23:45.624835+0000","last_clean":"2024-04-26T20:23:45.624835+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:23:45.624835+0000","last_undegraded":"2024-04-26T20:23:45.624835+0000","last_fullsized":"2024-04-26T20:23:45.624835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.707369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":72924,"num_write":718,"num_write_kb":105217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'209","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.677841+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:23:45.677841+0000","last_peered":"2024-04-26T20:23:45.677841+0000","last_clean":"2024-04-26T20:23:45.677841+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:23:45.677841+0000","last_undegraded":"2024-04-26T20:23:45.677841+0000","last_fullsized":"2024-04-26T20:23:45.677841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'56","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.571100+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:23:37.571100+0000","last_peered":"2024-04-26T20:23:37.571100+0000","last_clean":"2024-04-26T20:23:37.571100+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:23:37.571100+0000","last_undegraded":"2024-04-26T20:23:37.571100+0000","last_fullsized":"2024-04-26T20:23:37.571100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'791","reported_seq":844,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.593361+0000","last_change":"2024-04-26T20:15:02.206054+0000","last_active":"2024-04-26T20:23:45.593361+0000","last_peered":"2024-04-26T20:23:45.593361+0000","last_clean":"2024-04-26T20:23:45.593361+0000","last_became_active":"2024-04-26T20:15:02.205610+0000","last_became_peered":"2024-04-26T20:15:02.205610+0000","last_unstale":"2024-04-26T20:23:45.593361+0000","last_undegraded":"2024-04-26T20:23:45.593361+0000","last_fullsized":"2024-04-26T20:23:45.593361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:16.507443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":101392,"num_write":762,"num_write_kb":117505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'191","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.559287+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:23:42.559287+0000","last_peered":"2024-04-26T20:23:42.559287+0000","last_clean":"2024-04-26T20:23:42.559287+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:23:42.559287+0000","last_undegraded":"2024-04-26T20:23:42.559287+0000","last_fullsized":"2024-04-26T20:23:42.559287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'623","reported_seq":662,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.690568+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:23:22.690568+0000","last_peered":"2024-04-26T20:23:22.690568+0000","last_clean":"2024-04-26T20:23:22.690568+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:23:22.690568+0000","last_undegraded":"2024-04-26T20:23:22.690568+0000","last_fullsized":"2024-04-26T20:23:22.690568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":569,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'764","reported_seq":843,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.680715+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:23:45.680715+0000","last_peered":"2024-04-26T20:23:45.680715+0000","last_clean":"2024-04-26T20:23:45.680715+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:23:45.680715+0000","last_undegraded":"2024-04-26T20:23:45.680715+0000","last_fullsized":"2024-04-26T20:23:45.680715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:33:39.851673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6566,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":139574,"num_write":731,"num_write_kb":123608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.653449+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:23:37.653449+0000","last_peered":"2024-04-26T20:23:37.653449+0000","last_clean":"2024-04-26T20:23:37.653449+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:23:37.653449+0000","last_undegraded":"2024-04-26T20:23:37.653449+0000","last_fullsized":"2024-04-26T20:23:37.653449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:18.451516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'362","reported_seq":696,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.466492+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:23:45.466492+0000","last_peered":"2024-04-26T20:23:45.466492+0000","last_clean":"2024-04-26T20:23:45.466492+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:23:45.466492+0000","last_undegraded":"2024-04-26T20:23:45.466492+0000","last_fullsized":"2024-04-26T20:23:45.466492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:34.786233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548516,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":304,"num_read_kb":1720,"num_write":299,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'750","reported_seq":803,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.650772+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:23:45.650772+0000","last_peered":"2024-04-26T20:23:45.650772+0000","last_clean":"2024-04-26T20:23:45.650772+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:23:45.650772+0000","last_undegraded":"2024-04-26T20:23:45.650772+0000","last_fullsized":"2024-04-26T20:23:45.650772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:01.792569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":61996,"num_write":721,"num_write_kb":88897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'190","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.541495+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:23:45.541495+0000","last_peered":"2024-04-26T20:23:45.541495+0000","last_clean":"2024-04-26T20:23:45.541495+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:23:45.541495+0000","last_undegraded":"2024-04-26T20:23:45.541495+0000","last_fullsized":"2024-04-26T20:23:45.541495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:18.016167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'272","reported_seq":317,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.511693+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:23:37.511693+0000","last_peered":"2024-04-26T20:23:37.511693+0000","last_clean":"2024-04-26T20:23:37.511693+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:23:37.511693+0000","last_undegraded":"2024-04-26T20:23:37.511693+0000","last_fullsized":"2024-04-26T20:23:37.511693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":213,"num_write_kb":8309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'884","reported_seq":946,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.704749+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:23:45.704749+0000","last_peered":"2024-04-26T20:23:45.704749+0000","last_clean":"2024-04-26T20:23:45.704749+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:23:45.704749+0000","last_undegraded":"2024-04-26T20:23:45.704749+0000","last_fullsized":"2024-04-26T20:23:45.704749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:24.501662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":98068,"num_write":848,"num_write_kb":148105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'185","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.494905+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:23:45.494905+0000","last_peered":"2024-04-26T20:23:45.494905+0000","last_clean":"2024-04-26T20:23:45.494905+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:23:45.494905+0000","last_undegraded":"2024-04-26T20:23:45.494905+0000","last_fullsized":"2024-04-26T20:23:45.494905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'80","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.600749+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:23:45.600749+0000","last_peered":"2024-04-26T20:23:45.600749+0000","last_clean":"2024-04-26T20:23:45.600749+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:23:45.600749+0000","last_undegraded":"2024-04-26T20:23:45.600749+0000","last_fullsized":"2024-04-26T20:23:45.600749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":13,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:21:52.220087+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:21:52.220087+0000","last_peered":"2024-04-26T20:21:52.220087+0000","last_clean":"2024-04-26T20:21:52.220087+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:21:52.220087+0000","last_undegraded":"2024-04-26T20:21:52.220087+0000","last_fullsized":"2024-04-26T20:21:52.220087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'776","reported_seq":836,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.679350+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:23:45.679350+0000","last_peered":"2024-04-26T20:23:45.679350+0000","last_clean":"2024-04-26T20:23:45.679350+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:23:45.679350+0000","last_undegraded":"2024-04-26T20:23:45.679350+0000","last_fullsized":"2024-04-26T20:23:45.679350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":82002,"num_write":745,"num_write_kb":109731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.719573+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:23:37.719573+0000","last_peered":"2024-04-26T20:23:37.719573+0000","last_clean":"2024-04-26T20:23:37.719573+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:23:37.719573+0000","last_undegraded":"2024-04-26T20:23:37.719573+0000","last_fullsized":"2024-04-26T20:23:37.719573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'69","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.470561+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:23:42.470561+0000","last_peered":"2024-04-26T20:23:42.470561+0000","last_clean":"2024-04-26T20:23:42.470561+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:23:42.470561+0000","last_undegraded":"2024-04-26T20:23:42.470561+0000","last_fullsized":"2024-04-26T20:23:42.470561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:05.233841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'857","reported_seq":937,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.604690+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:23:45.604690+0000","last_peered":"2024-04-26T20:23:45.604690+0000","last_clean":"2024-04-26T20:23:45.604690+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:23:45.604690+0000","last_undegraded":"2024-04-26T20:23:45.604690+0000","last_fullsized":"2024-04-26T20:23:45.604690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6905,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":152120,"num_write":817,"num_write_kb":168870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'211","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.545933+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:23:45.545933+0000","last_peered":"2024-04-26T20:23:45.545933+0000","last_clean":"2024-04-26T20:23:45.545933+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:23:45.545933+0000","last_undegraded":"2024-04-26T20:23:45.545933+0000","last_fullsized":"2024-04-26T20:23:45.545933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'562","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.702386+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:23:34.702386+0000","last_peered":"2024-04-26T20:23:34.702386+0000","last_clean":"2024-04-26T20:23:34.702386+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:23:34.702386+0000","last_undegraded":"2024-04-26T20:23:34.702386+0000","last_fullsized":"2024-04-26T20:23:34.702386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:36.962154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":503,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'815","reported_seq":894,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.484953+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:23:45.484953+0000","last_peered":"2024-04-26T20:23:45.484953+0000","last_clean":"2024-04-26T20:23:45.484953+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:23:45.484953+0000","last_undegraded":"2024-04-26T20:23:45.484953+0000","last_fullsized":"2024-04-26T20:23:45.484953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.011710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":135112,"num_write":782,"num_write_kb":135635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'193","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.631452+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:23:45.631452+0000","last_peered":"2024-04-26T20:23:45.631452+0000","last_clean":"2024-04-26T20:23:45.631452+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:23:45.631452+0000","last_undegraded":"2024-04-26T20:23:45.631452+0000","last_fullsized":"2024-04-26T20:23:45.631452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'280","reported_seq":320,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.479572+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:23:30.479572+0000","last_peered":"2024-04-26T20:23:30.479572+0000","last_clean":"2024-04-26T20:23:30.479572+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:23:30.479572+0000","last_undegraded":"2024-04-26T20:23:30.479572+0000","last_fullsized":"2024-04-26T20:23:30.479572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:33.732367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":224,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'844","reported_seq":917,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.522767+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:23:42.522767+0000","last_peered":"2024-04-26T20:23:42.522767+0000","last_clean":"2024-04-26T20:23:42.522767+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:23:42.522767+0000","last_undegraded":"2024-04-26T20:23:42.522767+0000","last_fullsized":"2024-04-26T20:23:42.522767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4116,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":124531,"num_write":807,"num_write_kb":151625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'175","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.514605+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:23:45.514605+0000","last_peered":"2024-04-26T20:23:45.514605+0000","last_clean":"2024-04-26T20:23:45.514605+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:23:45.514605+0000","last_undegraded":"2024-04-26T20:23:45.514605+0000","last_fullsized":"2024-04-26T20:23:45.514605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'211","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.471464+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:23:45.471464+0000","last_peered":"2024-04-26T20:23:45.471464+0000","last_clean":"2024-04-26T20:23:45.471464+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:23:45.471464+0000","last_undegraded":"2024-04-26T20:23:45.471464+0000","last_fullsized":"2024-04-26T20:23:45.471464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":4101,"num_write":169,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'867","reported_seq":942,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.652628+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:23:45.652628+0000","last_peered":"2024-04-26T20:23:45.652628+0000","last_clean":"2024-04-26T20:23:45.652628+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:23:45.652628+0000","last_undegraded":"2024-04-26T20:23:45.652628+0000","last_fullsized":"2024-04-26T20:23:45.652628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":151765,"num_write":832,"num_write_kb":200590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'231","reported_seq":267,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.689989+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:23:45.689989+0000","last_peered":"2024-04-26T20:23:45.689989+0000","last_clean":"2024-04-26T20:23:45.689989+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:23:45.689989+0000","last_undegraded":"2024-04-26T20:23:45.689989+0000","last_fullsized":"2024-04-26T20:23:45.689989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'347","reported_seq":399,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:44.532202+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:23:44.532202+0000","last_peered":"2024-04-26T20:23:44.532202+0000","last_clean":"2024-04-26T20:23:44.532202+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:23:44.532202+0000","last_undegraded":"2024-04-26T20:23:44.532202+0000","last_fullsized":"2024-04-26T20:23:44.532202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:20.477635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6893535,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":299,"num_write_kb":6886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'793","reported_seq":854,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.602747+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:23:45.602747+0000","last_peered":"2024-04-26T20:23:45.602747+0000","last_clean":"2024-04-26T20:23:45.602747+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:23:45.602747+0000","last_undegraded":"2024-04-26T20:23:45.602747+0000","last_fullsized":"2024-04-26T20:23:45.602747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:00.526751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17847,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":112649,"num_write":765,"num_write_kb":135273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'211","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.531523+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:23:45.531523+0000","last_peered":"2024-04-26T20:23:45.531523+0000","last_clean":"2024-04-26T20:23:45.531523+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:23:45.531523+0000","last_undegraded":"2024-04-26T20:23:45.531523+0000","last_fullsized":"2024-04-26T20:23:45.531523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'69","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.596031+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:23:30.596031+0000","last_peered":"2024-04-26T20:23:30.596031+0000","last_clean":"2024-04-26T20:23:30.596031+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:23:30.596031+0000","last_undegraded":"2024-04-26T20:23:30.596031+0000","last_fullsized":"2024-04-26T20:23:30.596031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'770","reported_seq":827,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.544705+0000","last_change":"2024-04-26T20:15:02.257901+0000","last_active":"2024-04-26T20:23:45.544705+0000","last_peered":"2024-04-26T20:23:45.544705+0000","last_clean":"2024-04-26T20:23:45.544705+0000","last_became_active":"2024-04-26T20:15:02.257484+0000","last_became_peered":"2024-04-26T20:15:02.257484+0000","last_unstale":"2024-04-26T20:23:45.544705+0000","last_undegraded":"2024-04-26T20:23:45.544705+0000","last_fullsized":"2024-04-26T20:23:45.544705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:35.589446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17658,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":40921,"num_write":733,"num_write_kb":85912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'191","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.557078+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:23:45.557078+0000","last_peered":"2024-04-26T20:23:45.557078+0000","last_clean":"2024-04-26T20:23:45.557078+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:23:45.557078+0000","last_undegraded":"2024-04-26T20:23:45.557078+0000","last_fullsized":"2024-04-26T20:23:45.557078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'62","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.554023+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:23:37.554023+0000","last_peered":"2024-04-26T20:23:37.554023+0000","last_clean":"2024-04-26T20:23:37.554023+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:23:37.554023+0000","last_undegraded":"2024-04-26T20:23:37.554023+0000","last_fullsized":"2024-04-26T20:23:37.554023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":20,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'711","reported_seq":773,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.626304+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:23:45.626304+0000","last_peered":"2024-04-26T20:23:45.626304+0000","last_clean":"2024-04-26T20:23:45.626304+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:23:45.626304+0000","last_undegraded":"2024-04-26T20:23:45.626304+0000","last_fullsized":"2024-04-26T20:23:45.626304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":103743,"num_write":683,"num_write_kb":106165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'204","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.610901+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:23:45.610901+0000","last_peered":"2024-04-26T20:23:45.610901+0000","last_clean":"2024-04-26T20:23:45.610901+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:23:45.610901+0000","last_undegraded":"2024-04-26T20:23:45.610901+0000","last_fullsized":"2024-04-26T20:23:45.610901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.131968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'630","reported_seq":678,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.447673+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:23:37.447673+0000","last_peered":"2024-04-26T20:23:37.447673+0000","last_clean":"2024-04-26T20:23:37.447673+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:23:37.447673+0000","last_undegraded":"2024-04-26T20:23:37.447673+0000","last_fullsized":"2024-04-26T20:23:37.447673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:51.664754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":8218,"num_write":576,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'725","reported_seq":773,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.684907+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:23:45.684907+0000","last_peered":"2024-04-26T20:23:45.684907+0000","last_clean":"2024-04-26T20:23:45.684907+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:23:45.684907+0000","last_undegraded":"2024-04-26T20:23:45.684907+0000","last_fullsized":"2024-04-26T20:23:45.684907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":67432,"num_write":694,"num_write_kb":88740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'192","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.656715+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:23:45.656715+0000","last_peered":"2024-04-26T20:23:45.656715+0000","last_clean":"2024-04-26T20:23:45.656715+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:23:45.656715+0000","last_undegraded":"2024-04-26T20:23:45.656715+0000","last_fullsized":"2024-04-26T20:23:45.656715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'416","reported_seq":461,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.589389+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:23:34.589389+0000","last_peered":"2024-04-26T20:23:34.589389+0000","last_clean":"2024-04-26T20:23:34.589389+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:23:34.589389+0000","last_undegraded":"2024-04-26T20:23:34.589389+0000","last_fullsized":"2024-04-26T20:23:34.589389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":8203,"num_write":362,"num_write_kb":12499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'826","reported_seq":890,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.620456+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:23:45.620456+0000","last_peered":"2024-04-26T20:23:45.620456+0000","last_clean":"2024-04-26T20:23:45.620456+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:23:45.620456+0000","last_undegraded":"2024-04-26T20:23:45.620456+0000","last_fullsized":"2024-04-26T20:23:45.620456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.557945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10024,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":109998,"num_write":785,"num_write_kb":139293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'186","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.546032+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:23:45.546032+0000","last_peered":"2024-04-26T20:23:45.546032+0000","last_clean":"2024-04-26T20:23:45.546032+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:23:45.546032+0000","last_undegraded":"2024-04-26T20:23:45.546032+0000","last_fullsized":"2024-04-26T20:23:45.546032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'402","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.876763+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:23:42.876763+0000","last_peered":"2024-04-26T20:23:42.876763+0000","last_clean":"2024-04-26T20:23:42.876763+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:23:42.876763+0000","last_undegraded":"2024-04-26T20:23:42.876763+0000","last_fullsized":"2024-04-26T20:23:42.876763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:26.731420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":353,"num_write_kb":4643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'787","reported_seq":854,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.657571+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:23:45.657571+0000","last_peered":"2024-04-26T20:23:45.657571+0000","last_clean":"2024-04-26T20:23:45.657571+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:23:45.657571+0000","last_undegraded":"2024-04-26T20:23:45.657571+0000","last_fullsized":"2024-04-26T20:23:45.657571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":119092,"num_write":739,"num_write_kb":148060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'189","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.527113+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:23:45.527113+0000","last_peered":"2024-04-26T20:23:45.527113+0000","last_clean":"2024-04-26T20:23:45.527113+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:23:45.527113+0000","last_undegraded":"2024-04-26T20:23:45.527113+0000","last_fullsized":"2024-04-26T20:23:45.527113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:37.440516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'112","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.561564+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:23:42.561564+0000","last_peered":"2024-04-26T20:23:42.561564+0000","last_clean":"2024-04-26T20:23:42.561564+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:23:42.561564+0000","last_undegraded":"2024-04-26T20:23:42.561564+0000","last_fullsized":"2024-04-26T20:23:42.561564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":58,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'870","reported_seq":943,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.669266+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:23:45.669266+0000","last_peered":"2024-04-26T20:23:45.669266+0000","last_clean":"2024-04-26T20:23:45.669266+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:23:45.669266+0000","last_undegraded":"2024-04-26T20:23:45.669266+0000","last_fullsized":"2024-04-26T20:23:45.669266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":142355,"num_write":826,"num_write_kb":159668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'212","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.524762+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:23:42.524762+0000","last_peered":"2024-04-26T20:23:42.524762+0000","last_clean":"2024-04-26T20:23:42.524762+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:23:42.524762+0000","last_undegraded":"2024-04-26T20:23:42.524762+0000","last_fullsized":"2024-04-26T20:23:42.524762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'67","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.660148+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:23:34.660148+0000","last_peered":"2024-04-26T20:23:34.660148+0000","last_clean":"2024-04-26T20:23:34.660148+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:23:34.660148+0000","last_undegraded":"2024-04-26T20:23:34.660148+0000","last_fullsized":"2024-04-26T20:23:34.660148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'925","reported_seq":1034,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.685574+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:23:45.685574+0000","last_peered":"2024-04-26T20:23:45.685574+0000","last_clean":"2024-04-26T20:23:45.685574+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:23:45.685574+0000","last_undegraded":"2024-04-26T20:23:45.685574+0000","last_fullsized":"2024-04-26T20:23:45.685574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":239056,"num_write":898,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'787","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.633679+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:23:45.633679+0000","last_peered":"2024-04-26T20:23:45.633679+0000","last_clean":"2024-04-26T20:23:45.633679+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:23:45.633679+0000","last_undegraded":"2024-04-26T20:23:45.633679+0000","last_fullsized":"2024-04-26T20:23:45.633679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:46.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":94596,"num_write":747,"num_write_kb":94412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'201","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.641559+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:23:45.641559+0000","last_peered":"2024-04-26T20:23:45.641559+0000","last_clean":"2024-04-26T20:23:45.641559+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:23:45.641559+0000","last_undegraded":"2024-04-26T20:23:45.641559+0000","last_fullsized":"2024-04-26T20:23:45.641559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:40.729839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'800","reported_seq":838,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.463636+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:23:30.463636+0000","last_peered":"2024-04-26T20:23:30.463636+0000","last_clean":"2024-04-26T20:23:30.463636+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:23:30.463636+0000","last_undegraded":"2024-04-26T20:23:30.463636+0000","last_fullsized":"2024-04-26T20:23:30.463636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":733,"num_write_kb":8579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'775","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.485449+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:23:45.485449+0000","last_peered":"2024-04-26T20:23:45.485449+0000","last_clean":"2024-04-26T20:23:45.485449+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:23:45.485449+0000","last_undegraded":"2024-04-26T20:23:45.485449+0000","last_fullsized":"2024-04-26T20:23:45.485449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":124481,"num_write":743,"num_write_kb":150909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'212","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.591955+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:23:42.591955+0000","last_peered":"2024-04-26T20:23:42.591955+0000","last_clean":"2024-04-26T20:23:42.591955+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:23:42.591955+0000","last_undegraded":"2024-04-26T20:23:42.591955+0000","last_fullsized":"2024-04-26T20:23:42.591955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'108","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.511049+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:23:34.511049+0000","last_peered":"2024-04-26T20:23:34.511049+0000","last_clean":"2024-04-26T20:23:34.511049+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:23:34.511049+0000","last_undegraded":"2024-04-26T20:23:34.511049+0000","last_fullsized":"2024-04-26T20:23:34.511049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":58,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'495","reported_seq":540,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.512132+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:23:34.512132+0000","last_peered":"2024-04-26T20:23:34.512132+0000","last_clean":"2024-04-26T20:23:34.512132+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:23:34.512132+0000","last_undegraded":"2024-04-26T20:23:34.512132+0000","last_fullsized":"2024-04-26T20:23:34.512132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10061,"num_write":440,"num_write_kb":12524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'167","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.571001+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:23:45.571001+0000","last_peered":"2024-04-26T20:23:45.571001+0000","last_clean":"2024-04-26T20:23:45.571001+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:23:45.571001+0000","last_undegraded":"2024-04-26T20:23:45.571001+0000","last_fullsized":"2024-04-26T20:23:45.571001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:24.989612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'741","reported_seq":796,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.544043+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:23:45.544043+0000","last_peered":"2024-04-26T20:23:45.544043+0000","last_clean":"2024-04-26T20:23:45.544043+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:23:45.544043+0000","last_undegraded":"2024-04-26T20:23:45.544043+0000","last_fullsized":"2024-04-26T20:23:45.544043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:01.321414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":82664,"num_write":708,"num_write_kb":110622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'167","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:28.365031+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:23:28.365031+0000","last_peered":"2024-04-26T20:23:28.365031+0000","last_clean":"2024-04-26T20:23:28.365031+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:23:28.365031+0000","last_undegraded":"2024-04-26T20:23:28.365031+0000","last_fullsized":"2024-04-26T20:23:28.365031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195300,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":104,"num_write_kb":4157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'200","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.592422+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:23:45.592422+0000","last_peered":"2024-04-26T20:23:45.592422+0000","last_clean":"2024-04-26T20:23:45.592422+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:23:45.592422+0000","last_undegraded":"2024-04-26T20:23:45.592422+0000","last_fullsized":"2024-04-26T20:23:45.592422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'741","reported_seq":806,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.613022+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:23:45.613022+0000","last_peered":"2024-04-26T20:23:45.613022+0000","last_clean":"2024-04-26T20:23:45.613022+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:23:45.613022+0000","last_undegraded":"2024-04-26T20:23:45.613022+0000","last_fullsized":"2024-04-26T20:23:45.613022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":120190,"num_write":702,"num_write_kb":135097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'204","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.534565+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:23:45.534565+0000","last_peered":"2024-04-26T20:23:45.534565+0000","last_clean":"2024-04-26T20:23:45.534565+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:23:45.534565+0000","last_undegraded":"2024-04-26T20:23:45.534565+0000","last_fullsized":"2024-04-26T20:23:45.534565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'208","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.612577+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:23:45.612577+0000","last_peered":"2024-04-26T20:23:45.612577+0000","last_clean":"2024-04-26T20:23:45.612577+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:23:45.612577+0000","last_undegraded":"2024-04-26T20:23:45.612577+0000","last_fullsized":"2024-04-26T20:23:45.612577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:50.239732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'228","reported_seq":268,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.522545+0000","last_change":"2024-04-26T20:15:02.206712+0000","last_active":"2024-04-26T20:23:45.522545+0000","last_peered":"2024-04-26T20:23:45.522545+0000","last_clean":"2024-04-26T20:23:45.522545+0000","last_became_active":"2024-04-26T20:15:02.205525+0000","last_became_peered":"2024-04-26T20:15:02.205525+0000","last_unstale":"2024-04-26T20:23:45.522545+0000","last_undegraded":"2024-04-26T20:23:45.522545+0000","last_fullsized":"2024-04-26T20:23:45.522545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:45.077649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'195","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.618303+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:23:45.618303+0000","last_peered":"2024-04-26T20:23:45.618303+0000","last_clean":"2024-04-26T20:23:45.618303+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:23:45.618303+0000","last_undegraded":"2024-04-26T20:23:45.618303+0000","last_fullsized":"2024-04-26T20:23:45.618303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:30.993465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'185","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.886140+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:23:37.886140+0000","last_peered":"2024-04-26T20:23:37.886140+0000","last_clean":"2024-04-26T20:23:37.886140+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:23:37.886140+0000","last_undegraded":"2024-04-26T20:23:37.886140+0000","last_fullsized":"2024-04-26T20:23:37.886140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'191","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.566996+0000","last_change":"2024-04-26T20:14:14.458865+0000","last_active":"2024-04-26T20:23:42.566996+0000","last_peered":"2024-04-26T20:23:42.566996+0000","last_clean":"2024-04-26T20:23:42.566996+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:23:42.566996+0000","last_undegraded":"2024-04-26T20:23:42.566996+0000","last_fullsized":"2024-04-26T20:23:42.566996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:49.470647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'225","reported_seq":261,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.486595+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:23:45.486595+0000","last_peered":"2024-04-26T20:23:45.486595+0000","last_clean":"2024-04-26T20:23:45.486595+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:23:45.486595+0000","last_undegraded":"2024-04-26T20:23:45.486595+0000","last_fullsized":"2024-04-26T20:23:45.486595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.624464+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:23:45.624464+0000","last_peered":"2024-04-26T20:23:45.624464+0000","last_clean":"2024-04-26T20:23:45.624464+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:23:45.624464+0000","last_undegraded":"2024-04-26T20:23:45.624464+0000","last_fullsized":"2024-04-26T20:23:45.624464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'211","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.515048+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:23:42.515048+0000","last_peered":"2024-04-26T20:23:42.515048+0000","last_clean":"2024-04-26T20:23:42.515048+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:23:42.515048+0000","last_undegraded":"2024-04-26T20:23:42.515048+0000","last_fullsized":"2024-04-26T20:23:42.515048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.576334+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:23:45.576334+0000","last_peered":"2024-04-26T20:23:45.576334+0000","last_clean":"2024-04-26T20:23:45.576334+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:23:45.576334+0000","last_undegraded":"2024-04-26T20:23:45.576334+0000","last_fullsized":"2024-04-26T20:23:45.576334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'202","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.552817+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:23:42.552817+0000","last_peered":"2024-04-26T20:23:42.552817+0000","last_clean":"2024-04-26T20:23:42.552817+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:23:42.552817+0000","last_undegraded":"2024-04-26T20:23:42.552817+0000","last_fullsized":"2024-04-26T20:23:42.552817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'199","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.484789+0000","last_change":"2024-04-26T20:14:14.483945+0000","last_active":"2024-04-26T20:23:45.484789+0000","last_peered":"2024-04-26T20:23:45.484789+0000","last_clean":"2024-04-26T20:23:45.484789+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:23:45.484789+0000","last_undegraded":"2024-04-26T20:23:45.484789+0000","last_fullsized":"2024-04-26T20:23:45.484789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:26.324392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'212","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.883184+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:23:37.883184+0000","last_peered":"2024-04-26T20:23:37.883184+0000","last_clean":"2024-04-26T20:23:37.883184+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:23:37.883184+0000","last_undegraded":"2024-04-26T20:23:37.883184+0000","last_fullsized":"2024-04-26T20:23:37.883184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.593248+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:23:45.593248+0000","last_peered":"2024-04-26T20:23:45.593248+0000","last_clean":"2024-04-26T20:23:45.593248+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:23:45.593248+0000","last_undegraded":"2024-04-26T20:23:45.593248+0000","last_fullsized":"2024-04-26T20:23:45.593248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.698810+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:23:45.698810+0000","last_peered":"2024-04-26T20:23:45.698810+0000","last_clean":"2024-04-26T20:23:45.698810+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:23:45.698810+0000","last_undegraded":"2024-04-26T20:23:45.698810+0000","last_fullsized":"2024-04-26T20:23:45.698810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.336461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'200","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.644246+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:23:45.644246+0000","last_peered":"2024-04-26T20:23:45.644246+0000","last_clean":"2024-04-26T20:23:45.644246+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:23:45.644246+0000","last_undegraded":"2024-04-26T20:23:45.644246+0000","last_fullsized":"2024-04-26T20:23:45.644246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"31'215","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.662631+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:23:45.662631+0000","last_peered":"2024-04-26T20:23:45.662631+0000","last_clean":"2024-04-26T20:23:45.662631+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:23:45.662631+0000","last_undegraded":"2024-04-26T20:23:45.662631+0000","last_fullsized":"2024-04-26T20:23:45.662631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'203","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.855149+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:23:37.855149+0000","last_peered":"2024-04-26T20:23:37.855149+0000","last_clean":"2024-04-26T20:23:37.855149+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:23:37.855149+0000","last_undegraded":"2024-04-26T20:23:37.855149+0000","last_fullsized":"2024-04-26T20:23:37.855149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:09.954092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'203","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.578911+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:23:45.578911+0000","last_peered":"2024-04-26T20:23:45.578911+0000","last_clean":"2024-04-26T20:23:45.578911+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:23:45.578911+0000","last_undegraded":"2024-04-26T20:23:45.578911+0000","last_fullsized":"2024-04-26T20:23:45.578911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:11.438796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.572541+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:23:42.572541+0000","last_peered":"2024-04-26T20:23:42.572541+0000","last_clean":"2024-04-26T20:23:42.572541+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:23:42.572541+0000","last_undegraded":"2024-04-26T20:23:42.572541+0000","last_fullsized":"2024-04-26T20:23:42.572541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'169","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.623638+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:23:45.623638+0000","last_peered":"2024-04-26T20:23:45.623638+0000","last_clean":"2024-04-26T20:23:45.623638+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:23:45.623638+0000","last_undegraded":"2024-04-26T20:23:45.623638+0000","last_fullsized":"2024-04-26T20:23:45.623638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'178","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.606304+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:23:45.606304+0000","last_peered":"2024-04-26T20:23:45.606304+0000","last_clean":"2024-04-26T20:23:45.606304+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:23:45.606304+0000","last_undegraded":"2024-04-26T20:23:45.606304+0000","last_fullsized":"2024-04-26T20:23:45.606304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.602059+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:23:45.602059+0000","last_peered":"2024-04-26T20:23:45.602059+0000","last_clean":"2024-04-26T20:23:45.602059+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:23:45.602059+0000","last_undegraded":"2024-04-26T20:23:45.602059+0000","last_fullsized":"2024-04-26T20:23:45.602059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'200","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.612649+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:23:42.612649+0000","last_peered":"2024-04-26T20:23:42.612649+0000","last_clean":"2024-04-26T20:23:42.612649+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:23:42.612649+0000","last_undegraded":"2024-04-26T20:23:42.612649+0000","last_fullsized":"2024-04-26T20:23:42.612649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'177","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.628251+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:23:45.628251+0000","last_peered":"2024-04-26T20:23:45.628251+0000","last_clean":"2024-04-26T20:23:45.628251+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:23:45.628251+0000","last_undegraded":"2024-04-26T20:23:45.628251+0000","last_fullsized":"2024-04-26T20:23:45.628251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'198","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.543638+0000","last_change":"2024-04-26T20:15:02.200465+0000","last_active":"2024-04-26T20:23:42.543638+0000","last_peered":"2024-04-26T20:23:42.543638+0000","last_clean":"2024-04-26T20:23:42.543638+0000","last_became_active":"2024-04-26T20:15:02.200094+0000","last_became_peered":"2024-04-26T20:15:02.200094+0000","last_unstale":"2024-04-26T20:23:42.543638+0000","last_undegraded":"2024-04-26T20:23:42.543638+0000","last_fullsized":"2024-04-26T20:23:42.543638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:04.049772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'186","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.634880+0000","last_change":"2024-04-26T20:15:02.201696+0000","last_active":"2024-04-26T20:23:45.634880+0000","last_peered":"2024-04-26T20:23:45.634880+0000","last_clean":"2024-04-26T20:23:45.634880+0000","last_became_active":"2024-04-26T20:15:02.201216+0000","last_became_peered":"2024-04-26T20:15:02.201216+0000","last_unstale":"2024-04-26T20:23:45.634880+0000","last_undegraded":"2024-04-26T20:23:45.634880+0000","last_fullsized":"2024-04-26T20:23:45.634880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:55.081488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.571572+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:23:45.571572+0000","last_peered":"2024-04-26T20:23:45.571572+0000","last_clean":"2024-04-26T20:23:45.571572+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:23:45.571572+0000","last_undegraded":"2024-04-26T20:23:45.571572+0000","last_fullsized":"2024-04-26T20:23:45.571572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'189","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.507105+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:23:42.507105+0000","last_peered":"2024-04-26T20:23:42.507105+0000","last_clean":"2024-04-26T20:23:42.507105+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:23:42.507105+0000","last_undegraded":"2024-04-26T20:23:42.507105+0000","last_fullsized":"2024-04-26T20:23:42.507105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'185","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.479335+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:23:42.479335+0000","last_peered":"2024-04-26T20:23:42.479335+0000","last_clean":"2024-04-26T20:23:42.479335+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:23:42.479335+0000","last_undegraded":"2024-04-26T20:23:42.479335+0000","last_fullsized":"2024-04-26T20:23:42.479335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:14.703462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'208","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.578413+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:23:45.578413+0000","last_peered":"2024-04-26T20:23:45.578413+0000","last_clean":"2024-04-26T20:23:45.578413+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:23:45.578413+0000","last_undegraded":"2024-04-26T20:23:45.578413+0000","last_fullsized":"2024-04-26T20:23:45.578413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:14.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'206","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.548498+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:23:42.548498+0000","last_peered":"2024-04-26T20:23:42.548498+0000","last_clean":"2024-04-26T20:23:42.548498+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:23:42.548498+0000","last_undegraded":"2024-04-26T20:23:42.548498+0000","last_fullsized":"2024-04-26T20:23:42.548498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":104830,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1174,"num_read_kb":3559915,"num_write":24376,"num_write_kb":4217550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":425984,"data_compressed":55598,"data_compressed_allocated":73728,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},"log_size":25515,"ondisk_log_size":25515,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12624,"ondisk_log_size":12624,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":142664233,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":591,"num_read_kb":126725,"num_write":7007,"num_write_kb":145568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97042432,"data_stored":285328466,"data_compressed":42850252,"data_compressed_allocated":56057856,"data_compressed_original":244498432,"omap_allocated":0,"internal_metadata":0},"log_size":8260,"ondisk_log_size":8260,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542263,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85772,"kb_used_data":14340,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286068,"statfs":{"total":96636764160,"available":96548933632,"internally_reserved":0,"allocated":14684160,"data_stored":51115378,"data_compressed":7666257,"data_compressed_allocated":9920512,"data_compressed_original":46563328,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542264,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88012,"kb_used_data":12420,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94283828,"statfs":{"total":96636764160,"available":96546639872,"internally_reserved":0,"allocated":12718080,"data_stored":46363134,"data_compressed":7223348,"data_compressed_allocated":9043968,"data_compressed_original":42893312,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542264,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83296,"kb_used_data":11864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94288544,"statfs":{"total":96636764160,"available":96551469056,"internally_reserved":0,"allocated":12148736,"data_stored":29532698,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542263,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106996,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94264844,"statfs":{"total":96636764160,"available":96527200256,"internally_reserved":0,"allocated":18001920,"data_stored":46325634,"data_compressed":6802023,"data_compressed_allocated":8986624,"data_compressed_original":37515264,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542263,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86520,"kb_used_data":10928,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285320,"statfs":{"total":96636764160,"available":96548167680,"internally_reserved":0,"allocated":11190272,"data_stored":35324960,"data_compressed":5472054,"data_compressed_allocated":6946816,"data_compressed_original":31293440,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542262,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55056,"kb_used_data":5832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316784,"statfs":{"total":96636764160,"available":96580386816,"internally_reserved":0,"allocated":5971968,"data_stored":12845027,"data_compressed":1803959,"data_compressed_allocated":2555904,"data_compressed_original":9641984,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542263,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107680,"kb_used_data":14104,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94264160,"statfs":{"total":96636764160,"available":96526499840,"internally_reserved":0,"allocated":14442496,"data_stored":36454359,"data_compressed":5391836,"data_compressed_allocated":7290880,"data_compressed_original":29515776,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542262,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":10812,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":11071488,"data_stored":30146924,"data_compressed":4443373,"data_compressed_allocated":5840896,"data_compressed_original":25124864,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":29360788,"data_compressed":4405923,"data_compressed_allocated":5791744,"data_compressed_original":24539136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14053376,"data_stored":36254495,"data_compressed":5391836,"data_compressed_allocated":7290880,"data_compressed_original":29515776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5582848,"data_stored":12636971,"data_compressed":1791004,"data_compressed_allocated":2539520,"data_compressed_original":9617408,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10801152,"data_stored":35104616,"data_compressed":5452892,"data_compressed_allocated":6918144,"data_compressed_original":31244288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17629184,"data_stored":46138058,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11788288,"data_stored":29361506,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12312576,"data_stored":46138694,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":50333338,"data_compressed":7629580,"data_compressed_allocated":9871360,"data_compressed_original":45977600,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":49152,"data_compressed":3998,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":53248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":61440,"data_compressed":12955,"data_compressed_allocated":16384,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":73728,"data_compressed":19162,"data_compressed_allocated":28672,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":40960,"data_compressed":6042,"data_compressed_allocated":8192,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":77824,"data_compressed":10216,"data_compressed_allocated":12288,"data_compressed_original":20480,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":45056,"data_compressed":3225,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:23:49.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:23:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e02a00640 1 Processor -- start 2024-04-26T20:23:49.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e02a00640 1 -- start start 2024-04-26T20:23:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e02a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4dfc1574b0 0x7f4dfc0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e02a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc0c63f0 0x7f4dfc164520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e02a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dfc0cb7f0 con 0x7f4dfc0b47e0 2024-04-26T20:23:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e02a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f4dfc0ccd80 con 0x7f4dfc1574b0 2024-04-26T20:23:49.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e02a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4dfc0c9e80 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfb400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4dfc0b47e0 0x7f4dfc06feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.16:46760/0 (socket says 172.21.15.16:46760) 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfb400640 1 -- 172.21.15.16:0/2650489986 learned_addr learned my addr 172.21.15.16:0/2650489986 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4e00a00640 1 --2- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc0c63f0 0x7f4dfc164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfbe00640 1 --2- 172.21.15.16:0/2650489986 >> v2:172.21.15.192:3300/0 conn(0x7f4dfc1574b0 0x7f4dfc0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfaa00640 1 -- 172.21.15.16:0/2650489986 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956241756 0 0) 0x7f4dfc0cb7f0 con 0x7f4dfc0b47e0 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfaa00640 1 -- 172.21.15.16:0/2650489986 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4de0003530 con 0x7f4dfc0b47e0 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfbe00640 1 -- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc0c63f0 msgr2=0x7f4dfc164520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfbe00640 1 --2- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc0c63f0 0x7f4dfc164520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfbe00640 1 -- 172.21.15.16:0/2650489986 >> v1:172.21.15.192:6789/0 conn(0x7f4dfc0b47e0 legacy=0x7f4dfc06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.603+0000 7f4dfbe00640 1 -- 172.21.15.16:0/2650489986 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc0ca0d0 con 0x7f4dfc1574b0 2024-04-26T20:23:49.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4dfbe00640 1 --2- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1574b0 0x7f4dfc0ca730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0097c0 tx=0x7f4dec01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa6253899150598 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4dfaa00640 1 -- 172.21.15.16:0/2650489986 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec0b2070 con 0x7f4dfc1574b0 2024-04-26T20:23:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4dfaa00640 1 -- 172.21.15.16:0/2650489986 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dec0ad640 con 0x7f4dfc1574b0 2024-04-26T20:23:49.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4dfaa00640 1 -- 172.21.15.16:0/2650489986 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec0ada10 con 0x7f4dfc1574b0 2024-04-26T20:23:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 -- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1574b0 msgr2=0x7f4dfc0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1574b0 0x7f4dfc0ca730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0097c0 tx=0x7f4dec01c4a0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 -- 172.21.15.16:0/2650489986 shutdown_connections 2024-04-26T20:23:49.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc0c63f0 0x7f4dfc164520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2650489986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc1574b0 0x7f4dfc0ca730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 -- 172.21.15.16:0/2650489986 >> 172.21.15.16:0/2650489986 conn(0x7f4dfc071160 msgr2=0x7f4dfc068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 -- 172.21.15.16:0/2650489986 shutdown_connections 2024-04-26T20:23:49.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.607+0000 7f4e02a00640 1 -- 172.21.15.16:0/2650489986 wait complete. 2024-04-26T20:23:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 Processor -- start 2024-04-26T20:23:49.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 -- start start 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc0b47e0 0x7f4dfc1f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dfc0c63f0 0x7f4dfc15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc1574b0 0x7f4dfc0ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc0705c0 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4dfc0ca3b0 con 0x7f4dfc0b47e0 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4dfc070740 con 0x7f4dfc1574b0 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dfc0c63f0 0x7f4dfc15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dfc0c63f0 0x7f4dfc15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44882/0 (socket says 172.21.15.16:44882) 2024-04-26T20:23:49.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 -- 172.21.15.16:0/2215209630 learned_addr learned my addr 172.21.15.16:0/2215209630 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfbe00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc0b47e0 0x7f4dfc1f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e00a00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc1574b0 0x7f4dfc0ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 -- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc1574b0 msgr2=0x7f4dfc0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc1574b0 0x7f4dfc0ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 -- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc0b47e0 msgr2=0x7f4dfc1f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc0b47e0 0x7f4dfc1f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 -- 172.21.15.16:0/2215209630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dfc152200 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4dfb400640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dfc0c63f0 0x7f4dfc15a320 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c420 tx=0x7f4de800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4df3e00640 1 -- 172.21.15.16:0/2215209630 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8017070 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4df3e00640 1 -- 172.21.15.16:0/2215209630 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de8005d10 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4df3e00640 1 -- 172.21.15.16:0/2215209630 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8007310 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dfc1524a0 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.611+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dfc157c70 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.615+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dfc077c20 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.615+0000 7f4df3e00640 1 -- 172.21.15.16:0/2215209630 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4de801a070 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.615+0000 7f4df3e00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4ddc068380 0x7f4ddc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:49.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.615+0000 7f4df3e00640 1 -- 172.21.15.16:0/2215209630 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f4de8086380 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.615+0000 7f4dfbe00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4ddc068380 0x7f4ddc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:49.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.615+0000 7f4dfbe00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4ddc068380 0x7f4ddc06a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0af000 tx=0x7f4dec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:49.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.619+0000 7f4df3e00640 1 -- 172.21.15.16:0/2215209630 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4de8055db0 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.787+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dfc1f58e0 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.787+0000 7f4df3e00640 1 -- 172.21.15.16:0/2215209630 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+19436 (secure 0 0 0) 0x7f4de805a0b0 con 0x7f4dfc0c63f0 2024-04-26T20:23:49.791 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:23:49.791 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:21:50.873943+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6835/1962586875":"2024-04-27T20:21:50.873892+0000","172.21.15.16:6836/1882507975":"2024-04-27T20:20:50.864042+0000","172.21.15.192:6838/2295577139":"2024-04-27T20:19:00.847936+0000","172.21.15.192:6836/2295577139":"2024-04-27T20:19:00.847936+0000","172.21.15.16:6837/1962586875":"2024-04-27T20:21:50.873892+0000","172.21.15.16:6833/3670477050":"2024-04-27T20:17:00.827028+0000","172.21.15.16:6834/1882507975":"2024-04-27T20:20:50.864042+0000","172.21.15.16:6832/3670477050":"2024-04-27T20:17:00.827028+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:23:49.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4ddc068380 msgr2=0x7f4ddc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4ddc068380 0x7f4ddc06a840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0af000 tx=0x7f4dec008040 comp rx=0 tx=0).stop 2024-04-26T20:23:49.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dfc0c63f0 msgr2=0x7f4dfc15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:49.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dfc0c63f0 0x7f4dfc15a320 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c420 tx=0x7f4de800c8e0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 shutdown_connections 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f4ddc068380 0x7f4ddc06a840 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dfc1574b0 0x7f4dfc0ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dfc0c63f0 0x7f4dfc15a320 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 --2- 172.21.15.16:0/2215209630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dfc0b47e0 0x7f4dfc1f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 >> 172.21.15.16:0/2215209630 conn(0x7f4dfc071160 msgr2=0x7f4dfc14ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 shutdown_connections 2024-04-26T20:23:49.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:49.791+0000 7f4e02a00640 1 -- 172.21.15.16:0/2215209630 wait complete. 2024-04-26T20:23:50.813 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T20:23:50.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:50.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.967+0000 7fc38fa00640 1 Processor -- start 2024-04-26T20:23:50.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.967+0000 7fc38fa00640 1 -- start start 2024-04-26T20:23:50.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38fa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 0x7fc388152880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38fa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc38806f810 0x7fc388152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38fa00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38815ce80 con 0x7fc38815c0e0 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38fa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fc38815cbd0 con 0x7fc38806f810 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38fa00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc3880c6f80 con 0x7fc3880c9760 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38d000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc38815c0e0 0x7fc38815c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38420/0 (socket says 172.21.15.16:38420) 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38d000640 1 -- 172.21.15.16:0/3411884420 learned_addr learned my addr 172.21.15.16:0/3411884420 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38da00640 1 --2- 172.21.15.16:0/3411884420 >> v2:172.21.15.192:3300/0 conn(0x7fc38806f810 0x7fc388152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc37fe00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 0x7fc388152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172304066 0 0) 0x7fc38815ce80 con 0x7fc38815c0e0 2024-04-26T20:23:50.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc36c003530 con 0x7fc38815c0e0 2024-04-26T20:23:50.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3187169374 0 0) 0x7fc36c003530 con 0x7fc38815c0e0 2024-04-26T20:23:50.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 msgr2=0x7fc388152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 0x7fc388152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 >> v2:172.21.15.192:3300/0 conn(0x7fc38806f810 msgr2=0x7fc388152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 --2- 172.21.15.16:0/3411884420 >> v2:172.21.15.192:3300/0 conn(0x7fc38806f810 0x7fc388152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3880c7520 con 0x7fc38815c0e0 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fc3780016a0 con 0x7fc38815c0e0 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 >> v1:172.21.15.16:6789/0 conn(0x7fc38815c0e0 legacy=0x7fc38815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 0x7fc36c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c003f40 0x7fc36c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36c004d50 0x7fc36c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc38815cbd0 con 0x7fc36c004d50 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc3880c6f80 con 0x7fc36c003f40 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c00dc10 con 0x7fc3880c9760 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38da00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36c004d50 0x7fc36c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc37fe00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c003f40 0x7fc36c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38d000640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 0x7fc36c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38da00640 1 -- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 msgr2=0x7fc36c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:50.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38da00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc3880c9760 0x7fc36c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38da00640 1 -- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c003f40 msgr2=0x7fc36c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38da00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c003f40 0x7fc36c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.971+0000 7fc38da00640 1 -- 172.21.15.16:0/3411884420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c003530 con 0x7fc36c004d50 2024-04-26T20:23:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38da00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36c004d50 0x7fc36c0051d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc380009fc0 tx=0x7fc38001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3632a42a14a5ad08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3800b2070 con 0x7fc36c004d50 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3800a5cd0 con 0x7fc36c004d50 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc387e00640 1 -- 172.21.15.16:0/3411884420 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380009c10 con 0x7fc36c004d50 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 -- 172.21.15.16:0/3411884420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36c004d50 msgr2=0x7fc36c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 --2- 172.21.15.16:0/3411884420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36c004d50 0x7fc36c0051d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc380009fc0 tx=0x7fc38001ccc0 comp rx=0 tx=0).stop 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38da00640 1 -- 172.21.15.16:0/3411884420 reap_dead start 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 -- 172.21.15.16:0/3411884420 shutdown_connections 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 -- 172.21.15.16:0/3411884420 >> 172.21.15.16:0/3411884420 conn(0x7fc3880c9d10 msgr2=0x7fc3880ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 -- 172.21.15.16:0/3411884420 shutdown_connections 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 -- 172.21.15.16:0/3411884420 wait complete. 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 Processor -- start 2024-04-26T20:23:50.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.975+0000 7fc38fa00640 1 -- start start 2024-04-26T20:23:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c004d50 0x7fc3880cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3881f1660 0x7fc38814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc388151ff0 0x7fc38814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc3880c4a90 con 0x7fc3881f1660 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc3880c47b0 con 0x7fc36c004d50 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc3880c4d70 con 0x7fc388151ff0 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3881f1660 0x7fc38814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3881f1660 0x7fc38814f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44894/0 (socket says 172.21.15.16:44894) 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 -- 172.21.15.16:0/2479603861 learned_addr learned my addr 172.21.15.16:0/2479603861 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38d000640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c004d50 0x7fc3880cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38da00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc388151ff0 0x7fc38814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 -- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc388151ff0 msgr2=0x7fc38814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:50.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc388151ff0 0x7fc38814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 -- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c004d50 msgr2=0x7fc3880cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc36c004d50 0x7fc3880cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 -- 172.21.15.16:0/2479603861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3881f1b10 con 0x7fc3881f1660 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc37fe00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3881f1660 0x7fc38814f9a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc370011960 tx=0x7fc370011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37000f9d0 con 0x7fc3881f1660 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37000fb70 con 0x7fc3881f1660 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370014440 con 0x7fc3881f1660 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3881f1df0 con 0x7fc3881f1660 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3881f23b0 con 0x7fc3881f1660 2024-04-26T20:23:50.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.979+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc388077c20 con 0x7fc3881f1660 2024-04-26T20:23:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc370012040 con 0x7fc3881f1660 2024-04-26T20:23:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc385600640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3640683b0 0x7fc36406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fc370087a90 con 0x7fc3881f1660 2024-04-26T20:23:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc385600640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fc3640720b0 0x7fc364074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 --> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc364074c20 con 0x7fc3640720b0 2024-04-26T20:23:50.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc370087e40 con 0x7fc3881f1660 2024-04-26T20:23:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc38d000640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3640683b0 0x7fc36406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc38da00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fc3640720b0 0x7fc364074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc38da00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fc3640720b0 0x7fc364074550 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc38d000640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3640683b0 0x7fc36406a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc38815d050 tx=0x7fc378007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:50.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.983+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== osd.0 v2:172.21.15.16:6808/3068465968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc364074c20 con 0x7fc3640720b0 2024-04-26T20:23:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 --> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc38814f2e0 con 0x7fc3640720b0 2024-04-26T20:23:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc385600640 1 -- 172.21.15.16:0/2479603861 <== osd.0 v2:172.21.15.16:6808/3068465968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc38814f2e0 con 0x7fc3640720b0 2024-04-26T20:23:51.000 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:51.001 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:51.001 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fc3640720b0 msgr2=0x7fc364074550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:6808/3068465968,v1:172.21.15.16:6809/3068465968] conn(0x7fc3640720b0 0x7fc364074550 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3640683b0 msgr2=0x7fc36406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc3640683b0 0x7fc36406a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc38815d050 tx=0x7fc378007900 comp rx=0 tx=0).stop 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3881f1660 msgr2=0x7fc38814f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 --2- 172.21.15.16:0/2479603861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3881f1660 0x7fc38814f9a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc370011960 tx=0x7fc370011d60 comp rx=0 tx=0).stop 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38da00640 1 -- 172.21.15.16:0/2479603861 reap_dead start 2024-04-26T20:23:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 shutdown_connections 2024-04-26T20:23:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 >> 172.21.15.16:0/2479603861 conn(0x7fc3880c9d10 msgr2=0x7fc3880731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 shutdown_connections 2024-04-26T20:23:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:50.999+0000 7fc38fa00640 1 -- 172.21.15.16:0/2479603861 wait complete. 2024-04-26T20:23:51.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T20:23:51.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec85a00640 1 Processor -- start 2024-04-26T20:23:51.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec85a00640 1 -- start start 2024-04-26T20:23:51.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec85a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fec800c44a0 0x7fec8015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec85a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec85a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec800c49e0 con 0x7fec80157250 2024-04-26T20:23:51.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec85a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fec800cbb50 con 0x7fec800c44a0 2024-04-26T20:23:51.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec85a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec800caf80 con 0x7fec800c9e80 2024-04-26T20:23:51.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec76000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fec800c44a0 0x7fec8015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec7ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fec80157250 0x7fec8006ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38434/0 (socket says 172.21.15.16:38434) 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec7ea00640 1 -- 172.21.15.16:0/205971932 learned_addr learned my addr 172.21.15.16:0/205971932 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec7f400640 1 --2- 172.21.15.16:0/205971932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec76000640 1 -- 172.21.15.16:0/205971932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 msgr2=0x7fec8015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec76000640 1 --2- 172.21.15.16:0/205971932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec76000640 1 -- 172.21.15.16:0/205971932 >> v1:172.21.15.16:6789/0 conn(0x7fec80157250 legacy=0x7fec8006ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec76000640 1 -- 172.21.15.16:0/205971932 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec800c6450 con 0x7fec800c44a0 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.159+0000 7fec7e000640 1 -- 172.21.15.16:0/205971932 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849182472 0 0) 0x7fec800c49e0 con 0x7fec80157250 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec76000640 1 --2- 172.21.15.16:0/205971932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec800c44a0 0x7fec8015d190 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fec680097c0 tx=0x7fec6801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d862941efe4e1c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec7e000640 1 -- 172.21.15.16:0/205971932 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680b0070 con 0x7fec800c44a0 2024-04-26T20:23:51.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec7e000640 1 -- 172.21.15.16:0/205971932 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec680ab600 con 0x7fec800c44a0 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec7e000640 1 -- 172.21.15.16:0/205971932 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680ab9d0 con 0x7fec800c44a0 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 -- 172.21.15.16:0/205971932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec800c44a0 msgr2=0x7fec8015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 --2- 172.21.15.16:0/205971932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec800c44a0 0x7fec8015d190 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fec680097c0 tx=0x7fec6801c410 comp rx=0 tx=0).stop 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 -- 172.21.15.16:0/205971932 shutdown_connections 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 --2- 172.21.15.16:0/205971932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 --2- 172.21.15.16:0/205971932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec800c44a0 0x7fec8015d190 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 -- 172.21.15.16:0/205971932 >> 172.21.15.16:0/205971932 conn(0x7fec80068140 msgr2=0x7fec80068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 -- 172.21.15.16:0/205971932 shutdown_connections 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.163+0000 7fec85a00640 1 -- 172.21.15.16:0/205971932 wait complete. 2024-04-26T20:23:51.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 Processor -- start 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 -- start start 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec800c44a0 0x7fec801557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80157250 0x7fec8006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec800b26c0 con 0x7fec80157250 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec80157670 con 0x7fec800c44a0 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec800b2840 con 0x7fec800c9e80 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80157250 0x7fec8006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80157250 0x7fec8006d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44898/0 (socket says 172.21.15.16:44898) 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 -- 172.21.15.16:0/995399400 learned_addr learned my addr 172.21.15.16:0/995399400 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7ea00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec800c44a0 0x7fec801557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec76000640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 -- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 msgr2=0x7fec8015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 -- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec800c44a0 msgr2=0x7fec801557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec800c44a0 0x7fec801557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 -- 172.21.15.16:0/995399400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8015cb50 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec7f400640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80157250 0x7fec8006d450 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec78009dd0 tx=0x7fec7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec77400640 1 -- 172.21.15.16:0/995399400 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78018020 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec77400640 1 -- 172.21.15.16:0/995399400 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec78014480 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec77400640 1 -- 172.21.15.16:0/995399400 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78014870 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec801f46a0 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.167+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec801f4c60 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.171+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec80077c20 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.171+0000 7fec77400640 1 -- 172.21.15.16:0/995399400 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec7801b020 con 0x7fec80157250 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.171+0000 7fec77400640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec5c068380 0x7fec5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.171+0000 7fec77400640 1 -- 172.21.15.16:0/995399400 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fec78087dd0 con 0x7fec80157250 2024-04-26T20:23:51.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.171+0000 7fec7ea00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec5c068380 0x7fec5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.171+0000 7fec7ea00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec5c068380 0x7fec5c06a840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec70000f70 tx=0x7fec70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.175+0000 7fec77400640 1 -- 172.21.15.16:0/995399400 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fec78022020 con 0x7fec80157250 2024-04-26T20:23:51.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fec8015aab0 con 0x7fec5c068380 2024-04-26T20:23:51.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec77400640 1 -- 172.21.15.16:0/995399400 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec8015aab0 con 0x7fec5c068380 2024-04-26T20:23:51.346 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec5c068380 msgr2=0x7fec5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec5c068380 0x7fec5c06a840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec70000f70 tx=0x7fec70009040 comp rx=0 tx=0).stop 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80157250 msgr2=0x7fec8006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80157250 0x7fec8006d450 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fec78009dd0 tx=0x7fec7800c490 comp rx=0 tx=0).stop 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 shutdown_connections 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec5c068380 0x7fec5c06a840 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80157250 0x7fec8006d450 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec800c9e80 0x7fec8015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 --2- 172.21.15.16:0/995399400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec800c44a0 0x7fec801557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.343+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 >> 172.21.15.16:0/995399400 conn(0x7fec80068140 msgr2=0x7fec80152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.347+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 shutdown_connections 2024-04-26T20:23:51.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.347+0000 7fec85a00640 1 -- 172.21.15.16:0/995399400 wait complete. 2024-04-26T20:23:51.367 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T20:23:51.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:51.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.507+0000 7fec68200640 1 Processor -- start 2024-04-26T20:23:51.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.507+0000 7fec68200640 1 -- start start 2024-04-26T20:23:51.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec68200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 0x7fec6015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec68200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec600701a0 con 0x7fec600c4470 2024-04-26T20:23:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec68200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec60070480 con 0x7fec600c5520 2024-04-26T20:23:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec68200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec6015aa10 con 0x7fec60153d80 2024-04-26T20:23:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec64e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fec600c4470 0x7fec600c4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38442/0 (socket says 172.21.15.16:38442) 2024-04-26T20:23:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec64e00640 1 -- 172.21.15.16:0/2440190121 learned_addr learned my addr 172.21.15.16:0/2440190121 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec65800640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 0x7fec6015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131175993 0 0) 0x7fec600701a0 con 0x7fec600c4470 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec48003530 con 0x7fec600c4470 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2923773220 0 0) 0x7fec48003530 con 0x7fec600c4470 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 msgr2=0x7fec6015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 0x7fec6015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 >> v1:172.21.15.192:6789/0 conn(0x7fec600c5520 legacy=0x7fec600cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec60070760 con 0x7fec600c4470 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7fec4c001680 con 0x7fec600c4470 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 >> v1:172.21.15.16:6789/0 conn(0x7fec600c4470 legacy=0x7fec600c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec480039f0 0x7fec48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec48004350 0x7fec48004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 0x7fec48005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec6015aa10 con 0x7fec480039f0 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec4800b9d0 con 0x7fec48004350 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec4800bb80 con 0x7fec60153d80 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec65800640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec480039f0 0x7fec48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec64e00640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec48004350 0x7fec48004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec66200640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 0x7fec48005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec65800640 1 -- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 msgr2=0x7fec48005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec65800640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 0x7fec48005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec65800640 1 -- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec48004350 msgr2=0x7fec48004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec65800640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec48004350 0x7fec48004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec65800640 1 -- 172.21.15.16:0/2440190121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec60070760 con 0x7fec480039f0 2024-04-26T20:23:51.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.511+0000 7fec66200640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec60153d80 0x7fec48005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:23:51.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec65800640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec480039f0 0x7fec48003dd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fec54009ae0 tx=0x7fec5401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc1059f4bac9cba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540b2070 con 0x7fec480039f0 2024-04-26T20:23:51.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540a5550 con 0x7fec480039f0 2024-04-26T20:23:51.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec5fe00640 1 -- 172.21.15.16:0/2440190121 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540096b0 con 0x7fec480039f0 2024-04-26T20:23:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec68200640 1 -- 172.21.15.16:0/2440190121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec480039f0 msgr2=0x7fec48003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec68200640 1 --2- 172.21.15.16:0/2440190121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec480039f0 0x7fec48003dd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fec54009ae0 tx=0x7fec5401ca70 comp rx=0 tx=0).stop 2024-04-26T20:23:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec66200640 1 -- 172.21.15.16:0/2440190121 reap_dead start 2024-04-26T20:23:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec68200640 1 -- 172.21.15.16:0/2440190121 shutdown_connections 2024-04-26T20:23:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec68200640 1 -- 172.21.15.16:0/2440190121 >> 172.21.15.16:0/2440190121 conn(0x7fec60071f60 msgr2=0x7fec60072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec68200640 1 -- 172.21.15.16:0/2440190121 shutdown_connections 2024-04-26T20:23:51.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec68200640 1 -- 172.21.15.16:0/2440190121 wait complete. 2024-04-26T20:23:51.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.515+0000 7fec68200640 1 Processor -- start 2024-04-26T20:23:51.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 -- start start 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec601e3a30 0x7fec601e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec601e4350 0x7fec600b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec601e5a20 0x7fec600b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec60070d20 con 0x7fec601e5a20 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec60071090 con 0x7fec601e3a30 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec60154160 con 0x7fec601e4350 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec601e5a20 0x7fec600b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec601e5a20 0x7fec600b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44922/0 (socket says 172.21.15.16:44922) 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 -- 172.21.15.16:0/36222913 learned_addr learned my addr 172.21.15.16:0/36222913 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec64e00640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec601e4350 0x7fec600b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec65800640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec601e3a30 0x7fec601e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 -- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec601e4350 msgr2=0x7fec600b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec601e4350 0x7fec600b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 -- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec601e3a30 msgr2=0x7fec601e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec601e3a30 0x7fec601e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 -- 172.21.15.16:0/36222913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec601f2860 con 0x7fec601e5a20 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec66200640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec601e5a20 0x7fec600b4210 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec6006fb70 tx=0x7fec5800e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58011040 con 0x7fec601e5a20 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec58006d60 con 0x7fec601e5a20 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec600b49b0 con 0x7fec601e5a20 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5800ede0 con 0x7fec601e5a20 2024-04-26T20:23:51.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec600cfff0 con 0x7fec601e5a20 2024-04-26T20:23:51.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.519+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec601e3280 con 0x7fec601e5a20 2024-04-26T20:23:51.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec58015430 con 0x7fec601e5a20 2024-04-26T20:23:51.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec5d600640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec40068380 0x7fec4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fec58089d40 con 0x7fec601e5a20 2024-04-26T20:23:51.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec5d600640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7fec40072090 0x7fec40074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 --> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec40074c00 con 0x7fec40072090 2024-04-26T20:23:51.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fec5808c360 con 0x7fec601e5a20 2024-04-26T20:23:51.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec65800640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec40068380 0x7fec4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec64e00640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7fec40072090 0x7fec40074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec64e00640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7fec40072090 0x7fec40074530 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec65800640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec40068380 0x7fec4006a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fec540af000 tx=0x7fec540a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.523+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== osd.1 v2:172.21.15.16:6800/1572811015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec40074c00 con 0x7fec40072090 2024-04-26T20:23:51.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 --> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec60077c20 con 0x7fec40072090 2024-04-26T20:23:51.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec5d600640 1 -- 172.21.15.16:0/36222913 <== osd.1 v2:172.21.15.16:6800/1572811015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec60077c20 con 0x7fec40072090 2024-04-26T20:23:51.540 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:51.540 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:51.540 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:51.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7fec40072090 msgr2=0x7fec40074530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:6800/1572811015,v1:172.21.15.16:6801/1572811015] conn(0x7fec40072090 0x7fec40074530 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec40068380 msgr2=0x7fec4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fec40068380 0x7fec4006a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fec540af000 tx=0x7fec540a7040 comp rx=0 tx=0).stop 2024-04-26T20:23:51.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec601e5a20 msgr2=0x7fec600b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 --2- 172.21.15.16:0/36222913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec601e5a20 0x7fec600b4210 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec6006fb70 tx=0x7fec5800e4c0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec66200640 1 -- 172.21.15.16:0/36222913 reap_dead start 2024-04-26T20:23:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 shutdown_connections 2024-04-26T20:23:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 >> 172.21.15.16:0/36222913 conn(0x7fec60071f60 msgr2=0x7fec6014e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 shutdown_connections 2024-04-26T20:23:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.539+0000 7fec68200640 1 -- 172.21.15.16:0/36222913 wait complete. 2024-04-26T20:23:51.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T20:23:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827e00640 1 Processor -- start 2024-04-26T20:23:51.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827e00640 1 -- start start 2024-04-26T20:23:51.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f08280c73a0 0x7f08280731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08280c9cd0 0x7f08280736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08280c4780 con 0x7f0828152900 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f082815bc60 con 0x7f08280c73a0 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f08280c4a20 con 0x7f08280c9cd0 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f081e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f08280c73a0 0x7f08280731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0826a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0828152900 0x7f08281586f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38448/0 (socket says 172.21.15.16:38448) 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f081e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f08280c73a0 0x7f08280731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44928/0 (socket says 172.21.15.16:44928) 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0826a00640 1 -- 172.21.15.16:0/3168291808 learned_addr learned my addr 172.21.15.16:0/3168291808 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0827400640 1 --2- 172.21.15.16:0/3168291808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08280c9cd0 0x7f08280736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f081e000640 1 -- 172.21.15.16:0/3168291808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08280c9cd0 msgr2=0x7f08280736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f081e000640 1 --2- 172.21.15.16:0/3168291808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08280c9cd0 0x7f08280736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f081e000640 1 -- 172.21.15.16:0/3168291808 >> v1:172.21.15.16:6789/0 conn(0x7f0828152900 legacy=0x7f08281586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f081e000640 1 -- 172.21.15.16:0/3168291808 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082815beb0 con 0x7f08280c73a0 2024-04-26T20:23:51.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.699+0000 7f0826000640 1 -- 172.21.15.16:0/3168291808 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144065696 0 0) 0x7f08280c4780 con 0x7f0828152900 2024-04-26T20:23:51.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f081e000640 1 --2- 172.21.15.16:0/3168291808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c73a0 0x7f08280731b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0810009d90 tx=0x7f081001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4ac87ab035fad7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0826000640 1 -- 172.21.15.16:0/3168291808 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08100b4070 con 0x7f08280c73a0 2024-04-26T20:23:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0826000640 1 -- 172.21.15.16:0/3168291808 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08100af600 con 0x7f08280c73a0 2024-04-26T20:23:51.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0826000640 1 -- 172.21.15.16:0/3168291808 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08100af9d0 con 0x7f08280c73a0 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 -- 172.21.15.16:0/3168291808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c73a0 msgr2=0x7f08280731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 --2- 172.21.15.16:0/3168291808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c73a0 0x7f08280731b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0810009d90 tx=0x7f081001f150 comp rx=0 tx=0).stop 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 -- 172.21.15.16:0/3168291808 shutdown_connections 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 --2- 172.21.15.16:0/3168291808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08280c9cd0 0x7f08280736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 --2- 172.21.15.16:0/3168291808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c73a0 0x7f08280731b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 -- 172.21.15.16:0/3168291808 >> 172.21.15.16:0/3168291808 conn(0x7f082806e0a0 msgr2=0x7f082806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 -- 172.21.15.16:0/3168291808 shutdown_connections 2024-04-26T20:23:51.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.703+0000 7f0827e00640 1 -- 172.21.15.16:0/3168291808 wait complete. 2024-04-26T20:23:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 Processor -- start 2024-04-26T20:23:51.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 -- start start 2024-04-26T20:23:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08280c73a0 0x7f08281f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c9cd0 0x7f08280c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0828152900 0x7f08281f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f082815c990 con 0x7f08280c9cd0 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f082815c470 con 0x7f08280c73a0 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f08281f2400 con 0x7f0828152900 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c9cd0 0x7f08280c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c9cd0 0x7f08280c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44932/0 (socket says 172.21.15.16:44932) 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 -- 172.21.15.16:0/123790672 learned_addr learned my addr 172.21.15.16:0/123790672 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0826a00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08280c73a0 0x7f08281f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827400640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0828152900 0x7f08281f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 -- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0828152900 msgr2=0x7f08281f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0828152900 0x7f08281f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 -- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08280c73a0 msgr2=0x7f08281f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08280c73a0 0x7f08281f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 -- 172.21.15.16:0/123790672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08281548d0 con 0x7f08280c9cd0 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081e000640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c9cd0 0x7f08280c8d50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f08100b2040 tx=0x7f081001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081f400640 1 -- 172.21.15.16:0/123790672 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08100b4040 con 0x7f08280c9cd0 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081f400640 1 -- 172.21.15.16:0/123790672 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08100c1070 con 0x7f08280c9cd0 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0828154bb0 con 0x7f08280c9cd0 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f081f400640 1 -- 172.21.15.16:0/123790672 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08100ba6b0 con 0x7f08280c9cd0 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0828153310 con 0x7f08280c9cd0 2024-04-26T20:23:51.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.707+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08280506d0 con 0x7f08280c9cd0 2024-04-26T20:23:51.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.711+0000 7f081f400640 1 -- 172.21.15.16:0/123790672 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08100ba850 con 0x7f08280c9cd0 2024-04-26T20:23:51.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.711+0000 7f081f400640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0804068380 0x7f080406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:51.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.711+0000 7f081f400640 1 -- 172.21.15.16:0/123790672 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f08101259a0 con 0x7f08280c9cd0 2024-04-26T20:23:51.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.711+0000 7f0826a00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0804068380 0x7f080406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:51.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.711+0000 7f0826a00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0804068380 0x7f080406a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0818000f70 tx=0x7f0818007df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:51.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.715+0000 7f081f400640 1 -- 172.21.15.16:0/123790672 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0810018cb0 con 0x7f08280c9cd0 2024-04-26T20:23:51.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.879+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f08280c4760 con 0x7f0804068380 2024-04-26T20:23:51.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.879+0000 7f081f400640 1 -- 172.21.15.16:0/123790672 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f08280c4760 con 0x7f0804068380 2024-04-26T20:23:51.883 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T20:23:51.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0804068380 msgr2=0x7f080406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0804068380 0x7f080406a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0818000f70 tx=0x7f0818007df0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c9cd0 msgr2=0x7f08280c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:51.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c9cd0 0x7f08280c8d50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f08100b2040 tx=0x7f081001bef0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 shutdown_connections 2024-04-26T20:23:51.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f0804068380 0x7f080406a840 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0828152900 0x7f08281f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280c9cd0 0x7f08280c8d50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 --2- 172.21.15.16:0/123790672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08280c73a0 0x7f08281f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 >> 172.21.15.16:0/123790672 conn(0x7f082806e0a0 msgr2=0x7f082814f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 shutdown_connections 2024-04-26T20:23:51.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:51.883+0000 7f0827e00640 1 -- 172.21.15.16:0/123790672 wait complete. 2024-04-26T20:23:51.905 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T20:23:51.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:52.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cdaa00640 1 Processor -- start 2024-04-26T20:23:52.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cdaa00640 1 -- start start 2024-04-26T20:23:52.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cdaa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3cd415c0e0 0x7f3cd415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cdaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cd40c9760 0x7f3cd4073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cdaa00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd415ce80 con 0x7f3cd415ca00 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cdaa00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd40c6f80 con 0x7f3cd415c0e0 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cdaa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd40c7520 con 0x7f3cd40c9760 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cd3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3cd415c0e0 0x7f3cd415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cd3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3cd415c0e0 0x7f3cd415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44940/0 (socket says 172.21.15.16:44940) 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.047+0000 7f3cd3e00640 1 -- 172.21.15.16:0/557598033 learned_addr learned my addr 172.21.15.16:0/557598033 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:52.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd8a00640 1 --2- 172.21.15.16:0/557598033 >> v2:172.21.15.192:3300/0 conn(0x7f3cd40c9760 0x7f3cd4073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3e00640 1 -- 172.21.15.16:0/557598033 >> v2:172.21.15.192:3300/0 conn(0x7f3cd40c9760 msgr2=0x7f3cd4073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3e00640 1 --2- 172.21.15.16:0/557598033 >> v2:172.21.15.192:3300/0 conn(0x7f3cd40c9760 0x7f3cd4073000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3e00640 1 -- 172.21.15.16:0/557598033 >> v1:172.21.15.192:6789/0 conn(0x7f3cd415ca00 legacy=0x7f3cd4152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3e00640 1 -- 172.21.15.16:0/557598033 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd40c7240 con 0x7f3cd415c0e0 2024-04-26T20:23:52.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd8a00640 1 --2- 172.21.15.16:0/557598033 >> v2:172.21.15.192:3300/0 conn(0x7f3cd40c9760 0x7f3cd4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:52.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3e00640 1 --2- 172.21.15.16:0/557598033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd415c4c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4159b00 tx=0x7f3cc401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79813a6e407f361 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3400640 1 -- 172.21.15.16:0/557598033 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40b5070 con 0x7f3cd415c0e0 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3400640 1 -- 172.21.15.16:0/557598033 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc40a8a10 con 0x7f3cd415c0e0 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cd3400640 1 -- 172.21.15.16:0/557598033 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40a8de0 con 0x7f3cd415c0e0 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.051+0000 7f3cdaa00640 1 -- 172.21.15.16:0/557598033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 msgr2=0x7f3cd415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 --2- 172.21.15.16:0/557598033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd415c4c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4159b00 tx=0x7f3cc401ed10 comp rx=0 tx=0).stop 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- 172.21.15.16:0/557598033 shutdown_connections 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 --2- 172.21.15.16:0/557598033 >> v2:172.21.15.192:3300/0 conn(0x7f3cd40c9760 0x7f3cd4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 --2- 172.21.15.16:0/557598033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd415c4c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- 172.21.15.16:0/557598033 >> 172.21.15.16:0/557598033 conn(0x7f3cd40c9d10 msgr2=0x7f3cd40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- 172.21.15.16:0/557598033 shutdown_connections 2024-04-26T20:23:52.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- 172.21.15.16:0/557598033 wait complete. 2024-04-26T20:23:52.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 Processor -- start 2024-04-26T20:23:52.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- start start 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cd40c9760 0x7f3cd4159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd41f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd415ca00 0x7f3cd40c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd40c4d70 con 0x7f3cd415c0e0 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd40c4a90 con 0x7f3cd415ca00 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd40723d0 con 0x7f3cd40c9760 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd41f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd41f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44954/0 (socket says 172.21.15.16:44954) 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 -- 172.21.15.16:0/3344518061 learned_addr learned my addr 172.21.15.16:0/3344518061 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cd3e00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cd40c9760 0x7f3cd4159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cd8a00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd415ca00 0x7f3cd40c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 -- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cd40c9760 msgr2=0x7f3cd4159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cd40c9760 0x7f3cd4159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 -- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd415ca00 msgr2=0x7f3cd40c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd415ca00 0x7f3cd40c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 -- 172.21.15.16:0/3344518061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd41f5b40 con 0x7f3cd415c0e0 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cd3e00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cd40c9760 0x7f3cd4159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3ccbe00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd41f5170 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00c450 tx=0x7f3cbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc016020 con 0x7f3cd415c0e0 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0052d0 con 0x7f3cd415c0e0 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc007260 con 0x7f3cd415c0e0 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.055+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd4152120 con 0x7f3cd415c0e0 2024-04-26T20:23:52.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd415a4d0 con 0x7f3cd415c0e0 2024-04-26T20:23:52.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3cd41f5e20 con 0x7f3cd415c0e0 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3cbc007400 con 0x7f3cd415c0e0 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd0c00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3cb0068380 0x7f3cb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f3cbc086850 con 0x7f3cd415c0e0 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd0c00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f3cb0072090 0x7f3cb0074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 --> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cbc01eec0 con 0x7f3cb0072090 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3cbc08b2c0 con 0x7f3cd415c0e0 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd3e00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3cb0068380 0x7f3cb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd8a00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f3cb0072090 0x7f3cb0074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd8a00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f3cb0072090 0x7f3cb0074530 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.059+0000 7f3cd3e00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3cb0068380 0x7f3cb006a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40b2000 tx=0x7f3cc4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.063+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== osd.2 v2:172.21.15.16:6816/2566691617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3cbc01eec0 con 0x7f3cb0072090 2024-04-26T20:23:52.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 --> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3cd415bf20 con 0x7f3cb0072090 2024-04-26T20:23:52.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cd0c00640 1 -- 172.21.15.16:0/3344518061 <== osd.2 v2:172.21.15.16:6816/2566691617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3ccc009b50 con 0x7f3cb0072090 2024-04-26T20:23:52.078 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:52.078 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:52.078 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:52.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f3cb0072090 msgr2=0x7f3cb0074530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:6816/2566691617,v1:172.21.15.16:6817/2566691617] conn(0x7f3cb0072090 0x7f3cb0074530 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3cb0068380 msgr2=0x7f3cb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3cb0068380 0x7f3cb006a840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40b2000 tx=0x7f3cc4008040 comp rx=0 tx=0).stop 2024-04-26T20:23:52.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 msgr2=0x7f3cd41f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 --2- 172.21.15.16:0/3344518061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cd415c0e0 0x7f3cd41f5170 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00c450 tx=0x7f3cbc00c910 comp rx=0 tx=0).stop 2024-04-26T20:23:52.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cd8a00640 1 -- 172.21.15.16:0/3344518061 reap_dead start 2024-04-26T20:23:52.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 shutdown_connections 2024-04-26T20:23:52.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 >> 172.21.15.16:0/3344518061 conn(0x7f3cd40c9d10 msgr2=0x7f3cd40c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 shutdown_connections 2024-04-26T20:23:52.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.075+0000 7f3cdaa00640 1 -- 172.21.15.16:0/3344518061 wait complete. 2024-04-26T20:23:52.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T20:23:52.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.235+0000 7f2c25000640 1 Processor -- start 2024-04-26T20:23:52.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.235+0000 7f2c25000640 1 -- start start 2024-04-26T20:23:52.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.235+0000 7f2c25000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c201592b0 0x7f2c20070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.235+0000 7f2c25000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2015f9a0 con 0x7f2c20071630 2024-04-26T20:23:52.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c25000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c200cb520 con 0x7f2c200cbae0 2024-04-26T20:23:52.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c25000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c20071260 con 0x7f2c201592b0 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c16a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2c20071630 0x7f2c2015f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38464/0 (socket says 172.21.15.16:38464) 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c16a00640 1 -- 172.21.15.16:0/1036513639 learned_addr learned my addr 172.21.15.16:0/1036513639 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1f400640 1 --2- 172.21.15.16:0/1036513639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c201592b0 0x7f2c20070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3771549610 0 0) 0x7f2c2015f9a0 con 0x7f2c20071630 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c04003530 con 0x7f2c20071630 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249511584 0 0) 0x7f2c200cb520 con 0x7f2c200cbae0 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c2015f9a0 con 0x7f2c200cbae0 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1f400640 1 -- 172.21.15.16:0/1036513639 >> v1:172.21.15.192:6789/0 conn(0x7f2c200cbae0 legacy=0x7f2c200cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1f400640 1 -- 172.21.15.16:0/1036513639 >> v1:172.21.15.16:6789/0 conn(0x7f2c20071630 legacy=0x7f2c2015f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1353867429 0 0) 0x7f2c04003530 con 0x7f2c20071630 2024-04-26T20:23:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.239+0000 7f2c1f400640 1 -- 172.21.15.16:0/1036513639 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c200cb800 con 0x7f2c201592b0 2024-04-26T20:23:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1f400640 1 --2- 172.21.15.16:0/1036513639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c201592b0 0x7f2c20070b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c100097f0 tx=0x7f2c1001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48ba109e3c81566 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c100b0070 con 0x7f2c201592b0 2024-04-26T20:23:52.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c100ab400 con 0x7f2c201592b0 2024-04-26T20:23:52.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1ea00640 1 -- 172.21.15.16:0/1036513639 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08001680 con 0x7f2c201592b0 2024-04-26T20:23:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- 172.21.15.16:0/1036513639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c201592b0 msgr2=0x7f2c20070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 --2- 172.21.15.16:0/1036513639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c201592b0 0x7f2c20070b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c100097f0 tx=0x7f2c1001c400 comp rx=0 tx=0).stop 2024-04-26T20:23:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- 172.21.15.16:0/1036513639 shutdown_connections 2024-04-26T20:23:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 --2- 172.21.15.16:0/1036513639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c201592b0 0x7f2c20070b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- 172.21.15.16:0/1036513639 >> 172.21.15.16:0/1036513639 conn(0x7f2c2006c980 msgr2=0x7f2c20068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- 172.21.15.16:0/1036513639 shutdown_connections 2024-04-26T20:23:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- 172.21.15.16:0/1036513639 wait complete. 2024-04-26T20:23:52.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 Processor -- start 2024-04-26T20:23:52.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- start start 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20071630 0x7f2c201f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c200cbae0 0x7f2c200b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c201592b0 0x7f2c200b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2006f2e0 con 0x7f2c201592b0 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c200ca910 con 0x7f2c200cbae0 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c25000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2006f460 con 0x7f2c20071630 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c201592b0 0x7f2c200b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c201592b0 0x7f2c200b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44962/0 (socket says 172.21.15.16:44962) 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1fe00640 1 -- 172.21.15.16:0/982038322 learned_addr learned my addr 172.21.15.16:0/982038322 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.243+0000 7f2c1f400640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20071630 0x7f2c201f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c16a00640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c200cbae0 0x7f2c200b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c1fe00640 1 -- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20071630 msgr2=0x7f2c201f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c1fe00640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20071630 0x7f2c201f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c1fe00640 1 -- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c200cbae0 msgr2=0x7f2c200b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c1fe00640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c200cbae0 0x7f2c200b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c1fe00640 1 -- 172.21.15.16:0/982038322 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2015a830 con 0x7f2c201592b0 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c1fe00640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c201592b0 0x7f2c200b2300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c7c0 tx=0x7f2c1800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c17e00640 1 -- 172.21.15.16:0/982038322 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18003b80 con 0x7f2c201592b0 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c17e00640 1 -- 172.21.15.16:0/982038322 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c18003d20 con 0x7f2c201592b0 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c17e00640 1 -- 172.21.15.16:0/982038322 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800a9f0 con 0x7f2c201592b0 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2015a270 con 0x7f2c201592b0 2024-04-26T20:23:52.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c200afe80 con 0x7f2c201592b0 2024-04-26T20:23:52.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c200506d0 con 0x7f2c201592b0 2024-04-26T20:23:52.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.247+0000 7f2c17e00640 1 -- 172.21.15.16:0/982038322 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c1800ab90 con 0x7f2c201592b0 2024-04-26T20:23:52.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.251+0000 7f2c17e00640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bfc068380 0x7f2bfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.251+0000 7f2c17e00640 1 -- 172.21.15.16:0/982038322 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f2c18086d70 con 0x7f2c201592b0 2024-04-26T20:23:52.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.251+0000 7f2c1f400640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bfc068380 0x7f2bfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.251+0000 7f2c1f400640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bfc068380 0x7f2bfc06a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c100ad000 tx=0x7f2c100a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.255+0000 7f2c17e00640 1 -- 172.21.15.16:0/982038322 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2c180566d0 con 0x7f2c201592b0 2024-04-26T20:23:52.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.419+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2c20071410 con 0x7f2bfc068380 2024-04-26T20:23:52.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.419+0000 7f2c17e00640 1 -- 172.21.15.16:0/982038322 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c20071410 con 0x7f2bfc068380 2024-04-26T20:23:52.422 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T20:23:52.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bfc068380 msgr2=0x7f2bfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bfc068380 0x7f2bfc06a840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c100ad000 tx=0x7f2c100a6000 comp rx=0 tx=0).stop 2024-04-26T20:23:52.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c201592b0 msgr2=0x7f2c200b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c201592b0 0x7f2c200b2300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c7c0 tx=0x7f2c1800cc80 comp rx=0 tx=0).stop 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 shutdown_connections 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f2bfc068380 0x7f2bfc06a840 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c201592b0 0x7f2c200b2300 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c200cbae0 0x7f2c200b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 --2- 172.21.15.16:0/982038322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20071630 0x7f2c201f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 >> 172.21.15.16:0/982038322 conn(0x7f2c2006c980 msgr2=0x7f2c20157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 shutdown_connections 2024-04-26T20:23:52.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.423+0000 7f2c25000640 1 -- 172.21.15.16:0/982038322 wait complete. 2024-04-26T20:23:52.443 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T20:23:52.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd558c00640 1 Processor -- start 2024-04-26T20:23:52.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd558c00640 1 -- start start 2024-04-26T20:23:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd558c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5540703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd558c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd55406f7f0 con 0x7fd5541593f0 2024-04-26T20:23:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd558c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd55406f230 con 0x7fd5540c6a40 2024-04-26T20:23:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd558c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd554158f60 con 0x7fd5540c6660 2024-04-26T20:23:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd553e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd5541593f0 0x7fd554152640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38468/0 (socket says 172.21.15.16:38468) 2024-04-26T20:23:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd553e00640 1 -- 172.21.15.16:0/507039395 learned_addr learned my addr 172.21.15.16:0/507039395 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:52.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd553400640 1 --2- 172.21.15.16:0/507039395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5540703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248301472 0 0) 0x7fd55406f7f0 con 0x7fd5541593f0 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd538003530 con 0x7fd5541593f0 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1985149301 0 0) 0x7fd55406f230 con 0x7fd5540c6a40 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd55406f7f0 con 0x7fd5540c6a40 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd553400640 1 -- 172.21.15.16:0/507039395 >> v1:172.21.15.192:6789/0 conn(0x7fd5540c6a40 legacy=0x7fd5540c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1713653533 0 0) 0x7fd538003530 con 0x7fd5541593f0 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd553400640 1 -- 172.21.15.16:0/507039395 >> v1:172.21.15.16:6789/0 conn(0x7fd5541593f0 legacy=0x7fd554152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.587+0000 7fd553400640 1 -- 172.21.15.16:0/507039395 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55406f510 con 0x7fd5540c6660 2024-04-26T20:23:52.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd553400640 1 --2- 172.21.15.16:0/507039395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5540703f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd544009dc0 tx=0x7fd54401c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6988be9e7b13e9d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5440b2070 con 0x7fd5540c6660 2024-04-26T20:23:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5440a56c0 con 0x7fd5540c6660 2024-04-26T20:23:52.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd552a00640 1 -- 172.21.15.16:0/507039395 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c001680 con 0x7fd5540c6660 2024-04-26T20:23:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd558c00640 1 -- 172.21.15.16:0/507039395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 msgr2=0x7fd5540703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd558c00640 1 --2- 172.21.15.16:0/507039395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5540703f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd544009dc0 tx=0x7fd54401c880 comp rx=0 tx=0).stop 2024-04-26T20:23:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd558c00640 1 -- 172.21.15.16:0/507039395 shutdown_connections 2024-04-26T20:23:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd558c00640 1 --2- 172.21.15.16:0/507039395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5540703f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd558c00640 1 -- 172.21.15.16:0/507039395 >> 172.21.15.16:0/507039395 conn(0x7fd55406c380 msgr2=0x7fd55406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd558c00640 1 -- 172.21.15.16:0/507039395 shutdown_connections 2024-04-26T20:23:52.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.591+0000 7fd558c00640 1 -- 172.21.15.16:0/507039395 wait complete. 2024-04-26T20:23:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 Processor -- start 2024-04-26T20:23:52.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 -- start start 2024-04-26T20:23:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5541f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5540c6a40 0x7fd554146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5541593f0 0x7fd554143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540c8110 con 0x7fd5541593f0 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540c7f90 con 0x7fd5540c6a40 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd554152d50 con 0x7fd5540c6660 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5541593f0 0x7fd554143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5541f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5541593f0 0x7fd554143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44978/0 (socket says 172.21.15.16:44978) 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 -- 172.21.15.16:0/3964416338 learned_addr learned my addr 172.21.15.16:0/3964416338 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd54aa00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5540c6a40 0x7fd554146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 -- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 msgr2=0x7fd5541f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5540c6660 0x7fd5541f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 -- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5540c6a40 msgr2=0x7fd554146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5540c6a40 0x7fd554146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 -- 172.21.15.16:0/3964416338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55415c010 con 0x7fd5541593f0 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd553e00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5541593f0 0x7fd554143c30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c7b0 tx=0x7fd54c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c017070 con 0x7fd5541593f0 2024-04-26T20:23:52.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd54c005ae0 con 0x7fd5541593f0 2024-04-26T20:23:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c007070 con 0x7fd5541593f0 2024-04-26T20:23:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55414b8f0 con 0x7fd5541593f0 2024-04-26T20:23:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5540ca430 con 0x7fd5541593f0 2024-04-26T20:23:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.595+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd554159da0 con 0x7fd5541593f0 2024-04-26T20:23:52.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd54c01a070 con 0x7fd5541593f0 2024-04-26T20:23:52.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54be00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd530068380 0x7fd53006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fd54c086ae0 con 0x7fd5541593f0 2024-04-26T20:23:52.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54be00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7fd530072080 0x7fd530074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 --> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd54c006e50 con 0x7fd530072080 2024-04-26T20:23:52.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd54c086f70 con 0x7fd5541593f0 2024-04-26T20:23:52.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd553400640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd530068380 0x7fd53006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54aa00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7fd530072080 0x7fd530074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54aa00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7fd530072080 0x7fd530074520 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd553400640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd530068380 0x7fd53006a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd5440af000 tx=0x7fd5440a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.599+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== osd.3 v2:172.21.15.16:6824/3915935540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd54c006e50 con 0x7fd530072080 2024-04-26T20:23:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 --> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd5540506d0 con 0x7fd530072080 2024-04-26T20:23:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd54be00640 1 -- 172.21.15.16:0/3964416338 <== osd.3 v2:172.21.15.16:6824/3915935540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd5540506d0 con 0x7fd530072080 2024-04-26T20:23:52.617 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:52.617 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:52.617 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7fd530072080 msgr2=0x7fd530074520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:6824/3915935540,v1:172.21.15.16:6825/3915935540] conn(0x7fd530072080 0x7fd530074520 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd530068380 msgr2=0x7fd53006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd530068380 0x7fd53006a840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd5440af000 tx=0x7fd5440a7070 comp rx=0 tx=0).stop 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5541593f0 msgr2=0x7fd554143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 --2- 172.21.15.16:0/3964416338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5541593f0 0x7fd554143c30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c7b0 tx=0x7fd54c00cc70 comp rx=0 tx=0).stop 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd553e00640 1 -- 172.21.15.16:0/3964416338 reap_dead start 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 shutdown_connections 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 >> 172.21.15.16:0/3964416338 conn(0x7fd55406c380 msgr2=0x7fd554148010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 shutdown_connections 2024-04-26T20:23:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.615+0000 7fd558c00640 1 -- 172.21.15.16:0/3964416338 wait complete. 2024-04-26T20:23:52.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T20:23:52.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd6a2400640 1 Processor -- start 2024-04-26T20:23:52.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd6a2400640 1 -- start start 2024-04-26T20:23:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd6a2400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd69c073940 0x7fd69c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd6a2400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd6a2400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd69c0c4b30 con 0x7fd69c152d00 2024-04-26T20:23:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd6a2400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c0c6f60 con 0x7fd69c073940 2024-04-26T20:23:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd6a2400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c0c7240 con 0x7fd69c15c070 2024-04-26T20:23:52.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd693e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd69c073940 0x7fd69c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd693e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd69c073940 0x7fd69c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44990/0 (socket says 172.21.15.16:44990) 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd693e00640 1 -- 172.21.15.16:0/3973785547 learned_addr learned my addr 172.21.15.16:0/3973785547 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd69b400640 1 --1- 172.21.15.16:0/3973785547 >> v1:172.21.15.16:6789/0 conn(0x7fd69c152d00 0x7fd69c073230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38478/0 (socket says 172.21.15.16:38478) 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd69be00640 1 --2- 172.21.15.16:0/3973785547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd693e00640 1 -- 172.21.15.16:0/3973785547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 msgr2=0x7fd69c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd693e00640 1 --2- 172.21.15.16:0/3973785547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd693e00640 1 -- 172.21.15.16:0/3973785547 >> v1:172.21.15.16:6789/0 conn(0x7fd69c152d00 legacy=0x7fd69c073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.783+0000 7fd693e00640 1 -- 172.21.15.16:0/3973785547 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c0c7520 con 0x7fd69c073940 2024-04-26T20:23:52.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd693e00640 1 --2- 172.21.15.16:0/3973785547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c073940 0x7fd69c0c97d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd68400bb10 tx=0x7fd68401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e9e004d93fc526 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd69aa00640 1 -- 172.21.15.16:0/3973785547 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840b4070 con 0x7fd69c073940 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd69aa00640 1 -- 172.21.15.16:0/3973785547 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6840a7ba0 con 0x7fd69c073940 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd69aa00640 1 -- 172.21.15.16:0/3973785547 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840af440 con 0x7fd69c073940 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 -- 172.21.15.16:0/3973785547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c073940 msgr2=0x7fd69c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3973785547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c073940 0x7fd69c0c97d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd68400bb10 tx=0x7fd68401ec30 comp rx=0 tx=0).stop 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 -- 172.21.15.16:0/3973785547 shutdown_connections 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3973785547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3973785547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c073940 0x7fd69c0c97d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 -- 172.21.15.16:0/3973785547 >> 172.21.15.16:0/3973785547 conn(0x7fd69c0c9d10 msgr2=0x7fd69c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 -- 172.21.15.16:0/3973785547 shutdown_connections 2024-04-26T20:23:52.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.787+0000 7fd6a2400640 1 -- 172.21.15.16:0/3973785547 wait complete. 2024-04-26T20:23:52.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 Processor -- start 2024-04-26T20:23:52.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 -- start start 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd69c073940 0x7fd69c146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c152d00 0x7fd69c1ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c1ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c15cfb0 con 0x7fd69c152d00 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c15ce30 con 0x7fd69c073940 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c070500 con 0x7fd69c15c070 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c152d00 0x7fd69c1ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c152d00 0x7fd69c1ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45004/0 (socket says 172.21.15.16:45004) 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 -- 172.21.15.16:0/3333925563 learned_addr learned my addr 172.21.15.16:0/3333925563 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd69b400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd69c073940 0x7fd69c146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd69be00640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c1ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 -- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 msgr2=0x7fd69c1ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c1ea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 -- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd69c073940 msgr2=0x7fd69c146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd69c073940 0x7fd69c146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 -- 172.21.15.16:0/3333925563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c1f8410 con 0x7fd69c152d00 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693e00640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c152d00 0x7fd69c1ea120 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd68400b2c0 tx=0x7fd68401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693400640 1 -- 172.21.15.16:0/3333925563 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840b4030 con 0x7fd69c152d00 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693400640 1 -- 172.21.15.16:0/3333925563 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6840b6070 con 0x7fd69c152d00 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd693400640 1 -- 172.21.15.16:0/3333925563 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840ad550 con 0x7fd69c152d00 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c1f86f0 con 0x7fd69c152d00 2024-04-26T20:23:52.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.791+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c1f8cb0 con 0x7fd69c152d00 2024-04-26T20:23:52.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.795+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c077c20 con 0x7fd69c152d00 2024-04-26T20:23:52.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.795+0000 7fd693400640 1 -- 172.21.15.16:0/3333925563 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6840c1060 con 0x7fd69c152d00 2024-04-26T20:23:52.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.795+0000 7fd693400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd6780683b0 0x7fd67806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:52.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.795+0000 7fd693400640 1 -- 172.21.15.16:0/3333925563 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fd684121360 con 0x7fd69c152d00 2024-04-26T20:23:52.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.795+0000 7fd69b400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd6780683b0 0x7fd67806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:52.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.795+0000 7fd69b400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd6780683b0 0x7fd67806a870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd68c000f70 tx=0x7fd68c007cd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:52.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.799+0000 7fd693400640 1 -- 172.21.15.16:0/3333925563 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd684018820 con 0x7fd69c152d00 2024-04-26T20:23:52.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.963+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd69c156430 con 0x7fd6780683b0 2024-04-26T20:23:52.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.963+0000 7fd693400640 1 -- 172.21.15.16:0/3333925563 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd69c156430 con 0x7fd6780683b0 2024-04-26T20:23:52.967 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd6780683b0 msgr2=0x7fd67806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd6780683b0 0x7fd67806a870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd68c000f70 tx=0x7fd68c007cd0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c152d00 msgr2=0x7fd69c1ea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c152d00 0x7fd69c1ea120 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd68400b2c0 tx=0x7fd68401b9d0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 shutdown_connections 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd6780683b0 0x7fd67806a870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd69c15c070 0x7fd69c1ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd69c152d00 0x7fd69c1ea120 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 --2- 172.21.15.16:0/3333925563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd69c073940 0x7fd69c146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 >> 172.21.15.16:0/3333925563 conn(0x7fd69c0c9d10 msgr2=0x7fd69c162cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 shutdown_connections 2024-04-26T20:23:52.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:52.967+0000 7fd6a2400640 1 -- 172.21.15.16:0/3333925563 wait complete. 2024-04-26T20:23:52.988 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T20:23:52.989 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:53.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd97d600640 1 Processor -- start 2024-04-26T20:23:53.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd97d600640 1 -- start start 2024-04-26T20:23:53.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd97d600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd97806d490 0x7fd97806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd97d600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd978070380 con 0x7fd978155ee0 2024-04-26T20:23:53.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd97d600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd978070660 con 0x7fd97806e270 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd97d600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd97806d8d0 con 0x7fd97806d490 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd96e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd97806d490 0x7fd97806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd96e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd97806d490 0x7fd97806dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45018/0 (socket says 172.21.15.16:45018) 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd96e000640 1 -- 172.21.15.16:0/886835260 learned_addr learned my addr 172.21.15.16:0/886835260 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd976a00640 1 --1- 172.21.15.16:0/886835260 >> v1:172.21.15.16:6789/0 conn(0x7fd978155ee0 0x7fd97815fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38484/0 (socket says 172.21.15.16:38484) 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd96e000640 1 -- 172.21.15.16:0/886835260 >> v1:172.21.15.192:6789/0 conn(0x7fd97806e270 legacy=0x7fd9780c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd96e000640 1 -- 172.21.15.16:0/886835260 >> v1:172.21.15.16:6789/0 conn(0x7fd978155ee0 legacy=0x7fd97815fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.131+0000 7fd96e000640 1 -- 172.21.15.16:0/886835260 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd978070940 con 0x7fd97806d490 2024-04-26T20:23:53.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd96e000640 1 --2- 172.21.15.16:0/886835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806d490 0x7fd97806dd30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd960009870 tx=0x7fd96001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1a1c95b22e6968 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd976000640 1 -- 172.21.15.16:0/886835260 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600b5070 con 0x7fd97806d490 2024-04-26T20:23:53.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd976000640 1 -- 172.21.15.16:0/886835260 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9600a8a50 con 0x7fd97806d490 2024-04-26T20:23:53.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd976000640 1 -- 172.21.15.16:0/886835260 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600a8e20 con 0x7fd97806d490 2024-04-26T20:23:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd97d600640 1 -- 172.21.15.16:0/886835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806d490 msgr2=0x7fd97806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd97d600640 1 --2- 172.21.15.16:0/886835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806d490 0x7fd97806dd30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd960009870 tx=0x7fd96001ed50 comp rx=0 tx=0).stop 2024-04-26T20:23:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd97d600640 1 -- 172.21.15.16:0/886835260 shutdown_connections 2024-04-26T20:23:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd97d600640 1 --2- 172.21.15.16:0/886835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806d490 0x7fd97806dd30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd97d600640 1 -- 172.21.15.16:0/886835260 >> 172.21.15.16:0/886835260 conn(0x7fd978071f60 msgr2=0x7fd978072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd97d600640 1 -- 172.21.15.16:0/886835260 shutdown_connections 2024-04-26T20:23:53.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.135+0000 7fd97d600640 1 -- 172.21.15.16:0/886835260 wait complete. 2024-04-26T20:23:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 Processor -- start 2024-04-26T20:23:53.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 -- start start 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97806d490 0x7fd97814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806e270 0x7fd97814f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd978155ee0 0x7fd978158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd9781562c0 con 0x7fd97806e270 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd978070f00 con 0x7fd97806d490 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd9780c9fe0 con 0x7fd978155ee0 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806e270 0x7fd97814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806e270 0x7fd97814f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45026/0 (socket says 172.21.15.16:45026) 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 -- 172.21.15.16:0/954273756 learned_addr learned my addr 172.21.15.16:0/954273756 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd976a00640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97806d490 0x7fd97814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd977400640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd978155ee0 0x7fd978158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 -- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd978155ee0 msgr2=0x7fd978158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd978155ee0 0x7fd978158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 -- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97806d490 msgr2=0x7fd97814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97806d490 0x7fd97814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 -- 172.21.15.16:0/954273756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9780d00e0 con 0x7fd97806e270 2024-04-26T20:23:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96e000640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806e270 0x7fd97814f940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9600b3040 tx=0x7fd96001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600c0070 con 0x7fd97806e270 2024-04-26T20:23:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9600ae790 con 0x7fd97806e270 2024-04-26T20:23:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600b5070 con 0x7fd97806e270 2024-04-26T20:23:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97814dfb0 con 0x7fd97806e270 2024-04-26T20:23:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9781507c0 con 0x7fd97806e270 2024-04-26T20:23:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.139+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd978077c20 con 0x7fd97806e270 2024-04-26T20:23:53.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9600b9070 con 0x7fd97806e270 2024-04-26T20:23:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd96f400640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd954068380 0x7fd95406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fd960124630 con 0x7fd97806e270 2024-04-26T20:23:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd96f400640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7fd954072080 0x7fd954074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 --> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9600b8e50 con 0x7fd954072080 2024-04-26T20:23:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd976a00640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd954068380 0x7fd95406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd96012b050 con 0x7fd97806e270 2024-04-26T20:23:53.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd977400640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7fd954072080 0x7fd954074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd976a00640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd954068380 0x7fd95406a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd968000f70 tx=0x7fd968007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.143+0000 7fd977400640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7fd954072080 0x7fd954074520 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.147+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== osd.4 v2:172.21.15.192:6800/1921936919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9600b8e50 con 0x7fd954072080 2024-04-26T20:23:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 --> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd97814e460 con 0x7fd954072080 2024-04-26T20:23:53.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd96f400640 1 -- 172.21.15.16:0/954273756 <== osd.4 v2:172.21.15.192:6800/1921936919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd97814e460 con 0x7fd954072080 2024-04-26T20:23:53.163 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:53.163 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:53.163 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7fd954072080 msgr2=0x7fd954074520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6800/1921936919,v1:172.21.15.192:6801/1921936919] conn(0x7fd954072080 0x7fd954074520 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd954068380 msgr2=0x7fd95406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fd954068380 0x7fd95406a840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd968000f70 tx=0x7fd968007e10 comp rx=0 tx=0).stop 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806e270 msgr2=0x7fd97814f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 --2- 172.21.15.16:0/954273756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd97806e270 0x7fd97814f940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9600b3040 tx=0x7fd96001baf0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd977400640 1 -- 172.21.15.16:0/954273756 reap_dead start 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 shutdown_connections 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 >> 172.21.15.16:0/954273756 conn(0x7fd978071f60 msgr2=0x7fd97815e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 shutdown_connections 2024-04-26T20:23:53.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.159+0000 7fd97d600640 1 -- 172.21.15.16:0/954273756 wait complete. 2024-04-26T20:23:53.182 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T20:23:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3e00640 1 Processor -- start 2024-04-26T20:23:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3e00640 1 -- start start 2024-04-26T20:23:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7febb40c7b00 0x7febb406fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb40c7ee0 0x7febb4153750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb406c5d0 con 0x7febb406e680 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7febb406c380 con 0x7febb40c7b00 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7febb406c8b0 con 0x7febb40c7ee0 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7febb406e680 0x7febb4159d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38494/0 (socket says 172.21.15.16:38494) 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb3400640 1 -- 172.21.15.16:0/3681373917 learned_addr learned my addr 172.21.15.16:0/3681373917 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb2a00640 1 --2- 172.21.15.16:0/3681373917 >> v2:172.21.15.192:3300/0 conn(0x7febb40c7b00 0x7febb406fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febaa000640 1 --2- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb40c7ee0 0x7febb4153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb2000640 1 -- 172.21.15.16:0/3681373917 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615457627 0 0) 0x7febb406c5d0 con 0x7febb406e680 2024-04-26T20:23:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb2000640 1 -- 172.21.15.16:0/3681373917 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb98003530 con 0x7febb406e680 2024-04-26T20:23:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb2a00640 1 -- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb40c7ee0 msgr2=0x7febb4153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb2a00640 1 --2- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb40c7ee0 0x7febb4153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb2a00640 1 -- 172.21.15.16:0/3681373917 >> v1:172.21.15.16:6789/0 conn(0x7febb406e680 legacy=0x7febb4159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.323+0000 7febb2a00640 1 -- 172.21.15.16:0/3681373917 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb406cb90 con 0x7febb40c7b00 2024-04-26T20:23:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb2a00640 1 --2- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7b00 0x7febb406fce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feba40097c0 tx=0x7feba401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b055c2fadb9a3a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb2000640 1 -- 172.21.15.16:0/3681373917 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40b2070 con 0x7febb40c7b00 2024-04-26T20:23:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb2000640 1 -- 172.21.15.16:0/3681373917 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba40ad640 con 0x7febb40c7b00 2024-04-26T20:23:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb2000640 1 -- 172.21.15.16:0/3681373917 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40ad9f0 con 0x7febb40c7b00 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 -- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7b00 msgr2=0x7febb406fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 --2- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7b00 0x7febb406fce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feba40097c0 tx=0x7feba401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 -- 172.21.15.16:0/3681373917 shutdown_connections 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 --2- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb40c7ee0 0x7febb4153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 --2- 172.21.15.16:0/3681373917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7b00 0x7febb406fce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 -- 172.21.15.16:0/3681373917 >> 172.21.15.16:0/3681373917 conn(0x7febb4070ce0 msgr2=0x7febb40710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 -- 172.21.15.16:0/3681373917 shutdown_connections 2024-04-26T20:23:53.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.327+0000 7febb3e00640 1 -- 172.21.15.16:0/3681373917 wait complete. 2024-04-26T20:23:53.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 Processor -- start 2024-04-26T20:23:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 -- start start 2024-04-26T20:23:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb406e680 0x7febb40c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40c7b00 0x7febb40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7ee0 0x7febb41f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7febb41540a0 con 0x7febb40c7b00 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7febb40c96d0 con 0x7febb40c7ee0 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7febb4166aa0 con 0x7febb406e680 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40c7b00 0x7febb40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40c7b00 0x7febb40c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45040/0 (socket says 172.21.15.16:45040) 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 -- 172.21.15.16:0/1305482473 learned_addr learned my addr 172.21.15.16:0/1305482473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3400640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7ee0 0x7febb41f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb2a00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb406e680 0x7febb40c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 -- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb406e680 msgr2=0x7febb40c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb406e680 0x7febb40c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 -- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7ee0 msgr2=0x7febb41f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7ee0 0x7febb41f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 -- 172.21.15.16:0/1305482473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb40c61c0 con 0x7febb40c7b00 2024-04-26T20:23:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febaa000640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40c7b00 0x7febb40c6ee0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e930 tx=0x7feb9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febab400640 1 -- 172.21.15.16:0/1305482473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c017070 con 0x7febb40c7b00 2024-04-26T20:23:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febab400640 1 -- 172.21.15.16:0/1305482473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c00ca00 con 0x7febb40c7b00 2024-04-26T20:23:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febab400640 1 -- 172.21.15.16:0/1305482473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00cdd0 con 0x7febb40c7b00 2024-04-26T20:23:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb40c64a0 con 0x7febb40c7b00 2024-04-26T20:23:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.331+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb41f3c30 con 0x7febb40c7b00 2024-04-26T20:23:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.335+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb40506d0 con 0x7febb40c7b00 2024-04-26T20:23:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.335+0000 7febab400640 1 -- 172.21.15.16:0/1305482473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb9c01a070 con 0x7febb40c7b00 2024-04-26T20:23:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.335+0000 7febab400640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feb900683b0 0x7feb9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.335+0000 7febab400640 1 -- 172.21.15.16:0/1305482473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7feb9c087230 con 0x7febb40c7b00 2024-04-26T20:23:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.335+0000 7febb2a00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feb900683b0 0x7feb9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.339+0000 7febb2a00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feb900683b0 0x7feb9006a870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feba40af000 tx=0x7feba4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.339+0000 7febab400640 1 -- 172.21.15.16:0/1305482473 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb9c056c60 con 0x7febb40c7b00 2024-04-26T20:23:53.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.507+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7febb40c5f70 con 0x7feb900683b0 2024-04-26T20:23:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.507+0000 7febab400640 1 -- 172.21.15.16:0/1305482473 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7febb40c5f70 con 0x7feb900683b0 2024-04-26T20:23:53.510 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feb900683b0 msgr2=0x7feb9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feb900683b0 0x7feb9006a870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feba40af000 tx=0x7feba4008040 comp rx=0 tx=0).stop 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40c7b00 msgr2=0x7febb40c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40c7b00 0x7febb40c6ee0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00e930 tx=0x7feb9c00edf0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 shutdown_connections 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feb900683b0 0x7feb9006a870 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febb40c7ee0 0x7febb41f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40c7b00 0x7febb40c6ee0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 --2- 172.21.15.16:0/1305482473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febb406e680 0x7febb40c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 >> 172.21.15.16:0/1305482473 conn(0x7febb4070ce0 msgr2=0x7febb4157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 shutdown_connections 2024-04-26T20:23:53.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.511+0000 7febb3e00640 1 -- 172.21.15.16:0/1305482473 wait complete. 2024-04-26T20:23:53.531 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T20:23:53.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04aa800640 1 Processor -- start 2024-04-26T20:23:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04aa800640 1 -- start start 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04aa800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a41591e0 0x7f04a4071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04aa800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04a406f200 0x7f04a40cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04aa800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a406d6c0 con 0x7f04a40b1e50 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04aa800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f04a406d490 con 0x7f04a406f200 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04aa800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f04a406d9a0 con 0x7f04a41591e0 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a8a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04a406f200 0x7f04a40cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a9e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f04a40b1e50 0x7f04a415be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38502/0 (socket says 172.21.15.16:38502) 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a9e00640 1 -- 172.21.15.16:0/2980742649 learned_addr learned my addr 172.21.15.16:0/2980742649 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a9400640 1 --2- 172.21.15.16:0/2980742649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a41591e0 0x7f04a4071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a8a00640 1 -- 172.21.15.16:0/2980742649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a41591e0 msgr2=0x7f04a4071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a8a00640 1 --2- 172.21.15.16:0/2980742649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a41591e0 0x7f04a4071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a8a00640 1 -- 172.21.15.16:0/2980742649 >> v1:172.21.15.16:6789/0 conn(0x7f04a40b1e50 legacy=0x7f04a415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a8a00640 1 -- 172.21.15.16:0/2980742649 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a4070a60 con 0x7f04a406f200 2024-04-26T20:23:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a3e00640 1 -- 172.21.15.16:0/2980742649 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731818942 0 0) 0x7f04a406d6c0 con 0x7f04a40b1e50 2024-04-26T20:23:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.675+0000 7f04a9400640 1 --2- 172.21.15.16:0/2980742649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a41591e0 0x7f04a4071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04a8a00640 1 --2- 172.21.15.16:0/2980742649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a406f200 0x7f04a40cf390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04900097c0 tx=0x7f049001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759ad44eb9678cb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04a3e00640 1 -- 172.21.15.16:0/2980742649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900b0070 con 0x7f04a406f200 2024-04-26T20:23:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04a3e00640 1 -- 172.21.15.16:0/2980742649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04900ab600 con 0x7f04a406f200 2024-04-26T20:23:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04a3e00640 1 -- 172.21.15.16:0/2980742649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900ab9d0 con 0x7f04a406f200 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 -- 172.21.15.16:0/2980742649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a406f200 msgr2=0x7f04a40cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 --2- 172.21.15.16:0/2980742649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a406f200 0x7f04a40cf390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04900097c0 tx=0x7f049001c4a0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 -- 172.21.15.16:0/2980742649 shutdown_connections 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 --2- 172.21.15.16:0/2980742649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a406f200 0x7f04a40cf390 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 --2- 172.21.15.16:0/2980742649 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a41591e0 0x7f04a4071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 -- 172.21.15.16:0/2980742649 >> 172.21.15.16:0/2980742649 conn(0x7f04a4068140 msgr2=0x7f04a4068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 -- 172.21.15.16:0/2980742649 shutdown_connections 2024-04-26T20:23:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 -- 172.21.15.16:0/2980742649 wait complete. 2024-04-26T20:23:53.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 Processor -- start 2024-04-26T20:23:53.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.679+0000 7f04aa800640 1 -- start start 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f200 0x7f04a40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a40b1e50 0x7f04a4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41591e0 0x7f04a41f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f04a4168de0 con 0x7f04a40b1e50 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f04a41597d0 con 0x7f04a41591e0 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f04a4168f60 con 0x7f04a406f200 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a40b1e50 0x7f04a4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a40b1e50 0x7f04a4155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45050/0 (socket says 172.21.15.16:45050) 2024-04-26T20:23:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 -- 172.21.15.16:0/738824590 learned_addr learned my addr 172.21.15.16:0/738824590 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a9400640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f200 0x7f04a40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a9e00640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41591e0 0x7f04a41f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 -- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f200 msgr2=0x7f04a40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f200 0x7f04a40b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 -- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41591e0 msgr2=0x7f04a41f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a41591e0 0x7f04a41f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 -- 172.21.15.16:0/738824590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a40b44b0 con 0x7f04a40b1e50 2024-04-26T20:23:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a8a00640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a40b1e50 0x7f04a4155510 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f04900ae040 tx=0x7f0490019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900b0040 con 0x7f04a40b1e50 2024-04-26T20:23:53.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04900ab400 con 0x7f04a40b1e50 2024-04-26T20:23:53.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900b4650 con 0x7f04a40b1e50 2024-04-26T20:23:53.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a40b4750 con 0x7f04a40b1e50 2024-04-26T20:23:53.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a41f8470 con 0x7f04a40b1e50 2024-04-26T20:23:53.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.683+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04a40506d0 con 0x7f04a40b1e50 2024-04-26T20:23:53.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04900bc020 con 0x7f04a40b1e50 2024-04-26T20:23:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a1600640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f04840683b0 0x7f048406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f0490120180 con 0x7f04a40b1e50 2024-04-26T20:23:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a1600640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f04840720b0 0x7f0484074550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 --> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04900ace50 con 0x7f04840720b0 2024-04-26T20:23:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0490127050 con 0x7f04a40b1e50 2024-04-26T20:23:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a9400640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f04840683b0 0x7f048406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a9e00640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f04840720b0 0x7f0484074550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a9400640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f04840683b0 0x7f048406a870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0498009950 tx=0x7f0498008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.687+0000 7f04a9e00640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f04840720b0 0x7f0484074550 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.691+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== osd.5 v2:172.21.15.192:6811/3980303039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04900ace50 con 0x7f04840720b0 2024-04-26T20:23:53.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 --> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f04a40c65e0 con 0x7f04840720b0 2024-04-26T20:23:53.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04a1600640 1 -- 172.21.15.16:0/738824590 <== osd.5 v2:172.21.15.192:6811/3980303039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f04a40c65e0 con 0x7f04840720b0 2024-04-26T20:23:53.706 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:53.707 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:53.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f04840720b0 msgr2=0x7f0484074550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6811/3980303039,v1:172.21.15.192:6813/3980303039] conn(0x7f04840720b0 0x7f0484074550 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f04840683b0 msgr2=0x7f048406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f04840683b0 0x7f048406a870 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0498009950 tx=0x7f0498008040 comp rx=0 tx=0).stop 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a40b1e50 msgr2=0x7f04a4155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 --2- 172.21.15.16:0/738824590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04a40b1e50 0x7f04a4155510 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f04900ae040 tx=0x7f0490019240 comp rx=0 tx=0).stop 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04a9e00640 1 -- 172.21.15.16:0/738824590 reap_dead start 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 shutdown_connections 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 >> 172.21.15.16:0/738824590 conn(0x7f04a4068140 msgr2=0x7f04a40cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 shutdown_connections 2024-04-26T20:23:53.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.703+0000 7f04aa800640 1 -- 172.21.15.16:0/738824590 wait complete. 2024-04-26T20:23:53.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T20:23:53.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8ec00640 1 Processor -- start 2024-04-26T20:23:53.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8ec00640 1 -- start start 2024-04-26T20:23:53.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8ec00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf88156040 0x7faf88070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8ec00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faf88073760 0x7faf8806f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8ec00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf880706c0 con 0x7faf880c7b10 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8ec00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7faf88070c80 con 0x7faf88073760 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8ec00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7faf880709a0 con 0x7faf88156040 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faf88073760 0x7faf8806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf87400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faf880c7b10 0x7faf8815c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38510/0 (socket says 172.21.15.16:38510) 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faf88073760 0x7faf8806f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45060/0 (socket says 172.21.15.16:45060) 2024-04-26T20:23:53.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf87400640 1 -- 172.21.15.16:0/2147963649 learned_addr learned my addr 172.21.15.16:0/2147963649 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:53.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf87e00640 1 --2- 172.21.15.16:0/2147963649 >> v2:172.21.15.192:3300/0 conn(0x7faf88156040 0x7faf88070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8cc00640 1 -- 172.21.15.16:0/2147963649 >> v2:172.21.15.192:3300/0 conn(0x7faf88156040 msgr2=0x7faf88070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:53.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8cc00640 1 --2- 172.21.15.16:0/2147963649 >> v2:172.21.15.192:3300/0 conn(0x7faf88156040 0x7faf88070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8cc00640 1 -- 172.21.15.16:0/2147963649 >> v1:172.21.15.16:6789/0 conn(0x7faf880c7b10 legacy=0x7faf8815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf8cc00640 1 -- 172.21.15.16:0/2147963649 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf88072c80 con 0x7faf88073760 2024-04-26T20:23:53.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.867+0000 7faf86a00640 1 -- 172.21.15.16:0/2147963649 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319478690 0 0) 0x7faf880706c0 con 0x7faf880c7b10 2024-04-26T20:23:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8cc00640 1 --2- 172.21.15.16:0/2147963649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf88073760 0x7faf8806f460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf88071ed0 tx=0x7faf8001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f949c19bcd689cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf86a00640 1 -- 172.21.15.16:0/2147963649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf800b2070 con 0x7faf88073760 2024-04-26T20:23:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf86a00640 1 -- 172.21.15.16:0/2147963649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf800a58d0 con 0x7faf88073760 2024-04-26T20:23:53.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf86a00640 1 -- 172.21.15.16:0/2147963649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf800a5ca0 con 0x7faf88073760 2024-04-26T20:23:53.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 -- 172.21.15.16:0/2147963649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf88073760 msgr2=0x7faf8806f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 --2- 172.21.15.16:0/2147963649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf88073760 0x7faf8806f460 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf88071ed0 tx=0x7faf8001c900 comp rx=0 tx=0).stop 2024-04-26T20:23:53.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 -- 172.21.15.16:0/2147963649 shutdown_connections 2024-04-26T20:23:53.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 --2- 172.21.15.16:0/2147963649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf88073760 0x7faf8806f460 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 --2- 172.21.15.16:0/2147963649 >> v2:172.21.15.192:3300/0 conn(0x7faf88156040 0x7faf88070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 -- 172.21.15.16:0/2147963649 >> 172.21.15.16:0/2147963649 conn(0x7faf880c9d10 msgr2=0x7faf880ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 -- 172.21.15.16:0/2147963649 shutdown_connections 2024-04-26T20:23:53.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 -- 172.21.15.16:0/2147963649 wait complete. 2024-04-26T20:23:53.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.871+0000 7faf8ec00640 1 Processor -- start 2024-04-26T20:23:53.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 -- start start 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf88073760 0x7faf8815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf880c7b10 0x7faf880cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf88156040 0x7faf88144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faf880c94b0 con 0x7faf880c7b10 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faf880c9330 con 0x7faf88156040 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faf88073bb0 con 0x7faf88073760 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf880c7b10 0x7faf880cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf880c7b10 0x7faf880cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45072/0 (socket says 172.21.15.16:45072) 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 -- 172.21.15.16:0/1094810882 learned_addr learned my addr 172.21.15.16:0/1094810882 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8cc00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf88156040 0x7faf88144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87e00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf88073760 0x7faf8815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 -- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf88073760 msgr2=0x7faf8815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf88073760 0x7faf8815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 -- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf88156040 msgr2=0x7faf88144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf88156040 0x7faf88144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 -- 172.21.15.16:0/1094810882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8815f360 con 0x7faf880c7b10 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf87400640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf880c7b10 0x7faf880cc930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c4e0 tx=0x7faf7400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf7fe00640 1 -- 172.21.15.16:0/1094810882 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74018070 con 0x7faf880c7b10 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf7fe00640 1 -- 172.21.15.16:0/1094810882 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf74007500 con 0x7faf880c7b10 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf7fe00640 1 -- 172.21.15.16:0/1094810882 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74004a30 con 0x7faf880c7b10 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8815a730 con 0x7faf880c7b10 2024-04-26T20:23:53.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8815f5d0 con 0x7faf880c7b10 2024-04-26T20:23:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.875+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf88077c20 con 0x7faf880c7b10 2024-04-26T20:23:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.879+0000 7faf7fe00640 1 -- 172.21.15.16:0/1094810882 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faf7401b070 con 0x7faf880c7b10 2024-04-26T20:23:53.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.879+0000 7faf7fe00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faf68068380 0x7faf6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:53.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.879+0000 7faf7fe00640 1 -- 172.21.15.16:0/1094810882 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7faf74086280 con 0x7faf880c7b10 2024-04-26T20:23:53.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.879+0000 7faf87e00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faf68068380 0x7faf6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:53.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.879+0000 7faf87e00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faf68068380 0x7faf6806a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf780079c0 tx=0x7faf78008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:53.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:53.883+0000 7faf7fe00640 1 -- 172.21.15.16:0/1094810882 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faf74055cb0 con 0x7faf880c7b10 2024-04-26T20:23:54.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7faf881537e0 con 0x7faf68068380 2024-04-26T20:23:54.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf7fe00640 1 -- 172.21.15.16:0/1094810882 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faf881537e0 con 0x7faf68068380 2024-04-26T20:23:54.053 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faf68068380 msgr2=0x7faf6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faf68068380 0x7faf6806a840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf780079c0 tx=0x7faf78008040 comp rx=0 tx=0).stop 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf880c7b10 msgr2=0x7faf880cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf880c7b10 0x7faf880cc930 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c4e0 tx=0x7faf7400c9a0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 shutdown_connections 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7faf68068380 0x7faf6806a840 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf88156040 0x7faf88144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf880c7b10 0x7faf880cc930 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 --2- 172.21.15.16:0/1094810882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf88073760 0x7faf8815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 >> 172.21.15.16:0/1094810882 conn(0x7faf880c9d10 msgr2=0x7faf88154070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 shutdown_connections 2024-04-26T20:23:54.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.051+0000 7faf8ec00640 1 -- 172.21.15.16:0/1094810882 wait complete. 2024-04-26T20:23:54.074 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T20:23:54.074 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:54.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.215+0000 7f2723c00640 1 Processor -- start 2024-04-26T20:23:54.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.215+0000 7f2723c00640 1 -- start start 2024-04-26T20:23:54.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2723c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c156010 0x7f271c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2723c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f271c0cd4d0 0x7f271c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2723c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f271c15bf70 0x7f271c15c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2723c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f271c15f270 con 0x7f271c0cd4d0 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2723c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f271c15c960 con 0x7f271c15bf70 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2723c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f271c15f4c0 con 0x7f271c156010 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f271c0cd4d0 0x7f271c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f271c0cd4d0 0x7f271c0cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45076/0 (socket says 172.21.15.16:45076) 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 -- 172.21.15.16:0/2259642455 learned_addr learned my addr 172.21.15.16:0/2259642455 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2721c00640 1 --2- 172.21.15.16:0/2259642455 >> v2:172.21.15.192:3300/0 conn(0x7f271c15bf70 0x7f271c15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2721200640 1 --2- 172.21.15.16:0/2259642455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c156010 0x7f271c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 -- 172.21.15.16:0/2259642455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c156010 msgr2=0x7f271c0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 --2- 172.21.15.16:0/2259642455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c156010 0x7f271c0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 -- 172.21.15.16:0/2259642455 >> v2:172.21.15.192:3300/0 conn(0x7f271c15bf70 msgr2=0x7f271c15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 --2- 172.21.15.16:0/2259642455 >> v2:172.21.15.192:3300/0 conn(0x7f271c15bf70 0x7f271c15c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 -- 172.21.15.16:0/2259642455 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c15f7a0 con 0x7f271c0cd4d0 2024-04-26T20:23:54.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f2721c00640 1 --2- 172.21.15.16:0/2259642455 >> v2:172.21.15.192:3300/0 conn(0x7f271c15bf70 0x7f271c15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:54.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271be00640 1 --2- 172.21.15.16:0/2259642455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c0cd4d0 0x7f271c0cc940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f271c06e880 tx=0x7f270801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6a6ff602131636 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.219+0000 7f271b400640 1 -- 172.21.15.16:0/2259642455 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080aa610 con 0x7f271c0cd4d0 2024-04-26T20:23:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f271b400640 1 -- 172.21.15.16:0/2259642455 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27080af070 con 0x7f271c0cd4d0 2024-04-26T20:23:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f271b400640 1 -- 172.21.15.16:0/2259642455 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080aa9d0 con 0x7f271c0cd4d0 2024-04-26T20:23:54.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- 172.21.15.16:0/2259642455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c0cd4d0 msgr2=0x7f271c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 --2- 172.21.15.16:0/2259642455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c0cd4d0 0x7f271c0cc940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f271c06e880 tx=0x7f270801c4f0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- 172.21.15.16:0/2259642455 shutdown_connections 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 --2- 172.21.15.16:0/2259642455 >> v2:172.21.15.192:3300/0 conn(0x7f271c15bf70 0x7f271c15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 --2- 172.21.15.16:0/2259642455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c0cd4d0 0x7f271c0cc940 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 --2- 172.21.15.16:0/2259642455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c156010 0x7f271c0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- 172.21.15.16:0/2259642455 >> 172.21.15.16:0/2259642455 conn(0x7f271c06c380 msgr2=0x7f271c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- 172.21.15.16:0/2259642455 shutdown_connections 2024-04-26T20:23:54.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- 172.21.15.16:0/2259642455 wait complete. 2024-04-26T20:23:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 Processor -- start 2024-04-26T20:23:54.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- start start 2024-04-26T20:23:54.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c0cd4d0 0x7f271c0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c156010 0x7f271c153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271c15bf70 0x7f271c1f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f271c0ca9b0 con 0x7f271c156010 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f271c1563f0 con 0x7f271c15bf70 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2723c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0cab30 con 0x7f271c0cd4d0 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f271be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c156010 0x7f271c153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f271be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c156010 0x7f271c153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45086/0 (socket says 172.21.15.16:45086) 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f271be00640 1 -- 172.21.15.16:0/3746586358 learned_addr learned my addr 172.21.15.16:0/3746586358 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2721200640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c0cd4d0 0x7f271c0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f2721c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271c15bf70 0x7f271c1f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f271be00640 1 -- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c0cd4d0 msgr2=0x7f271c0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.223+0000 7f271be00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f271c0cd4d0 0x7f271c0c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f271be00640 1 -- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271c15bf70 msgr2=0x7f271c1f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f271be00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271c15bf70 0x7f271c1f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f271be00640 1 -- 172.21.15.16:0/3746586358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c1547e0 con 0x7f271c156010 2024-04-26T20:23:54.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f271be00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c156010 0x7f271c153d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f27080ac040 tx=0x7f270801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080bd5f0 con 0x7f271c156010 2024-04-26T20:23:54.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27080bd790 con 0x7f271c156010 2024-04-26T20:23:54.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c1f7ab0 con 0x7f271c156010 2024-04-26T20:23:54.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27080bdb60 con 0x7f271c156010 2024-04-26T20:23:54.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c1f8070 con 0x7f271c156010 2024-04-26T20:23:54.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f271c1f8730 con 0x7f271c156010 2024-04-26T20:23:54.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f27080b33f0 con 0x7f271c156010 2024-04-26T20:23:54.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f26fc068380 0x7f26fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f2708121c60 con 0x7f271c156010 2024-04-26T20:23:54.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f26fc072090 0x7f26fc074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 --> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f270800af30 con 0x7f26fc072090 2024-04-26T20:23:54.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f27081262a0 con 0x7f271c156010 2024-04-26T20:23:54.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.227+0000 7f2721200640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f26fc068380 0x7f26fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.231+0000 7f2721c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f26fc072090 0x7f26fc074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.231+0000 7f2721200640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f26fc068380 0x7f26fc06a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27100045f0 tx=0x7f2710008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.231+0000 7f2721c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f26fc072090 0x7f26fc074530 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.231+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== osd.6 v2:172.21.15.192:6808/3572924654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f270800af30 con 0x7f26fc072090 2024-04-26T20:23:54.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 --> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f271c077c20 con 0x7f26fc072090 2024-04-26T20:23:54.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2718c00640 1 -- 172.21.15.16:0/3746586358 <== osd.6 v2:172.21.15.192:6808/3572924654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f271c077c20 con 0x7f26fc072090 2024-04-26T20:23:54.249 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:54.249 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:54.249 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f26fc072090 msgr2=0x7f26fc074530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6808/3572924654,v1:172.21.15.192:6809/3572924654] conn(0x7f26fc072090 0x7f26fc074530 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f26fc068380 msgr2=0x7f26fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f26fc068380 0x7f26fc06a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f27100045f0 tx=0x7f2710008040 comp rx=0 tx=0).stop 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c156010 msgr2=0x7f271c153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 --2- 172.21.15.16:0/3746586358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f271c156010 0x7f271c153d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f27080ac040 tx=0x7f270801ad30 comp rx=0 tx=0).stop 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2721c00640 1 -- 172.21.15.16:0/3746586358 reap_dead start 2024-04-26T20:23:54.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 shutdown_connections 2024-04-26T20:23:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 >> 172.21.15.16:0/3746586358 conn(0x7f271c06c380 msgr2=0x7f271c072fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 shutdown_connections 2024-04-26T20:23:54.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.247+0000 7f2723c00640 1 -- 172.21.15.16:0/3746586358 wait complete. 2024-04-26T20:23:54.268 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T20:23:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6195e00640 1 Processor -- start 2024-04-26T20:23:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6195e00640 1 -- start start 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6195e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f61900c6250 0x7f61900cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6195e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61900cf8a0 0x7f619015d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6195e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900c9f80 con 0x7f6190153ea0 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6195e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6190154280 con 0x7f61900c6250 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6195e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f61900c4470 con 0x7f61900cf8a0 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f618ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6190153ea0 0x7f61900709e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38524/0 (socket says 172.21.15.16:38524) 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f618ea00640 1 -- 172.21.15.16:0/445045876 learned_addr learned my addr 172.21.15.16:0/445045876 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6186000640 1 --2- 172.21.15.16:0/445045876 >> v2:172.21.15.16:3300/0 conn(0x7f61900c6250 0x7f61900cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f618f400640 1 --2- 172.21.15.16:0/445045876 >> v2:172.21.15.192:3300/0 conn(0x7f61900cf8a0 0x7f619015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6186000640 1 -- 172.21.15.16:0/445045876 >> v2:172.21.15.192:3300/0 conn(0x7f61900cf8a0 msgr2=0x7f619015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:54.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6186000640 1 --2- 172.21.15.16:0/445045876 >> v2:172.21.15.192:3300/0 conn(0x7f61900cf8a0 0x7f619015d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6186000640 1 -- 172.21.15.16:0/445045876 >> v1:172.21.15.16:6789/0 conn(0x7f6190153ea0 legacy=0x7f61900709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.411+0000 7f6186000640 1 -- 172.21.15.16:0/445045876 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900ca260 con 0x7f61900c6250 2024-04-26T20:23:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6186000640 1 --2- 172.21.15.16:0/445045876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61900cf360 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f61900c6170 tx=0x7f617801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65446bfe490be18a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f618e000640 1 -- 172.21.15.16:0/445045876 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61780b0070 con 0x7f61900c6250 2024-04-26T20:23:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f618e000640 1 -- 172.21.15.16:0/445045876 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61780ab600 con 0x7f61900c6250 2024-04-26T20:23:54.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f618e000640 1 -- 172.21.15.16:0/445045876 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61780ab9d0 con 0x7f61900c6250 2024-04-26T20:23:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 -- 172.21.15.16:0/445045876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 msgr2=0x7f61900cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 --2- 172.21.15.16:0/445045876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61900cf360 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f61900c6170 tx=0x7f617801c3c0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 -- 172.21.15.16:0/445045876 shutdown_connections 2024-04-26T20:23:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 --2- 172.21.15.16:0/445045876 >> v2:172.21.15.192:3300/0 conn(0x7f61900cf8a0 0x7f619015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 --2- 172.21.15.16:0/445045876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61900cf360 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 -- 172.21.15.16:0/445045876 >> 172.21.15.16:0/445045876 conn(0x7f6190068140 msgr2=0x7f6190068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 -- 172.21.15.16:0/445045876 shutdown_connections 2024-04-26T20:23:54.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.415+0000 7f6195e00640 1 -- 172.21.15.16:0/445045876 wait complete. 2024-04-26T20:23:54.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 Processor -- start 2024-04-26T20:23:54.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 -- start start 2024-04-26T20:23:54.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61901506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61900cf8a0 0x7f6190142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190153ea0 0x7f6190143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6190071860 con 0x7f61900c6250 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61900c4c80 con 0x7f6190153ea0 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61900719e0 con 0x7f61900cf8a0 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61901506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61901506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45094/0 (socket says 172.21.15.16:45094) 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 -- 172.21.15.16:0/2084127691 learned_addr learned my addr 172.21.15.16:0/2084127691 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618f400640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190153ea0 0x7f6190143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6186000640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61900cf8a0 0x7f6190142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 -- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61900cf8a0 msgr2=0x7f6190142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61900cf8a0 0x7f6190142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 -- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190153ea0 msgr2=0x7f6190143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190153ea0 0x7f6190143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 -- 172.21.15.16:0/2084127691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900725f0 con 0x7f61900c6250 2024-04-26T20:23:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f618ea00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61901506e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f618000c450 tx=0x7f618000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6187e00640 1 -- 172.21.15.16:0/2084127691 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180017070 con 0x7f61900c6250 2024-04-26T20:23:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6187e00640 1 -- 172.21.15.16:0/2084127691 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180005cf0 con 0x7f61900c6250 2024-04-26T20:23:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6187e00640 1 -- 172.21.15.16:0/2084127691 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180007290 con 0x7f61900c6250 2024-04-26T20:23:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61901f8570 con 0x7f61900c6250 2024-04-26T20:23:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61901f8b30 con 0x7f61900c6250 2024-04-26T20:23:54.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.419+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6190077c20 con 0x7f61900c6250 2024-04-26T20:23:54.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.423+0000 7f6187e00640 1 -- 172.21.15.16:0/2084127691 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f618001a070 con 0x7f61900c6250 2024-04-26T20:23:54.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.423+0000 7f6187e00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f616c068380 0x7f616c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.423+0000 7f6187e00640 1 -- 172.21.15.16:0/2084127691 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f6180086190 con 0x7f61900c6250 2024-04-26T20:23:54.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.423+0000 7f6186000640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f616c068380 0x7f616c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.423+0000 7f6186000640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f616c068380 0x7f616c06a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61780ad000 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.427+0000 7f6187e00640 1 -- 172.21.15.16:0/2084127691 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6180056280 con 0x7f61900c6250 2024-04-26T20:23:54.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.595+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f61900cfe80 con 0x7f616c068380 2024-04-26T20:23:54.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.595+0000 7f6187e00640 1 -- 172.21.15.16:0/2084127691 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f61900cfe80 con 0x7f616c068380 2024-04-26T20:23:54.598 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T20:23:54.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f616c068380 msgr2=0x7f616c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f616c068380 0x7f616c06a840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61780ad000 tx=0x7f6178008040 comp rx=0 tx=0).stop 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 msgr2=0x7f61901506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61901506e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f618000c450 tx=0x7f618000c910 comp rx=0 tx=0).stop 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 shutdown_connections 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f616c068380 0x7f616c06a840 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190153ea0 0x7f6190143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61900cf8a0 0x7f6190142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 --2- 172.21.15.16:0/2084127691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61900c6250 0x7f61901506e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 >> 172.21.15.16:0/2084127691 conn(0x7f6190068140 msgr2=0x7f6190071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 shutdown_connections 2024-04-26T20:23:54.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.599+0000 7f6195e00640 1 -- 172.21.15.16:0/2084127691 wait complete. 2024-04-26T20:23:54.619 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T20:23:54.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T20:23:54.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73f0600640 1 Processor -- start 2024-04-26T20:23:54.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73f0600640 1 -- start start 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73f0600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 0x7f73e815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73f0600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73e80c9760 0x7f73e8073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73f0600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e815ce80 con 0x7f73e815ca00 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73f0600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f73e80c6f80 con 0x7f73e80c9760 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73f0600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f73e80c7520 con 0x7f73e815c0e0 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73ed200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f73e815ca00 0x7f73e8152880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38536/0 (socket says 172.21.15.16:38536) 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73ed200640 1 -- 172.21.15.16:0/1283229294 learned_addr learned my addr 172.21.15.16:0/1283229294 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73edc00640 1 --2- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 0x7f73e815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73ee600640 1 --2- 172.21.15.16:0/1283229294 >> v2:172.21.15.192:3300/0 conn(0x7f73e80c9760 0x7f73e8073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73e7e00640 1 -- 172.21.15.16:0/1283229294 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607048404 0 0) 0x7f73e815ce80 con 0x7f73e815ca00 2024-04-26T20:23:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73e7e00640 1 -- 172.21.15.16:0/1283229294 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73d0005740 con 0x7f73e815ca00 2024-04-26T20:23:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73ee600640 1 -- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 msgr2=0x7f73e815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.767+0000 7f73ee600640 1 --2- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 0x7f73e815c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73ee600640 1 -- 172.21.15.16:0/1283229294 >> v1:172.21.15.16:6789/0 conn(0x7f73e815ca00 legacy=0x7f73e8152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73ee600640 1 -- 172.21.15.16:0/1283229294 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e80c7240 con 0x7f73e80c9760 2024-04-26T20:23:54.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73ee600640 1 --2- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80c9760 0x7f73e8073000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009d90 tx=0x7f73e001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361189129a39208 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73e7e00640 1 -- 172.21.15.16:0/1283229294 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e00b4070 con 0x7f73e80c9760 2024-04-26T20:23:54.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73e7e00640 1 -- 172.21.15.16:0/1283229294 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e00af600 con 0x7f73e80c9760 2024-04-26T20:23:54.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73e7e00640 1 -- 172.21.15.16:0/1283229294 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e00af9b0 con 0x7f73e80c9760 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73f0600640 1 -- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80c9760 msgr2=0x7f73e8073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73f0600640 1 --2- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80c9760 0x7f73e8073000 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009d90 tx=0x7f73e001f150 comp rx=0 tx=0).stop 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73f0600640 1 -- 172.21.15.16:0/1283229294 shutdown_connections 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.771+0000 7f73f0600640 1 --2- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e80c9760 0x7f73e8073000 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 --2- 172.21.15.16:0/1283229294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 0x7f73e815c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- 172.21.15.16:0/1283229294 >> 172.21.15.16:0/1283229294 conn(0x7f73e80c9d10 msgr2=0x7f73e80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- 172.21.15.16:0/1283229294 shutdown_connections 2024-04-26T20:23:54.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- 172.21.15.16:0/1283229294 wait complete. 2024-04-26T20:23:54.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 Processor -- start 2024-04-26T20:23:54.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- start start 2024-04-26T20:23:54.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e80c9760 0x7f73e815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 0x7f73e814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e815ca00 0x7f73e81f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f73e80c4d70 con 0x7f73e80c9760 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73e80c4a90 con 0x7f73e815ca00 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f73e80723d0 con 0x7f73e815c0e0 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e80c9760 0x7f73e815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e80c9760 0x7f73e815b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45096/0 (socket says 172.21.15.16:45096) 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 -- 172.21.15.16:0/1260404966 learned_addr learned my addr 172.21.15.16:0/1260404966 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73ed200640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 0x7f73e814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73ee600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e815ca00 0x7f73e81f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 -- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 msgr2=0x7f73e814d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f73e815c0e0 0x7f73e814d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 -- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e815ca00 msgr2=0x7f73e81f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e815ca00 0x7f73e81f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 -- 172.21.15.16:0/1260404966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e814a9d0 con 0x7f73e80c9760 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73edc00640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e80c9760 0x7f73e815b170 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00e960 tx=0x7f73dc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc017070 con 0x7f73e80c9760 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73dc00ca00 con 0x7f73e80c9760 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00cdb0 con 0x7f73e80c9760 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.775+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e814c750 con 0x7f73e80c9760 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e814cd10 con 0x7f73e80c9760 2024-04-26T20:23:54.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73e8077c20 con 0x7f73e80c9760 2024-04-26T20:23:54.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f73dc01a070 con 0x7f73e80c9760 2024-04-26T20:23:54.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73e5600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f73c8068380 0x7f73c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f73dc087790 con 0x7f73e80c9760 2024-04-26T20:23:54.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73e5600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f73c8072080 0x7f73c8074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 --> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73dc013e50 con 0x7f73c8072080 2024-04-26T20:23:54.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f73dc087b40 con 0x7f73e80c9760 2024-04-26T20:23:54.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73ed200640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f73c8068380 0x7f73c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73ee600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f73c8072080 0x7f73c8074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.779+0000 7f73ed200640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f73c8068380 0x7f73c806a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73e8073ea0 tx=0x7f73d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.783+0000 7f73ee600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f73c8072080 0x7f73c8074520 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.783+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== osd.7 v2:172.21.15.192:6824/3143162750 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73dc013e50 con 0x7f73c8072080 2024-04-26T20:23:54.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.795+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 --> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f73e80c8900 con 0x7f73c8072080 2024-04-26T20:23:54.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.795+0000 7f73e5600640 1 -- 172.21.15.16:0/1260404966 <== osd.7 v2:172.21.15.192:6824/3143162750 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f73e80c8900 con 0x7f73c8072080 2024-04-26T20:23:54.800 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T20:23:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T20:23:54.800 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f73c8072080 msgr2=0x7f73c8074520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6824/3143162750,v1:172.21.15.192:6825/3143162750] conn(0x7f73c8072080 0x7f73c8074520 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f73c8068380 msgr2=0x7f73c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f73c8068380 0x7f73c806a840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73e8073ea0 tx=0x7f73d4009040 comp rx=0 tx=0).stop 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e80c9760 msgr2=0x7f73e815b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 --2- 172.21.15.16:0/1260404966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e80c9760 0x7f73e815b170 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00e960 tx=0x7f73dc00ee20 comp rx=0 tx=0).stop 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73ee600640 1 -- 172.21.15.16:0/1260404966 reap_dead start 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 shutdown_connections 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 >> 172.21.15.16:0/1260404966 conn(0x7f73e80c9d10 msgr2=0x7f73e80cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 shutdown_connections 2024-04-26T20:23:54.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.799+0000 7f73f0600640 1 -- 172.21.15.16:0/1260404966 wait complete. 2024-04-26T20:23:54.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T20:23:54.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 Processor -- start 2024-04-26T20:23:54.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 -- start start 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f529c157250 0x7f529c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f529c0c9e80 0x7f529c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f529c0cbb50 con 0x7f529c157250 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f529c0c49e0 con 0x7f529c0c9e80 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f52a2200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f529c0caf80 con 0x7f529c0c44a0 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f529c157250 0x7f529c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f529c157250 0x7f529c06ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45104/0 (socket says 172.21.15.16:45104) 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 -- 172.21.15.16:0/3378500933 learned_addr learned my addr 172.21.15.16:0/3378500933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f5293e00640 1 --2- 172.21.15.16:0/3378500933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529be00640 1 --2- 172.21.15.16:0/3378500933 >> v2:172.21.15.192:3300/0 conn(0x7f529c0c9e80 0x7f529c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 -- 172.21.15.16:0/3378500933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 msgr2=0x7f529c070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 --2- 172.21.15.16:0/3378500933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 -- 172.21.15.16:0/3378500933 >> v2:172.21.15.192:3300/0 conn(0x7f529c0c9e80 msgr2=0x7f529c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 --2- 172.21.15.16:0/3378500933 >> v2:172.21.15.192:3300/0 conn(0x7f529c0c9e80 0x7f529c15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.959+0000 7f529b400640 1 -- 172.21.15.16:0/3378500933 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c0c6450 con 0x7f529c157250 2024-04-26T20:23:54.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f529b400640 1 --2- 172.21.15.16:0/3378500933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c157250 0x7f529c06ff00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f529c074250 tx=0x7f528c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4952d6bc98c680 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f529aa00640 1 -- 172.21.15.16:0/3378500933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c0b0070 con 0x7f529c157250 2024-04-26T20:23:54.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f529aa00640 1 -- 172.21.15.16:0/3378500933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c0ab600 con 0x7f529c157250 2024-04-26T20:23:54.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f529aa00640 1 -- 172.21.15.16:0/3378500933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c0ab9d0 con 0x7f529c157250 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 -- 172.21.15.16:0/3378500933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c157250 msgr2=0x7f529c06ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 --2- 172.21.15.16:0/3378500933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c157250 0x7f529c06ff00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f529c074250 tx=0x7f528c01c490 comp rx=0 tx=0).stop 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 -- 172.21.15.16:0/3378500933 shutdown_connections 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 --2- 172.21.15.16:0/3378500933 >> v2:172.21.15.192:3300/0 conn(0x7f529c0c9e80 0x7f529c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 --2- 172.21.15.16:0/3378500933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 --2- 172.21.15.16:0/3378500933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c157250 0x7f529c06ff00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 -- 172.21.15.16:0/3378500933 >> 172.21.15.16:0/3378500933 conn(0x7f529c068140 msgr2=0x7f529c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 -- 172.21.15.16:0/3378500933 shutdown_connections 2024-04-26T20:23:54.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.963+0000 7f52a2200640 1 -- 172.21.15.16:0/3378500933 wait complete. 2024-04-26T20:23:54.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 Processor -- start 2024-04-26T20:23:54.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 -- start start 2024-04-26T20:23:54.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c0c9e80 0x7f529c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c157250 0x7f529c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f529c157630 con 0x7f529c0c9e80 2024-04-26T20:23:54.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f529c15dae0 con 0x7f529c157250 2024-04-26T20:23:54.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f529c0b26c0 con 0x7f529c0c44a0 2024-04-26T20:23:54.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c0c9e80 0x7f529c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c0c9e80 0x7f529c0b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45114/0 (socket says 172.21.15.16:45114) 2024-04-26T20:23:54.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 -- 172.21.15.16:0/3707519092 learned_addr learned my addr 172.21.15.16:0/3707519092 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:54.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f529be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c157250 0x7f529c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f529b400640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 -- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 msgr2=0x7f529c0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 -- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c157250 msgr2=0x7f529c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:54.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c157250 0x7f529c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:54.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 -- 172.21.15.16:0/3707519092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c14f560 con 0x7f529c0c9e80 2024-04-26T20:23:54.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293e00640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c0c9e80 0x7f529c0b02e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f528400d800 tx=0x7f528400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293400640 1 -- 172.21.15.16:0/3707519092 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284018020 con 0x7f529c0c9e80 2024-04-26T20:23:54.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293400640 1 -- 172.21.15.16:0/3707519092 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52840096a0 con 0x7f529c0c9e80 2024-04-26T20:23:54.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f5293400640 1 -- 172.21.15.16:0/3707519092 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284009a50 con 0x7f529c0c9e80 2024-04-26T20:23:54.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c14f820 con 0x7f529c0c9e80 2024-04-26T20:23:54.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c0afdc0 con 0x7f529c0c9e80 2024-04-26T20:23:54.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.967+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c0af8d0 con 0x7f529c0c9e80 2024-04-26T20:23:54.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.971+0000 7f5293400640 1 -- 172.21.15.16:0/3707519092 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f528401b020 con 0x7f529c0c9e80 2024-04-26T20:23:54.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.971+0000 7f5293400640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5278068380 0x7f527806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:54.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.971+0000 7f5293400640 1 -- 172.21.15.16:0/3707519092 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f5284087360 con 0x7f529c0c9e80 2024-04-26T20:23:54.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.971+0000 7f529b400640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5278068380 0x7f527806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:54.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.971+0000 7f529b400640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5278068380 0x7f527806a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f529c0c6850 tx=0x7f528c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:54.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:54.975+0000 7f5293400640 1 -- 172.21.15.16:0/3707519092 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5284022020 con 0x7f529c0c9e80 2024-04-26T20:23:55.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.139+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f529c077c20 con 0x7f5278068380 2024-04-26T20:23:55.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.139+0000 7f5293400640 1 -- 172.21.15.16:0/3707519092 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f529c077c20 con 0x7f5278068380 2024-04-26T20:23:55.143 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T20:23:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5278068380 msgr2=0x7f527806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5278068380 0x7f527806a840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f529c0c6850 tx=0x7f528c008040 comp rx=0 tx=0).stop 2024-04-26T20:23:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c0c9e80 msgr2=0x7f529c0b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c0c9e80 0x7f529c0b02e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f528400d800 tx=0x7f528400dcc0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 shutdown_connections 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f5278068380 0x7f527806a840 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f529c157250 0x7f529c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f529c0c9e80 0x7f529c0b02e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 --2- 172.21.15.16:0/3707519092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f529c0c44a0 0x7f529c0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 >> 172.21.15.16:0/3707519092 conn(0x7f529c068140 msgr2=0x7f529c068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 shutdown_connections 2024-04-26T20:23:55.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.143+0000 7f52a2200640 1 -- 172.21.15.16:0/3707519092 wait complete. 2024-04-26T20:23:55.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:23:55.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.303+0000 7f69ba000640 1 Processor -- start 2024-04-26T20:23:55.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.303+0000 7f69ba000640 1 -- start start 2024-04-26T20:23:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69ba000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f69b4153af0 0x7f69b415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69ba000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:55.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69ba000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b40c9d90 con 0x7f69b40c9010 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69ba000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f69b40ca630 con 0x7f69b4153af0 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69ba000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f69b40ca070 con 0x7f69b40c7b80 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f69b4153af0 0x7f69b415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f69b4153af0 0x7f69b415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33568/0 (socket says 172.21.15.16:33568) 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 -- 172.21.15.16:0/2866366520 learned_addr learned my addr 172.21.15.16:0/2866366520 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69aaa00640 1 --2- 172.21.15.16:0/2866366520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 -- 172.21.15.16:0/2866366520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 msgr2=0x7f69b40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 --2- 172.21.15.16:0/2866366520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b40c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 -- 172.21.15.16:0/2866366520 >> v1:172.21.15.192:6789/0 conn(0x7f69b40c9010 legacy=0x7f69b40c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 -- 172.21.15.16:0/2866366520 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b40ca350 con 0x7f69b4153af0 2024-04-26T20:23:55.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69aaa00640 1 --2- 172.21.15.16:0/2866366520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:23:55.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.307+0000 7f69b3400640 1 --2- 172.21.15.16:0/2866366520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4153af0 0x7f69b415d7b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009870 tx=0x7f69a401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f3ce3b9303bc6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:55.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69b2a00640 1 -- 172.21.15.16:0/2866366520 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a40b5070 con 0x7f69b4153af0 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69b2a00640 1 -- 172.21.15.16:0/2866366520 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a40a8a50 con 0x7f69b4153af0 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69b2a00640 1 -- 172.21.15.16:0/2866366520 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a40a8e20 con 0x7f69b4153af0 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- 172.21.15.16:0/2866366520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4153af0 msgr2=0x7f69b415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 --2- 172.21.15.16:0/2866366520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4153af0 0x7f69b415d7b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009870 tx=0x7f69a401ed50 comp rx=0 tx=0).stop 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- 172.21.15.16:0/2866366520 shutdown_connections 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 --2- 172.21.15.16:0/2866366520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 --2- 172.21.15.16:0/2866366520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4153af0 0x7f69b415d7b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- 172.21.15.16:0/2866366520 >> 172.21.15.16:0/2866366520 conn(0x7f69b406c380 msgr2=0x7f69b406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- 172.21.15.16:0/2866366520 shutdown_connections 2024-04-26T20:23:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- 172.21.15.16:0/2866366520 wait complete. 2024-04-26T20:23:55.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 Processor -- start 2024-04-26T20:23:55.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- start start 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b4159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b40c9010 0x7f69b41f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69b4153af0 0x7f69b41f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4153ed0 con 0x7f69b40c9010 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f69b415d290 con 0x7f69b4153af0 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69ba000640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f69b4154050 con 0x7f69b40c7b80 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69b3400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b4159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69aaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b40c9010 0x7f69b41f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69b3400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b4159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.16:49640/0 (socket says 172.21.15.16:49640) 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69b3400640 1 -- 172.21.15.16:0/1303179391 learned_addr learned my addr 172.21.15.16:0/1303179391 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.311+0000 7f69b3e00640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69b4153af0 0x7f69b41f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69b3400640 1 -- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69b4153af0 msgr2=0x7f69b41f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69b3400640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69b4153af0 0x7f69b41f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69b3400640 1 -- 172.21.15.16:0/1303179391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b40c9010 msgr2=0x7f69b41f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69b3400640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b40c9010 0x7f69b41f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69b3400640 1 -- 172.21.15.16:0/1303179391 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b41f1ec0 con 0x7f69b40c7b80 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69aaa00640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b40c9010 0x7f69b41f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T20:23:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69b3400640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b4159480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69a401d400 tx=0x7f69a401baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69abe00640 1 -- 172.21.15.16:0/1303179391 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a40c0070 con 0x7f69b40c7b80 2024-04-26T20:23:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69abe00640 1 -- 172.21.15.16:0/1303179391 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a40ae550 con 0x7f69b40c7b80 2024-04-26T20:23:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b41f21a0 con 0x7f69b40c7b80 2024-04-26T20:23:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69abe00640 1 -- 172.21.15.16:0/1303179391 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a40b5070 con 0x7f69b40c7b80 2024-04-26T20:23:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b41f2760 con 0x7f69b40c7b80 2024-04-26T20:23:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b4077c20 con 0x7f69b40c7b80 2024-04-26T20:23:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69abe00640 1 -- 172.21.15.16:0/1303179391 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69a40c3070 con 0x7f69b40c7b80 2024-04-26T20:23:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.315+0000 7f69abe00640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:23:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.319+0000 7f69abe00640 1 -- 172.21.15.16:0/1303179391 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f69a4124840 con 0x7f69b40c7b80 2024-04-26T20:23:55.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.319+0000 7f69aaa00640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:23:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.319+0000 7f69aaa00640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f69b41567f0 tx=0x7f699c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:23:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.319+0000 7f69abe00640 1 -- 172.21.15.16:0/1303179391 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f69a40188b0 con 0x7f69b40c7b80 2024-04-26T20:23:55.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.487+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69b4076010 con 0x7f6990068380 2024-04-26T20:23:55.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69abe00640 1 -- 172.21.15.16:0/1303179391 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333417 (secure 0 0 0) 0x7f69b4076010 con 0x7f6990068380 2024-04-26T20:23:55.515 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:23:55.517 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 msgr2=0x7f699006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f69b41567f0 tx=0x7f699c008040 comp rx=0 tx=0).stop 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 msgr2=0x7f69b4159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b4159480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69a401d400 tx=0x7f69a401baf0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 shutdown_connections 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69b4153af0 0x7f69b41f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b40c9010 0x7f69b41f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 --2- 172.21.15.16:0/1303179391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b40c7b80 0x7f69b4159480 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:23:55.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 >> 172.21.15.16:0/1303179391 conn(0x7f69b406c380 msgr2=0x7f69b415b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:23:55.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.511+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 shutdown_connections 2024-04-26T20:23:55.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:23:55.515+0000 7f69ba000640 1 -- 172.21.15.16:0/1303179391 wait complete. 2024-04-26T20:23:55.534 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-04-26T20:23:55.195958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":143277185,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1883,"num_read_kb":3686744,"num_write":31571,"num_write_kb":4365564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46569,"ondisk_log_size":46569,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":691080,"kb_used_data":97544,"kb_used_omap":12,"kb_used_meta":593459,"kb_avail":754283640,"statfs":{"total":773094113280,"available":772386447360,"internally_reserved":0,"allocated":99885056,"data_stored":287727298,"data_compressed":42920622,"data_compressed_allocated":56156160,"data_compressed_original":245669888,"omap_allocated":12752,"internal_metadata":607702576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1230160,"num_objects":-253,"num_object_clones":0,"num_object_copies":-1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-253,"num_whiteouts":0,"num_read":8,"num_read_kb":37,"num_write":305,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005149"},"pg_stats":[{"pgid":"2.1f","version":"31'138","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.479029+0000","last_change":"2024-04-26T20:14:13.469112+0000","last_active":"2024-04-26T20:23:48.479029+0000","last_peered":"2024-04-26T20:23:48.479029+0000","last_clean":"2024-04-26T20:23:48.479029+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:23:48.479029+0000","last_undegraded":"2024-04-26T20:23:48.479029+0000","last_fullsized":"2024-04-26T20:23:48.479029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":4124,"num_write":97,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.662229+0000","last_change":"2024-04-26T20:14:14.470484+0000","last_active":"2024-04-26T20:23:45.662229+0000","last_peered":"2024-04-26T20:23:45.662229+0000","last_clean":"2024-04-26T20:23:45.662229+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:23:45.662229+0000","last_undegraded":"2024-04-26T20:23:45.662229+0000","last_fullsized":"2024-04-26T20:23:45.662229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:43.840933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'820","reported_seq":890,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.675268+0000","last_change":"2024-04-26T20:14:18.643487+0000","last_active":"2024-04-26T20:23:45.675268+0000","last_peered":"2024-04-26T20:23:45.675268+0000","last_clean":"2024-04-26T20:23:45.675268+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:23:45.675268+0000","last_undegraded":"2024-04-26T20:23:45.675268+0000","last_fullsized":"2024-04-26T20:23:45.675268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:15.548306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":127167,"num_write":792,"num_write_kb":160617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'67","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.544019+0000","last_change":"2024-04-26T20:14:13.467020+0000","last_active":"2024-04-26T20:23:34.544019+0000","last_peered":"2024-04-26T20:23:34.544019+0000","last_clean":"2024-04-26T20:23:34.544019+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:23:34.544019+0000","last_undegraded":"2024-04-26T20:23:34.544019+0000","last_fullsized":"2024-04-26T20:23:34.544019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:31.154781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":16,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'178","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.478889+0000","last_change":"2024-04-26T20:14:14.495346+0000","last_active":"2024-04-26T20:23:45.478889+0000","last_peered":"2024-04-26T20:23:45.478889+0000","last_clean":"2024-04-26T20:23:45.478889+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:23:45.478889+0000","last_undegraded":"2024-04-26T20:23:45.478889+0000","last_fullsized":"2024-04-26T20:23:45.478889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'783","reported_seq":848,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.670834+0000","last_change":"2024-04-26T20:14:18.529803+0000","last_active":"2024-04-26T20:23:45.670834+0000","last_peered":"2024-04-26T20:23:45.670834+0000","last_clean":"2024-04-26T20:23:45.670834+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:23:45.670834+0000","last_undegraded":"2024-04-26T20:23:45.670834+0000","last_fullsized":"2024-04-26T20:23:45.670834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:39.675858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":94315,"num_write":748,"num_write_kb":130983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'211","reported_seq":254,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.589002+0000","last_change":"2024-04-26T20:14:13.493635+0000","last_active":"2024-04-26T20:23:45.589002+0000","last_peered":"2024-04-26T20:23:45.589002+0000","last_clean":"2024-04-26T20:23:45.589002+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:23:45.589002+0000","last_undegraded":"2024-04-26T20:23:45.589002+0000","last_fullsized":"2024-04-26T20:23:45.589002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:16.821658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12305,"num_write":138,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'175","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.581786+0000","last_change":"2024-04-26T20:14:14.499524+0000","last_active":"2024-04-26T20:23:42.581786+0000","last_peered":"2024-04-26T20:23:42.581786+0000","last_clean":"2024-04-26T20:23:42.581786+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:23:42.581786+0000","last_undegraded":"2024-04-26T20:23:42.581786+0000","last_fullsized":"2024-04-26T20:23:42.581786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:23.821575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'765","reported_seq":830,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.651865+0000","last_change":"2024-04-26T20:14:18.535587+0000","last_active":"2024-04-26T20:23:45.651865+0000","last_peered":"2024-04-26T20:23:45.651865+0000","last_clean":"2024-04-26T20:23:45.651865+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:23:45.651865+0000","last_undegraded":"2024-04-26T20:23:45.651865+0000","last_fullsized":"2024-04-26T20:23:45.651865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:04.043142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":92426,"num_write":730,"num_write_kb":119140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'165","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.516574+0000","last_change":"2024-04-26T20:14:13.494201+0000","last_active":"2024-04-26T20:23:42.516574+0000","last_peered":"2024-04-26T20:23:42.516574+0000","last_clean":"2024-04-26T20:23:42.516574+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:23:42.516574+0000","last_undegraded":"2024-04-26T20:23:42.516574+0000","last_fullsized":"2024-04-26T20:23:42.516574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:43.004402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":110,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'179","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.647483+0000","last_change":"2024-04-26T20:15:02.201407+0000","last_active":"2024-04-26T20:23:45.647483+0000","last_peered":"2024-04-26T20:23:45.647483+0000","last_clean":"2024-04-26T20:23:45.647483+0000","last_became_active":"2024-04-26T20:15:02.201092+0000","last_became_peered":"2024-04-26T20:15:02.201092+0000","last_unstale":"2024-04-26T20:23:45.647483+0000","last_undegraded":"2024-04-26T20:23:45.647483+0000","last_fullsized":"2024-04-26T20:23:45.647483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'807","reported_seq":873,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.643281+0000","last_change":"2024-04-26T20:14:18.540569+0000","last_active":"2024-04-26T20:23:45.643281+0000","last_peered":"2024-04-26T20:23:45.643281+0000","last_clean":"2024-04-26T20:23:45.643281+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:23:45.643281+0000","last_undegraded":"2024-04-26T20:23:45.643281+0000","last_fullsized":"2024-04-26T20:23:45.643281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:52.914757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":115919,"num_write":775,"num_write_kb":110976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'212","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.689931+0000","last_change":"2024-04-26T20:14:14.485199+0000","last_active":"2024-04-26T20:23:45.689931+0000","last_peered":"2024-04-26T20:23:45.689931+0000","last_clean":"2024-04-26T20:23:45.689931+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:23:45.689931+0000","last_undegraded":"2024-04-26T20:23:45.689931+0000","last_fullsized":"2024-04-26T20:23:45.689931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:24.357427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'161","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.604403+0000","last_change":"2024-04-26T20:14:13.497634+0000","last_active":"2024-04-26T20:23:37.604403+0000","last_peered":"2024-04-26T20:23:37.604403+0000","last_clean":"2024-04-26T20:23:37.604403+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:23:37.604403+0000","last_undegraded":"2024-04-26T20:23:37.604403+0000","last_fullsized":"2024-04-26T20:23:37.604403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:58.870683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":106,"num_write_kb":8336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'790","reported_seq":857,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.594430+0000","last_change":"2024-04-26T20:15:02.208844+0000","last_active":"2024-04-26T20:23:45.594430+0000","last_peered":"2024-04-26T20:23:45.594430+0000","last_clean":"2024-04-26T20:23:45.594430+0000","last_became_active":"2024-04-26T20:15:02.207782+0000","last_became_peered":"2024-04-26T20:15:02.207782+0000","last_unstale":"2024-04-26T20:23:45.594430+0000","last_undegraded":"2024-04-26T20:23:45.594430+0000","last_fullsized":"2024-04-26T20:23:45.594430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":86223,"num_write":746,"num_write_kb":106297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'203","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.583443+0000","last_change":"2024-04-26T20:14:14.455527+0000","last_active":"2024-04-26T20:23:37.583443+0000","last_peered":"2024-04-26T20:23:37.583443+0000","last_clean":"2024-04-26T20:23:37.583443+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:23:37.583443+0000","last_undegraded":"2024-04-26T20:23:37.583443+0000","last_fullsized":"2024-04-26T20:23:37.583443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:17.684397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'166","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.464981+0000","last_change":"2024-04-26T20:14:13.463343+0000","last_active":"2024-04-26T20:23:37.464981+0000","last_peered":"2024-04-26T20:23:37.464981+0000","last_clean":"2024-04-26T20:23:37.464981+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:23:37.464981+0000","last_undegraded":"2024-04-26T20:23:37.464981+0000","last_fullsized":"2024-04-26T20:23:37.464981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4098,"num_write":113,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'846","reported_seq":902,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.680425+0000","last_change":"2024-04-26T20:14:18.541101+0000","last_active":"2024-04-26T20:23:45.680425+0000","last_peered":"2024-04-26T20:23:45.680425+0000","last_clean":"2024-04-26T20:23:45.680425+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:23:45.680425+0000","last_undegraded":"2024-04-26T20:23:45.680425+0000","last_fullsized":"2024-04-26T20:23:45.680425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:13.999676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":76471,"num_write":804,"num_write_kb":93343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.910809+0000","last_change":"2024-04-26T20:14:14.457376+0000","last_active":"2024-04-26T20:23:37.910809+0000","last_peered":"2024-04-26T20:23:37.910809+0000","last_clean":"2024-04-26T20:23:37.910809+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:23:37.910809+0000","last_undegraded":"2024-04-26T20:23:37.910809+0000","last_fullsized":"2024-04-26T20:23:37.910809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:34.564851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'60","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.475268+0000","last_change":"2024-04-26T20:14:13.484844+0000","last_active":"2024-04-26T20:23:37.475268+0000","last_peered":"2024-04-26T20:23:37.475268+0000","last_clean":"2024-04-26T20:23:37.475268+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:23:37.475268+0000","last_undegraded":"2024-04-26T20:23:37.475268+0000","last_fullsized":"2024-04-26T20:23:37.475268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'793","reported_seq":872,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.670759+0000","last_change":"2024-04-26T20:14:18.648773+0000","last_active":"2024-04-26T20:23:45.670759+0000","last_peered":"2024-04-26T20:23:45.670759+0000","last_clean":"2024-04-26T20:23:45.670759+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:23:45.670759+0000","last_undegraded":"2024-04-26T20:23:45.670759+0000","last_fullsized":"2024-04-26T20:23:45.670759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":121482,"num_write":758,"num_write_kb":114987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'218","reported_seq":254,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.650028+0000","last_change":"2024-04-26T20:14:14.480838+0000","last_active":"2024-04-26T20:23:45.650028+0000","last_peered":"2024-04-26T20:23:45.650028+0000","last_clean":"2024-04-26T20:23:45.650028+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:23:45.650028+0000","last_undegraded":"2024-04-26T20:23:45.650028+0000","last_fullsized":"2024-04-26T20:23:45.650028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:38.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'442","reported_seq":483,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.556262+0000","last_change":"2024-04-26T20:14:13.491640+0000","last_active":"2024-04-26T20:23:37.556262+0000","last_peered":"2024-04-26T20:23:37.556262+0000","last_clean":"2024-04-26T20:23:37.556262+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:23:37.556262+0000","last_undegraded":"2024-04-26T20:23:37.556262+0000","last_fullsized":"2024-04-26T20:23:37.556262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:56.857645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":388,"num_write_kb":4324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'737","reported_seq":795,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.706739+0000","last_change":"2024-04-26T20:14:18.530925+0000","last_active":"2024-04-26T20:23:45.706739+0000","last_peered":"2024-04-26T20:23:45.706739+0000","last_clean":"2024-04-26T20:23:45.706739+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:23:45.706739+0000","last_undegraded":"2024-04-26T20:23:45.706739+0000","last_fullsized":"2024-04-26T20:23:45.706739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:59.441137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":100836,"num_write":691,"num_write_kb":105101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'215","reported_seq":252,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.704753+0000","last_change":"2024-04-26T20:14:14.466335+0000","last_active":"2024-04-26T20:23:45.704753+0000","last_peered":"2024-04-26T20:23:45.704753+0000","last_clean":"2024-04-26T20:23:45.704753+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:23:45.704753+0000","last_undegraded":"2024-04-26T20:23:45.704753+0000","last_fullsized":"2024-04-26T20:23:45.704753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'63","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.884937+0000","last_change":"2024-04-26T20:14:13.490175+0000","last_active":"2024-04-26T20:23:37.884937+0000","last_peered":"2024-04-26T20:23:37.884937+0000","last_clean":"2024-04-26T20:23:37.884937+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:23:37.884937+0000","last_undegraded":"2024-04-26T20:23:37.884937+0000","last_fullsized":"2024-04-26T20:23:37.884937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:09.596263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'832","reported_seq":926,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.671642+0000","last_change":"2024-04-26T20:14:18.646256+0000","last_active":"2024-04-26T20:23:45.671642+0000","last_peered":"2024-04-26T20:23:45.671642+0000","last_clean":"2024-04-26T20:23:45.671642+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:23:45.671642+0000","last_undegraded":"2024-04-26T20:23:45.671642+0000","last_fullsized":"2024-04-26T20:23:45.671642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:34.147450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":203084,"num_write":796,"num_write_kb":205909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'171","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.876269+0000","last_change":"2024-04-26T20:14:14.502660+0000","last_active":"2024-04-26T20:23:37.876269+0000","last_peered":"2024-04-26T20:23:37.876269+0000","last_clean":"2024-04-26T20:23:37.876269+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:23:37.876269+0000","last_undegraded":"2024-04-26T20:23:37.876269+0000","last_fullsized":"2024-04-26T20:23:37.876269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:41.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'401","reported_seq":445,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.328092+0000","last_change":"2024-04-26T20:14:13.469600+0000","last_active":"2024-04-26T20:23:48.328092+0000","last_peered":"2024-04-26T20:23:48.328092+0000","last_clean":"2024-04-26T20:23:48.328092+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:23:48.328092+0000","last_undegraded":"2024-04-26T20:23:48.328092+0000","last_fullsized":"2024-04-26T20:23:48.328092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":842,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'787","reported_seq":837,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.600587+0000","last_change":"2024-04-26T20:14:18.644391+0000","last_active":"2024-04-26T20:23:45.600587+0000","last_peered":"2024-04-26T20:23:45.600587+0000","last_clean":"2024-04-26T20:23:45.600587+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:23:45.600587+0000","last_undegraded":"2024-04-26T20:23:45.600587+0000","last_fullsized":"2024-04-26T20:23:45.600587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:47.511041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":65331,"num_write":754,"num_write_kb":82709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'193","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.676005+0000","last_change":"2024-04-26T20:14:14.467443+0000","last_active":"2024-04-26T20:23:45.676005+0000","last_peered":"2024-04-26T20:23:45.676005+0000","last_clean":"2024-04-26T20:23:45.676005+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:23:45.676005+0000","last_undegraded":"2024-04-26T20:23:45.676005+0000","last_fullsized":"2024-04-26T20:23:45.676005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'199","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.535719+0000","last_change":"2024-04-26T20:14:13.494869+0000","last_active":"2024-04-26T20:23:37.535719+0000","last_peered":"2024-04-26T20:23:37.535719+0000","last_clean":"2024-04-26T20:23:37.535719+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:23:37.535719+0000","last_undegraded":"2024-04-26T20:23:37.535719+0000","last_fullsized":"2024-04-26T20:23:37.535719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:00.993498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":138,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'760","reported_seq":818,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.689757+0000","last_change":"2024-04-26T20:14:18.639113+0000","last_active":"2024-04-26T20:23:45.689757+0000","last_peered":"2024-04-26T20:23:45.689757+0000","last_clean":"2024-04-26T20:23:45.689757+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:23:45.689757+0000","last_undegraded":"2024-04-26T20:23:45.689757+0000","last_fullsized":"2024-04-26T20:23:45.689757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":72924,"num_write":718,"num_write_kb":105217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'209","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.677841+0000","last_change":"2024-04-26T20:14:14.496953+0000","last_active":"2024-04-26T20:23:45.677841+0000","last_peered":"2024-04-26T20:23:45.677841+0000","last_clean":"2024-04-26T20:23:45.677841+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:23:45.677841+0000","last_undegraded":"2024-04-26T20:23:45.677841+0000","last_fullsized":"2024-04-26T20:23:45.677841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:00.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'56","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.609420+0000","last_change":"2024-04-26T20:14:13.459383+0000","last_active":"2024-04-26T20:23:37.609420+0000","last_peered":"2024-04-26T20:23:37.609420+0000","last_clean":"2024-04-26T20:23:37.609420+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:23:37.609420+0000","last_undegraded":"2024-04-26T20:23:37.609420+0000","last_fullsized":"2024-04-26T20:23:37.609420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'792","reported_seq":846,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.484366+0000","last_change":"2024-04-26T20:15:02.206054+0000","last_active":"2024-04-26T20:23:48.484366+0000","last_peered":"2024-04-26T20:23:48.484366+0000","last_clean":"2024-04-26T20:23:48.484366+0000","last_became_active":"2024-04-26T20:15:02.205610+0000","last_became_peered":"2024-04-26T20:15:02.205610+0000","last_unstale":"2024-04-26T20:23:48.484366+0000","last_undegraded":"2024-04-26T20:23:48.484366+0000","last_fullsized":"2024-04-26T20:23:48.484366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":101392,"num_write":763,"num_write_kb":117505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'191","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.559287+0000","last_change":"2024-04-26T20:14:14.482435+0000","last_active":"2024-04-26T20:23:42.559287+0000","last_peered":"2024-04-26T20:23:42.559287+0000","last_clean":"2024-04-26T20:23:42.559287+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:23:42.559287+0000","last_undegraded":"2024-04-26T20:23:42.559287+0000","last_fullsized":"2024-04-26T20:23:42.559287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:52.019433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'623","reported_seq":662,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:22.690568+0000","last_change":"2024-04-26T20:14:13.489186+0000","last_active":"2024-04-26T20:23:22.690568+0000","last_peered":"2024-04-26T20:23:22.690568+0000","last_clean":"2024-04-26T20:23:22.690568+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:23:22.690568+0000","last_undegraded":"2024-04-26T20:23:22.690568+0000","last_fullsized":"2024-04-26T20:23:22.690568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:43.051630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":569,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'766","reported_seq":846,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.504136+0000","last_change":"2024-04-26T20:14:18.519316+0000","last_active":"2024-04-26T20:23:48.504136+0000","last_peered":"2024-04-26T20:23:48.504136+0000","last_clean":"2024-04-26T20:23:48.504136+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:23:48.504136+0000","last_undegraded":"2024-04-26T20:23:48.504136+0000","last_fullsized":"2024-04-26T20:23:48.504136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":139574,"num_write":733,"num_write_kb":123608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'201","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.599072+0000","last_change":"2024-04-26T20:14:14.458811+0000","last_active":"2024-04-26T20:23:45.599072+0000","last_peered":"2024-04-26T20:23:45.599072+0000","last_clean":"2024-04-26T20:23:45.599072+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:23:45.599072+0000","last_undegraded":"2024-04-26T20:23:45.599072+0000","last_fullsized":"2024-04-26T20:23:45.599072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'364","reported_seq":701,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.471982+0000","last_change":"2024-04-26T20:14:13.466977+0000","last_active":"2024-04-26T20:23:48.471982+0000","last_peered":"2024-04-26T20:23:48.471982+0000","last_clean":"2024-04-26T20:23:48.471982+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:23:48.471982+0000","last_undegraded":"2024-04-26T20:23:48.471982+0000","last_fullsized":"2024-04-26T20:23:48.471982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551177,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":1724,"num_write":301,"num_write_kb":1707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'750","reported_seq":804,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.667181+0000","last_change":"2024-04-26T20:14:18.529158+0000","last_active":"2024-04-26T20:23:45.667181+0000","last_peered":"2024-04-26T20:23:45.667181+0000","last_clean":"2024-04-26T20:23:45.667181+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:23:45.667181+0000","last_undegraded":"2024-04-26T20:23:45.667181+0000","last_fullsized":"2024-04-26T20:23:45.667181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":61996,"num_write":721,"num_write_kb":88897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'190","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.664738+0000","last_change":"2024-04-26T20:14:14.479911+0000","last_active":"2024-04-26T20:23:45.664738+0000","last_peered":"2024-04-26T20:23:45.664738+0000","last_clean":"2024-04-26T20:23:45.664738+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:23:45.664738+0000","last_undegraded":"2024-04-26T20:23:45.664738+0000","last_fullsized":"2024-04-26T20:23:45.664738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'272","reported_seq":317,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.511693+0000","last_change":"2024-04-26T20:14:13.491300+0000","last_active":"2024-04-26T20:23:37.511693+0000","last_peered":"2024-04-26T20:23:37.511693+0000","last_clean":"2024-04-26T20:23:37.511693+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:23:37.511693+0000","last_undegraded":"2024-04-26T20:23:37.511693+0000","last_fullsized":"2024-04-26T20:23:37.511693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:36.225492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":213,"num_write_kb":8309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'884","reported_seq":947,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.705047+0000","last_change":"2024-04-26T20:14:18.638639+0000","last_active":"2024-04-26T20:23:45.705047+0000","last_peered":"2024-04-26T20:23:45.705047+0000","last_clean":"2024-04-26T20:23:45.705047+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:23:45.705047+0000","last_undegraded":"2024-04-26T20:23:45.705047+0000","last_fullsized":"2024-04-26T20:23:45.705047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":98068,"num_write":848,"num_write_kb":148105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'185","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.494905+0000","last_change":"2024-04-26T20:14:14.493049+0000","last_active":"2024-04-26T20:23:45.494905+0000","last_peered":"2024-04-26T20:23:45.494905+0000","last_clean":"2024-04-26T20:23:45.494905+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:23:45.494905+0000","last_undegraded":"2024-04-26T20:23:45.494905+0000","last_fullsized":"2024-04-26T20:23:45.494905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:11.791309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'80","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.600749+0000","last_change":"2024-04-26T20:14:13.466373+0000","last_active":"2024-04-26T20:23:45.600749+0000","last_peered":"2024-04-26T20:23:45.600749+0000","last_clean":"2024-04-26T20:23:45.600749+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:23:45.600749+0000","last_undegraded":"2024-04-26T20:23:45.600749+0000","last_fullsized":"2024-04-26T20:23:45.600749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:21.617456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":13,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:21:52.220087+0000","last_change":"2024-04-26T20:14:08.483028+0000","last_active":"2024-04-26T20:21:52.220087+0000","last_peered":"2024-04-26T20:21:52.220087+0000","last_clean":"2024-04-26T20:21:52.220087+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:21:52.220087+0000","last_undegraded":"2024-04-26T20:21:52.220087+0000","last_fullsized":"2024-04-26T20:21:52.220087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:07.323173+0000","last_clean_scrub_stamp":"2024-04-26T20:14:07.323173+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:34.109058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'776","reported_seq":836,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.679350+0000","last_change":"2024-04-26T20:14:18.646051+0000","last_active":"2024-04-26T20:23:45.679350+0000","last_peered":"2024-04-26T20:23:45.679350+0000","last_clean":"2024-04-26T20:23:45.679350+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:23:45.679350+0000","last_undegraded":"2024-04-26T20:23:45.679350+0000","last_fullsized":"2024-04-26T20:23:45.679350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:46.635251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":82002,"num_write":745,"num_write_kb":109731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'192","reported_seq":228,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.719573+0000","last_change":"2024-04-26T20:14:14.504450+0000","last_active":"2024-04-26T20:23:37.719573+0000","last_peered":"2024-04-26T20:23:37.719573+0000","last_clean":"2024-04-26T20:23:37.719573+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:23:37.719573+0000","last_undegraded":"2024-04-26T20:23:37.719573+0000","last_fullsized":"2024-04-26T20:23:37.719573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:34.261847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'69","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.616791+0000","last_change":"2024-04-26T20:14:13.461087+0000","last_active":"2024-04-26T20:23:45.616791+0000","last_peered":"2024-04-26T20:23:45.616791+0000","last_clean":"2024-04-26T20:23:45.616791+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:23:45.616791+0000","last_undegraded":"2024-04-26T20:23:45.616791+0000","last_fullsized":"2024-04-26T20:23:45.616791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'858","reported_seq":938,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.690272+0000","last_change":"2024-04-26T20:14:18.640851+0000","last_active":"2024-04-26T20:23:45.690272+0000","last_peered":"2024-04-26T20:23:45.690272+0000","last_clean":"2024-04-26T20:23:45.690272+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:23:45.690272+0000","last_undegraded":"2024-04-26T20:23:45.690272+0000","last_fullsized":"2024-04-26T20:23:45.690272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:36.821859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":152120,"num_write":818,"num_write_kb":168870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'212","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.678802+0000","last_change":"2024-04-26T20:14:14.492579+0000","last_active":"2024-04-26T20:23:45.678802+0000","last_peered":"2024-04-26T20:23:45.678802+0000","last_clean":"2024-04-26T20:23:45.678802+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:23:45.678802+0000","last_undegraded":"2024-04-26T20:23:45.678802+0000","last_fullsized":"2024-04-26T20:23:45.678802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:15.184148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'562","reported_seq":603,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.491783+0000","last_change":"2024-04-26T20:14:13.466705+0000","last_active":"2024-04-26T20:23:37.491783+0000","last_peered":"2024-04-26T20:23:37.491783+0000","last_clean":"2024-04-26T20:23:37.491783+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:23:37.491783+0000","last_undegraded":"2024-04-26T20:23:37.491783+0000","last_fullsized":"2024-04-26T20:23:37.491783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":503,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'816","reported_seq":896,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.484412+0000","last_change":"2024-04-26T20:14:18.530468+0000","last_active":"2024-04-26T20:23:48.484412+0000","last_peered":"2024-04-26T20:23:48.484412+0000","last_clean":"2024-04-26T20:23:48.484412+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:23:48.484412+0000","last_undegraded":"2024-04-26T20:23:48.484412+0000","last_fullsized":"2024-04-26T20:23:48.484412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":135112,"num_write":783,"num_write_kb":135635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'193","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.631452+0000","last_change":"2024-04-26T20:14:14.509097+0000","last_active":"2024-04-26T20:23:45.631452+0000","last_peered":"2024-04-26T20:23:45.631452+0000","last_clean":"2024-04-26T20:23:45.631452+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:23:45.631452+0000","last_undegraded":"2024-04-26T20:23:45.631452+0000","last_fullsized":"2024-04-26T20:23:45.631452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:10.312023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'280","reported_seq":321,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.595217+0000","last_change":"2024-04-26T20:14:13.469143+0000","last_active":"2024-04-26T20:23:34.595217+0000","last_peered":"2024-04-26T20:23:34.595217+0000","last_clean":"2024-04-26T20:23:34.595217+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:23:34.595217+0000","last_undegraded":"2024-04-26T20:23:34.595217+0000","last_fullsized":"2024-04-26T20:23:34.595217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":224,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'847","reported_seq":920,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.506702+0000","last_change":"2024-04-26T20:14:18.646391+0000","last_active":"2024-04-26T20:23:48.506702+0000","last_peered":"2024-04-26T20:23:48.506702+0000","last_clean":"2024-04-26T20:23:48.506702+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:23:48.506702+0000","last_undegraded":"2024-04-26T20:23:48.506702+0000","last_fullsized":"2024-04-26T20:23:48.506702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:45.503058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":124531,"num_write":810,"num_write_kb":151625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'176","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.540738+0000","last_change":"2024-04-26T20:14:14.494587+0000","last_active":"2024-04-26T20:23:45.540738+0000","last_peered":"2024-04-26T20:23:45.540738+0000","last_clean":"2024-04-26T20:23:45.540738+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:23:45.540738+0000","last_undegraded":"2024-04-26T20:23:45.540738+0000","last_fullsized":"2024-04-26T20:23:45.540738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:29.118516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'211","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.471464+0000","last_change":"2024-04-26T20:14:13.457341+0000","last_active":"2024-04-26T20:23:45.471464+0000","last_peered":"2024-04-26T20:23:45.471464+0000","last_clean":"2024-04-26T20:23:45.471464+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:23:45.471464+0000","last_undegraded":"2024-04-26T20:23:45.471464+0000","last_fullsized":"2024-04-26T20:23:45.471464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:16.585264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":4101,"num_write":169,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'867","reported_seq":942,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.652628+0000","last_change":"2024-04-26T20:14:18.536744+0000","last_active":"2024-04-26T20:23:45.652628+0000","last_peered":"2024-04-26T20:23:45.652628+0000","last_clean":"2024-04-26T20:23:45.652628+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:23:45.652628+0000","last_undegraded":"2024-04-26T20:23:45.652628+0000","last_fullsized":"2024-04-26T20:23:45.652628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:50.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":151765,"num_write":832,"num_write_kb":200590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'231","reported_seq":267,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.689989+0000","last_change":"2024-04-26T20:14:14.495366+0000","last_active":"2024-04-26T20:23:45.689989+0000","last_peered":"2024-04-26T20:23:45.689989+0000","last_clean":"2024-04-26T20:23:45.689989+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:23:45.689989+0000","last_undegraded":"2024-04-26T20:23:45.689989+0000","last_fullsized":"2024-04-26T20:23:45.689989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:02.010531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'353","reported_seq":406,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:49.235743+0000","last_change":"2024-04-26T20:14:13.458549+0000","last_active":"2024-04-26T20:23:49.235743+0000","last_peered":"2024-04-26T20:23:49.235743+0000","last_clean":"2024-04-26T20:23:49.235743+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:23:49.235743+0000","last_undegraded":"2024-04-26T20:23:49.235743+0000","last_fullsized":"2024-04-26T20:23:49.235743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6913317,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":303,"num_write_kb":6908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'794","reported_seq":856,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.507964+0000","last_change":"2024-04-26T20:14:18.518799+0000","last_active":"2024-04-26T20:23:48.507964+0000","last_peered":"2024-04-26T20:23:48.507964+0000","last_clean":"2024-04-26T20:23:48.507964+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:23:48.507964+0000","last_undegraded":"2024-04-26T20:23:48.507964+0000","last_fullsized":"2024-04-26T20:23:48.507964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":112649,"num_write":766,"num_write_kb":135273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'211","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.531523+0000","last_change":"2024-04-26T20:14:14.465247+0000","last_active":"2024-04-26T20:23:45.531523+0000","last_peered":"2024-04-26T20:23:45.531523+0000","last_clean":"2024-04-26T20:23:45.531523+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:23:45.531523+0000","last_undegraded":"2024-04-26T20:23:45.531523+0000","last_fullsized":"2024-04-26T20:23:45.531523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:41.490415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'69","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:30.596031+0000","last_change":"2024-04-26T20:14:13.472993+0000","last_active":"2024-04-26T20:23:30.596031+0000","last_peered":"2024-04-26T20:23:30.596031+0000","last_clean":"2024-04-26T20:23:30.596031+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:23:30.596031+0000","last_undegraded":"2024-04-26T20:23:30.596031+0000","last_fullsized":"2024-04-26T20:23:30.596031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:43:47.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'771","reported_seq":828,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.559555+0000","last_change":"2024-04-26T20:15:02.257901+0000","last_active":"2024-04-26T20:23:45.559555+0000","last_peered":"2024-04-26T20:23:45.559555+0000","last_clean":"2024-04-26T20:23:45.559555+0000","last_became_active":"2024-04-26T20:15:02.257484+0000","last_became_peered":"2024-04-26T20:15:02.257484+0000","last_unstale":"2024-04-26T20:23:45.559555+0000","last_undegraded":"2024-04-26T20:23:45.559555+0000","last_fullsized":"2024-04-26T20:23:45.559555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:35.589446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":40921,"num_write":734,"num_write_kb":85912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'191","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.557078+0000","last_change":"2024-04-26T20:14:14.494749+0000","last_active":"2024-04-26T20:23:45.557078+0000","last_peered":"2024-04-26T20:23:45.557078+0000","last_clean":"2024-04-26T20:23:45.557078+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:23:45.557078+0000","last_undegraded":"2024-04-26T20:23:45.557078+0000","last_fullsized":"2024-04-26T20:23:45.557078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:41.441881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'64","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.479081+0000","last_change":"2024-04-26T20:14:13.479770+0000","last_active":"2024-04-26T20:23:48.479081+0000","last_peered":"2024-04-26T20:23:48.479081+0000","last_clean":"2024-04-26T20:23:48.479081+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:23:48.479081+0000","last_undegraded":"2024-04-26T20:23:48.479081+0000","last_fullsized":"2024-04-26T20:23:48.479081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:46.478366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":20,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'711","reported_seq":773,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.626304+0000","last_change":"2024-04-26T20:14:18.642252+0000","last_active":"2024-04-26T20:23:45.626304+0000","last_peered":"2024-04-26T20:23:45.626304+0000","last_clean":"2024-04-26T20:23:45.626304+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:23:45.626304+0000","last_undegraded":"2024-04-26T20:23:45.626304+0000","last_fullsized":"2024-04-26T20:23:45.626304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:50.087584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":103743,"num_write":683,"num_write_kb":106165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'205","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.480188+0000","last_change":"2024-04-26T20:14:14.472207+0000","last_active":"2024-04-26T20:23:48.480188+0000","last_peered":"2024-04-26T20:23:48.480188+0000","last_clean":"2024-04-26T20:23:48.480188+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:23:48.480188+0000","last_undegraded":"2024-04-26T20:23:48.480188+0000","last_fullsized":"2024-04-26T20:23:48.480188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'630","reported_seq":679,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.551691+0000","last_change":"2024-04-26T20:14:13.461626+0000","last_active":"2024-04-26T20:23:37.551691+0000","last_peered":"2024-04-26T20:23:37.551691+0000","last_clean":"2024-04-26T20:23:37.551691+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:23:37.551691+0000","last_undegraded":"2024-04-26T20:23:37.551691+0000","last_fullsized":"2024-04-26T20:23:37.551691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":8218,"num_write":576,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'725","reported_seq":773,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.684907+0000","last_change":"2024-04-26T20:14:18.651856+0000","last_active":"2024-04-26T20:23:45.684907+0000","last_peered":"2024-04-26T20:23:45.684907+0000","last_clean":"2024-04-26T20:23:45.684907+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:23:45.684907+0000","last_undegraded":"2024-04-26T20:23:45.684907+0000","last_fullsized":"2024-04-26T20:23:45.684907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:27.685628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":67432,"num_write":694,"num_write_kb":88740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'192","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.656715+0000","last_change":"2024-04-26T20:14:14.485497+0000","last_active":"2024-04-26T20:23:45.656715+0000","last_peered":"2024-04-26T20:23:45.656715+0000","last_clean":"2024-04-26T20:23:45.656715+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:23:45.656715+0000","last_undegraded":"2024-04-26T20:23:45.656715+0000","last_fullsized":"2024-04-26T20:23:45.656715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.259077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'417","reported_seq":462,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.477040+0000","last_change":"2024-04-26T20:14:13.474558+0000","last_active":"2024-04-26T20:23:37.477040+0000","last_peered":"2024-04-26T20:23:37.477040+0000","last_clean":"2024-04-26T20:23:37.477040+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:23:37.477040+0000","last_undegraded":"2024-04-26T20:23:37.477040+0000","last_fullsized":"2024-04-26T20:23:37.477040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:36.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":8203,"num_write":363,"num_write_kb":12500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'827","reported_seq":892,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.480332+0000","last_change":"2024-04-26T20:14:18.518710+0000","last_active":"2024-04-26T20:23:48.480332+0000","last_peered":"2024-04-26T20:23:48.480332+0000","last_clean":"2024-04-26T20:23:48.480332+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:23:48.480332+0000","last_undegraded":"2024-04-26T20:23:48.480332+0000","last_fullsized":"2024-04-26T20:23:48.480332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":109998,"num_write":786,"num_write_kb":139293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'186","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.546032+0000","last_change":"2024-04-26T20:14:14.487917+0000","last_active":"2024-04-26T20:23:45.546032+0000","last_peered":"2024-04-26T20:23:45.546032+0000","last_clean":"2024-04-26T20:23:45.546032+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:23:45.546032+0000","last_undegraded":"2024-04-26T20:23:45.546032+0000","last_fullsized":"2024-04-26T20:23:45.546032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:36.136911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'403","reported_seq":444,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:49.041105+0000","last_change":"2024-04-26T20:14:13.479128+0000","last_active":"2024-04-26T20:23:49.041105+0000","last_peered":"2024-04-26T20:23:49.041105+0000","last_clean":"2024-04-26T20:23:49.041105+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:23:49.041105+0000","last_undegraded":"2024-04-26T20:23:49.041105+0000","last_fullsized":"2024-04-26T20:23:49.041105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":354,"num_write_kb":4644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'787","reported_seq":854,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.657571+0000","last_change":"2024-04-26T20:14:18.535905+0000","last_active":"2024-04-26T20:23:45.657571+0000","last_peered":"2024-04-26T20:23:45.657571+0000","last_clean":"2024-04-26T20:23:45.657571+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:23:45.657571+0000","last_undegraded":"2024-04-26T20:23:45.657571+0000","last_fullsized":"2024-04-26T20:23:45.657571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:45.258360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":119092,"num_write":739,"num_write_kb":148060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'189","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.544420+0000","last_change":"2024-04-26T20:14:14.495159+0000","last_active":"2024-04-26T20:23:45.544420+0000","last_peered":"2024-04-26T20:23:45.544420+0000","last_clean":"2024-04-26T20:23:45.544420+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:23:45.544420+0000","last_undegraded":"2024-04-26T20:23:45.544420+0000","last_fullsized":"2024-04-26T20:23:45.544420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'112","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.561564+0000","last_change":"2024-04-26T20:14:13.480325+0000","last_active":"2024-04-26T20:23:42.561564+0000","last_peered":"2024-04-26T20:23:42.561564+0000","last_clean":"2024-04-26T20:23:42.561564+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:23:42.561564+0000","last_undegraded":"2024-04-26T20:23:42.561564+0000","last_fullsized":"2024-04-26T20:23:42.561564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:03.797939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":58,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'870","reported_seq":943,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.669266+0000","last_change":"2024-04-26T20:14:18.525506+0000","last_active":"2024-04-26T20:23:45.669266+0000","last_peered":"2024-04-26T20:23:45.669266+0000","last_clean":"2024-04-26T20:23:45.669266+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:23:45.669266+0000","last_undegraded":"2024-04-26T20:23:45.669266+0000","last_fullsized":"2024-04-26T20:23:45.669266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:57.835733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":142355,"num_write":826,"num_write_kb":159668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'213","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.586410+0000","last_change":"2024-04-26T20:14:14.500830+0000","last_active":"2024-04-26T20:23:42.586410+0000","last_peered":"2024-04-26T20:23:42.586410+0000","last_clean":"2024-04-26T20:23:42.586410+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:23:42.586410+0000","last_undegraded":"2024-04-26T20:23:42.586410+0000","last_fullsized":"2024-04-26T20:23:42.586410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:09.510288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'68","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.523670+0000","last_change":"2024-04-26T20:14:13.492901+0000","last_active":"2024-04-26T20:23:42.523670+0000","last_peered":"2024-04-26T20:23:42.523670+0000","last_clean":"2024-04-26T20:23:42.523670+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:23:42.523670+0000","last_undegraded":"2024-04-26T20:23:42.523670+0000","last_fullsized":"2024-04-26T20:23:42.523670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.280099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'925","reported_seq":1034,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.685574+0000","last_change":"2024-04-26T20:14:18.638392+0000","last_active":"2024-04-26T20:23:45.685574+0000","last_peered":"2024-04-26T20:23:45.685574+0000","last_clean":"2024-04-26T20:23:45.685574+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:23:45.685574+0000","last_undegraded":"2024-04-26T20:23:45.685574+0000","last_fullsized":"2024-04-26T20:23:45.685574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:50.820708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":239056,"num_write":898,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'788","reported_seq":849,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.492615+0000","last_change":"2024-04-26T20:14:18.647971+0000","last_active":"2024-04-26T20:23:48.492615+0000","last_peered":"2024-04-26T20:23:48.492615+0000","last_clean":"2024-04-26T20:23:48.492615+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:23:48.492615+0000","last_undegraded":"2024-04-26T20:23:48.492615+0000","last_fullsized":"2024-04-26T20:23:48.492615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":94596,"num_write":748,"num_write_kb":94412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.672173+0000","last_change":"2024-04-26T20:14:14.458590+0000","last_active":"2024-04-26T20:23:45.672173+0000","last_peered":"2024-04-26T20:23:45.672173+0000","last_clean":"2024-04-26T20:23:45.672173+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:23:45.672173+0000","last_undegraded":"2024-04-26T20:23:45.672173+0000","last_fullsized":"2024-04-26T20:23:45.672173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'801","reported_seq":839,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.611959+0000","last_change":"2024-04-26T20:14:13.471725+0000","last_active":"2024-04-26T20:23:34.611959+0000","last_peered":"2024-04-26T20:23:34.611959+0000","last_clean":"2024-04-26T20:23:34.611959+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:23:34.611959+0000","last_undegraded":"2024-04-26T20:23:34.611959+0000","last_fullsized":"2024-04-26T20:23:34.611959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:59.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":733,"num_write_kb":8579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'775","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.485449+0000","last_change":"2024-04-26T20:14:18.531646+0000","last_active":"2024-04-26T20:23:45.485449+0000","last_peered":"2024-04-26T20:23:45.485449+0000","last_clean":"2024-04-26T20:23:45.485449+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:23:45.485449+0000","last_undegraded":"2024-04-26T20:23:45.485449+0000","last_fullsized":"2024-04-26T20:23:45.485449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:26.920658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":124481,"num_write":743,"num_write_kb":150909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'212","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.591955+0000","last_change":"2024-04-26T20:14:14.460800+0000","last_active":"2024-04-26T20:23:42.591955+0000","last_peered":"2024-04-26T20:23:42.591955+0000","last_clean":"2024-04-26T20:23:42.591955+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:23:42.591955+0000","last_undegraded":"2024-04-26T20:23:42.591955+0000","last_fullsized":"2024-04-26T20:23:42.591955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:32.729156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'109","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.664931+0000","last_change":"2024-04-26T20:14:13.473733+0000","last_active":"2024-04-26T20:23:34.664931+0000","last_peered":"2024-04-26T20:23:34.664931+0000","last_clean":"2024-04-26T20:23:34.664931+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:23:34.664931+0000","last_undegraded":"2024-04-26T20:23:34.664931+0000","last_fullsized":"2024-04-26T20:23:34.664931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:06.101669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":58,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'495","reported_seq":540,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:34.512132+0000","last_change":"2024-04-26T20:14:13.482096+0000","last_active":"2024-04-26T20:23:34.512132+0000","last_peered":"2024-04-26T20:23:34.512132+0000","last_clean":"2024-04-26T20:23:34.512132+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:23:34.512132+0000","last_undegraded":"2024-04-26T20:23:34.512132+0000","last_fullsized":"2024-04-26T20:23:34.512132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.431091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10061,"num_write":440,"num_write_kb":12524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'167","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.646229+0000","last_change":"2024-04-26T20:14:14.484526+0000","last_active":"2024-04-26T20:23:45.646229+0000","last_peered":"2024-04-26T20:23:45.646229+0000","last_clean":"2024-04-26T20:23:45.646229+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:23:45.646229+0000","last_undegraded":"2024-04-26T20:23:45.646229+0000","last_fullsized":"2024-04-26T20:23:45.646229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'742","reported_seq":798,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.503538+0000","last_change":"2024-04-26T20:14:18.522729+0000","last_active":"2024-04-26T20:23:48.503538+0000","last_peered":"2024-04-26T20:23:48.503538+0000","last_clean":"2024-04-26T20:23:48.503538+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:23:48.503538+0000","last_undegraded":"2024-04-26T20:23:48.503538+0000","last_fullsized":"2024-04-26T20:23:48.503538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":82664,"num_write":709,"num_write_kb":110622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'168","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.515468+0000","last_change":"2024-04-26T20:14:13.487909+0000","last_active":"2024-04-26T20:23:37.515468+0000","last_peered":"2024-04-26T20:23:37.515468+0000","last_clean":"2024-04-26T20:23:37.515468+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:23:37.515468+0000","last_undegraded":"2024-04-26T20:23:37.515468+0000","last_fullsized":"2024-04-26T20:23:37.515468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:12.418560+0000","last_clean_scrub_stamp":"2024-04-26T20:14:12.418560+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:42.794823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":105,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'200","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.592422+0000","last_change":"2024-04-26T20:14:14.481244+0000","last_active":"2024-04-26T20:23:45.592422+0000","last_peered":"2024-04-26T20:23:45.592422+0000","last_clean":"2024-04-26T20:23:45.592422+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:23:45.592422+0000","last_undegraded":"2024-04-26T20:23:45.592422+0000","last_fullsized":"2024-04-26T20:23:45.592422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:15.416078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'741","reported_seq":806,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.613022+0000","last_change":"2024-04-26T20:14:18.525966+0000","last_active":"2024-04-26T20:23:45.613022+0000","last_peered":"2024-04-26T20:23:45.613022+0000","last_clean":"2024-04-26T20:23:45.613022+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:23:45.613022+0000","last_undegraded":"2024-04-26T20:23:45.613022+0000","last_fullsized":"2024-04-26T20:23:45.613022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:23.445749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":120190,"num_write":702,"num_write_kb":135097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'204","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.534565+0000","last_change":"2024-04-26T20:14:14.463649+0000","last_active":"2024-04-26T20:23:45.534565+0000","last_peered":"2024-04-26T20:23:45.534565+0000","last_clean":"2024-04-26T20:23:45.534565+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:23:45.534565+0000","last_undegraded":"2024-04-26T20:23:45.534565+0000","last_fullsized":"2024-04-26T20:23:45.534565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:14.006056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'208","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.690733+0000","last_change":"2024-04-26T20:14:14.467586+0000","last_active":"2024-04-26T20:23:45.690733+0000","last_peered":"2024-04-26T20:23:45.690733+0000","last_clean":"2024-04-26T20:23:45.690733+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:23:45.690733+0000","last_undegraded":"2024-04-26T20:23:45.690733+0000","last_fullsized":"2024-04-26T20:23:45.690733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'229","reported_seq":269,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.593424+0000","last_change":"2024-04-26T20:15:02.206712+0000","last_active":"2024-04-26T20:23:45.593424+0000","last_peered":"2024-04-26T20:23:45.593424+0000","last_clean":"2024-04-26T20:23:45.593424+0000","last_became_active":"2024-04-26T20:15:02.205525+0000","last_became_peered":"2024-04-26T20:15:02.205525+0000","last_unstale":"2024-04-26T20:23:45.593424+0000","last_undegraded":"2024-04-26T20:23:45.593424+0000","last_fullsized":"2024-04-26T20:23:45.593424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:45.077649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'195","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.685188+0000","last_change":"2024-04-26T20:14:14.451519+0000","last_active":"2024-04-26T20:23:45.685188+0000","last_peered":"2024-04-26T20:23:45.685188+0000","last_clean":"2024-04-26T20:23:45.685188+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:23:45.685188+0000","last_undegraded":"2024-04-26T20:23:45.685188+0000","last_fullsized":"2024-04-26T20:23:45.685188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'187","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.494048+0000","last_change":"2024-04-26T20:14:14.482237+0000","last_active":"2024-04-26T20:23:48.494048+0000","last_peered":"2024-04-26T20:23:48.494048+0000","last_clean":"2024-04-26T20:23:48.494048+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:23:48.494048+0000","last_undegraded":"2024-04-26T20:23:48.494048+0000","last_fullsized":"2024-04-26T20:23:48.494048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:43.876150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'191","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.285248+0000","last_change":"2024-04-26T20:23:52.285269+0000","last_active":"2024-04-26T20:23:52.285248+0000","last_peered":"2024-04-26T20:23:52.285248+0000","last_clean":"2024-04-26T20:23:52.285248+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:23:52.285248+0000","last_undegraded":"2024-04-26T20:23:52.285248+0000","last_fullsized":"2024-04-26T20:23:52.285248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'191","last_scrub_stamp":"2024-04-26T20:23:52.285185+0000","last_deep_scrub":"31'191","last_deep_scrub_stamp":"2024-04-26T20:23:52.285185+0000","last_clean_scrub_stamp":"2024-04-26T20:23:52.285185+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:58.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'225","reported_seq":261,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.486595+0000","last_change":"2024-04-26T20:14:14.472871+0000","last_active":"2024-04-26T20:23:45.486595+0000","last_peered":"2024-04-26T20:23:45.486595+0000","last_clean":"2024-04-26T20:23:45.486595+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:23:45.486595+0000","last_undegraded":"2024-04-26T20:23:45.486595+0000","last_fullsized":"2024-04-26T20:23:45.486595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:54.220783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.624464+0000","last_change":"2024-04-26T20:14:14.479317+0000","last_active":"2024-04-26T20:23:45.624464+0000","last_peered":"2024-04-26T20:23:45.624464+0000","last_clean":"2024-04-26T20:23:45.624464+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:23:45.624464+0000","last_undegraded":"2024-04-26T20:23:45.624464+0000","last_fullsized":"2024-04-26T20:23:45.624464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:25.173619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'214","reported_seq":249,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.502784+0000","last_change":"2024-04-26T20:14:14.483889+0000","last_active":"2024-04-26T20:23:48.502784+0000","last_peered":"2024-04-26T20:23:48.502784+0000","last_clean":"2024-04-26T20:23:48.502784+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:23:48.502784+0000","last_undegraded":"2024-04-26T20:23:48.502784+0000","last_fullsized":"2024-04-26T20:23:48.502784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:08.277309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'201","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.576334+0000","last_change":"2024-04-26T20:14:14.482240+0000","last_active":"2024-04-26T20:23:45.576334+0000","last_peered":"2024-04-26T20:23:45.576334+0000","last_clean":"2024-04-26T20:23:45.576334+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:23:45.576334+0000","last_undegraded":"2024-04-26T20:23:45.576334+0000","last_fullsized":"2024-04-26T20:23:45.576334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'202","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.552817+0000","last_change":"2024-04-26T20:14:14.498419+0000","last_active":"2024-04-26T20:23:42.552817+0000","last_peered":"2024-04-26T20:23:42.552817+0000","last_clean":"2024-04-26T20:23:42.552817+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:23:42.552817+0000","last_undegraded":"2024-04-26T20:23:42.552817+0000","last_fullsized":"2024-04-26T20:23:42.552817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:01.927366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'200","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:51.676401+0000","last_change":"2024-04-26T20:23:51.676445+0000","last_active":"2024-04-26T20:23:51.676401+0000","last_peered":"2024-04-26T20:23:51.676401+0000","last_clean":"2024-04-26T20:23:51.676401+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:23:51.676401+0000","last_undegraded":"2024-04-26T20:23:51.676401+0000","last_fullsized":"2024-04-26T20:23:51.676401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'200","last_scrub_stamp":"2024-04-26T20:23:51.676316+0000","last_deep_scrub":"31'200","last_deep_scrub_stamp":"2024-04-26T20:23:51.676316+0000","last_clean_scrub_stamp":"2024-04-26T20:23:51.676316+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:36.711505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'212","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:37.883184+0000","last_change":"2024-04-26T20:14:14.486318+0000","last_active":"2024-04-26T20:23:37.883184+0000","last_peered":"2024-04-26T20:23:37.883184+0000","last_clean":"2024-04-26T20:23:37.883184+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:23:37.883184+0000","last_undegraded":"2024-04-26T20:23:37.883184+0000","last_fullsized":"2024-04-26T20:23:37.883184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.360155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'198","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.593248+0000","last_change":"2024-04-26T20:14:14.502699+0000","last_active":"2024-04-26T20:23:45.593248+0000","last_peered":"2024-04-26T20:23:45.593248+0000","last_clean":"2024-04-26T20:23:45.593248+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:23:45.593248+0000","last_undegraded":"2024-04-26T20:23:45.593248+0000","last_fullsized":"2024-04-26T20:23:45.593248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:06.279114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'192","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.703370+0000","last_change":"2024-04-26T20:14:14.468448+0000","last_active":"2024-04-26T20:23:45.703370+0000","last_peered":"2024-04-26T20:23:45.703370+0000","last_clean":"2024-04-26T20:23:45.703370+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:23:45.703370+0000","last_undegraded":"2024-04-26T20:23:45.703370+0000","last_fullsized":"2024-04-26T20:23:45.703370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'200","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.644246+0000","last_change":"2024-04-26T20:14:14.506503+0000","last_active":"2024-04-26T20:23:45.644246+0000","last_peered":"2024-04-26T20:23:45.644246+0000","last_clean":"2024-04-26T20:23:45.644246+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:23:45.644246+0000","last_undegraded":"2024-04-26T20:23:45.644246+0000","last_fullsized":"2024-04-26T20:23:45.644246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:42.611221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"31'215","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.662631+0000","last_change":"2024-04-26T20:14:14.473733+0000","last_active":"2024-04-26T20:23:45.662631+0000","last_peered":"2024-04-26T20:23:45.662631+0000","last_clean":"2024-04-26T20:23:45.662631+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:23:45.662631+0000","last_undegraded":"2024-04-26T20:23:45.662631+0000","last_fullsized":"2024-04-26T20:23:45.662631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:45.543764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'203","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.654943+0000","last_change":"2024-04-26T20:14:14.486073+0000","last_active":"2024-04-26T20:23:45.654943+0000","last_peered":"2024-04-26T20:23:45.654943+0000","last_clean":"2024-04-26T20:23:45.654943+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:23:45.654943+0000","last_undegraded":"2024-04-26T20:23:45.654943+0000","last_fullsized":"2024-04-26T20:23:45.654943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'203","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.621483+0000","last_change":"2024-04-26T20:14:14.466354+0000","last_active":"2024-04-26T20:23:45.621483+0000","last_peered":"2024-04-26T20:23:45.621483+0000","last_clean":"2024-04-26T20:23:45.621483+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:23:45.621483+0000","last_undegraded":"2024-04-26T20:23:45.621483+0000","last_fullsized":"2024-04-26T20:23:45.621483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.572541+0000","last_change":"2024-04-26T20:14:14.468308+0000","last_active":"2024-04-26T20:23:42.572541+0000","last_peered":"2024-04-26T20:23:42.572541+0000","last_clean":"2024-04-26T20:23:42.572541+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:23:42.572541+0000","last_undegraded":"2024-04-26T20:23:42.572541+0000","last_fullsized":"2024-04-26T20:23:42.572541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:51.865148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'169","reported_seq":204,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.623638+0000","last_change":"2024-04-26T20:14:14.483041+0000","last_active":"2024-04-26T20:23:45.623638+0000","last_peered":"2024-04-26T20:23:45.623638+0000","last_clean":"2024-04-26T20:23:45.623638+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:23:45.623638+0000","last_undegraded":"2024-04-26T20:23:45.623638+0000","last_fullsized":"2024-04-26T20:23:45.623638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:51.873361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'178","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.606304+0000","last_change":"2024-04-26T20:14:14.484672+0000","last_active":"2024-04-26T20:23:45.606304+0000","last_peered":"2024-04-26T20:23:45.606304+0000","last_clean":"2024-04-26T20:23:45.606304+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:23:45.606304+0000","last_undegraded":"2024-04-26T20:23:45.606304+0000","last_fullsized":"2024-04-26T20:23:45.606304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:54:35.942759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'186","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.602059+0000","last_change":"2024-04-26T20:14:14.498566+0000","last_active":"2024-04-26T20:23:45.602059+0000","last_peered":"2024-04-26T20:23:45.602059+0000","last_clean":"2024-04-26T20:23:45.602059+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:23:45.602059+0000","last_undegraded":"2024-04-26T20:23:45.602059+0000","last_fullsized":"2024-04-26T20:23:45.602059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:40.210282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'201","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.555153+0000","last_change":"2024-04-26T20:14:14.503334+0000","last_active":"2024-04-26T20:23:45.555153+0000","last_peered":"2024-04-26T20:23:45.555153+0000","last_clean":"2024-04-26T20:23:45.555153+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:23:45.555153+0000","last_undegraded":"2024-04-26T20:23:45.555153+0000","last_fullsized":"2024-04-26T20:23:45.555153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:12.069699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'178","reported_seq":213,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.669267+0000","last_change":"2024-04-26T20:14:14.473382+0000","last_active":"2024-04-26T20:23:45.669267+0000","last_peered":"2024-04-26T20:23:45.669267+0000","last_clean":"2024-04-26T20:23:45.669267+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:23:45.669267+0000","last_undegraded":"2024-04-26T20:23:45.669267+0000","last_fullsized":"2024-04-26T20:23:45.669267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:13.760838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'199","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:48.482913+0000","last_change":"2024-04-26T20:15:02.200465+0000","last_active":"2024-04-26T20:23:48.482913+0000","last_peered":"2024-04-26T20:23:48.482913+0000","last_clean":"2024-04-26T20:23:48.482913+0000","last_became_active":"2024-04-26T20:15:02.200094+0000","last_became_peered":"2024-04-26T20:15:02.200094+0000","last_unstale":"2024-04-26T20:23:48.482913+0000","last_undegraded":"2024-04-26T20:23:48.482913+0000","last_fullsized":"2024-04-26T20:23:48.482913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'186","reported_seq":208,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.694605+0000","last_change":"2024-04-26T20:15:02.201696+0000","last_active":"2024-04-26T20:23:45.694605+0000","last_peered":"2024-04-26T20:23:45.694605+0000","last_clean":"2024-04-26T20:23:45.694605+0000","last_became_active":"2024-04-26T20:15:02.201216+0000","last_became_peered":"2024-04-26T20:15:02.201216+0000","last_unstale":"2024-04-26T20:23:45.694605+0000","last_undegraded":"2024-04-26T20:23:45.694605+0000","last_fullsized":"2024-04-26T20:23:45.694605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'208","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.571572+0000","last_change":"2024-04-26T20:14:14.485207+0000","last_active":"2024-04-26T20:23:45.571572+0000","last_peered":"2024-04-26T20:23:45.571572+0000","last_clean":"2024-04-26T20:23:45.571572+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:23:45.571572+0000","last_undegraded":"2024-04-26T20:23:45.571572+0000","last_fullsized":"2024-04-26T20:23:45.571572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:23.761375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'190","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.657147+0000","last_change":"2024-04-26T20:14:14.496748+0000","last_active":"2024-04-26T20:23:45.657147+0000","last_peered":"2024-04-26T20:23:45.657147+0000","last_clean":"2024-04-26T20:23:45.657147+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:23:45.657147+0000","last_undegraded":"2024-04-26T20:23:45.657147+0000","last_fullsized":"2024-04-26T20:23:45.657147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:08.743856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'185","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.604136+0000","last_change":"2024-04-26T20:14:14.458396+0000","last_active":"2024-04-26T20:23:42.604136+0000","last_peered":"2024-04-26T20:23:42.604136+0000","last_clean":"2024-04-26T20:23:42.604136+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:23:42.604136+0000","last_undegraded":"2024-04-26T20:23:42.604136+0000","last_fullsized":"2024-04-26T20:23:42.604136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'208","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:45.578588+0000","last_change":"2024-04-26T20:14:14.461067+0000","last_active":"2024-04-26T20:23:45.578588+0000","last_peered":"2024-04-26T20:23:45.578588+0000","last_clean":"2024-04-26T20:23:45.578588+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:23:45.578588+0000","last_undegraded":"2024-04-26T20:23:45.578588+0000","last_fullsized":"2024-04-26T20:23:45.578588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'206","reported_seq":242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:42.548498+0000","last_change":"2024-04-26T20:14:14.503624+0000","last_active":"2024-04-26T20:23:42.548498+0000","last_peered":"2024-04-26T20:23:42.548498+0000","last_clean":"2024-04-26T20:23:42.548498+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:23:42.548498+0000","last_undegraded":"2024-04-26T20:23:42.548498+0000","last_fullsized":"2024-04-26T20:23:42.548498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:13.427722+0000","last_clean_scrub_stamp":"2024-04-26T20:14:13.427722+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:30.319946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1174,"num_read_kb":3559915,"num_write":24393,"num_write_kb":4217550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25532,"ondisk_log_size":25532,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12641,"ondisk_log_size":12641,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":142686817,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":593,"num_read_kb":126729,"num_write":7019,"num_write_kb":145598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97067008,"data_stored":285373634,"data_compressed":42853718,"data_compressed_allocated":56066048,"data_compressed_original":244523008,"omap_allocated":0,"internal_metadata":0},"log_size":8279,"ondisk_log_size":8279,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542264,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85736,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286104,"statfs":{"total":96636764160,"available":96548970496,"internally_reserved":0,"allocated":14647296,"data_stored":51070463,"data_compressed":7663032,"data_compressed_allocated":9916416,"data_compressed_original":46551040,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542265,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87944,"kb_used_data":12352,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94283896,"statfs":{"total":96636764160,"available":96546709504,"internally_reserved":0,"allocated":12648448,"data_stored":46285310,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542265,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83272,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94288568,"statfs":{"total":96636764160,"available":96551493632,"internally_reserved":0,"allocated":12124160,"data_stored":29508122,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542264,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111120,"kb_used_data":17544,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94260720,"statfs":{"total":96636764160,"available":96522977280,"internally_reserved":0,"allocated":17965056,"data_stored":46284674,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542264,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86468,"kb_used_data":10876,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285372,"statfs":{"total":96636764160,"available":96548220928,"internally_reserved":0,"allocated":11137024,"data_stored":35254034,"data_compressed":5452892,"data_compressed_allocated":6918144,"data_compressed_original":31244288,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542263,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55016,"kb_used_data":5792,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316824,"statfs":{"total":96636764160,"available":96580427776,"internally_reserved":0,"allocated":5931008,"data_stored":12806030,"data_compressed":1792737,"data_compressed_allocated":2543616,"data_compressed_original":9629696,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542264,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107640,"kb_used_data":14064,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94264200,"statfs":{"total":96636764160,"available":96526540800,"internally_reserved":0,"allocated":14401536,"data_stored":36420893,"data_compressed":5393569,"data_compressed_allocated":7294976,"data_compressed_original":29528064,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542263,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73884,"kb_used_data":10772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94297956,"statfs":{"total":96636764160,"available":96561106944,"internally_reserved":0,"allocated":11030528,"data_stored":30097772,"data_compressed":4439375,"data_compressed_allocated":5836800,"data_compressed_original":25112576,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":29360788,"data_compressed":4405923,"data_compressed_allocated":5791744,"data_compressed_original":24539136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14065664,"data_stored":36274277,"data_compressed":5393569,"data_compressed_allocated":7294976,"data_compressed_original":29528064,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5595136,"data_stored":12659414,"data_compressed":1792737,"data_compressed_allocated":2543616,"data_compressed_original":9629696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10801152,"data_stored":35107418,"data_compressed":5452892,"data_compressed_allocated":6918144,"data_compressed_original":31244288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17629184,"data_stored":46138058,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11788288,"data_stored":29361506,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12312576,"data_stored":46138694,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":50333479,"data_compressed":7629580,"data_compressed_allocated":9871360,"data_compressed_original":45977600,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:23:55.543 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.543 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.544 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.545 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.546 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.547 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T20:14:07.323173+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.548 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.549 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.550 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.551 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.552 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-26T20:14:12.418560+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.553 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.554 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.555 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.556 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.557 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T20:14:13.427722+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:23:55.557 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T20:24:15.558 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:24:15.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.707+0000 7fc181a00640 1 Processor -- start 2024-04-26T20:24:15.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.707+0000 7fc181a00640 1 -- start start 2024-04-26T20:24:15.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc181a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:15.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc181a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc17c0c9720 0x7fc17c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:15.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc181a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17c0c9d90 con 0x7fc17c0c7b80 2024-04-26T20:24:15.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc181a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc17c0ca630 con 0x7fc17c0c9720 2024-04-26T20:24:15.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc181a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc17c0ca070 con 0x7fc17c153af0 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc17b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc17c0c9720 0x7fc17c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc173e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc17c0c7b80 0x7fc17c0c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38976/0 (socket says 172.21.15.16:38976) 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc173e00640 1 -- 172.21.15.16:0/1655720414 learned_addr learned my addr 172.21.15.16:0/1655720414 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc17aa00640 1 --2- 172.21.15.16:0/1655720414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc17b400640 1 -- 172.21.15.16:0/1655720414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 msgr2=0x7fc17c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc17b400640 1 --2- 172.21.15.16:0/1655720414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc17b400640 1 -- 172.21.15.16:0/1655720414 >> v1:172.21.15.16:6789/0 conn(0x7fc17c0c7b80 legacy=0x7fc17c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:15.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.711+0000 7fc17b400640 1 -- 172.21.15.16:0/1655720414 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c0ca350 con 0x7fc17c0c9720 2024-04-26T20:24:15.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc17b400640 1 --2- 172.21.15.16:0/1655720414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0c7f80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc174009d90 tx=0x7fc17401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc251b89ffd4f5c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:15.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc17a000640 1 -- 172.21.15.16:0/1655720414 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740b4070 con 0x7fc17c0c9720 2024-04-26T20:24:15.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc17a000640 1 -- 172.21.15.16:0/1655720414 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1740af600 con 0x7fc17c0c9720 2024-04-26T20:24:15.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc17a000640 1 -- 172.21.15.16:0/1655720414 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740af9d0 con 0x7fc17c0c9720 2024-04-26T20:24:15.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 -- 172.21.15.16:0/1655720414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 msgr2=0x7fc17c0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:15.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 --2- 172.21.15.16:0/1655720414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0c7f80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc174009d90 tx=0x7fc17401f150 comp rx=0 tx=0).stop 2024-04-26T20:24:15.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 -- 172.21.15.16:0/1655720414 shutdown_connections 2024-04-26T20:24:15.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 --2- 172.21.15.16:0/1655720414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0c7f80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 --2- 172.21.15.16:0/1655720414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 -- 172.21.15.16:0/1655720414 >> 172.21.15.16:0/1655720414 conn(0x7fc17c06c380 msgr2=0x7fc17c06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:15.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 -- 172.21.15.16:0/1655720414 shutdown_connections 2024-04-26T20:24:15.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 -- 172.21.15.16:0/1655720414 wait complete. 2024-04-26T20:24:15.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 Processor -- start 2024-04-26T20:24:15.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.715+0000 7fc181a00640 1 -- start start 2024-04-26T20:24:15.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17c0c7b80 0x7fc17c1f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:15.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c153ed0 con 0x7fc17c0c9720 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c15d290 con 0x7fc17c0c7b80 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc17c154050 con 0x7fc17c153af0 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33134/0 (socket says 172.21.15.16:33134) 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 -- 172.21.15.16:0/2281689813 learned_addr learned my addr 172.21.15.16:0/2281689813 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc17b400640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc17aa00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17c0c7b80 0x7fc17c1f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:15.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 -- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 msgr2=0x7fc17c0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 -- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17c0c7b80 msgr2=0x7fc17c1f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17c0c7b80 0x7fc17c1f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 -- 172.21.15.16:0/2281689813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c0bf740 con 0x7fc17c0c9720 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc17aa00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17c0c7b80 0x7fc17c1f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc173e00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0bee80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c420 tx=0x7fc16400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc172a00640 1 -- 172.21.15.16:0/2281689813 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164017070 con 0x7fc17c0c9720 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc172a00640 1 -- 172.21.15.16:0/2281689813 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc164005cf0 con 0x7fc17c0c9720 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc172a00640 1 -- 172.21.15.16:0/2281689813 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640072f0 con 0x7fc17c0c9720 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c0c5670 con 0x7fc17c0c9720 2024-04-26T20:24:15.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1f2290 con 0x7fc17c0c9720 2024-04-26T20:24:15.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c077c20 con 0x7fc17c0c9720 2024-04-26T20:24:15.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.719+0000 7fc172a00640 1 -- 172.21.15.16:0/2281689813 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc16401a070 con 0x7fc17c0c9720 2024-04-26T20:24:15.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.723+0000 7fc172a00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc158068380 0x7fc15806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:15.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.723+0000 7fc172a00640 1 -- 172.21.15.16:0/2281689813 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fc164086240 con 0x7fc17c0c9720 2024-04-26T20:24:15.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.723+0000 7fc17aa00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc158068380 0x7fc15806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:15.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.723+0000 7fc17aa00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc158068380 0x7fc15806a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009b10 tx=0x7fc16c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:15.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.727+0000 7fc172a00640 1 -- 172.21.15.16:0/2281689813 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc17c0c5670 con 0x7fc17c0c9720 2024-04-26T20:24:15.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.887+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc17c0c82e0 con 0x7fc158068380 2024-04-26T20:24:15.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.911+0000 7fc172a00640 1 -- 172.21.15.16:0/2281689813 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335645 (secure 0 0 0) 0x7fc17c0c82e0 con 0x7fc158068380 2024-04-26T20:24:15.917 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:24:15.919 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:24:15.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc158068380 msgr2=0x7fc15806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:15.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc158068380 0x7fc15806a840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009b10 tx=0x7fc16c008040 comp rx=0 tx=0).stop 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 msgr2=0x7fc17c0bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0bee80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c420 tx=0x7fc16400c8e0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 shutdown_connections 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc158068380 0x7fc15806a840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc17c153af0 0x7fc17c0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc17c0c9720 0x7fc17c0bee80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 --2- 172.21.15.16:0/2281689813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc17c0c7b80 0x7fc17c1f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 >> 172.21.15.16:0/2281689813 conn(0x7fc17c06c380 msgr2=0x7fc17c15b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 shutdown_connections 2024-04-26T20:24:15.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:15.915+0000 7fc181a00640 1 -- 172.21.15.16:0/2281689813 wait complete. 2024-04-26T20:24:15.938 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-04-26T20:24:15.204516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":143278323,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1883,"num_read_kb":3686744,"num_write":31572,"num_write_kb":4365566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46658,"ondisk_log_size":46658,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":691088,"kb_used_data":97552,"kb_used_omap":12,"kb_used_meta":593459,"kb_avail":754283632,"statfs":{"total":773094113280,"available":772386439168,"internally_reserved":0,"allocated":99893248,"data_stored":287729574,"data_compressed":42920622,"data_compressed_allocated":56156160,"data_compressed_original":245669888,"omap_allocated":12752,"internal_metadata":607702576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005513"},"pg_stats":[{"pgid":"2.1f","version":"31'143","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.757384+0000","last_change":"2024-04-26T20:23:53.757416+0000","last_active":"2024-04-26T20:23:53.757384+0000","last_peered":"2024-04-26T20:23:53.757384+0000","last_clean":"2024-04-26T20:23:53.757384+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:23:53.757384+0000","last_undegraded":"2024-04-26T20:23:53.757384+0000","last_fullsized":"2024-04-26T20:23:53.757384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2024-04-26T20:23:53.757319+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2024-04-26T20:23:53.757319+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.757319+0000","objects_scrubbed":5,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:27.300847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":4124,"num_write":97,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.571885+0000","last_change":"2024-04-26T20:24:05.571912+0000","last_active":"2024-04-26T20:24:05.571885+0000","last_peered":"2024-04-26T20:24:05.571885+0000","last_clean":"2024-04-26T20:24:05.571885+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:24:05.571885+0000","last_undegraded":"2024-04-26T20:24:05.571885+0000","last_fullsized":"2024-04-26T20:24:05.571885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:24:05.571795+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:24:05.571795+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.571795+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:56.055857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'820","reported_seq":900,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:11.441856+0000","last_change":"2024-04-26T20:24:11.441911+0000","last_active":"2024-04-26T20:24:11.441856+0000","last_peered":"2024-04-26T20:24:11.441856+0000","last_clean":"2024-04-26T20:24:11.441856+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:24:11.441856+0000","last_undegraded":"2024-04-26T20:24:11.441856+0000","last_fullsized":"2024-04-26T20:24:11.441856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'820","last_scrub_stamp":"2024-04-26T20:24:11.441754+0000","last_deep_scrub":"31'820","last_deep_scrub_stamp":"2024-04-26T20:24:11.441754+0000","last_clean_scrub_stamp":"2024-04-26T20:24:11.441754+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:05.733933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":127167,"num_write":792,"num_write_kb":160617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'68","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.680233+0000","last_change":"2024-04-26T20:23:58.680262+0000","last_active":"2024-04-26T20:23:58.680233+0000","last_peered":"2024-04-26T20:23:58.680233+0000","last_clean":"2024-04-26T20:23:58.680233+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:23:58.680233+0000","last_undegraded":"2024-04-26T20:23:58.680233+0000","last_fullsized":"2024-04-26T20:23:58.680233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'68","last_scrub_stamp":"2024-04-26T20:23:58.680148+0000","last_deep_scrub":"31'68","last_deep_scrub_stamp":"2024-04-26T20:23:58.680148+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.680148+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:20.401142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":16,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'178","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.703422+0000","last_change":"2024-04-26T20:24:02.703449+0000","last_active":"2024-04-26T20:24:02.703422+0000","last_peered":"2024-04-26T20:24:02.703422+0000","last_clean":"2024-04-26T20:24:02.703422+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:24:02.703422+0000","last_undegraded":"2024-04-26T20:24:02.703422+0000","last_fullsized":"2024-04-26T20:24:02.703422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'178","last_scrub_stamp":"2024-04-26T20:24:02.703345+0000","last_deep_scrub":"31'178","last_deep_scrub_stamp":"2024-04-26T20:24:02.703345+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.703345+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:47.967746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'783","reported_seq":858,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.829777+0000","last_change":"2024-04-26T20:23:59.829777+0000","last_active":"2024-04-26T20:23:59.829777+0000","last_peered":"2024-04-26T20:23:59.829777+0000","last_clean":"2024-04-26T20:23:59.829777+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:23:59.829777+0000","last_undegraded":"2024-04-26T20:23:59.829777+0000","last_fullsized":"2024-04-26T20:23:59.829777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'783","last_scrub_stamp":"2024-04-26T20:23:59.829532+0000","last_deep_scrub":"31'783","last_deep_scrub_stamp":"2024-04-26T20:23:59.829532+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.829532+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:33.174963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":94315,"num_write":748,"num_write_kb":130983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'216","reported_seq":268,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.430394+0000","last_change":"2024-04-26T20:23:59.430474+0000","last_active":"2024-04-26T20:23:59.430394+0000","last_peered":"2024-04-26T20:23:59.430394+0000","last_clean":"2024-04-26T20:23:59.430394+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:23:59.430394+0000","last_undegraded":"2024-04-26T20:23:59.430394+0000","last_fullsized":"2024-04-26T20:23:59.430394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'216","last_scrub_stamp":"2024-04-26T20:23:59.430204+0000","last_deep_scrub":"31'216","last_deep_scrub_stamp":"2024-04-26T20:23:59.430204+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.430204+0000","objects_scrubbed":5,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:00.796789+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12305,"num_write":138,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'175","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.198665+0000","last_change":"2024-04-26T20:24:05.198723+0000","last_active":"2024-04-26T20:24:05.198665+0000","last_peered":"2024-04-26T20:24:05.198665+0000","last_clean":"2024-04-26T20:24:05.198665+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:24:05.198665+0000","last_undegraded":"2024-04-26T20:24:05.198665+0000","last_fullsized":"2024-04-26T20:24:05.198665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'175","last_scrub_stamp":"2024-04-26T20:24:05.198469+0000","last_deep_scrub":"31'175","last_deep_scrub_stamp":"2024-04-26T20:24:05.198469+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.198469+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:42.903867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'765","reported_seq":839,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.884358+0000","last_change":"2024-04-26T20:24:01.884420+0000","last_active":"2024-04-26T20:24:01.884358+0000","last_peered":"2024-04-26T20:24:01.884358+0000","last_clean":"2024-04-26T20:24:01.884358+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:24:01.884358+0000","last_undegraded":"2024-04-26T20:24:01.884358+0000","last_fullsized":"2024-04-26T20:24:01.884358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'765","last_scrub_stamp":"2024-04-26T20:24:01.884182+0000","last_deep_scrub":"31'765","last_deep_scrub_stamp":"2024-04-26T20:24:01.884182+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.884182+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:21.792690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":92426,"num_write":730,"num_write_kb":119140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'167","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.449582+0000","last_change":"2024-04-26T20:24:00.449652+0000","last_active":"2024-04-26T20:24:00.449582+0000","last_peered":"2024-04-26T20:24:00.449582+0000","last_clean":"2024-04-26T20:24:00.449582+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:24:00.449582+0000","last_undegraded":"2024-04-26T20:24:00.449582+0000","last_fullsized":"2024-04-26T20:24:00.449582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2024-04-26T20:24:00.449405+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2024-04-26T20:24:00.449405+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.449405+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:25.379098+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":110,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'179","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.727160+0000","last_change":"2024-04-26T20:23:59.727203+0000","last_active":"2024-04-26T20:23:59.727160+0000","last_peered":"2024-04-26T20:23:59.727160+0000","last_clean":"2024-04-26T20:23:59.727160+0000","last_became_active":"2024-04-26T20:15:02.201092+0000","last_became_peered":"2024-04-26T20:15:02.201092+0000","last_unstale":"2024-04-26T20:23:59.727160+0000","last_undegraded":"2024-04-26T20:23:59.727160+0000","last_fullsized":"2024-04-26T20:23:59.727160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'179","last_scrub_stamp":"2024-04-26T20:23:59.727068+0000","last_deep_scrub":"31'179","last_deep_scrub_stamp":"2024-04-26T20:23:59.727068+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.727068+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:27.726572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'807","reported_seq":882,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.963179+0000","last_change":"2024-04-26T20:24:04.963298+0000","last_active":"2024-04-26T20:24:04.963179+0000","last_peered":"2024-04-26T20:24:04.963179+0000","last_clean":"2024-04-26T20:24:04.963179+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:24:04.963179+0000","last_undegraded":"2024-04-26T20:24:04.963179+0000","last_fullsized":"2024-04-26T20:24:04.963179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'807","last_scrub_stamp":"2024-04-26T20:24:04.962956+0000","last_deep_scrub":"31'807","last_deep_scrub_stamp":"2024-04-26T20:24:04.962956+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.962956+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:26.228315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":115919,"num_write":775,"num_write_kb":110976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'212","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.257865+0000","last_change":"2024-04-26T20:24:04.257922+0000","last_active":"2024-04-26T20:24:04.257865+0000","last_peered":"2024-04-26T20:24:04.257865+0000","last_clean":"2024-04-26T20:24:04.257865+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:24:04.257865+0000","last_undegraded":"2024-04-26T20:24:04.257865+0000","last_fullsized":"2024-04-26T20:24:04.257865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:04.257699+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:04.257699+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.257699+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:31.279917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'165","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.391045+0000","last_change":"2024-04-26T20:24:02.391120+0000","last_active":"2024-04-26T20:24:02.391045+0000","last_peered":"2024-04-26T20:24:02.391045+0000","last_clean":"2024-04-26T20:24:02.391045+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:24:02.391045+0000","last_undegraded":"2024-04-26T20:24:02.391045+0000","last_fullsized":"2024-04-26T20:24:02.391045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2024-04-26T20:24:02.390871+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2024-04-26T20:24:02.390871+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.390871+0000","objects_scrubbed":4,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:17.527653+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":106,"num_write_kb":8336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'790","reported_seq":866,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.960382+0000","last_change":"2024-04-26T20:24:07.960444+0000","last_active":"2024-04-26T20:24:07.960382+0000","last_peered":"2024-04-26T20:24:07.960382+0000","last_clean":"2024-04-26T20:24:07.960382+0000","last_became_active":"2024-04-26T20:15:02.207782+0000","last_became_peered":"2024-04-26T20:15:02.207782+0000","last_unstale":"2024-04-26T20:24:07.960382+0000","last_undegraded":"2024-04-26T20:24:07.960382+0000","last_fullsized":"2024-04-26T20:24:07.960382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'790","last_scrub_stamp":"2024-04-26T20:24:07.960194+0000","last_deep_scrub":"31'790","last_deep_scrub_stamp":"2024-04-26T20:24:07.960194+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.960194+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:14.658884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":86223,"num_write":746,"num_write_kb":106297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'203","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.661883+0000","last_change":"2024-04-26T20:24:01.661912+0000","last_active":"2024-04-26T20:24:01.661883+0000","last_peered":"2024-04-26T20:24:01.661883+0000","last_clean":"2024-04-26T20:24:01.661883+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:24:01.661883+0000","last_undegraded":"2024-04-26T20:24:01.661883+0000","last_fullsized":"2024-04-26T20:24:01.661883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'203","last_scrub_stamp":"2024-04-26T20:24:01.661747+0000","last_deep_scrub":"31'203","last_deep_scrub_stamp":"2024-04-26T20:24:01.661747+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.661747+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:07.796745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'168","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.373255+0000","last_change":"2024-04-26T20:23:54.373280+0000","last_active":"2024-04-26T20:23:54.373255+0000","last_peered":"2024-04-26T20:23:54.373255+0000","last_clean":"2024-04-26T20:23:54.373255+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:23:54.373255+0000","last_undegraded":"2024-04-26T20:23:54.373255+0000","last_fullsized":"2024-04-26T20:23:54.373255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'168","last_scrub_stamp":"2024-04-26T20:23:54.373190+0000","last_deep_scrub":"31'168","last_deep_scrub_stamp":"2024-04-26T20:23:54.373190+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.373190+0000","objects_scrubbed":2,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:38.713751+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4098,"num_write":113,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'846","reported_seq":911,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.948253+0000","last_change":"2024-04-26T20:24:05.948315+0000","last_active":"2024-04-26T20:24:05.948253+0000","last_peered":"2024-04-26T20:24:05.948253+0000","last_clean":"2024-04-26T20:24:05.948253+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:24:05.948253+0000","last_undegraded":"2024-04-26T20:24:05.948253+0000","last_fullsized":"2024-04-26T20:24:05.948253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'846","last_scrub_stamp":"2024-04-26T20:24:05.948083+0000","last_deep_scrub":"31'846","last_deep_scrub_stamp":"2024-04-26T20:24:05.948083+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.948083+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:34.129251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":76471,"num_write":804,"num_write_kb":93343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'198","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.643734+0000","last_change":"2024-04-26T20:24:02.643782+0000","last_active":"2024-04-26T20:24:02.643734+0000","last_peered":"2024-04-26T20:24:02.643734+0000","last_clean":"2024-04-26T20:24:02.643734+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:24:02.643734+0000","last_undegraded":"2024-04-26T20:24:02.643734+0000","last_fullsized":"2024-04-26T20:24:02.643734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'198","last_scrub_stamp":"2024-04-26T20:24:02.643622+0000","last_deep_scrub":"31'198","last_deep_scrub_stamp":"2024-04-26T20:24:02.643622+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.643622+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:45.898524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'62","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.341615+0000","last_change":"2024-04-26T20:23:58.341669+0000","last_active":"2024-04-26T20:23:58.341615+0000","last_peered":"2024-04-26T20:23:58.341615+0000","last_clean":"2024-04-26T20:23:58.341615+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:23:58.341615+0000","last_undegraded":"2024-04-26T20:23:58.341615+0000","last_fullsized":"2024-04-26T20:23:58.341615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'62","last_scrub_stamp":"2024-04-26T20:23:58.341515+0000","last_deep_scrub":"31'62","last_deep_scrub_stamp":"2024-04-26T20:23:58.341515+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.341515+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:54.552782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'793","reported_seq":880,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.267506+0000","last_change":"2024-04-26T20:24:07.267530+0000","last_active":"2024-04-26T20:24:07.267506+0000","last_peered":"2024-04-26T20:24:07.267506+0000","last_clean":"2024-04-26T20:24:07.267506+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:24:07.267506+0000","last_undegraded":"2024-04-26T20:24:07.267506+0000","last_fullsized":"2024-04-26T20:24:07.267506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'793","last_scrub_stamp":"2024-04-26T20:24:07.267423+0000","last_deep_scrub":"31'793","last_deep_scrub_stamp":"2024-04-26T20:24:07.267423+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.267423+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:36.743007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":121482,"num_write":758,"num_write_kb":114987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'218","reported_seq":263,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.869977+0000","last_change":"2024-04-26T20:23:54.870034+0000","last_active":"2024-04-26T20:23:54.869977+0000","last_peered":"2024-04-26T20:23:54.869977+0000","last_clean":"2024-04-26T20:23:54.869977+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:23:54.869977+0000","last_undegraded":"2024-04-26T20:23:54.869977+0000","last_fullsized":"2024-04-26T20:23:54.869977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'218","last_scrub_stamp":"2024-04-26T20:23:54.869809+0000","last_deep_scrub":"31'218","last_deep_scrub_stamp":"2024-04-26T20:23:54.869809+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.869809+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:11.569670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'444","reported_seq":494,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.399103+0000","last_change":"2024-04-26T20:23:58.399179+0000","last_active":"2024-04-26T20:23:58.399103+0000","last_peered":"2024-04-26T20:23:58.399103+0000","last_clean":"2024-04-26T20:23:58.399103+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:23:58.399103+0000","last_undegraded":"2024-04-26T20:23:58.399103+0000","last_fullsized":"2024-04-26T20:23:58.399103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'444","last_scrub_stamp":"2024-04-26T20:23:58.398944+0000","last_deep_scrub":"31'444","last_deep_scrub_stamp":"2024-04-26T20:23:58.398944+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.398944+0000","objects_scrubbed":2,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.162304+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":388,"num_write_kb":4324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'737","reported_seq":804,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.860019+0000","last_change":"2024-04-26T20:24:00.860090+0000","last_active":"2024-04-26T20:24:00.860019+0000","last_peered":"2024-04-26T20:24:00.860019+0000","last_clean":"2024-04-26T20:24:00.860019+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:24:00.860019+0000","last_undegraded":"2024-04-26T20:24:00.860019+0000","last_fullsized":"2024-04-26T20:24:00.860019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'737","last_scrub_stamp":"2024-04-26T20:24:00.859819+0000","last_deep_scrub":"31'737","last_deep_scrub_stamp":"2024-04-26T20:24:00.859819+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.859819+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:10.365583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":100836,"num_write":691,"num_write_kb":105101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'215","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.760440+0000","last_change":"2024-04-26T20:23:56.760463+0000","last_active":"2024-04-26T20:23:56.760440+0000","last_peered":"2024-04-26T20:23:56.760440+0000","last_clean":"2024-04-26T20:23:56.760440+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:23:56.760440+0000","last_undegraded":"2024-04-26T20:23:56.760440+0000","last_fullsized":"2024-04-26T20:23:56.760440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'215","last_scrub_stamp":"2024-04-26T20:23:56.760361+0000","last_deep_scrub":"31'215","last_deep_scrub_stamp":"2024-04-26T20:23:56.760361+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.760361+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:46:05.006438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'65","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.197393+0000","last_change":"2024-04-26T20:23:58.197465+0000","last_active":"2024-04-26T20:23:58.197393+0000","last_peered":"2024-04-26T20:23:58.197393+0000","last_clean":"2024-04-26T20:23:58.197393+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:23:58.197393+0000","last_undegraded":"2024-04-26T20:23:58.197393+0000","last_fullsized":"2024-04-26T20:23:58.197393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2024-04-26T20:23:58.197223+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2024-04-26T20:23:58.197223+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.197223+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:14.642043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'832","reported_seq":935,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.946918+0000","last_change":"2024-04-26T20:24:06.946980+0000","last_active":"2024-04-26T20:24:06.946918+0000","last_peered":"2024-04-26T20:24:06.946918+0000","last_clean":"2024-04-26T20:24:06.946918+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:24:06.946918+0000","last_undegraded":"2024-04-26T20:24:06.946918+0000","last_fullsized":"2024-04-26T20:24:06.946918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'832","last_scrub_stamp":"2024-04-26T20:24:06.946731+0000","last_deep_scrub":"31'832","last_deep_scrub_stamp":"2024-04-26T20:24:06.946731+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.946731+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:43.790500+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":203084,"num_write":796,"num_write_kb":205909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'171","reported_seq":216,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.529843+0000","last_change":"2024-04-26T20:24:06.529868+0000","last_active":"2024-04-26T20:24:06.529843+0000","last_peered":"2024-04-26T20:24:06.529843+0000","last_clean":"2024-04-26T20:24:06.529843+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:24:06.529843+0000","last_undegraded":"2024-04-26T20:24:06.529843+0000","last_fullsized":"2024-04-26T20:24:06.529843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'171","last_scrub_stamp":"2024-04-26T20:24:06.529757+0000","last_deep_scrub":"31'171","last_deep_scrub_stamp":"2024-04-26T20:24:06.529757+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.529757+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:55.508467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'402","reported_seq":454,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.426722+0000","last_change":"2024-04-26T20:23:56.426777+0000","last_active":"2024-04-26T20:23:56.426722+0000","last_peered":"2024-04-26T20:23:56.426722+0000","last_clean":"2024-04-26T20:23:56.426722+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:23:56.426722+0000","last_undegraded":"2024-04-26T20:23:56.426722+0000","last_fullsized":"2024-04-26T20:23:56.426722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'402","last_scrub_stamp":"2024-04-26T20:23:56.426628+0000","last_deep_scrub":"31'402","last_deep_scrub_stamp":"2024-04-26T20:23:56.426628+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.426628+0000","objects_scrubbed":2,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:55.578723+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":842,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'787","reported_seq":846,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:12.462725+0000","last_change":"2024-04-26T20:24:12.462752+0000","last_active":"2024-04-26T20:24:12.462725+0000","last_peered":"2024-04-26T20:24:12.462725+0000","last_clean":"2024-04-26T20:24:12.462725+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:24:12.462725+0000","last_undegraded":"2024-04-26T20:24:12.462725+0000","last_fullsized":"2024-04-26T20:24:12.462725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'787","last_scrub_stamp":"2024-04-26T20:24:12.462635+0000","last_deep_scrub":"31'787","last_deep_scrub_stamp":"2024-04-26T20:24:12.462635+0000","last_clean_scrub_stamp":"2024-04-26T20:24:12.462635+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:53.699746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":65331,"num_write":754,"num_write_kb":82709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'193","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.280068+0000","last_change":"2024-04-26T20:24:02.280094+0000","last_active":"2024-04-26T20:24:02.280068+0000","last_peered":"2024-04-26T20:24:02.280068+0000","last_clean":"2024-04-26T20:24:02.280068+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:24:02.280068+0000","last_undegraded":"2024-04-26T20:24:02.280068+0000","last_fullsized":"2024-04-26T20:24:02.280068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'193","last_scrub_stamp":"2024-04-26T20:24:02.279976+0000","last_deep_scrub":"31'193","last_deep_scrub_stamp":"2024-04-26T20:24:02.279976+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.279976+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:02.433288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'201","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.396562+0000","last_change":"2024-04-26T20:24:01.396651+0000","last_active":"2024-04-26T20:24:01.396562+0000","last_peered":"2024-04-26T20:24:01.396562+0000","last_clean":"2024-04-26T20:24:01.396562+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:24:01.396562+0000","last_undegraded":"2024-04-26T20:24:01.396562+0000","last_fullsized":"2024-04-26T20:24:01.396562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:24:01.396356+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:24:01.396356+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.396356+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.784652+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":138,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'760","reported_seq":826,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.678264+0000","last_change":"2024-04-26T20:24:06.678290+0000","last_active":"2024-04-26T20:24:06.678264+0000","last_peered":"2024-04-26T20:24:06.678264+0000","last_clean":"2024-04-26T20:24:06.678264+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:24:06.678264+0000","last_undegraded":"2024-04-26T20:24:06.678264+0000","last_fullsized":"2024-04-26T20:24:06.678264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'760","last_scrub_stamp":"2024-04-26T20:24:06.678178+0000","last_deep_scrub":"31'760","last_deep_scrub_stamp":"2024-04-26T20:24:06.678178+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.678178+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:41.225818+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":72924,"num_write":718,"num_write_kb":105217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'209","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.174770+0000","last_change":"2024-04-26T20:24:03.174829+0000","last_active":"2024-04-26T20:24:03.174770+0000","last_peered":"2024-04-26T20:24:03.174770+0000","last_clean":"2024-04-26T20:24:03.174770+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:24:03.174770+0000","last_undegraded":"2024-04-26T20:24:03.174770+0000","last_fullsized":"2024-04-26T20:24:03.174770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'209","last_scrub_stamp":"2024-04-26T20:24:03.174599+0000","last_deep_scrub":"31'209","last_deep_scrub_stamp":"2024-04-26T20:24:03.174599+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.174599+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:20.096861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'56","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.313281+0000","last_change":"2024-04-26T20:23:53.313303+0000","last_active":"2024-04-26T20:23:53.313281+0000","last_peered":"2024-04-26T20:23:53.313281+0000","last_clean":"2024-04-26T20:23:53.313281+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:23:53.313281+0000","last_undegraded":"2024-04-26T20:23:53.313281+0000","last_fullsized":"2024-04-26T20:23:53.313281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2024-04-26T20:23:53.313214+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2024-04-26T20:23:53.313214+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.313214+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:16.528108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'792","reported_seq":854,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.665359+0000","last_change":"2024-04-26T20:24:01.665385+0000","last_active":"2024-04-26T20:24:01.665359+0000","last_peered":"2024-04-26T20:24:01.665359+0000","last_clean":"2024-04-26T20:24:01.665359+0000","last_became_active":"2024-04-26T20:15:02.205610+0000","last_became_peered":"2024-04-26T20:15:02.205610+0000","last_unstale":"2024-04-26T20:24:01.665359+0000","last_undegraded":"2024-04-26T20:24:01.665359+0000","last_fullsized":"2024-04-26T20:24:01.665359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'792","last_scrub_stamp":"2024-04-26T20:24:01.665270+0000","last_deep_scrub":"31'792","last_deep_scrub_stamp":"2024-04-26T20:24:01.665270+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.665270+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:58.198793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":101392,"num_write":763,"num_write_kb":117505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'191","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.860609+0000","last_change":"2024-04-26T20:23:56.860666+0000","last_active":"2024-04-26T20:23:56.860609+0000","last_peered":"2024-04-26T20:23:56.860609+0000","last_clean":"2024-04-26T20:23:56.860609+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:23:56.860609+0000","last_undegraded":"2024-04-26T20:23:56.860609+0000","last_fullsized":"2024-04-26T20:23:56.860609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'191","last_scrub_stamp":"2024-04-26T20:23:56.860431+0000","last_deep_scrub":"31'191","last_deep_scrub_stamp":"2024-04-26T20:23:56.860431+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.860431+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:38.950591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'625","reported_seq":673,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.199108+0000","last_change":"2024-04-26T20:23:59.199176+0000","last_active":"2024-04-26T20:23:59.199108+0000","last_peered":"2024-04-26T20:23:59.199108+0000","last_clean":"2024-04-26T20:23:59.199108+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:23:59.199108+0000","last_undegraded":"2024-04-26T20:23:59.199108+0000","last_fullsized":"2024-04-26T20:23:59.199108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'625","last_scrub_stamp":"2024-04-26T20:23:59.198811+0000","last_deep_scrub":"31'625","last_deep_scrub_stamp":"2024-04-26T20:23:59.198811+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.198811+0000","objects_scrubbed":2,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:48.920508+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":569,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'766","reported_seq":854,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.224386+0000","last_change":"2024-04-26T20:24:05.224413+0000","last_active":"2024-04-26T20:24:05.224386+0000","last_peered":"2024-04-26T20:24:05.224386+0000","last_clean":"2024-04-26T20:24:05.224386+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:24:05.224386+0000","last_undegraded":"2024-04-26T20:24:05.224386+0000","last_fullsized":"2024-04-26T20:24:05.224386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'766","last_scrub_stamp":"2024-04-26T20:24:05.224292+0000","last_deep_scrub":"31'766","last_deep_scrub_stamp":"2024-04-26T20:24:05.224292+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.224292+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:16.950161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":139574,"num_write":733,"num_write_kb":123608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.339178+0000","last_change":"2024-04-26T20:24:00.339203+0000","last_active":"2024-04-26T20:24:00.339178+0000","last_peered":"2024-04-26T20:24:00.339178+0000","last_clean":"2024-04-26T20:24:00.339178+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:24:00.339178+0000","last_undegraded":"2024-04-26T20:24:00.339178+0000","last_fullsized":"2024-04-26T20:24:00.339178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:24:00.339108+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:24:00.339108+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.339108+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:02:33.764464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'366","reported_seq":711,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.696547+0000","last_change":"2024-04-26T20:23:54.696578+0000","last_active":"2024-04-26T20:23:54.696547+0000","last_peered":"2024-04-26T20:23:54.696547+0000","last_clean":"2024-04-26T20:23:54.696547+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:23:54.696547+0000","last_undegraded":"2024-04-26T20:23:54.696547+0000","last_fullsized":"2024-04-26T20:23:54.696547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'366","last_scrub_stamp":"2024-04-26T20:23:54.696482+0000","last_deep_scrub":"31'366","last_deep_scrub_stamp":"2024-04-26T20:23:54.696482+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.696482+0000","objects_scrubbed":3,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:54.841562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551177,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":1724,"num_write":301,"num_write_kb":1707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'750","reported_seq":812,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.238522+0000","last_change":"2024-04-26T20:24:06.238548+0000","last_active":"2024-04-26T20:24:06.238522+0000","last_peered":"2024-04-26T20:24:06.238522+0000","last_clean":"2024-04-26T20:24:06.238522+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:24:06.238522+0000","last_undegraded":"2024-04-26T20:24:06.238522+0000","last_fullsized":"2024-04-26T20:24:06.238522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'750","last_scrub_stamp":"2024-04-26T20:24:06.238434+0000","last_deep_scrub":"31'750","last_deep_scrub_stamp":"2024-04-26T20:24:06.238434+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.238434+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:59.799891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":61996,"num_write":721,"num_write_kb":88897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'190","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.774219+0000","last_change":"2024-04-26T20:23:59.774247+0000","last_active":"2024-04-26T20:23:59.774219+0000","last_peered":"2024-04-26T20:23:59.774219+0000","last_clean":"2024-04-26T20:23:59.774219+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:23:59.774219+0000","last_undegraded":"2024-04-26T20:23:59.774219+0000","last_fullsized":"2024-04-26T20:23:59.774219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'190","last_scrub_stamp":"2024-04-26T20:23:59.774114+0000","last_deep_scrub":"31'190","last_deep_scrub_stamp":"2024-04-26T20:23:59.774114+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.774114+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:05.419958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'275","reported_seq":329,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.363296+0000","last_change":"2024-04-26T20:23:57.363378+0000","last_active":"2024-04-26T20:23:57.363296+0000","last_peered":"2024-04-26T20:23:57.363296+0000","last_clean":"2024-04-26T20:23:57.363296+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:23:57.363296+0000","last_undegraded":"2024-04-26T20:23:57.363296+0000","last_fullsized":"2024-04-26T20:23:57.363296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'275","last_scrub_stamp":"2024-04-26T20:23:57.363110+0000","last_deep_scrub":"31'275","last_deep_scrub_stamp":"2024-04-26T20:23:57.363110+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.363110+0000","objects_scrubbed":3,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.300903+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":213,"num_write_kb":8309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'884","reported_seq":955,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.667745+0000","last_change":"2024-04-26T20:24:05.667820+0000","last_active":"2024-04-26T20:24:05.667745+0000","last_peered":"2024-04-26T20:24:05.667745+0000","last_clean":"2024-04-26T20:24:05.667745+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:24:05.667745+0000","last_undegraded":"2024-04-26T20:24:05.667745+0000","last_fullsized":"2024-04-26T20:24:05.667745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'884","last_scrub_stamp":"2024-04-26T20:24:05.667640+0000","last_deep_scrub":"31'884","last_deep_scrub_stamp":"2024-04-26T20:24:05.667640+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.667640+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:59.213330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":98068,"num_write":848,"num_write_kb":148105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'185","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.649375+0000","last_change":"2024-04-26T20:23:56.649417+0000","last_active":"2024-04-26T20:23:56.649375+0000","last_peered":"2024-04-26T20:23:56.649375+0000","last_clean":"2024-04-26T20:23:56.649375+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:23:56.649375+0000","last_undegraded":"2024-04-26T20:23:56.649375+0000","last_fullsized":"2024-04-26T20:23:56.649375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2024-04-26T20:23:56.649249+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2024-04-26T20:23:56.649249+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.649249+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:09.923325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'83","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.128984+0000","last_change":"2024-04-26T20:23:55.129077+0000","last_active":"2024-04-26T20:23:55.128984+0000","last_peered":"2024-04-26T20:23:55.128984+0000","last_clean":"2024-04-26T20:23:55.128984+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:23:55.128984+0000","last_undegraded":"2024-04-26T20:23:55.128984+0000","last_fullsized":"2024-04-26T20:23:55.128984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-04-26T20:23:55.128813+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-04-26T20:23:55.128813+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.128813+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.799050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":13,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.355262+0000","last_change":"2024-04-26T20:23:56.355262+0000","last_active":"2024-04-26T20:23:56.355262+0000","last_peered":"2024-04-26T20:23:56.355262+0000","last_clean":"2024-04-26T20:23:56.355262+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:23:56.355262+0000","last_undegraded":"2024-04-26T20:23:56.355262+0000","last_fullsized":"2024-04-26T20:23:56.355262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-04-26T20:23:56.355054+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-04-26T20:23:56.355054+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.355054+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:32.603916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'776","reported_seq":845,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.348276+0000","last_change":"2024-04-26T20:24:09.348339+0000","last_active":"2024-04-26T20:24:09.348276+0000","last_peered":"2024-04-26T20:24:09.348276+0000","last_clean":"2024-04-26T20:24:09.348276+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:24:09.348276+0000","last_undegraded":"2024-04-26T20:24:09.348276+0000","last_fullsized":"2024-04-26T20:24:09.348276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'776","last_scrub_stamp":"2024-04-26T20:24:09.348093+0000","last_deep_scrub":"31'776","last_deep_scrub_stamp":"2024-04-26T20:24:09.348093+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.348093+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:27.788168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":82002,"num_write":745,"num_write_kb":109731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:10.354974+0000","last_change":"2024-04-26T20:24:10.355032+0000","last_active":"2024-04-26T20:24:10.354974+0000","last_peered":"2024-04-26T20:24:10.354974+0000","last_clean":"2024-04-26T20:24:10.354974+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:24:10.354974+0000","last_undegraded":"2024-04-26T20:24:10.354974+0000","last_fullsized":"2024-04-26T20:24:10.354974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:24:10.354779+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:24:10.354779+0000","last_clean_scrub_stamp":"2024-04-26T20:24:10.354779+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:54.733567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'71","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.707381+0000","last_change":"2024-04-26T20:23:53.707405+0000","last_active":"2024-04-26T20:23:53.707381+0000","last_peered":"2024-04-26T20:23:53.707381+0000","last_clean":"2024-04-26T20:23:53.707381+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:23:53.707381+0000","last_undegraded":"2024-04-26T20:23:53.707381+0000","last_fullsized":"2024-04-26T20:23:53.707381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2024-04-26T20:23:53.707323+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2024-04-26T20:23:53.707323+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.707323+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:45.597973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'858","reported_seq":947,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.309851+0000","last_change":"2024-04-26T20:24:08.309913+0000","last_active":"2024-04-26T20:24:08.309851+0000","last_peered":"2024-04-26T20:24:08.309851+0000","last_clean":"2024-04-26T20:24:08.309851+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:24:08.309851+0000","last_undegraded":"2024-04-26T20:24:08.309851+0000","last_fullsized":"2024-04-26T20:24:08.309851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'858","last_scrub_stamp":"2024-04-26T20:24:08.309674+0000","last_deep_scrub":"31'858","last_deep_scrub_stamp":"2024-04-26T20:24:08.309674+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.309674+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:06.438966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":152120,"num_write":818,"num_write_kb":168870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'212","reported_seq":256,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.133517+0000","last_change":"2024-04-26T20:24:02.133577+0000","last_active":"2024-04-26T20:24:02.133517+0000","last_peered":"2024-04-26T20:24:02.133517+0000","last_clean":"2024-04-26T20:24:02.133517+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:24:02.133517+0000","last_undegraded":"2024-04-26T20:24:02.133517+0000","last_fullsized":"2024-04-26T20:24:02.133517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:02.133346+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:02.133346+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.133346+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:21.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'564","reported_seq":613,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.417079+0000","last_change":"2024-04-26T20:23:55.417125+0000","last_active":"2024-04-26T20:23:55.417079+0000","last_peered":"2024-04-26T20:23:55.417079+0000","last_clean":"2024-04-26T20:23:55.417079+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:23:55.417079+0000","last_undegraded":"2024-04-26T20:23:55.417079+0000","last_fullsized":"2024-04-26T20:23:55.417079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'564","last_scrub_stamp":"2024-04-26T20:23:55.416975+0000","last_deep_scrub":"31'564","last_deep_scrub_stamp":"2024-04-26T20:23:55.416975+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.416975+0000","objects_scrubbed":2,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:11.546142+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":503,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'816","reported_seq":904,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.687704+0000","last_change":"2024-04-26T20:24:04.687774+0000","last_active":"2024-04-26T20:24:04.687704+0000","last_peered":"2024-04-26T20:24:04.687704+0000","last_clean":"2024-04-26T20:24:04.687704+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:24:04.687704+0000","last_undegraded":"2024-04-26T20:24:04.687704+0000","last_fullsized":"2024-04-26T20:24:04.687704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'816","last_scrub_stamp":"2024-04-26T20:24:04.687604+0000","last_deep_scrub":"31'816","last_deep_scrub_stamp":"2024-04-26T20:24:04.687604+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.687604+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:53.854535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":135112,"num_write":783,"num_write_kb":135635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'193","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:11.386235+0000","last_change":"2024-04-26T20:24:11.386388+0000","last_active":"2024-04-26T20:24:11.386235+0000","last_peered":"2024-04-26T20:24:11.386235+0000","last_clean":"2024-04-26T20:24:11.386235+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:24:11.386235+0000","last_undegraded":"2024-04-26T20:24:11.386235+0000","last_fullsized":"2024-04-26T20:24:11.386235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'193","last_scrub_stamp":"2024-04-26T20:24:11.386005+0000","last_deep_scrub":"31'193","last_deep_scrub_stamp":"2024-04-26T20:24:11.386005+0000","last_clean_scrub_stamp":"2024-04-26T20:24:11.386005+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:51.691287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'282","reported_seq":331,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.685065+0000","last_change":"2024-04-26T20:23:55.685092+0000","last_active":"2024-04-26T20:23:55.685065+0000","last_peered":"2024-04-26T20:23:55.685065+0000","last_clean":"2024-04-26T20:23:55.685065+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:23:55.685065+0000","last_undegraded":"2024-04-26T20:23:55.685065+0000","last_fullsized":"2024-04-26T20:23:55.685065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'282","last_scrub_stamp":"2024-04-26T20:23:55.685000+0000","last_deep_scrub":"31'282","last_deep_scrub_stamp":"2024-04-26T20:23:55.685000+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.685000+0000","objects_scrubbed":2,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:41.327730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":224,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'847","reported_seq":929,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.218410+0000","last_change":"2024-04-26T20:24:08.218472+0000","last_active":"2024-04-26T20:24:08.218410+0000","last_peered":"2024-04-26T20:24:08.218410+0000","last_clean":"2024-04-26T20:24:08.218410+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:24:08.218410+0000","last_undegraded":"2024-04-26T20:24:08.218410+0000","last_fullsized":"2024-04-26T20:24:08.218410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'847","last_scrub_stamp":"2024-04-26T20:24:08.218226+0000","last_deep_scrub":"31'847","last_deep_scrub_stamp":"2024-04-26T20:24:08.218226+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.218226+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:44.675267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":124531,"num_write":810,"num_write_kb":151625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'176","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.378086+0000","last_change":"2024-04-26T20:24:04.378155+0000","last_active":"2024-04-26T20:24:04.378086+0000","last_peered":"2024-04-26T20:24:04.378086+0000","last_clean":"2024-04-26T20:24:04.378086+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:24:04.378086+0000","last_undegraded":"2024-04-26T20:24:04.378086+0000","last_fullsized":"2024-04-26T20:24:04.378086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'176","last_scrub_stamp":"2024-04-26T20:24:04.377906+0000","last_deep_scrub":"31'176","last_deep_scrub_stamp":"2024-04-26T20:24:04.377906+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.377906+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:05.462439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'214","reported_seq":265,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.937295+0000","last_change":"2024-04-26T20:23:53.937448+0000","last_active":"2024-04-26T20:23:53.937295+0000","last_peered":"2024-04-26T20:23:53.937295+0000","last_clean":"2024-04-26T20:23:53.937295+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:23:53.937295+0000","last_undegraded":"2024-04-26T20:23:53.937295+0000","last_fullsized":"2024-04-26T20:23:53.937295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'214","last_scrub_stamp":"2024-04-26T20:23:53.937098+0000","last_deep_scrub":"31'214","last_deep_scrub_stamp":"2024-04-26T20:23:53.937098+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.937098+0000","objects_scrubbed":3,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:00.768497+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":4101,"num_write":169,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'867","reported_seq":951,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.917157+0000","last_change":"2024-04-26T20:24:03.917220+0000","last_active":"2024-04-26T20:24:03.917157+0000","last_peered":"2024-04-26T20:24:03.917157+0000","last_clean":"2024-04-26T20:24:03.917157+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:24:03.917157+0000","last_undegraded":"2024-04-26T20:24:03.917157+0000","last_fullsized":"2024-04-26T20:24:03.917157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'867","last_scrub_stamp":"2024-04-26T20:24:03.916985+0000","last_deep_scrub":"31'867","last_deep_scrub_stamp":"2024-04-26T20:24:03.916985+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.916985+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:15.946470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":151765,"num_write":832,"num_write_kb":200590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'231","reported_seq":276,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.298419+0000","last_change":"2024-04-26T20:24:06.298482+0000","last_active":"2024-04-26T20:24:06.298419+0000","last_peered":"2024-04-26T20:24:06.298419+0000","last_clean":"2024-04-26T20:24:06.298419+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:24:06.298419+0000","last_undegraded":"2024-04-26T20:24:06.298419+0000","last_fullsized":"2024-04-26T20:24:06.298419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2024-04-26T20:24:06.298216+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2024-04-26T20:24:06.298216+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.298216+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:46.519230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'363","reported_seq":424,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.716731+0000","last_change":"2024-04-26T20:23:52.716731+0000","last_active":"2024-04-26T20:23:52.716731+0000","last_peered":"2024-04-26T20:23:52.716731+0000","last_clean":"2024-04-26T20:23:52.716731+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:23:52.716731+0000","last_undegraded":"2024-04-26T20:23:52.716731+0000","last_fullsized":"2024-04-26T20:23:52.716731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'362","last_scrub_stamp":"2024-04-26T20:23:52.716593+0000","last_deep_scrub":"31'362","last_deep_scrub_stamp":"2024-04-26T20:23:52.716593+0000","last_clean_scrub_stamp":"2024-04-26T20:23:52.716593+0000","objects_scrubbed":10,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:06.893420+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6914455,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":304,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'794","reported_seq":865,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.710688+0000","last_change":"2024-04-26T20:24:03.710714+0000","last_active":"2024-04-26T20:24:03.710688+0000","last_peered":"2024-04-26T20:24:03.710688+0000","last_clean":"2024-04-26T20:24:03.710688+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:24:03.710688+0000","last_undegraded":"2024-04-26T20:24:03.710688+0000","last_fullsized":"2024-04-26T20:24:03.710688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'794","last_scrub_stamp":"2024-04-26T20:24:03.710607+0000","last_deep_scrub":"31'794","last_deep_scrub_stamp":"2024-04-26T20:24:03.710607+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.710607+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:36.258743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":112649,"num_write":766,"num_write_kb":135273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'211","reported_seq":256,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.227281+0000","last_change":"2024-04-26T20:24:01.227337+0000","last_active":"2024-04-26T20:24:01.227281+0000","last_peered":"2024-04-26T20:24:01.227281+0000","last_clean":"2024-04-26T20:24:01.227281+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:24:01.227281+0000","last_undegraded":"2024-04-26T20:24:01.227281+0000","last_fullsized":"2024-04-26T20:24:01.227281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'211","last_scrub_stamp":"2024-04-26T20:24:01.227124+0000","last_deep_scrub":"31'211","last_deep_scrub_stamp":"2024-04-26T20:24:01.227124+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.227124+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:56.408496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'71","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.319506+0000","last_change":"2024-04-26T20:23:55.319556+0000","last_active":"2024-04-26T20:23:55.319506+0000","last_peered":"2024-04-26T20:23:55.319506+0000","last_clean":"2024-04-26T20:23:55.319506+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:23:55.319506+0000","last_undegraded":"2024-04-26T20:23:55.319506+0000","last_fullsized":"2024-04-26T20:23:55.319506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2024-04-26T20:23:55.319386+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2024-04-26T20:23:55.319386+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.319386+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:44.234800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'771","reported_seq":830,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.969907+0000","last_change":"2024-04-26T20:15:02.257901+0000","last_active":"2024-04-26T20:23:52.969907+0000","last_peered":"2024-04-26T20:23:52.969907+0000","last_clean":"2024-04-26T20:23:52.969907+0000","last_became_active":"2024-04-26T20:15:02.257484+0000","last_became_peered":"2024-04-26T20:15:02.257484+0000","last_unstale":"2024-04-26T20:23:52.969907+0000","last_undegraded":"2024-04-26T20:23:52.969907+0000","last_fullsized":"2024-04-26T20:23:52.969907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T20:14:17.477206+0000","last_clean_scrub_stamp":"2024-04-26T20:14:17.477206+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":40921,"num_write":734,"num_write_kb":85912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'191","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.337683+0000","last_change":"2024-04-26T20:24:05.337797+0000","last_active":"2024-04-26T20:24:05.337683+0000","last_peered":"2024-04-26T20:24:05.337683+0000","last_clean":"2024-04-26T20:24:05.337683+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:24:05.337683+0000","last_undegraded":"2024-04-26T20:24:05.337683+0000","last_fullsized":"2024-04-26T20:24:05.337683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'191","last_scrub_stamp":"2024-04-26T20:24:05.337431+0000","last_deep_scrub":"31'191","last_deep_scrub_stamp":"2024-04-26T20:24:05.337431+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.337431+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:33.983007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'65","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.106551+0000","last_change":"2024-04-26T20:23:57.106616+0000","last_active":"2024-04-26T20:23:57.106551+0000","last_peered":"2024-04-26T20:23:57.106551+0000","last_clean":"2024-04-26T20:23:57.106551+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:23:57.106551+0000","last_undegraded":"2024-04-26T20:23:57.106551+0000","last_fullsized":"2024-04-26T20:23:57.106551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2024-04-26T20:23:57.106369+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2024-04-26T20:23:57.106369+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.106369+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:53.878594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":20,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'711","reported_seq":782,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:10.461229+0000","last_change":"2024-04-26T20:24:10.461257+0000","last_active":"2024-04-26T20:24:10.461229+0000","last_peered":"2024-04-26T20:24:10.461229+0000","last_clean":"2024-04-26T20:24:10.461229+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:24:10.461229+0000","last_undegraded":"2024-04-26T20:24:10.461229+0000","last_fullsized":"2024-04-26T20:24:10.461229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'711","last_scrub_stamp":"2024-04-26T20:24:10.461135+0000","last_deep_scrub":"31'711","last_deep_scrub_stamp":"2024-04-26T20:24:10.461135+0000","last_clean_scrub_stamp":"2024-04-26T20:24:10.461135+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:34.322091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":103743,"num_write":683,"num_write_kb":106165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'205","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.741807+0000","last_change":"2024-04-26T20:23:58.741829+0000","last_active":"2024-04-26T20:23:58.741807+0000","last_peered":"2024-04-26T20:23:58.741807+0000","last_clean":"2024-04-26T20:23:58.741807+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:23:58.741807+0000","last_undegraded":"2024-04-26T20:23:58.741807+0000","last_fullsized":"2024-04-26T20:23:58.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'205","last_scrub_stamp":"2024-04-26T20:23:58.741737+0000","last_deep_scrub":"31'205","last_deep_scrub_stamp":"2024-04-26T20:23:58.741737+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.741737+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:08.553649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'636","reported_seq":693,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.741810+0000","last_change":"2024-04-26T20:23:52.741840+0000","last_active":"2024-04-26T20:23:52.741810+0000","last_peered":"2024-04-26T20:23:52.741810+0000","last_clean":"2024-04-26T20:23:52.741810+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:23:52.741810+0000","last_undegraded":"2024-04-26T20:23:52.741810+0000","last_fullsized":"2024-04-26T20:23:52.741810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'636","last_scrub_stamp":"2024-04-26T20:23:52.741747+0000","last_deep_scrub":"31'636","last_deep_scrub_stamp":"2024-04-26T20:23:52.741747+0000","last_clean_scrub_stamp":"2024-04-26T20:23:52.741747+0000","objects_scrubbed":6,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:50.571495+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":8218,"num_write":576,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'725","reported_seq":783,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.260438+0000","last_change":"2024-04-26T20:24:09.260569+0000","last_active":"2024-04-26T20:24:09.260438+0000","last_peered":"2024-04-26T20:24:09.260438+0000","last_clean":"2024-04-26T20:24:09.260438+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:24:09.260438+0000","last_undegraded":"2024-04-26T20:24:09.260438+0000","last_fullsized":"2024-04-26T20:24:09.260438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'725","last_scrub_stamp":"2024-04-26T20:24:09.260212+0000","last_deep_scrub":"31'725","last_deep_scrub_stamp":"2024-04-26T20:24:09.260212+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.260212+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:06.941797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":67432,"num_write":694,"num_write_kb":88740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.385982+0000","last_change":"2024-04-26T20:23:55.385982+0000","last_active":"2024-04-26T20:23:55.385982+0000","last_peered":"2024-04-26T20:23:55.385982+0000","last_clean":"2024-04-26T20:23:55.385982+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:23:55.385982+0000","last_undegraded":"2024-04-26T20:23:55.385982+0000","last_fullsized":"2024-04-26T20:23:55.385982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:23:55.385583+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:23:55.385583+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.385583+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:02.268168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'423","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.349116+0000","last_change":"2024-04-26T20:23:56.349216+0000","last_active":"2024-04-26T20:23:56.349116+0000","last_peered":"2024-04-26T20:23:56.349116+0000","last_clean":"2024-04-26T20:23:56.349116+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:23:56.349116+0000","last_undegraded":"2024-04-26T20:23:56.349116+0000","last_fullsized":"2024-04-26T20:23:56.349116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2024-04-26T20:23:56.348896+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2024-04-26T20:23:56.348896+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.348896+0000","objects_scrubbed":7,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.097499+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":8203,"num_write":363,"num_write_kb":12500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'827","reported_seq":900,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.260475+0000","last_change":"2024-04-26T20:24:04.260503+0000","last_active":"2024-04-26T20:24:04.260475+0000","last_peered":"2024-04-26T20:24:04.260475+0000","last_clean":"2024-04-26T20:24:04.260475+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:24:04.260475+0000","last_undegraded":"2024-04-26T20:24:04.260475+0000","last_fullsized":"2024-04-26T20:24:04.260475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'827","last_scrub_stamp":"2024-04-26T20:24:04.260386+0000","last_deep_scrub":"31'827","last_deep_scrub_stamp":"2024-04-26T20:24:04.260386+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.260386+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:58.847218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":109998,"num_write":786,"num_write_kb":139293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'186","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.836677+0000","last_change":"2024-04-26T20:23:58.836735+0000","last_active":"2024-04-26T20:23:58.836677+0000","last_peered":"2024-04-26T20:23:58.836677+0000","last_clean":"2024-04-26T20:23:58.836677+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:23:58.836677+0000","last_undegraded":"2024-04-26T20:23:58.836677+0000","last_fullsized":"2024-04-26T20:23:58.836677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:23:58.836510+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:23:58.836510+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.836510+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:48.329530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'405","reported_seq":455,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.393084+0000","last_change":"2024-04-26T20:23:57.393084+0000","last_active":"2024-04-26T20:23:57.393084+0000","last_peered":"2024-04-26T20:23:57.393084+0000","last_clean":"2024-04-26T20:23:57.393084+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:23:57.393084+0000","last_undegraded":"2024-04-26T20:23:57.393084+0000","last_fullsized":"2024-04-26T20:23:57.393084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'405","last_scrub_stamp":"2024-04-26T20:23:57.392981+0000","last_deep_scrub":"31'405","last_deep_scrub_stamp":"2024-04-26T20:23:57.392981+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.392981+0000","objects_scrubbed":4,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:52.448216+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":354,"num_write_kb":4644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'787","reported_seq":863,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.898089+0000","last_change":"2024-04-26T20:24:02.898215+0000","last_active":"2024-04-26T20:24:02.898089+0000","last_peered":"2024-04-26T20:24:02.898089+0000","last_clean":"2024-04-26T20:24:02.898089+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:24:02.898089+0000","last_undegraded":"2024-04-26T20:24:02.898089+0000","last_fullsized":"2024-04-26T20:24:02.898089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'787","last_scrub_stamp":"2024-04-26T20:24:02.897862+0000","last_deep_scrub":"31'787","last_deep_scrub_stamp":"2024-04-26T20:24:02.897862+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.897862+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:42.365446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":119092,"num_write":739,"num_write_kb":148060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'189","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.726123+0000","last_change":"2024-04-26T20:24:01.726148+0000","last_active":"2024-04-26T20:24:01.726123+0000","last_peered":"2024-04-26T20:24:01.726123+0000","last_clean":"2024-04-26T20:24:01.726123+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:24:01.726123+0000","last_undegraded":"2024-04-26T20:24:01.726123+0000","last_fullsized":"2024-04-26T20:24:01.726123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'189","last_scrub_stamp":"2024-04-26T20:24:01.726024+0000","last_deep_scrub":"31'189","last_deep_scrub_stamp":"2024-04-26T20:24:01.726024+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.726024+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:00.615651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'114","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.124647+0000","last_change":"2024-04-26T20:23:58.124775+0000","last_active":"2024-04-26T20:23:58.124647+0000","last_peered":"2024-04-26T20:23:58.124647+0000","last_clean":"2024-04-26T20:23:58.124647+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:23:58.124647+0000","last_undegraded":"2024-04-26T20:23:58.124647+0000","last_fullsized":"2024-04-26T20:23:58.124647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'114","last_scrub_stamp":"2024-04-26T20:23:58.124418+0000","last_deep_scrub":"31'114","last_deep_scrub_stamp":"2024-04-26T20:23:58.124418+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.124418+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:42.428626+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":58,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'870","reported_seq":952,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.508378+0000","last_change":"2024-04-26T20:24:07.508410+0000","last_active":"2024-04-26T20:24:07.508378+0000","last_peered":"2024-04-26T20:24:07.508378+0000","last_clean":"2024-04-26T20:24:07.508378+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:24:07.508378+0000","last_undegraded":"2024-04-26T20:24:07.508378+0000","last_fullsized":"2024-04-26T20:24:07.508378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'870","last_scrub_stamp":"2024-04-26T20:24:07.508290+0000","last_deep_scrub":"31'870","last_deep_scrub_stamp":"2024-04-26T20:24:07.508290+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.508290+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:34.064016+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":142355,"num_write":826,"num_write_kb":159668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'213","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.214238+0000","last_change":"2024-04-26T20:24:06.214321+0000","last_active":"2024-04-26T20:24:06.214238+0000","last_peered":"2024-04-26T20:24:06.214238+0000","last_clean":"2024-04-26T20:24:06.214238+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:24:06.214238+0000","last_undegraded":"2024-04-26T20:24:06.214238+0000","last_fullsized":"2024-04-26T20:24:06.214238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'213","last_scrub_stamp":"2024-04-26T20:24:06.214066+0000","last_deep_scrub":"31'213","last_deep_scrub_stamp":"2024-04-26T20:24:06.214066+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.214066+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:59:32.676916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'69","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.163864+0000","last_change":"2024-04-26T20:23:59.163930+0000","last_active":"2024-04-26T20:23:59.163864+0000","last_peered":"2024-04-26T20:23:59.163864+0000","last_clean":"2024-04-26T20:23:59.163864+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:23:59.163864+0000","last_undegraded":"2024-04-26T20:23:59.163864+0000","last_fullsized":"2024-04-26T20:23:59.163864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'69","last_scrub_stamp":"2024-04-26T20:23:59.163700+0000","last_deep_scrub":"31'69","last_deep_scrub_stamp":"2024-04-26T20:23:59.163700+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.163700+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:52.539172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'925","reported_seq":1043,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.501640+0000","last_change":"2024-04-26T20:24:09.501668+0000","last_active":"2024-04-26T20:24:09.501640+0000","last_peered":"2024-04-26T20:24:09.501640+0000","last_clean":"2024-04-26T20:24:09.501640+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:24:09.501640+0000","last_undegraded":"2024-04-26T20:24:09.501640+0000","last_fullsized":"2024-04-26T20:24:09.501640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'925","last_scrub_stamp":"2024-04-26T20:24:09.501555+0000","last_deep_scrub":"31'925","last_deep_scrub_stamp":"2024-04-26T20:24:09.501555+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.501555+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:48.111255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":239056,"num_write":898,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'788","reported_seq":857,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.641679+0000","last_change":"2024-04-26T20:24:07.641705+0000","last_active":"2024-04-26T20:24:07.641679+0000","last_peered":"2024-04-26T20:24:07.641679+0000","last_clean":"2024-04-26T20:24:07.641679+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:24:07.641679+0000","last_undegraded":"2024-04-26T20:24:07.641679+0000","last_fullsized":"2024-04-26T20:24:07.641679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'788","last_scrub_stamp":"2024-04-26T20:24:07.641593+0000","last_deep_scrub":"31'788","last_deep_scrub_stamp":"2024-04-26T20:24:07.641593+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.641593+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:54.684308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":94596,"num_write":748,"num_write_kb":94412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.388055+0000","last_change":"2024-04-26T20:23:59.388102+0000","last_active":"2024-04-26T20:23:59.388055+0000","last_peered":"2024-04-26T20:23:59.388055+0000","last_clean":"2024-04-26T20:23:59.388055+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:23:59.388055+0000","last_undegraded":"2024-04-26T20:23:59.388055+0000","last_fullsized":"2024-04-26T20:23:59.388055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:23:59.387942+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:23:59.387942+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.387942+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:40.273342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'803","reported_seq":851,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.201429+0000","last_change":"2024-04-26T20:23:56.201429+0000","last_active":"2024-04-26T20:23:56.201429+0000","last_peered":"2024-04-26T20:23:56.201429+0000","last_clean":"2024-04-26T20:23:56.201429+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:23:56.201429+0000","last_undegraded":"2024-04-26T20:23:56.201429+0000","last_fullsized":"2024-04-26T20:23:56.201429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'803","last_scrub_stamp":"2024-04-26T20:23:56.201181+0000","last_deep_scrub":"31'803","last_deep_scrub_stamp":"2024-04-26T20:23:56.201181+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.201181+0000","objects_scrubbed":2,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:07.402617+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":733,"num_write_kb":8579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'775","reported_seq":856,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.349421+0000","last_change":"2024-04-26T20:24:07.349505+0000","last_active":"2024-04-26T20:24:07.349421+0000","last_peered":"2024-04-26T20:24:07.349421+0000","last_clean":"2024-04-26T20:24:07.349421+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:24:07.349421+0000","last_undegraded":"2024-04-26T20:24:07.349421+0000","last_fullsized":"2024-04-26T20:24:07.349421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'775","last_scrub_stamp":"2024-04-26T20:24:07.349224+0000","last_deep_scrub":"31'775","last_deep_scrub_stamp":"2024-04-26T20:24:07.349224+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.349224+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:09.118989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":124481,"num_write":743,"num_write_kb":150909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'212","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.598401+0000","last_change":"2024-04-26T20:24:03.598423+0000","last_active":"2024-04-26T20:24:03.598401+0000","last_peered":"2024-04-26T20:24:03.598401+0000","last_clean":"2024-04-26T20:24:03.598401+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:24:03.598401+0000","last_undegraded":"2024-04-26T20:24:03.598401+0000","last_fullsized":"2024-04-26T20:24:03.598401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:03.598321+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:03.598321+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.598321+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:28.261419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'111","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.651876+0000","last_change":"2024-04-26T20:23:59.651905+0000","last_active":"2024-04-26T20:23:59.651876+0000","last_peered":"2024-04-26T20:23:59.651876+0000","last_clean":"2024-04-26T20:23:59.651876+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:23:59.651876+0000","last_undegraded":"2024-04-26T20:23:59.651876+0000","last_fullsized":"2024-04-26T20:23:59.651876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'111","last_scrub_stamp":"2024-04-26T20:23:59.651800+0000","last_deep_scrub":"31'111","last_deep_scrub_stamp":"2024-04-26T20:23:59.651800+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.651800+0000","objects_scrubbed":2,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:08:18.731660+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":58,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'499","reported_seq":553,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.308403+0000","last_change":"2024-04-26T20:23:57.308478+0000","last_active":"2024-04-26T20:23:57.308403+0000","last_peered":"2024-04-26T20:23:57.308403+0000","last_clean":"2024-04-26T20:23:57.308403+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:23:57.308403+0000","last_undegraded":"2024-04-26T20:23:57.308403+0000","last_fullsized":"2024-04-26T20:23:57.308403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'499","last_scrub_stamp":"2024-04-26T20:23:57.308234+0000","last_deep_scrub":"31'499","last_deep_scrub_stamp":"2024-04-26T20:23:57.308234+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.308234+0000","objects_scrubbed":4,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:20.009383+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10061,"num_write":440,"num_write_kb":12524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'167","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.756736+0000","last_change":"2024-04-26T20:24:00.756758+0000","last_active":"2024-04-26T20:24:00.756736+0000","last_peered":"2024-04-26T20:24:00.756736+0000","last_clean":"2024-04-26T20:24:00.756736+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:24:00.756736+0000","last_undegraded":"2024-04-26T20:24:00.756736+0000","last_fullsized":"2024-04-26T20:24:00.756736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2024-04-26T20:24:00.756664+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2024-04-26T20:24:00.756664+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.756664+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:10.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'742","reported_seq":806,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.708960+0000","last_change":"2024-04-26T20:23:58.709012+0000","last_active":"2024-04-26T20:23:58.708960+0000","last_peered":"2024-04-26T20:23:58.708960+0000","last_clean":"2024-04-26T20:23:58.708960+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:23:58.708960+0000","last_undegraded":"2024-04-26T20:23:58.708960+0000","last_fullsized":"2024-04-26T20:23:58.708960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'742","last_scrub_stamp":"2024-04-26T20:23:58.708861+0000","last_deep_scrub":"31'742","last_deep_scrub_stamp":"2024-04-26T20:23:58.708861+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.708861+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:51.103432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":82664,"num_write":709,"num_write_kb":110622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'170","reported_seq":220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.668943+0000","last_change":"2024-04-26T20:24:00.668975+0000","last_active":"2024-04-26T20:24:00.668943+0000","last_peered":"2024-04-26T20:24:00.668943+0000","last_clean":"2024-04-26T20:24:00.668943+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:24:00.668943+0000","last_undegraded":"2024-04-26T20:24:00.668943+0000","last_fullsized":"2024-04-26T20:24:00.668943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'170","last_scrub_stamp":"2024-04-26T20:24:00.668873+0000","last_deep_scrub":"31'170","last_deep_scrub_stamp":"2024-04-26T20:24:00.668873+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.668873+0000","objects_scrubbed":3,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:35.462248+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":105,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'200","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.897214+0000","last_change":"2024-04-26T20:23:55.897272+0000","last_active":"2024-04-26T20:23:55.897214+0000","last_peered":"2024-04-26T20:23:55.897214+0000","last_clean":"2024-04-26T20:23:55.897214+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:23:55.897214+0000","last_undegraded":"2024-04-26T20:23:55.897214+0000","last_fullsized":"2024-04-26T20:23:55.897214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'200","last_scrub_stamp":"2024-04-26T20:23:55.897034+0000","last_deep_scrub":"31'200","last_deep_scrub_stamp":"2024-04-26T20:23:55.897034+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.897034+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:27.439805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'741","reported_seq":815,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.472490+0000","last_change":"2024-04-26T20:24:08.472520+0000","last_active":"2024-04-26T20:24:08.472490+0000","last_peered":"2024-04-26T20:24:08.472490+0000","last_clean":"2024-04-26T20:24:08.472490+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:24:08.472490+0000","last_undegraded":"2024-04-26T20:24:08.472490+0000","last_fullsized":"2024-04-26T20:24:08.472490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'741","last_scrub_stamp":"2024-04-26T20:24:08.472396+0000","last_deep_scrub":"31'741","last_deep_scrub_stamp":"2024-04-26T20:24:08.472396+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.472396+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:53.747282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":120190,"num_write":702,"num_write_kb":135097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'204","reported_seq":249,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.201796+0000","last_change":"2024-04-26T20:24:00.201911+0000","last_active":"2024-04-26T20:24:00.201796+0000","last_peered":"2024-04-26T20:24:00.201796+0000","last_clean":"2024-04-26T20:24:00.201796+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:24:00.201796+0000","last_undegraded":"2024-04-26T20:24:00.201796+0000","last_fullsized":"2024-04-26T20:24:00.201796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'204","last_scrub_stamp":"2024-04-26T20:24:00.201558+0000","last_deep_scrub":"31'204","last_deep_scrub_stamp":"2024-04-26T20:24:00.201558+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.201558+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:15.948706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'208","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.695751+0000","last_change":"2024-04-26T20:23:56.695776+0000","last_active":"2024-04-26T20:23:56.695751+0000","last_peered":"2024-04-26T20:23:56.695751+0000","last_clean":"2024-04-26T20:23:56.695751+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:23:56.695751+0000","last_undegraded":"2024-04-26T20:23:56.695751+0000","last_fullsized":"2024-04-26T20:23:56.695751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2024-04-26T20:23:56.695670+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2024-04-26T20:23:56.695670+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.695670+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:08.996038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'229","reported_seq":278,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:10.239310+0000","last_change":"2024-04-26T20:24:10.239367+0000","last_active":"2024-04-26T20:24:10.239310+0000","last_peered":"2024-04-26T20:24:10.239310+0000","last_clean":"2024-04-26T20:24:10.239310+0000","last_became_active":"2024-04-26T20:15:02.205525+0000","last_became_peered":"2024-04-26T20:15:02.205525+0000","last_unstale":"2024-04-26T20:24:10.239310+0000","last_undegraded":"2024-04-26T20:24:10.239310+0000","last_fullsized":"2024-04-26T20:24:10.239310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'229","last_scrub_stamp":"2024-04-26T20:24:10.239066+0000","last_deep_scrub":"31'229","last_deep_scrub_stamp":"2024-04-26T20:24:10.239066+0000","last_clean_scrub_stamp":"2024-04-26T20:24:10.239066+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:20.924059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'195","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.752308+0000","last_change":"2024-04-26T20:23:54.752330+0000","last_active":"2024-04-26T20:23:54.752308+0000","last_peered":"2024-04-26T20:23:54.752308+0000","last_clean":"2024-04-26T20:23:54.752308+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:23:54.752308+0000","last_undegraded":"2024-04-26T20:23:54.752308+0000","last_fullsized":"2024-04-26T20:23:54.752308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'195","last_scrub_stamp":"2024-04-26T20:23:54.752244+0000","last_deep_scrub":"31'195","last_deep_scrub_stamp":"2024-04-26T20:23:54.752244+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.752244+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:58.124458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'187","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.700964+0000","last_change":"2024-04-26T20:23:53.700985+0000","last_active":"2024-04-26T20:23:53.700964+0000","last_peered":"2024-04-26T20:23:53.700964+0000","last_clean":"2024-04-26T20:23:53.700964+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:23:53.700964+0000","last_undegraded":"2024-04-26T20:23:53.700964+0000","last_fullsized":"2024-04-26T20:23:53.700964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'187","last_scrub_stamp":"2024-04-26T20:23:53.700900+0000","last_deep_scrub":"31'187","last_deep_scrub_stamp":"2024-04-26T20:23:53.700900+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.700900+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:38.207196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'191","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.285248+0000","last_change":"2024-04-26T20:23:52.285269+0000","last_active":"2024-04-26T20:23:52.285248+0000","last_peered":"2024-04-26T20:23:52.285248+0000","last_clean":"2024-04-26T20:23:52.285248+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:23:52.285248+0000","last_undegraded":"2024-04-26T20:23:52.285248+0000","last_fullsized":"2024-04-26T20:23:52.285248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'191","last_scrub_stamp":"2024-04-26T20:23:52.285185+0000","last_deep_scrub":"31'191","last_deep_scrub_stamp":"2024-04-26T20:23:52.285185+0000","last_clean_scrub_stamp":"2024-04-26T20:23:52.285185+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:58.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'225","reported_seq":270,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.270507+0000","last_change":"2024-04-26T20:24:02.270569+0000","last_active":"2024-04-26T20:24:02.270507+0000","last_peered":"2024-04-26T20:24:02.270507+0000","last_clean":"2024-04-26T20:24:02.270507+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:24:02.270507+0000","last_undegraded":"2024-04-26T20:24:02.270507+0000","last_fullsized":"2024-04-26T20:24:02.270507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'225","last_scrub_stamp":"2024-04-26T20:24:02.270332+0000","last_deep_scrub":"31'225","last_deep_scrub_stamp":"2024-04-26T20:24:02.270332+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.270332+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:48.694255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.687517+0000","last_change":"2024-04-26T20:23:55.687537+0000","last_active":"2024-04-26T20:23:55.687517+0000","last_peered":"2024-04-26T20:23:55.687517+0000","last_clean":"2024-04-26T20:23:55.687517+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:23:55.687517+0000","last_undegraded":"2024-04-26T20:23:55.687517+0000","last_fullsized":"2024-04-26T20:23:55.687517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:23:55.687459+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:23:55.687459+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.687459+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:03.660542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'214","reported_seq":258,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.151367+0000","last_change":"2024-04-26T20:24:01.151424+0000","last_active":"2024-04-26T20:24:01.151367+0000","last_peered":"2024-04-26T20:24:01.151367+0000","last_clean":"2024-04-26T20:24:01.151367+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:24:01.151367+0000","last_undegraded":"2024-04-26T20:24:01.151367+0000","last_fullsized":"2024-04-26T20:24:01.151367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'214","last_scrub_stamp":"2024-04-26T20:24:01.151196+0000","last_deep_scrub":"31'214","last_deep_scrub_stamp":"2024-04-26T20:24:01.151196+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.151196+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:36.534195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.720737+0000","last_change":"2024-04-26T20:23:54.720757+0000","last_active":"2024-04-26T20:23:54.720737+0000","last_peered":"2024-04-26T20:23:54.720737+0000","last_clean":"2024-04-26T20:23:54.720737+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:23:54.720737+0000","last_undegraded":"2024-04-26T20:23:54.720737+0000","last_fullsized":"2024-04-26T20:23:54.720737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:23:54.720670+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:23:54.720670+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.720670+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:18.551233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'202","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.173774+0000","last_change":"2024-04-26T20:24:04.173832+0000","last_active":"2024-04-26T20:24:04.173774+0000","last_peered":"2024-04-26T20:24:04.173774+0000","last_clean":"2024-04-26T20:24:04.173774+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:24:04.173774+0000","last_undegraded":"2024-04-26T20:24:04.173774+0000","last_fullsized":"2024-04-26T20:24:04.173774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'202","last_scrub_stamp":"2024-04-26T20:24:04.173547+0000","last_deep_scrub":"31'202","last_deep_scrub_stamp":"2024-04-26T20:24:04.173547+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.173547+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:13.727113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'200","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:51.676401+0000","last_change":"2024-04-26T20:23:51.676445+0000","last_active":"2024-04-26T20:23:51.676401+0000","last_peered":"2024-04-26T20:23:51.676401+0000","last_clean":"2024-04-26T20:23:51.676401+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:23:51.676401+0000","last_undegraded":"2024-04-26T20:23:51.676401+0000","last_fullsized":"2024-04-26T20:23:51.676401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'200","last_scrub_stamp":"2024-04-26T20:23:51.676316+0000","last_deep_scrub":"31'200","last_deep_scrub_stamp":"2024-04-26T20:23:51.676316+0000","last_clean_scrub_stamp":"2024-04-26T20:23:51.676316+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:36.711505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'212","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.305035+0000","last_change":"2024-04-26T20:24:05.305095+0000","last_active":"2024-04-26T20:24:05.305035+0000","last_peered":"2024-04-26T20:24:05.305035+0000","last_clean":"2024-04-26T20:24:05.305035+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:24:05.305035+0000","last_undegraded":"2024-04-26T20:24:05.305035+0000","last_fullsized":"2024-04-26T20:24:05.305035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:05.304853+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:05.304853+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.304853+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.534081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'198","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.345042+0000","last_change":"2024-04-26T20:24:07.345209+0000","last_active":"2024-04-26T20:24:07.345042+0000","last_peered":"2024-04-26T20:24:07.345042+0000","last_clean":"2024-04-26T20:24:07.345042+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:24:07.345042+0000","last_undegraded":"2024-04-26T20:24:07.345042+0000","last_fullsized":"2024-04-26T20:24:07.345042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'198","last_scrub_stamp":"2024-04-26T20:24:07.344797+0000","last_deep_scrub":"31'198","last_deep_scrub_stamp":"2024-04-26T20:24:07.344797+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.344797+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:59.897346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.674565+0000","last_change":"2024-04-26T20:23:57.674591+0000","last_active":"2024-04-26T20:23:57.674565+0000","last_peered":"2024-04-26T20:23:57.674565+0000","last_clean":"2024-04-26T20:23:57.674565+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:23:57.674565+0000","last_undegraded":"2024-04-26T20:23:57.674565+0000","last_fullsized":"2024-04-26T20:23:57.674565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:23:57.674484+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:23:57.674484+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.674484+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:38.839087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'200","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.247528+0000","last_change":"2024-04-26T20:24:07.247656+0000","last_active":"2024-04-26T20:24:07.247528+0000","last_peered":"2024-04-26T20:24:07.247528+0000","last_clean":"2024-04-26T20:24:07.247528+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:24:07.247528+0000","last_undegraded":"2024-04-26T20:24:07.247528+0000","last_fullsized":"2024-04-26T20:24:07.247528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'200","last_scrub_stamp":"2024-04-26T20:24:07.247311+0000","last_deep_scrub":"31'200","last_deep_scrub_stamp":"2024-04-26T20:24:07.247311+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.247311+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:55.642586+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"31'215","reported_seq":259,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.119670+0000","last_change":"2024-04-26T20:24:00.119735+0000","last_active":"2024-04-26T20:24:00.119670+0000","last_peered":"2024-04-26T20:24:00.119670+0000","last_clean":"2024-04-26T20:24:00.119670+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:24:00.119670+0000","last_undegraded":"2024-04-26T20:24:00.119670+0000","last_fullsized":"2024-04-26T20:24:00.119670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'215","last_scrub_stamp":"2024-04-26T20:24:00.119469+0000","last_deep_scrub":"31'215","last_deep_scrub_stamp":"2024-04-26T20:24:00.119469+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.119469+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:24.090537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'203","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.252304+0000","last_change":"2024-04-26T20:24:03.252329+0000","last_active":"2024-04-26T20:24:03.252304+0000","last_peered":"2024-04-26T20:24:03.252304+0000","last_clean":"2024-04-26T20:24:03.252304+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:24:03.252304+0000","last_undegraded":"2024-04-26T20:24:03.252304+0000","last_fullsized":"2024-04-26T20:24:03.252304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'203","last_scrub_stamp":"2024-04-26T20:24:03.252218+0000","last_deep_scrub":"31'203","last_deep_scrub_stamp":"2024-04-26T20:24:03.252218+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.252218+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:01.135727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'203","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.737878+0000","last_change":"2024-04-26T20:23:57.737929+0000","last_active":"2024-04-26T20:23:57.737878+0000","last_peered":"2024-04-26T20:23:57.737878+0000","last_clean":"2024-04-26T20:23:57.737878+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:23:57.737878+0000","last_undegraded":"2024-04-26T20:23:57.737878+0000","last_fullsized":"2024-04-26T20:23:57.737878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'203","last_scrub_stamp":"2024-04-26T20:23:57.737782+0000","last_deep_scrub":"31'203","last_deep_scrub_stamp":"2024-04-26T20:23:57.737782+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.737782+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:18:09.316355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'186","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.573961+0000","last_change":"2024-04-26T20:24:04.574008+0000","last_active":"2024-04-26T20:24:04.573961+0000","last_peered":"2024-04-26T20:24:04.573961+0000","last_clean":"2024-04-26T20:24:04.573961+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:24:04.573961+0000","last_undegraded":"2024-04-26T20:24:04.573961+0000","last_fullsized":"2024-04-26T20:24:04.573961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:24:04.573848+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:24:04.573848+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.573848+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:51.072936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'169","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.820822+0000","last_change":"2024-04-26T20:23:57.820940+0000","last_active":"2024-04-26T20:23:57.820822+0000","last_peered":"2024-04-26T20:23:57.820822+0000","last_clean":"2024-04-26T20:23:57.820822+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:23:57.820822+0000","last_undegraded":"2024-04-26T20:23:57.820822+0000","last_fullsized":"2024-04-26T20:23:57.820822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'169","last_scrub_stamp":"2024-04-26T20:23:57.820548+0000","last_deep_scrub":"31'169","last_deep_scrub_stamp":"2024-04-26T20:23:57.820548+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.820548+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:03.966589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'178","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.305753+0000","last_change":"2024-04-26T20:24:03.305891+0000","last_active":"2024-04-26T20:24:03.305753+0000","last_peered":"2024-04-26T20:24:03.305753+0000","last_clean":"2024-04-26T20:24:03.305753+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:24:03.305753+0000","last_undegraded":"2024-04-26T20:24:03.305753+0000","last_fullsized":"2024-04-26T20:24:03.305753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'178","last_scrub_stamp":"2024-04-26T20:24:03.305550+0000","last_deep_scrub":"31'178","last_deep_scrub_stamp":"2024-04-26T20:24:03.305550+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.305550+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:20.042477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'186","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.351202+0000","last_change":"2024-04-26T20:24:06.351259+0000","last_active":"2024-04-26T20:24:06.351202+0000","last_peered":"2024-04-26T20:24:06.351202+0000","last_clean":"2024-04-26T20:24:06.351202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:24:06.351202+0000","last_undegraded":"2024-04-26T20:24:06.351202+0000","last_fullsized":"2024-04-26T20:24:06.351202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:24:06.351018+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:24:06.351018+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.351018+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:31.197649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.350532+0000","last_change":"2024-04-26T20:24:08.350592+0000","last_active":"2024-04-26T20:24:08.350532+0000","last_peered":"2024-04-26T20:24:08.350532+0000","last_clean":"2024-04-26T20:24:08.350532+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:24:08.350532+0000","last_undegraded":"2024-04-26T20:24:08.350532+0000","last_fullsized":"2024-04-26T20:24:08.350532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:24:08.350342+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:24:08.350342+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.350342+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:56.308447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'178","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.686211+0000","last_change":"2024-04-26T20:23:57.686237+0000","last_active":"2024-04-26T20:23:57.686211+0000","last_peered":"2024-04-26T20:23:57.686211+0000","last_clean":"2024-04-26T20:23:57.686211+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:23:57.686211+0000","last_undegraded":"2024-04-26T20:23:57.686211+0000","last_fullsized":"2024-04-26T20:23:57.686211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'178","last_scrub_stamp":"2024-04-26T20:23:57.686080+0000","last_deep_scrub":"31'178","last_deep_scrub_stamp":"2024-04-26T20:23:57.686080+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.686080+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:46.241881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'199","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.297665+0000","last_change":"2024-04-26T20:24:08.297690+0000","last_active":"2024-04-26T20:24:08.297665+0000","last_peered":"2024-04-26T20:24:08.297665+0000","last_clean":"2024-04-26T20:24:08.297665+0000","last_became_active":"2024-04-26T20:15:02.200094+0000","last_became_peered":"2024-04-26T20:15:02.200094+0000","last_unstale":"2024-04-26T20:24:08.297665+0000","last_undegraded":"2024-04-26T20:24:08.297665+0000","last_fullsized":"2024-04-26T20:24:08.297665+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'199","last_scrub_stamp":"2024-04-26T20:24:08.297571+0000","last_deep_scrub":"31'199","last_deep_scrub_stamp":"2024-04-26T20:24:08.297571+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.297571+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:50.146245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'186","reported_seq":216,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.699064+0000","last_change":"2024-04-26T20:24:00.699089+0000","last_active":"2024-04-26T20:24:00.699064+0000","last_peered":"2024-04-26T20:24:00.699064+0000","last_clean":"2024-04-26T20:24:00.699064+0000","last_became_active":"2024-04-26T20:15:02.201216+0000","last_became_peered":"2024-04-26T20:15:02.201216+0000","last_unstale":"2024-04-26T20:24:00.699064+0000","last_undegraded":"2024-04-26T20:24:00.699064+0000","last_fullsized":"2024-04-26T20:24:00.699064+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:24:00.698992+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:24:00.698992+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.698992+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:15.432170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'208","reported_seq":252,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.340193+0000","last_change":"2024-04-26T20:24:03.340251+0000","last_active":"2024-04-26T20:24:03.340193+0000","last_peered":"2024-04-26T20:24:03.340193+0000","last_clean":"2024-04-26T20:24:03.340193+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:24:03.340193+0000","last_undegraded":"2024-04-26T20:24:03.340193+0000","last_fullsized":"2024-04-26T20:24:03.340193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2024-04-26T20:24:03.340011+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2024-04-26T20:24:03.340011+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.340011+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.849736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'190","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.107110+0000","last_change":"2024-04-26T20:23:54.107175+0000","last_active":"2024-04-26T20:23:54.107110+0000","last_peered":"2024-04-26T20:23:54.107110+0000","last_clean":"2024-04-26T20:23:54.107110+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:23:54.107110+0000","last_undegraded":"2024-04-26T20:23:54.107110+0000","last_fullsized":"2024-04-26T20:23:54.107110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'190","last_scrub_stamp":"2024-04-26T20:23:54.106935+0000","last_deep_scrub":"31'190","last_deep_scrub_stamp":"2024-04-26T20:23:54.106935+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.106935+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:22.280574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'185","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.793140+0000","last_change":"2024-04-26T20:23:55.793161+0000","last_active":"2024-04-26T20:23:55.793140+0000","last_peered":"2024-04-26T20:23:55.793140+0000","last_clean":"2024-04-26T20:23:55.793140+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:23:55.793140+0000","last_undegraded":"2024-04-26T20:23:55.793140+0000","last_fullsized":"2024-04-26T20:23:55.793140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2024-04-26T20:23:55.793074+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2024-04-26T20:23:55.793074+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.793074+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:28.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'208","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.295292+0000","last_change":"2024-04-26T20:24:01.295321+0000","last_active":"2024-04-26T20:24:01.295292+0000","last_peered":"2024-04-26T20:24:01.295292+0000","last_clean":"2024-04-26T20:24:01.295292+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:24:01.295292+0000","last_undegraded":"2024-04-26T20:24:01.295292+0000","last_fullsized":"2024-04-26T20:24:01.295292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2024-04-26T20:24:01.295204+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2024-04-26T20:24:01.295204+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.295204+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:35.255168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'206","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.397166+0000","last_change":"2024-04-26T20:24:09.397291+0000","last_active":"2024-04-26T20:24:09.397166+0000","last_peered":"2024-04-26T20:24:09.397166+0000","last_clean":"2024-04-26T20:24:09.397166+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:24:09.397166+0000","last_undegraded":"2024-04-26T20:24:09.397166+0000","last_fullsized":"2024-04-26T20:24:09.397166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'206","last_scrub_stamp":"2024-04-26T20:24:09.396909+0000","last_deep_scrub":"31'206","last_deep_scrub_stamp":"2024-04-26T20:24:09.396909+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.396909+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:08.286636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1174,"num_read_kb":3559915,"num_write":24393,"num_write_kb":4217550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25532,"ondisk_log_size":25532,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12641,"ondisk_log_size":12641,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":142687955,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":593,"num_read_kb":126729,"num_write":7020,"num_write_kb":145600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97075200,"data_stored":285375910,"data_compressed":42853718,"data_compressed_allocated":56066048,"data_compressed_original":244523008,"omap_allocated":0,"internal_metadata":0},"log_size":8366,"ondisk_log_size":8366,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542268,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85736,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286104,"statfs":{"total":96636764160,"available":96548970496,"internally_reserved":0,"allocated":14647296,"data_stored":51070463,"data_compressed":7663032,"data_compressed_allocated":9916416,"data_compressed_original":46551040,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87944,"kb_used_data":12352,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94283896,"statfs":{"total":96636764160,"available":96546709504,"internally_reserved":0,"allocated":12648448,"data_stored":46285310,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542269,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83272,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94288568,"statfs":{"total":96636764160,"available":96551493632,"internally_reserved":0,"allocated":12124160,"data_stored":29508122,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542268,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111120,"kb_used_data":17544,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94260720,"statfs":{"total":96636764160,"available":96522977280,"internally_reserved":0,"allocated":17965056,"data_stored":46284674,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542268,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86468,"kb_used_data":10876,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285372,"statfs":{"total":96636764160,"available":96548220928,"internally_reserved":0,"allocated":11137024,"data_stored":35254034,"data_compressed":5452892,"data_compressed_allocated":6918144,"data_compressed_original":31244288,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542267,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55020,"kb_used_data":5796,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316820,"statfs":{"total":96636764160,"available":96580423680,"internally_reserved":0,"allocated":5935104,"data_stored":12807168,"data_compressed":1792737,"data_compressed_allocated":2543616,"data_compressed_original":9629696,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542268,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107644,"kb_used_data":14068,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94264196,"statfs":{"total":96636764160,"available":96526536704,"internally_reserved":0,"allocated":14405632,"data_stored":36422031,"data_compressed":5393569,"data_compressed_allocated":7294976,"data_compressed_original":29528064,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542267,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73884,"kb_used_data":10772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94297956,"statfs":{"total":96636764160,"available":96561106944,"internally_reserved":0,"allocated":11030528,"data_stored":30097772,"data_compressed":4439375,"data_compressed_allocated":5836800,"data_compressed_original":25112576,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":29360788,"data_compressed":4405923,"data_compressed_allocated":5791744,"data_compressed_original":24539136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14069760,"data_stored":36275415,"data_compressed":5393569,"data_compressed_allocated":7294976,"data_compressed_original":29528064,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":12660552,"data_compressed":1792737,"data_compressed_allocated":2543616,"data_compressed_original":9629696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10801152,"data_stored":35107418,"data_compressed":5452892,"data_compressed_allocated":6918144,"data_compressed_original":31244288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17629184,"data_stored":46138058,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11788288,"data_stored":29361506,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12312576,"data_stored":46138694,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":50333479,"data_compressed":7629580,"data_compressed_allocated":9871360,"data_compressed_original":45977600,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:24:15.945 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T20:14:17.477206+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=14, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=20, tm_min=23, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T20:24:15.946 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T20:24:19.082 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:24:19.086 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:24:35.947 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T20:24:36.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2985e00640 1 Processor -- start 2024-04-26T20:24:36.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2985e00640 1 -- start start 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2985e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f29800cec90 0x7f29800c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2985e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f2980159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2985e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29800cb080 con 0x7f2980153fc0 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2985e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f29801543a0 con 0x7f29800cec90 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2985e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f29800cae30 con 0x7f29800c7ff0 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f297ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2980153fc0 0x7f29800c8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49224/0 (socket says 172.21.15.16:49224) 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f297ea00640 1 -- 172.21.15.16:0/847944558 learned_addr learned my addr 172.21.15.16:0/847944558 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2976000640 1 --2- 172.21.15.16:0/847944558 >> v2:172.21.15.16:3300/0 conn(0x7f29800cec90 0x7f29800c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f297f400640 1 --2- 172.21.15.16:0/847944558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f2980159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f297e000640 1 -- 172.21.15.16:0/847944558 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636631480 0 0) 0x7f29800cb080 con 0x7f2980153fc0 2024-04-26T20:24:36.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f297e000640 1 -- 172.21.15.16:0/847944558 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2964003530 con 0x7f2980153fc0 2024-04-26T20:24:36.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2976000640 1 -- 172.21.15.16:0/847944558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 msgr2=0x7f2980159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:36.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2976000640 1 --2- 172.21.15.16:0/847944558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f2980159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2976000640 1 -- 172.21.15.16:0/847944558 >> v1:172.21.15.16:6789/0 conn(0x7f2980153fc0 legacy=0x7f29800c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.099+0000 7f2976000640 1 -- 172.21.15.16:0/847944558 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29800cb360 con 0x7f29800cec90 2024-04-26T20:24:36.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2976000640 1 --2- 172.21.15.16:0/847944558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29800cec90 0x7f29800c7ab0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f29680097c0 tx=0x7f296801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f80338915705f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f297e000640 1 -- 172.21.15.16:0/847944558 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680b0070 con 0x7f29800cec90 2024-04-26T20:24:36.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f297e000640 1 -- 172.21.15.16:0/847944558 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29680ab600 con 0x7f29800cec90 2024-04-26T20:24:36.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f297e000640 1 -- 172.21.15.16:0/847944558 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680ab9b0 con 0x7f29800cec90 2024-04-26T20:24:36.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 -- 172.21.15.16:0/847944558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29800cec90 msgr2=0x7f29800c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 --2- 172.21.15.16:0/847944558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29800cec90 0x7f29800c7ab0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f29680097c0 tx=0x7f296801c4a0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 -- 172.21.15.16:0/847944558 shutdown_connections 2024-04-26T20:24:36.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 --2- 172.21.15.16:0/847944558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f2980159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 --2- 172.21.15.16:0/847944558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29800cec90 0x7f29800c7ab0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 -- 172.21.15.16:0/847944558 >> 172.21.15.16:0/847944558 conn(0x7f2980073240 msgr2=0x7f2980073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 -- 172.21.15.16:0/847944558 shutdown_connections 2024-04-26T20:24:36.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.103+0000 7f2985e00640 1 -- 172.21.15.16:0/847944558 wait complete. 2024-04-26T20:24:36.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 Processor -- start 2024-04-26T20:24:36.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 -- start start 2024-04-26T20:24:36.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f29801f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29800cec90 0x7f29801f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980153fc0 0x7f29801419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2980070650 con 0x7f2980153fc0 2024-04-26T20:24:36.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29800cbc90 con 0x7f29800cec90 2024-04-26T20:24:36.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2980166ce0 con 0x7f29800c7ff0 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980153fc0 0x7f29801419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980153fc0 0x7f29801419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51146/0 (socket says 172.21.15.16:51146) 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 -- 172.21.15.16:0/4253105768 learned_addr learned my addr 172.21.15.16:0/4253105768 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297ea00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f29801f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2976000640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29800cec90 0x7f29801f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 -- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 msgr2=0x7f29801f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f29801f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 -- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29800cec90 msgr2=0x7f29801f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29800cec90 0x7f29801f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 -- 172.21.15.16:0/4253105768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29801425e0 con 0x7f2980153fc0 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297ea00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f29801f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f297f400640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980153fc0 0x7f29801419f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f297800efc0 tx=0x7f297800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2977e00640 1 -- 172.21.15.16:0/4253105768 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978018020 con 0x7f2980153fc0 2024-04-26T20:24:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2977e00640 1 -- 172.21.15.16:0/4253105768 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2978014480 con 0x7f2980153fc0 2024-04-26T20:24:36.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29801f91c0 con 0x7f2980153fc0 2024-04-26T20:24:36.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2977e00640 1 -- 172.21.15.16:0/4253105768 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978014870 con 0x7f2980153fc0 2024-04-26T20:24:36.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29800cdd10 con 0x7f2980153fc0 2024-04-26T20:24:36.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.107+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2980077c20 con 0x7f2980153fc0 2024-04-26T20:24:36.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.111+0000 7f2977e00640 1 -- 172.21.15.16:0/4253105768 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f297801b020 con 0x7f2980153fc0 2024-04-26T20:24:36.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.111+0000 7f2977e00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f295c068380 0x7f295c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.111+0000 7f2977e00640 1 -- 172.21.15.16:0/4253105768 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f2978087db0 con 0x7f2980153fc0 2024-04-26T20:24:36.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.111+0000 7f297ea00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f295c068380 0x7f295c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.111+0000 7f297ea00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f295c068380 0x7f295c06a840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2970005890 tx=0x7f2970009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.115+0000 7f2977e00640 1 -- 172.21.15.16:0/4253105768 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f297808c070 con 0x7f2980153fc0 2024-04-26T20:24:36.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.279+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 --> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29800cdac0 con 0x7f295c068380 2024-04-26T20:24:36.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.303+0000 7f2977e00640 1 -- 172.21.15.16:0/4253105768 <== mgr.4106 v2:172.21.15.192:6832/773157316 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335664 (secure 0 0 0) 0x7f29800cdac0 con 0x7f295c068380 2024-04-26T20:24:36.309 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:24:36.311 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f295c068380 msgr2=0x7f295c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f295c068380 0x7f295c06a840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2970005890 tx=0x7f2970009040 comp rx=0 tx=0).stop 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980153fc0 msgr2=0x7f29801419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980153fc0 0x7f29801419f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f297800efc0 tx=0x7f297800c490 comp rx=0 tx=0).stop 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 shutdown_connections 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f295c068380 0x7f295c06a840 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980153fc0 0x7f29801419f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29800cec90 0x7f29801f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 --2- 172.21.15.16:0/4253105768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29800c7ff0 0x7f29801f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 >> 172.21.15.16:0/4253105768 conn(0x7f2980073240 msgr2=0x7f29800710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 shutdown_connections 2024-04-26T20:24:36.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.307+0000 7f2985e00640 1 -- 172.21.15.16:0/4253105768 wait complete. 2024-04-26T20:24:36.330 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-26T20:24:35.212908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":143278323,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":1883,"num_read_kb":3686744,"num_write":31572,"num_write_kb":4365566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46658,"ondisk_log_size":46658,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":691088,"kb_used_data":97552,"kb_used_omap":12,"kb_used_meta":593459,"kb_avail":754283632,"statfs":{"total":773094113280,"available":772386439168,"internally_reserved":0,"allocated":99893248,"data_stored":287729574,"data_compressed":42920622,"data_compressed_allocated":56156160,"data_compressed_original":245669888,"omap_allocated":12752,"internal_metadata":607702576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005621"},"pg_stats":[{"pgid":"2.1f","version":"31'143","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.757384+0000","last_change":"2024-04-26T20:23:53.757416+0000","last_active":"2024-04-26T20:23:53.757384+0000","last_peered":"2024-04-26T20:23:53.757384+0000","last_clean":"2024-04-26T20:23:53.757384+0000","last_became_active":"2024-04-26T20:14:13.468793+0000","last_became_peered":"2024-04-26T20:14:13.468793+0000","last_unstale":"2024-04-26T20:23:53.757384+0000","last_undegraded":"2024-04-26T20:23:53.757384+0000","last_fullsized":"2024-04-26T20:23:53.757384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'143","last_scrub_stamp":"2024-04-26T20:23:53.757319+0000","last_deep_scrub":"31'143","last_deep_scrub_stamp":"2024-04-26T20:23:53.757319+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.757319+0000","objects_scrubbed":5,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:27.300847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":4124,"num_write":97,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'192","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.571912+0000","last_change":"2024-04-26T20:24:05.571912+0000","last_active":"2024-04-26T20:24:05.571912+0000","last_peered":"2024-04-26T20:24:05.571912+0000","last_clean":"2024-04-26T20:24:05.571912+0000","last_became_active":"2024-04-26T20:14:14.470274+0000","last_became_peered":"2024-04-26T20:14:14.470274+0000","last_unstale":"2024-04-26T20:24:05.571912+0000","last_undegraded":"2024-04-26T20:24:05.571912+0000","last_fullsized":"2024-04-26T20:24:05.571912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:24:05.571795+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:24:05.571795+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.571795+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:56.055857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'820","reported_seq":900,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:11.441856+0000","last_change":"2024-04-26T20:24:11.441911+0000","last_active":"2024-04-26T20:24:11.441856+0000","last_peered":"2024-04-26T20:24:11.441856+0000","last_clean":"2024-04-26T20:24:11.441856+0000","last_became_active":"2024-04-26T20:14:18.643138+0000","last_became_peered":"2024-04-26T20:14:18.643138+0000","last_unstale":"2024-04-26T20:24:11.441856+0000","last_undegraded":"2024-04-26T20:24:11.441856+0000","last_fullsized":"2024-04-26T20:24:11.441856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'820","last_scrub_stamp":"2024-04-26T20:24:11.441754+0000","last_deep_scrub":"31'820","last_deep_scrub_stamp":"2024-04-26T20:24:11.441754+0000","last_clean_scrub_stamp":"2024-04-26T20:24:11.441754+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:05.733933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":127167,"num_write":792,"num_write_kb":160617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'68","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.680262+0000","last_change":"2024-04-26T20:23:58.680262+0000","last_active":"2024-04-26T20:23:58.680262+0000","last_peered":"2024-04-26T20:23:58.680262+0000","last_clean":"2024-04-26T20:23:58.680262+0000","last_became_active":"2024-04-26T20:14:13.466468+0000","last_became_peered":"2024-04-26T20:14:13.466468+0000","last_unstale":"2024-04-26T20:23:58.680262+0000","last_undegraded":"2024-04-26T20:23:58.680262+0000","last_fullsized":"2024-04-26T20:23:58.680262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'68","last_scrub_stamp":"2024-04-26T20:23:58.680148+0000","last_deep_scrub":"31'68","last_deep_scrub_stamp":"2024-04-26T20:23:58.680148+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.680148+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:20.401142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":16,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'178","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.703422+0000","last_change":"2024-04-26T20:24:02.703449+0000","last_active":"2024-04-26T20:24:02.703422+0000","last_peered":"2024-04-26T20:24:02.703422+0000","last_clean":"2024-04-26T20:24:02.703422+0000","last_became_active":"2024-04-26T20:14:14.495084+0000","last_became_peered":"2024-04-26T20:14:14.495084+0000","last_unstale":"2024-04-26T20:24:02.703422+0000","last_undegraded":"2024-04-26T20:24:02.703422+0000","last_fullsized":"2024-04-26T20:24:02.703422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'178","last_scrub_stamp":"2024-04-26T20:24:02.703345+0000","last_deep_scrub":"31'178","last_deep_scrub_stamp":"2024-04-26T20:24:02.703345+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.703345+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:47.967746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'783","reported_seq":858,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.829777+0000","last_change":"2024-04-26T20:23:59.829777+0000","last_active":"2024-04-26T20:23:59.829777+0000","last_peered":"2024-04-26T20:23:59.829777+0000","last_clean":"2024-04-26T20:23:59.829777+0000","last_became_active":"2024-04-26T20:14:18.527720+0000","last_became_peered":"2024-04-26T20:14:18.527720+0000","last_unstale":"2024-04-26T20:23:59.829777+0000","last_undegraded":"2024-04-26T20:23:59.829777+0000","last_fullsized":"2024-04-26T20:23:59.829777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'783","last_scrub_stamp":"2024-04-26T20:23:59.829532+0000","last_deep_scrub":"31'783","last_deep_scrub_stamp":"2024-04-26T20:23:59.829532+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.829532+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:33.174963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":94315,"num_write":748,"num_write_kb":130983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'216","reported_seq":269,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.430474+0000","last_change":"2024-04-26T20:23:59.430474+0000","last_active":"2024-04-26T20:23:59.430474+0000","last_peered":"2024-04-26T20:23:59.430474+0000","last_clean":"2024-04-26T20:23:59.430474+0000","last_became_active":"2024-04-26T20:14:13.492340+0000","last_became_peered":"2024-04-26T20:14:13.492340+0000","last_unstale":"2024-04-26T20:23:59.430474+0000","last_undegraded":"2024-04-26T20:23:59.430474+0000","last_fullsized":"2024-04-26T20:23:59.430474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'216","last_scrub_stamp":"2024-04-26T20:23:59.430204+0000","last_deep_scrub":"31'216","last_deep_scrub_stamp":"2024-04-26T20:23:59.430204+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.430204+0000","objects_scrubbed":5,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:59:00.796789+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12305,"num_write":138,"num_write_kb":12416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'175","reported_seq":219,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.198723+0000","last_change":"2024-04-26T20:24:05.198723+0000","last_active":"2024-04-26T20:24:05.198723+0000","last_peered":"2024-04-26T20:24:05.198723+0000","last_clean":"2024-04-26T20:24:05.198723+0000","last_became_active":"2024-04-26T20:14:14.498663+0000","last_became_peered":"2024-04-26T20:14:14.498663+0000","last_unstale":"2024-04-26T20:24:05.198723+0000","last_undegraded":"2024-04-26T20:24:05.198723+0000","last_fullsized":"2024-04-26T20:24:05.198723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'175","last_scrub_stamp":"2024-04-26T20:24:05.198469+0000","last_deep_scrub":"31'175","last_deep_scrub_stamp":"2024-04-26T20:24:05.198469+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.198469+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:23:42.903867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'765","reported_seq":840,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.884420+0000","last_change":"2024-04-26T20:24:01.884420+0000","last_active":"2024-04-26T20:24:01.884420+0000","last_peered":"2024-04-26T20:24:01.884420+0000","last_clean":"2024-04-26T20:24:01.884420+0000","last_became_active":"2024-04-26T20:14:18.532016+0000","last_became_peered":"2024-04-26T20:14:18.532016+0000","last_unstale":"2024-04-26T20:24:01.884420+0000","last_undegraded":"2024-04-26T20:24:01.884420+0000","last_fullsized":"2024-04-26T20:24:01.884420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'765","last_scrub_stamp":"2024-04-26T20:24:01.884182+0000","last_deep_scrub":"31'765","last_deep_scrub_stamp":"2024-04-26T20:24:01.884182+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.884182+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:21.792690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":92426,"num_write":730,"num_write_kb":119140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'167","reported_seq":216,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.449652+0000","last_change":"2024-04-26T20:24:00.449652+0000","last_active":"2024-04-26T20:24:00.449652+0000","last_peered":"2024-04-26T20:24:00.449652+0000","last_clean":"2024-04-26T20:24:00.449652+0000","last_became_active":"2024-04-26T20:14:13.493490+0000","last_became_peered":"2024-04-26T20:14:13.493490+0000","last_unstale":"2024-04-26T20:24:00.449652+0000","last_undegraded":"2024-04-26T20:24:00.449652+0000","last_fullsized":"2024-04-26T20:24:00.449652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2024-04-26T20:24:00.449405+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2024-04-26T20:24:00.449405+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.449405+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:25.379098+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":110,"num_write_kb":4195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'179","reported_seq":209,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.727160+0000","last_change":"2024-04-26T20:23:59.727203+0000","last_active":"2024-04-26T20:23:59.727160+0000","last_peered":"2024-04-26T20:23:59.727160+0000","last_clean":"2024-04-26T20:23:59.727160+0000","last_became_active":"2024-04-26T20:15:02.201092+0000","last_became_peered":"2024-04-26T20:15:02.201092+0000","last_unstale":"2024-04-26T20:23:59.727160+0000","last_undegraded":"2024-04-26T20:23:59.727160+0000","last_fullsized":"2024-04-26T20:23:59.727160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'179","last_scrub_stamp":"2024-04-26T20:23:59.727068+0000","last_deep_scrub":"31'179","last_deep_scrub_stamp":"2024-04-26T20:23:59.727068+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.727068+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:27.726572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'807","reported_seq":883,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.963298+0000","last_change":"2024-04-26T20:24:04.963298+0000","last_active":"2024-04-26T20:24:04.963298+0000","last_peered":"2024-04-26T20:24:04.963298+0000","last_clean":"2024-04-26T20:24:04.963298+0000","last_became_active":"2024-04-26T20:14:18.538602+0000","last_became_peered":"2024-04-26T20:14:18.538602+0000","last_unstale":"2024-04-26T20:24:04.963298+0000","last_undegraded":"2024-04-26T20:24:04.963298+0000","last_fullsized":"2024-04-26T20:24:04.963298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'807","last_scrub_stamp":"2024-04-26T20:24:04.962956+0000","last_deep_scrub":"31'807","last_deep_scrub_stamp":"2024-04-26T20:24:04.962956+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.962956+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:26.228315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":115919,"num_write":775,"num_write_kb":110976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'212","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.257865+0000","last_change":"2024-04-26T20:24:04.257922+0000","last_active":"2024-04-26T20:24:04.257865+0000","last_peered":"2024-04-26T20:24:04.257865+0000","last_clean":"2024-04-26T20:24:04.257865+0000","last_became_active":"2024-04-26T20:14:14.484280+0000","last_became_peered":"2024-04-26T20:14:14.484280+0000","last_unstale":"2024-04-26T20:24:04.257865+0000","last_undegraded":"2024-04-26T20:24:04.257865+0000","last_fullsized":"2024-04-26T20:24:04.257865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:04.257699+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:04.257699+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.257699+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:31.279917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'165","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.391045+0000","last_change":"2024-04-26T20:24:02.391120+0000","last_active":"2024-04-26T20:24:02.391045+0000","last_peered":"2024-04-26T20:24:02.391045+0000","last_clean":"2024-04-26T20:24:02.391045+0000","last_became_active":"2024-04-26T20:14:13.497043+0000","last_became_peered":"2024-04-26T20:14:13.497043+0000","last_unstale":"2024-04-26T20:24:02.391045+0000","last_undegraded":"2024-04-26T20:24:02.391045+0000","last_fullsized":"2024-04-26T20:24:02.391045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'165","last_scrub_stamp":"2024-04-26T20:24:02.390871+0000","last_deep_scrub":"31'165","last_deep_scrub_stamp":"2024-04-26T20:24:02.390871+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.390871+0000","objects_scrubbed":4,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:17.527653+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":106,"num_write_kb":8336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'790","reported_seq":866,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.960382+0000","last_change":"2024-04-26T20:24:07.960444+0000","last_active":"2024-04-26T20:24:07.960382+0000","last_peered":"2024-04-26T20:24:07.960382+0000","last_clean":"2024-04-26T20:24:07.960382+0000","last_became_active":"2024-04-26T20:15:02.207782+0000","last_became_peered":"2024-04-26T20:15:02.207782+0000","last_unstale":"2024-04-26T20:24:07.960382+0000","last_undegraded":"2024-04-26T20:24:07.960382+0000","last_fullsized":"2024-04-26T20:24:07.960382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'790","last_scrub_stamp":"2024-04-26T20:24:07.960194+0000","last_deep_scrub":"31'790","last_deep_scrub_stamp":"2024-04-26T20:24:07.960194+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.960194+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:14.658884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":86223,"num_write":746,"num_write_kb":106297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'203","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.661883+0000","last_change":"2024-04-26T20:24:01.661912+0000","last_active":"2024-04-26T20:24:01.661883+0000","last_peered":"2024-04-26T20:24:01.661883+0000","last_clean":"2024-04-26T20:24:01.661883+0000","last_became_active":"2024-04-26T20:14:14.455260+0000","last_became_peered":"2024-04-26T20:14:14.455260+0000","last_unstale":"2024-04-26T20:24:01.661883+0000","last_undegraded":"2024-04-26T20:24:01.661883+0000","last_fullsized":"2024-04-26T20:24:01.661883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'203","last_scrub_stamp":"2024-04-26T20:24:01.661747+0000","last_deep_scrub":"31'203","last_deep_scrub_stamp":"2024-04-26T20:24:01.661747+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.661747+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:07.796745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'168","reported_seq":217,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.373255+0000","last_change":"2024-04-26T20:23:54.373280+0000","last_active":"2024-04-26T20:23:54.373255+0000","last_peered":"2024-04-26T20:23:54.373255+0000","last_clean":"2024-04-26T20:23:54.373255+0000","last_became_active":"2024-04-26T20:14:13.462889+0000","last_became_peered":"2024-04-26T20:14:13.462889+0000","last_unstale":"2024-04-26T20:23:54.373255+0000","last_undegraded":"2024-04-26T20:23:54.373255+0000","last_fullsized":"2024-04-26T20:23:54.373255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'168","last_scrub_stamp":"2024-04-26T20:23:54.373190+0000","last_deep_scrub":"31'168","last_deep_scrub_stamp":"2024-04-26T20:23:54.373190+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.373190+0000","objects_scrubbed":2,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:38.713751+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":4098,"num_write":113,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'846","reported_seq":911,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.948253+0000","last_change":"2024-04-26T20:24:05.948315+0000","last_active":"2024-04-26T20:24:05.948253+0000","last_peered":"2024-04-26T20:24:05.948253+0000","last_clean":"2024-04-26T20:24:05.948253+0000","last_became_active":"2024-04-26T20:14:18.540075+0000","last_became_peered":"2024-04-26T20:14:18.540075+0000","last_unstale":"2024-04-26T20:24:05.948253+0000","last_undegraded":"2024-04-26T20:24:05.948253+0000","last_fullsized":"2024-04-26T20:24:05.948253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'846","last_scrub_stamp":"2024-04-26T20:24:05.948083+0000","last_deep_scrub":"31'846","last_deep_scrub_stamp":"2024-04-26T20:24:05.948083+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.948083+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:34.129251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":76471,"num_write":804,"num_write_kb":93343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'198","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.643734+0000","last_change":"2024-04-26T20:24:02.643782+0000","last_active":"2024-04-26T20:24:02.643734+0000","last_peered":"2024-04-26T20:24:02.643734+0000","last_clean":"2024-04-26T20:24:02.643734+0000","last_became_active":"2024-04-26T20:14:14.457032+0000","last_became_peered":"2024-04-26T20:14:14.457032+0000","last_unstale":"2024-04-26T20:24:02.643734+0000","last_undegraded":"2024-04-26T20:24:02.643734+0000","last_fullsized":"2024-04-26T20:24:02.643734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'198","last_scrub_stamp":"2024-04-26T20:24:02.643622+0000","last_deep_scrub":"31'198","last_deep_scrub_stamp":"2024-04-26T20:24:02.643622+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.643622+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:45.898524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'62","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.341615+0000","last_change":"2024-04-26T20:23:58.341669+0000","last_active":"2024-04-26T20:23:58.341615+0000","last_peered":"2024-04-26T20:23:58.341615+0000","last_clean":"2024-04-26T20:23:58.341615+0000","last_became_active":"2024-04-26T20:14:13.484486+0000","last_became_peered":"2024-04-26T20:14:13.484486+0000","last_unstale":"2024-04-26T20:23:58.341615+0000","last_undegraded":"2024-04-26T20:23:58.341615+0000","last_fullsized":"2024-04-26T20:23:58.341615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'62","last_scrub_stamp":"2024-04-26T20:23:58.341515+0000","last_deep_scrub":"31'62","last_deep_scrub_stamp":"2024-04-26T20:23:58.341515+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.341515+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:54.552782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'793","reported_seq":880,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.267506+0000","last_change":"2024-04-26T20:24:07.267530+0000","last_active":"2024-04-26T20:24:07.267506+0000","last_peered":"2024-04-26T20:24:07.267506+0000","last_clean":"2024-04-26T20:24:07.267506+0000","last_became_active":"2024-04-26T20:14:18.648120+0000","last_became_peered":"2024-04-26T20:14:18.648120+0000","last_unstale":"2024-04-26T20:24:07.267506+0000","last_undegraded":"2024-04-26T20:24:07.267506+0000","last_fullsized":"2024-04-26T20:24:07.267506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'793","last_scrub_stamp":"2024-04-26T20:24:07.267423+0000","last_deep_scrub":"31'793","last_deep_scrub_stamp":"2024-04-26T20:24:07.267423+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.267423+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:36.743007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":121482,"num_write":758,"num_write_kb":114987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'218","reported_seq":263,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.869977+0000","last_change":"2024-04-26T20:23:54.870034+0000","last_active":"2024-04-26T20:23:54.869977+0000","last_peered":"2024-04-26T20:23:54.869977+0000","last_clean":"2024-04-26T20:23:54.869977+0000","last_became_active":"2024-04-26T20:14:14.480112+0000","last_became_peered":"2024-04-26T20:14:14.480112+0000","last_unstale":"2024-04-26T20:23:54.869977+0000","last_undegraded":"2024-04-26T20:23:54.869977+0000","last_fullsized":"2024-04-26T20:23:54.869977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'218","last_scrub_stamp":"2024-04-26T20:23:54.869809+0000","last_deep_scrub":"31'218","last_deep_scrub_stamp":"2024-04-26T20:23:54.869809+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.869809+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:11.569670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'444","reported_seq":494,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.399103+0000","last_change":"2024-04-26T20:23:58.399179+0000","last_active":"2024-04-26T20:23:58.399103+0000","last_peered":"2024-04-26T20:23:58.399103+0000","last_clean":"2024-04-26T20:23:58.399103+0000","last_became_active":"2024-04-26T20:14:13.490960+0000","last_became_peered":"2024-04-26T20:14:13.490960+0000","last_unstale":"2024-04-26T20:23:58.399103+0000","last_undegraded":"2024-04-26T20:23:58.399103+0000","last_fullsized":"2024-04-26T20:23:58.399103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'444","last_scrub_stamp":"2024-04-26T20:23:58.398944+0000","last_deep_scrub":"31'444","last_deep_scrub_stamp":"2024-04-26T20:23:58.398944+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.398944+0000","objects_scrubbed":2,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.162304+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":388,"num_write_kb":4324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'737","reported_seq":804,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.860019+0000","last_change":"2024-04-26T20:24:00.860090+0000","last_active":"2024-04-26T20:24:00.860019+0000","last_peered":"2024-04-26T20:24:00.860019+0000","last_clean":"2024-04-26T20:24:00.860019+0000","last_became_active":"2024-04-26T20:14:18.529702+0000","last_became_peered":"2024-04-26T20:14:18.529702+0000","last_unstale":"2024-04-26T20:24:00.860019+0000","last_undegraded":"2024-04-26T20:24:00.860019+0000","last_fullsized":"2024-04-26T20:24:00.860019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'737","last_scrub_stamp":"2024-04-26T20:24:00.859819+0000","last_deep_scrub":"31'737","last_deep_scrub_stamp":"2024-04-26T20:24:00.859819+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.859819+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:10.365583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":100836,"num_write":691,"num_write_kb":105101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'215","reported_seq":260,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.760440+0000","last_change":"2024-04-26T20:23:56.760463+0000","last_active":"2024-04-26T20:23:56.760440+0000","last_peered":"2024-04-26T20:23:56.760440+0000","last_clean":"2024-04-26T20:23:56.760440+0000","last_became_active":"2024-04-26T20:14:14.460212+0000","last_became_peered":"2024-04-26T20:14:14.460212+0000","last_unstale":"2024-04-26T20:23:56.760440+0000","last_undegraded":"2024-04-26T20:23:56.760440+0000","last_fullsized":"2024-04-26T20:23:56.760440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'215","last_scrub_stamp":"2024-04-26T20:23:56.760361+0000","last_deep_scrub":"31'215","last_deep_scrub_stamp":"2024-04-26T20:23:56.760361+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.760361+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:46:05.006438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'65","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.197393+0000","last_change":"2024-04-26T20:23:58.197465+0000","last_active":"2024-04-26T20:23:58.197393+0000","last_peered":"2024-04-26T20:23:58.197393+0000","last_clean":"2024-04-26T20:23:58.197393+0000","last_became_active":"2024-04-26T20:14:13.489483+0000","last_became_peered":"2024-04-26T20:14:13.489483+0000","last_unstale":"2024-04-26T20:23:58.197393+0000","last_undegraded":"2024-04-26T20:23:58.197393+0000","last_fullsized":"2024-04-26T20:23:58.197393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2024-04-26T20:23:58.197223+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2024-04-26T20:23:58.197223+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.197223+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:11:14.642043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'832","reported_seq":935,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.946918+0000","last_change":"2024-04-26T20:24:06.946980+0000","last_active":"2024-04-26T20:24:06.946918+0000","last_peered":"2024-04-26T20:24:06.946918+0000","last_clean":"2024-04-26T20:24:06.946918+0000","last_became_active":"2024-04-26T20:14:18.645141+0000","last_became_peered":"2024-04-26T20:14:18.645141+0000","last_unstale":"2024-04-26T20:24:06.946918+0000","last_undegraded":"2024-04-26T20:24:06.946918+0000","last_fullsized":"2024-04-26T20:24:06.946918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'832","last_scrub_stamp":"2024-04-26T20:24:06.946731+0000","last_deep_scrub":"31'832","last_deep_scrub_stamp":"2024-04-26T20:24:06.946731+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.946731+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:43.790500+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":203084,"num_write":796,"num_write_kb":205909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'171","reported_seq":216,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.529843+0000","last_change":"2024-04-26T20:24:06.529868+0000","last_active":"2024-04-26T20:24:06.529843+0000","last_peered":"2024-04-26T20:24:06.529843+0000","last_clean":"2024-04-26T20:24:06.529843+0000","last_became_active":"2024-04-26T20:14:14.502352+0000","last_became_peered":"2024-04-26T20:14:14.502352+0000","last_unstale":"2024-04-26T20:24:06.529843+0000","last_undegraded":"2024-04-26T20:24:06.529843+0000","last_fullsized":"2024-04-26T20:24:06.529843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'171","last_scrub_stamp":"2024-04-26T20:24:06.529757+0000","last_deep_scrub":"31'171","last_deep_scrub_stamp":"2024-04-26T20:24:06.529757+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.529757+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:55.508467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'402","reported_seq":454,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.426722+0000","last_change":"2024-04-26T20:23:56.426777+0000","last_active":"2024-04-26T20:23:56.426722+0000","last_peered":"2024-04-26T20:23:56.426722+0000","last_clean":"2024-04-26T20:23:56.426722+0000","last_became_active":"2024-04-26T20:14:13.469261+0000","last_became_peered":"2024-04-26T20:14:13.469261+0000","last_unstale":"2024-04-26T20:23:56.426722+0000","last_undegraded":"2024-04-26T20:23:56.426722+0000","last_fullsized":"2024-04-26T20:23:56.426722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'402","last_scrub_stamp":"2024-04-26T20:23:56.426628+0000","last_deep_scrub":"31'402","last_deep_scrub_stamp":"2024-04-26T20:23:56.426628+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.426628+0000","objects_scrubbed":2,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:55.578723+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":842,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'787","reported_seq":847,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:12.462752+0000","last_change":"2024-04-26T20:24:12.462752+0000","last_active":"2024-04-26T20:24:12.462752+0000","last_peered":"2024-04-26T20:24:12.462752+0000","last_clean":"2024-04-26T20:24:12.462752+0000","last_became_active":"2024-04-26T20:14:18.644033+0000","last_became_peered":"2024-04-26T20:14:18.644033+0000","last_unstale":"2024-04-26T20:24:12.462752+0000","last_undegraded":"2024-04-26T20:24:12.462752+0000","last_fullsized":"2024-04-26T20:24:12.462752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'787","last_scrub_stamp":"2024-04-26T20:24:12.462635+0000","last_deep_scrub":"31'787","last_deep_scrub_stamp":"2024-04-26T20:24:12.462635+0000","last_clean_scrub_stamp":"2024-04-26T20:24:12.462635+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:53.699746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":65331,"num_write":754,"num_write_kb":82709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'193","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.280068+0000","last_change":"2024-04-26T20:24:02.280094+0000","last_active":"2024-04-26T20:24:02.280068+0000","last_peered":"2024-04-26T20:24:02.280068+0000","last_clean":"2024-04-26T20:24:02.280068+0000","last_became_active":"2024-04-26T20:14:14.466665+0000","last_became_peered":"2024-04-26T20:14:14.466665+0000","last_unstale":"2024-04-26T20:24:02.280068+0000","last_undegraded":"2024-04-26T20:24:02.280068+0000","last_fullsized":"2024-04-26T20:24:02.280068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'193","last_scrub_stamp":"2024-04-26T20:24:02.279976+0000","last_deep_scrub":"31'193","last_deep_scrub_stamp":"2024-04-26T20:24:02.279976+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.279976+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:02.433288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'201","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.396562+0000","last_change":"2024-04-26T20:24:01.396651+0000","last_active":"2024-04-26T20:24:01.396562+0000","last_peered":"2024-04-26T20:24:01.396562+0000","last_clean":"2024-04-26T20:24:01.396562+0000","last_became_active":"2024-04-26T20:14:13.492970+0000","last_became_peered":"2024-04-26T20:14:13.492970+0000","last_unstale":"2024-04-26T20:24:01.396562+0000","last_undegraded":"2024-04-26T20:24:01.396562+0000","last_fullsized":"2024-04-26T20:24:01.396562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:24:01.396356+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:24:01.396356+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.396356+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.784652+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":138,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'760","reported_seq":826,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.678264+0000","last_change":"2024-04-26T20:24:06.678290+0000","last_active":"2024-04-26T20:24:06.678264+0000","last_peered":"2024-04-26T20:24:06.678264+0000","last_clean":"2024-04-26T20:24:06.678264+0000","last_became_active":"2024-04-26T20:14:18.638687+0000","last_became_peered":"2024-04-26T20:14:18.638687+0000","last_unstale":"2024-04-26T20:24:06.678264+0000","last_undegraded":"2024-04-26T20:24:06.678264+0000","last_fullsized":"2024-04-26T20:24:06.678264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'760","last_scrub_stamp":"2024-04-26T20:24:06.678178+0000","last_deep_scrub":"31'760","last_deep_scrub_stamp":"2024-04-26T20:24:06.678178+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.678178+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:41.225818+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":72924,"num_write":718,"num_write_kb":105217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'209","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.174770+0000","last_change":"2024-04-26T20:24:03.174829+0000","last_active":"2024-04-26T20:24:03.174770+0000","last_peered":"2024-04-26T20:24:03.174770+0000","last_clean":"2024-04-26T20:24:03.174770+0000","last_became_active":"2024-04-26T20:14:14.496293+0000","last_became_peered":"2024-04-26T20:14:14.496293+0000","last_unstale":"2024-04-26T20:24:03.174770+0000","last_undegraded":"2024-04-26T20:24:03.174770+0000","last_fullsized":"2024-04-26T20:24:03.174770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'209","last_scrub_stamp":"2024-04-26T20:24:03.174599+0000","last_deep_scrub":"31'209","last_deep_scrub_stamp":"2024-04-26T20:24:03.174599+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.174599+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:20.096861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'56","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.313281+0000","last_change":"2024-04-26T20:23:53.313303+0000","last_active":"2024-04-26T20:23:53.313281+0000","last_peered":"2024-04-26T20:23:53.313281+0000","last_clean":"2024-04-26T20:23:53.313281+0000","last_became_active":"2024-04-26T20:14:13.459119+0000","last_became_peered":"2024-04-26T20:14:13.459119+0000","last_unstale":"2024-04-26T20:23:53.313281+0000","last_undegraded":"2024-04-26T20:23:53.313281+0000","last_fullsized":"2024-04-26T20:23:53.313281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'56","last_scrub_stamp":"2024-04-26T20:23:53.313214+0000","last_deep_scrub":"31'56","last_deep_scrub_stamp":"2024-04-26T20:23:53.313214+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.313214+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:09:16.528108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'792","reported_seq":854,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.665359+0000","last_change":"2024-04-26T20:24:01.665385+0000","last_active":"2024-04-26T20:24:01.665359+0000","last_peered":"2024-04-26T20:24:01.665359+0000","last_clean":"2024-04-26T20:24:01.665359+0000","last_became_active":"2024-04-26T20:15:02.205610+0000","last_became_peered":"2024-04-26T20:15:02.205610+0000","last_unstale":"2024-04-26T20:24:01.665359+0000","last_undegraded":"2024-04-26T20:24:01.665359+0000","last_fullsized":"2024-04-26T20:24:01.665359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'792","last_scrub_stamp":"2024-04-26T20:24:01.665270+0000","last_deep_scrub":"31'792","last_deep_scrub_stamp":"2024-04-26T20:24:01.665270+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.665270+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:58.198793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":101392,"num_write":763,"num_write_kb":117505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'191","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.860609+0000","last_change":"2024-04-26T20:23:56.860666+0000","last_active":"2024-04-26T20:23:56.860609+0000","last_peered":"2024-04-26T20:23:56.860609+0000","last_clean":"2024-04-26T20:23:56.860609+0000","last_became_active":"2024-04-26T20:14:14.481584+0000","last_became_peered":"2024-04-26T20:14:14.481584+0000","last_unstale":"2024-04-26T20:23:56.860609+0000","last_undegraded":"2024-04-26T20:23:56.860609+0000","last_fullsized":"2024-04-26T20:23:56.860609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'191","last_scrub_stamp":"2024-04-26T20:23:56.860431+0000","last_deep_scrub":"31'191","last_deep_scrub_stamp":"2024-04-26T20:23:56.860431+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.860431+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:38.950591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'625","reported_seq":673,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.199108+0000","last_change":"2024-04-26T20:23:59.199176+0000","last_active":"2024-04-26T20:23:59.199108+0000","last_peered":"2024-04-26T20:23:59.199108+0000","last_clean":"2024-04-26T20:23:59.199108+0000","last_became_active":"2024-04-26T20:14:13.487941+0000","last_became_peered":"2024-04-26T20:14:13.487941+0000","last_unstale":"2024-04-26T20:23:59.199108+0000","last_undegraded":"2024-04-26T20:23:59.199108+0000","last_fullsized":"2024-04-26T20:23:59.199108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'625","last_scrub_stamp":"2024-04-26T20:23:59.198811+0000","last_deep_scrub":"31'625","last_deep_scrub_stamp":"2024-04-26T20:23:59.198811+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.198811+0000","objects_scrubbed":2,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:48.920508+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":569,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'766","reported_seq":854,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.224386+0000","last_change":"2024-04-26T20:24:05.224413+0000","last_active":"2024-04-26T20:24:05.224386+0000","last_peered":"2024-04-26T20:24:05.224386+0000","last_clean":"2024-04-26T20:24:05.224386+0000","last_became_active":"2024-04-26T20:14:18.518761+0000","last_became_peered":"2024-04-26T20:14:18.518761+0000","last_unstale":"2024-04-26T20:24:05.224386+0000","last_undegraded":"2024-04-26T20:24:05.224386+0000","last_fullsized":"2024-04-26T20:24:05.224386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'766","last_scrub_stamp":"2024-04-26T20:24:05.224292+0000","last_deep_scrub":"31'766","last_deep_scrub_stamp":"2024-04-26T20:24:05.224292+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.224292+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:16.950161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":139574,"num_write":733,"num_write_kb":123608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'201","reported_seq":247,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.339203+0000","last_change":"2024-04-26T20:24:00.339203+0000","last_active":"2024-04-26T20:24:00.339203+0000","last_peered":"2024-04-26T20:24:00.339203+0000","last_clean":"2024-04-26T20:24:00.339203+0000","last_became_active":"2024-04-26T20:14:14.458584+0000","last_became_peered":"2024-04-26T20:14:14.458584+0000","last_unstale":"2024-04-26T20:24:00.339203+0000","last_undegraded":"2024-04-26T20:24:00.339203+0000","last_fullsized":"2024-04-26T20:24:00.339203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:24:00.339108+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:24:00.339108+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.339108+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:02:33.764464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'366","reported_seq":711,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.696547+0000","last_change":"2024-04-26T20:23:54.696578+0000","last_active":"2024-04-26T20:23:54.696547+0000","last_peered":"2024-04-26T20:23:54.696547+0000","last_clean":"2024-04-26T20:23:54.696547+0000","last_became_active":"2024-04-26T20:14:13.466684+0000","last_became_peered":"2024-04-26T20:14:13.466684+0000","last_unstale":"2024-04-26T20:23:54.696547+0000","last_undegraded":"2024-04-26T20:23:54.696547+0000","last_fullsized":"2024-04-26T20:23:54.696547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'366","last_scrub_stamp":"2024-04-26T20:23:54.696482+0000","last_deep_scrub":"31'366","last_deep_scrub_stamp":"2024-04-26T20:23:54.696482+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.696482+0000","objects_scrubbed":3,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:54.841562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551177,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":306,"num_read_kb":1724,"num_write":301,"num_write_kb":1707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'750","reported_seq":812,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.238522+0000","last_change":"2024-04-26T20:24:06.238548+0000","last_active":"2024-04-26T20:24:06.238522+0000","last_peered":"2024-04-26T20:24:06.238522+0000","last_clean":"2024-04-26T20:24:06.238522+0000","last_became_active":"2024-04-26T20:14:18.528606+0000","last_became_peered":"2024-04-26T20:14:18.528606+0000","last_unstale":"2024-04-26T20:24:06.238522+0000","last_undegraded":"2024-04-26T20:24:06.238522+0000","last_fullsized":"2024-04-26T20:24:06.238522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'750","last_scrub_stamp":"2024-04-26T20:24:06.238434+0000","last_deep_scrub":"31'750","last_deep_scrub_stamp":"2024-04-26T20:24:06.238434+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.238434+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:59.799891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":61996,"num_write":721,"num_write_kb":88897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'190","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.774219+0000","last_change":"2024-04-26T20:23:59.774247+0000","last_active":"2024-04-26T20:23:59.774219+0000","last_peered":"2024-04-26T20:23:59.774219+0000","last_clean":"2024-04-26T20:23:59.774219+0000","last_became_active":"2024-04-26T20:14:14.479596+0000","last_became_peered":"2024-04-26T20:14:14.479596+0000","last_unstale":"2024-04-26T20:23:59.774219+0000","last_undegraded":"2024-04-26T20:23:59.774219+0000","last_fullsized":"2024-04-26T20:23:59.774219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'190","last_scrub_stamp":"2024-04-26T20:23:59.774114+0000","last_deep_scrub":"31'190","last_deep_scrub_stamp":"2024-04-26T20:23:59.774114+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.774114+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:05.419958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'275","reported_seq":330,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.363378+0000","last_change":"2024-04-26T20:23:57.363378+0000","last_active":"2024-04-26T20:23:57.363378+0000","last_peered":"2024-04-26T20:23:57.363378+0000","last_clean":"2024-04-26T20:23:57.363378+0000","last_became_active":"2024-04-26T20:14:13.490873+0000","last_became_peered":"2024-04-26T20:14:13.490873+0000","last_unstale":"2024-04-26T20:23:57.363378+0000","last_undegraded":"2024-04-26T20:23:57.363378+0000","last_fullsized":"2024-04-26T20:23:57.363378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'275","last_scrub_stamp":"2024-04-26T20:23:57.363110+0000","last_deep_scrub":"31'275","last_deep_scrub_stamp":"2024-04-26T20:23:57.363110+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.363110+0000","objects_scrubbed":3,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.300903+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12300,"num_write":213,"num_write_kb":8309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'884","reported_seq":955,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.667745+0000","last_change":"2024-04-26T20:24:05.667820+0000","last_active":"2024-04-26T20:24:05.667745+0000","last_peered":"2024-04-26T20:24:05.667745+0000","last_clean":"2024-04-26T20:24:05.667745+0000","last_became_active":"2024-04-26T20:14:18.638190+0000","last_became_peered":"2024-04-26T20:14:18.638190+0000","last_unstale":"2024-04-26T20:24:05.667745+0000","last_undegraded":"2024-04-26T20:24:05.667745+0000","last_fullsized":"2024-04-26T20:24:05.667745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'884","last_scrub_stamp":"2024-04-26T20:24:05.667640+0000","last_deep_scrub":"31'884","last_deep_scrub_stamp":"2024-04-26T20:24:05.667640+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.667640+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:59.213330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":98068,"num_write":848,"num_write_kb":148105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'185","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.649375+0000","last_change":"2024-04-26T20:23:56.649417+0000","last_active":"2024-04-26T20:23:56.649375+0000","last_peered":"2024-04-26T20:23:56.649375+0000","last_clean":"2024-04-26T20:23:56.649375+0000","last_became_active":"2024-04-26T20:14:14.492734+0000","last_became_peered":"2024-04-26T20:14:14.492734+0000","last_unstale":"2024-04-26T20:23:56.649375+0000","last_undegraded":"2024-04-26T20:23:56.649375+0000","last_fullsized":"2024-04-26T20:23:56.649375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2024-04-26T20:23:56.649249+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2024-04-26T20:23:56.649249+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.649249+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:09.923325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'83","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.128984+0000","last_change":"2024-04-26T20:23:55.129077+0000","last_active":"2024-04-26T20:23:55.128984+0000","last_peered":"2024-04-26T20:23:55.128984+0000","last_clean":"2024-04-26T20:23:55.128984+0000","last_became_active":"2024-04-26T20:14:13.462604+0000","last_became_peered":"2024-04-26T20:14:13.462604+0000","last_unstale":"2024-04-26T20:23:55.128984+0000","last_undegraded":"2024-04-26T20:23:55.128984+0000","last_fullsized":"2024-04-26T20:23:55.128984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2024-04-26T20:23:55.128813+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2024-04-26T20:23:55.128813+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.128813+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.799050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":11,"num_write":13,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":206,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.355262+0000","last_change":"2024-04-26T20:23:56.355262+0000","last_active":"2024-04-26T20:23:56.355262+0000","last_peered":"2024-04-26T20:23:56.355262+0000","last_clean":"2024-04-26T20:23:56.355262+0000","last_became_active":"2024-04-26T20:14:08.481179+0000","last_became_peered":"2024-04-26T20:14:08.481179+0000","last_unstale":"2024-04-26T20:23:56.355262+0000","last_undegraded":"2024-04-26T20:23:56.355262+0000","last_fullsized":"2024-04-26T20:23:56.355262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-04-26T20:23:56.355054+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-04-26T20:23:56.355054+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.355054+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:32.603916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'776","reported_seq":845,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.348276+0000","last_change":"2024-04-26T20:24:09.348339+0000","last_active":"2024-04-26T20:24:09.348276+0000","last_peered":"2024-04-26T20:24:09.348276+0000","last_clean":"2024-04-26T20:24:09.348276+0000","last_became_active":"2024-04-26T20:14:18.645067+0000","last_became_peered":"2024-04-26T20:14:18.645067+0000","last_unstale":"2024-04-26T20:24:09.348276+0000","last_undegraded":"2024-04-26T20:24:09.348276+0000","last_fullsized":"2024-04-26T20:24:09.348276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'776","last_scrub_stamp":"2024-04-26T20:24:09.348093+0000","last_deep_scrub":"31'776","last_deep_scrub_stamp":"2024-04-26T20:24:09.348093+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.348093+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:27.788168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":82002,"num_write":745,"num_write_kb":109731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:10.354974+0000","last_change":"2024-04-26T20:24:10.355032+0000","last_active":"2024-04-26T20:24:10.354974+0000","last_peered":"2024-04-26T20:24:10.354974+0000","last_clean":"2024-04-26T20:24:10.354974+0000","last_became_active":"2024-04-26T20:14:14.503518+0000","last_became_peered":"2024-04-26T20:14:14.503518+0000","last_unstale":"2024-04-26T20:24:10.354974+0000","last_undegraded":"2024-04-26T20:24:10.354974+0000","last_fullsized":"2024-04-26T20:24:10.354974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:24:10.354779+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:24:10.354779+0000","last_clean_scrub_stamp":"2024-04-26T20:24:10.354779+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:54.733567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'71","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.707381+0000","last_change":"2024-04-26T20:23:53.707405+0000","last_active":"2024-04-26T20:23:53.707381+0000","last_peered":"2024-04-26T20:23:53.707381+0000","last_clean":"2024-04-26T20:23:53.707381+0000","last_became_active":"2024-04-26T20:14:13.460586+0000","last_became_peered":"2024-04-26T20:14:13.460586+0000","last_unstale":"2024-04-26T20:23:53.707381+0000","last_undegraded":"2024-04-26T20:23:53.707381+0000","last_fullsized":"2024-04-26T20:23:53.707381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2024-04-26T20:23:53.707323+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2024-04-26T20:23:53.707323+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.707323+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:45.597973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'858","reported_seq":947,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.309851+0000","last_change":"2024-04-26T20:24:08.309913+0000","last_active":"2024-04-26T20:24:08.309851+0000","last_peered":"2024-04-26T20:24:08.309851+0000","last_clean":"2024-04-26T20:24:08.309851+0000","last_became_active":"2024-04-26T20:14:18.639589+0000","last_became_peered":"2024-04-26T20:14:18.639589+0000","last_unstale":"2024-04-26T20:24:08.309851+0000","last_undegraded":"2024-04-26T20:24:08.309851+0000","last_fullsized":"2024-04-26T20:24:08.309851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'858","last_scrub_stamp":"2024-04-26T20:24:08.309674+0000","last_deep_scrub":"31'858","last_deep_scrub_stamp":"2024-04-26T20:24:08.309674+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.309674+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:06.438966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":152120,"num_write":818,"num_write_kb":168870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'212","reported_seq":256,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.133517+0000","last_change":"2024-04-26T20:24:02.133577+0000","last_active":"2024-04-26T20:24:02.133517+0000","last_peered":"2024-04-26T20:24:02.133517+0000","last_clean":"2024-04-26T20:24:02.133517+0000","last_became_active":"2024-04-26T20:14:14.486541+0000","last_became_peered":"2024-04-26T20:14:14.486541+0000","last_unstale":"2024-04-26T20:24:02.133517+0000","last_undegraded":"2024-04-26T20:24:02.133517+0000","last_fullsized":"2024-04-26T20:24:02.133517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:02.133346+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:02.133346+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.133346+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:21.769466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'564","reported_seq":613,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.417079+0000","last_change":"2024-04-26T20:23:55.417125+0000","last_active":"2024-04-26T20:23:55.417079+0000","last_peered":"2024-04-26T20:23:55.417079+0000","last_clean":"2024-04-26T20:23:55.417079+0000","last_became_active":"2024-04-26T20:14:13.466432+0000","last_became_peered":"2024-04-26T20:14:13.466432+0000","last_unstale":"2024-04-26T20:23:55.417079+0000","last_undegraded":"2024-04-26T20:23:55.417079+0000","last_fullsized":"2024-04-26T20:23:55.417079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'564","last_scrub_stamp":"2024-04-26T20:23:55.416975+0000","last_deep_scrub":"31'564","last_deep_scrub_stamp":"2024-04-26T20:23:55.416975+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.416975+0000","objects_scrubbed":2,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:11.546142+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":503,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'816","reported_seq":904,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.687704+0000","last_change":"2024-04-26T20:24:04.687774+0000","last_active":"2024-04-26T20:24:04.687704+0000","last_peered":"2024-04-26T20:24:04.687704+0000","last_clean":"2024-04-26T20:24:04.687704+0000","last_became_active":"2024-04-26T20:14:18.527880+0000","last_became_peered":"2024-04-26T20:14:18.527880+0000","last_unstale":"2024-04-26T20:24:04.687704+0000","last_undegraded":"2024-04-26T20:24:04.687704+0000","last_fullsized":"2024-04-26T20:24:04.687704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'816","last_scrub_stamp":"2024-04-26T20:24:04.687604+0000","last_deep_scrub":"31'816","last_deep_scrub_stamp":"2024-04-26T20:24:04.687604+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.687604+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:53.854535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":135112,"num_write":783,"num_write_kb":135635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'193","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:11.386235+0000","last_change":"2024-04-26T20:24:11.386388+0000","last_active":"2024-04-26T20:24:11.386235+0000","last_peered":"2024-04-26T20:24:11.386235+0000","last_clean":"2024-04-26T20:24:11.386235+0000","last_became_active":"2024-04-26T20:14:14.508396+0000","last_became_peered":"2024-04-26T20:14:14.508396+0000","last_unstale":"2024-04-26T20:24:11.386235+0000","last_undegraded":"2024-04-26T20:24:11.386235+0000","last_fullsized":"2024-04-26T20:24:11.386235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'193","last_scrub_stamp":"2024-04-26T20:24:11.386005+0000","last_deep_scrub":"31'193","last_deep_scrub_stamp":"2024-04-26T20:24:11.386005+0000","last_clean_scrub_stamp":"2024-04-26T20:24:11.386005+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:51.691287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'282","reported_seq":331,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.685065+0000","last_change":"2024-04-26T20:23:55.685092+0000","last_active":"2024-04-26T20:23:55.685065+0000","last_peered":"2024-04-26T20:23:55.685065+0000","last_clean":"2024-04-26T20:23:55.685065+0000","last_became_active":"2024-04-26T20:14:13.468862+0000","last_became_peered":"2024-04-26T20:14:13.468862+0000","last_unstale":"2024-04-26T20:23:55.685065+0000","last_undegraded":"2024-04-26T20:23:55.685065+0000","last_fullsized":"2024-04-26T20:23:55.685065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'282","last_scrub_stamp":"2024-04-26T20:23:55.685000+0000","last_deep_scrub":"31'282","last_deep_scrub_stamp":"2024-04-26T20:23:55.685000+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.685000+0000","objects_scrubbed":2,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:41.327730+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":224,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'847","reported_seq":929,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.218410+0000","last_change":"2024-04-26T20:24:08.218472+0000","last_active":"2024-04-26T20:24:08.218410+0000","last_peered":"2024-04-26T20:24:08.218410+0000","last_clean":"2024-04-26T20:24:08.218410+0000","last_became_active":"2024-04-26T20:14:18.645207+0000","last_became_peered":"2024-04-26T20:14:18.645207+0000","last_unstale":"2024-04-26T20:24:08.218410+0000","last_undegraded":"2024-04-26T20:24:08.218410+0000","last_fullsized":"2024-04-26T20:24:08.218410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'847","last_scrub_stamp":"2024-04-26T20:24:08.218226+0000","last_deep_scrub":"31'847","last_deep_scrub_stamp":"2024-04-26T20:24:08.218226+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.218226+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:44.675267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":124531,"num_write":810,"num_write_kb":151625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'176","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.378086+0000","last_change":"2024-04-26T20:24:04.378155+0000","last_active":"2024-04-26T20:24:04.378086+0000","last_peered":"2024-04-26T20:24:04.378086+0000","last_clean":"2024-04-26T20:24:04.378086+0000","last_became_active":"2024-04-26T20:14:14.493809+0000","last_became_peered":"2024-04-26T20:14:14.493809+0000","last_unstale":"2024-04-26T20:24:04.378086+0000","last_undegraded":"2024-04-26T20:24:04.378086+0000","last_fullsized":"2024-04-26T20:24:04.378086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'176","last_scrub_stamp":"2024-04-26T20:24:04.377906+0000","last_deep_scrub":"31'176","last_deep_scrub_stamp":"2024-04-26T20:24:04.377906+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.377906+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:05.462439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'214","reported_seq":265,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.937295+0000","last_change":"2024-04-26T20:23:53.937448+0000","last_active":"2024-04-26T20:23:53.937295+0000","last_peered":"2024-04-26T20:23:53.937295+0000","last_clean":"2024-04-26T20:23:53.937295+0000","last_became_active":"2024-04-26T20:14:13.456534+0000","last_became_peered":"2024-04-26T20:14:13.456534+0000","last_unstale":"2024-04-26T20:23:53.937295+0000","last_undegraded":"2024-04-26T20:23:53.937295+0000","last_fullsized":"2024-04-26T20:23:53.937295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'214","last_scrub_stamp":"2024-04-26T20:23:53.937098+0000","last_deep_scrub":"31'214","last_deep_scrub_stamp":"2024-04-26T20:23:53.937098+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.937098+0000","objects_scrubbed":3,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:00.768497+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":4101,"num_write":169,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'867","reported_seq":951,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.917157+0000","last_change":"2024-04-26T20:24:03.917220+0000","last_active":"2024-04-26T20:24:03.917157+0000","last_peered":"2024-04-26T20:24:03.917157+0000","last_clean":"2024-04-26T20:24:03.917157+0000","last_became_active":"2024-04-26T20:14:18.535444+0000","last_became_peered":"2024-04-26T20:14:18.535444+0000","last_unstale":"2024-04-26T20:24:03.917157+0000","last_undegraded":"2024-04-26T20:24:03.917157+0000","last_fullsized":"2024-04-26T20:24:03.917157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'867","last_scrub_stamp":"2024-04-26T20:24:03.916985+0000","last_deep_scrub":"31'867","last_deep_scrub_stamp":"2024-04-26T20:24:03.916985+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.916985+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:15.946470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":151765,"num_write":832,"num_write_kb":200590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'231","reported_seq":276,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.298419+0000","last_change":"2024-04-26T20:24:06.298482+0000","last_active":"2024-04-26T20:24:06.298419+0000","last_peered":"2024-04-26T20:24:06.298419+0000","last_clean":"2024-04-26T20:24:06.298419+0000","last_became_active":"2024-04-26T20:14:14.494492+0000","last_became_peered":"2024-04-26T20:14:14.494492+0000","last_unstale":"2024-04-26T20:24:06.298419+0000","last_undegraded":"2024-04-26T20:24:06.298419+0000","last_fullsized":"2024-04-26T20:24:06.298419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2024-04-26T20:24:06.298216+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2024-04-26T20:24:06.298216+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.298216+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:46.519230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'363","reported_seq":424,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.716731+0000","last_change":"2024-04-26T20:23:52.716731+0000","last_active":"2024-04-26T20:23:52.716731+0000","last_peered":"2024-04-26T20:23:52.716731+0000","last_clean":"2024-04-26T20:23:52.716731+0000","last_became_active":"2024-04-26T20:14:13.455441+0000","last_became_peered":"2024-04-26T20:14:13.455441+0000","last_unstale":"2024-04-26T20:23:52.716731+0000","last_undegraded":"2024-04-26T20:23:52.716731+0000","last_fullsized":"2024-04-26T20:23:52.716731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'362","last_scrub_stamp":"2024-04-26T20:23:52.716593+0000","last_deep_scrub":"31'362","last_deep_scrub_stamp":"2024-04-26T20:23:52.716593+0000","last_clean_scrub_stamp":"2024-04-26T20:23:52.716593+0000","objects_scrubbed":10,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:06.893420+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6914455,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":304,"num_write_kb":6910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'794","reported_seq":865,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.710688+0000","last_change":"2024-04-26T20:24:03.710714+0000","last_active":"2024-04-26T20:24:03.710688+0000","last_peered":"2024-04-26T20:24:03.710688+0000","last_clean":"2024-04-26T20:24:03.710688+0000","last_became_active":"2024-04-26T20:14:18.518193+0000","last_became_peered":"2024-04-26T20:14:18.518193+0000","last_unstale":"2024-04-26T20:24:03.710688+0000","last_undegraded":"2024-04-26T20:24:03.710688+0000","last_fullsized":"2024-04-26T20:24:03.710688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'794","last_scrub_stamp":"2024-04-26T20:24:03.710607+0000","last_deep_scrub":"31'794","last_deep_scrub_stamp":"2024-04-26T20:24:03.710607+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.710607+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:36.258743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":112649,"num_write":766,"num_write_kb":135273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'211","reported_seq":256,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.227281+0000","last_change":"2024-04-26T20:24:01.227337+0000","last_active":"2024-04-26T20:24:01.227281+0000","last_peered":"2024-04-26T20:24:01.227281+0000","last_clean":"2024-04-26T20:24:01.227281+0000","last_became_active":"2024-04-26T20:14:14.464455+0000","last_became_peered":"2024-04-26T20:14:14.464455+0000","last_unstale":"2024-04-26T20:24:01.227281+0000","last_undegraded":"2024-04-26T20:24:01.227281+0000","last_fullsized":"2024-04-26T20:24:01.227281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'211","last_scrub_stamp":"2024-04-26T20:24:01.227124+0000","last_deep_scrub":"31'211","last_deep_scrub_stamp":"2024-04-26T20:24:01.227124+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.227124+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:56.408496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'71","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.319506+0000","last_change":"2024-04-26T20:23:55.319556+0000","last_active":"2024-04-26T20:23:55.319506+0000","last_peered":"2024-04-26T20:23:55.319506+0000","last_clean":"2024-04-26T20:23:55.319506+0000","last_became_active":"2024-04-26T20:14:13.472292+0000","last_became_peered":"2024-04-26T20:14:13.472292+0000","last_unstale":"2024-04-26T20:23:55.319506+0000","last_undegraded":"2024-04-26T20:23:55.319506+0000","last_fullsized":"2024-04-26T20:23:55.319506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2024-04-26T20:23:55.319386+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2024-04-26T20:23:55.319386+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.319386+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:44.234800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":13,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'771","reported_seq":838,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:13.477152+0000","last_change":"2024-04-26T20:24:13.477179+0000","last_active":"2024-04-26T20:24:13.477152+0000","last_peered":"2024-04-26T20:24:13.477152+0000","last_clean":"2024-04-26T20:24:13.477152+0000","last_became_active":"2024-04-26T20:15:02.257484+0000","last_became_peered":"2024-04-26T20:15:02.257484+0000","last_unstale":"2024-04-26T20:24:13.477152+0000","last_undegraded":"2024-04-26T20:24:13.477152+0000","last_fullsized":"2024-04-26T20:24:13.477152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'771","last_scrub_stamp":"2024-04-26T20:24:13.477056+0000","last_deep_scrub":"31'771","last_deep_scrub_stamp":"2024-04-26T20:24:13.477056+0000","last_clean_scrub_stamp":"2024-04-26T20:24:13.477056+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:50.213645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":40921,"num_write":734,"num_write_kb":85912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'191","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.337683+0000","last_change":"2024-04-26T20:24:05.337797+0000","last_active":"2024-04-26T20:24:05.337683+0000","last_peered":"2024-04-26T20:24:05.337683+0000","last_clean":"2024-04-26T20:24:05.337683+0000","last_became_active":"2024-04-26T20:14:14.494129+0000","last_became_peered":"2024-04-26T20:14:14.494129+0000","last_unstale":"2024-04-26T20:24:05.337683+0000","last_undegraded":"2024-04-26T20:24:05.337683+0000","last_fullsized":"2024-04-26T20:24:05.337683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'191","last_scrub_stamp":"2024-04-26T20:24:05.337431+0000","last_deep_scrub":"31'191","last_deep_scrub_stamp":"2024-04-26T20:24:05.337431+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.337431+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:33.983007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'65","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.106551+0000","last_change":"2024-04-26T20:23:57.106616+0000","last_active":"2024-04-26T20:23:57.106551+0000","last_peered":"2024-04-26T20:23:57.106551+0000","last_clean":"2024-04-26T20:23:57.106551+0000","last_became_active":"2024-04-26T20:14:13.475662+0000","last_became_peered":"2024-04-26T20:14:13.475662+0000","last_unstale":"2024-04-26T20:23:57.106551+0000","last_undegraded":"2024-04-26T20:23:57.106551+0000","last_fullsized":"2024-04-26T20:23:57.106551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'65","last_scrub_stamp":"2024-04-26T20:23:57.106369+0000","last_deep_scrub":"31'65","last_deep_scrub_stamp":"2024-04-26T20:23:57.106369+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.106369+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:53.878594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":20,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'711","reported_seq":782,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:10.461229+0000","last_change":"2024-04-26T20:24:10.461257+0000","last_active":"2024-04-26T20:24:10.461229+0000","last_peered":"2024-04-26T20:24:10.461229+0000","last_clean":"2024-04-26T20:24:10.461229+0000","last_became_active":"2024-04-26T20:14:18.641516+0000","last_became_peered":"2024-04-26T20:14:18.641516+0000","last_unstale":"2024-04-26T20:24:10.461229+0000","last_undegraded":"2024-04-26T20:24:10.461229+0000","last_fullsized":"2024-04-26T20:24:10.461229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'711","last_scrub_stamp":"2024-04-26T20:24:10.461135+0000","last_deep_scrub":"31'711","last_deep_scrub_stamp":"2024-04-26T20:24:10.461135+0000","last_clean_scrub_stamp":"2024-04-26T20:24:10.461135+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:34.322091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":103743,"num_write":683,"num_write_kb":106165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'205","reported_seq":250,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.741807+0000","last_change":"2024-04-26T20:23:58.741829+0000","last_active":"2024-04-26T20:23:58.741807+0000","last_peered":"2024-04-26T20:23:58.741807+0000","last_clean":"2024-04-26T20:23:58.741807+0000","last_became_active":"2024-04-26T20:14:14.471403+0000","last_became_peered":"2024-04-26T20:14:14.471403+0000","last_unstale":"2024-04-26T20:23:58.741807+0000","last_undegraded":"2024-04-26T20:23:58.741807+0000","last_fullsized":"2024-04-26T20:23:58.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'205","last_scrub_stamp":"2024-04-26T20:23:58.741737+0000","last_deep_scrub":"31'205","last_deep_scrub_stamp":"2024-04-26T20:23:58.741737+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.741737+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:08.553649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'636","reported_seq":693,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.741810+0000","last_change":"2024-04-26T20:23:52.741840+0000","last_active":"2024-04-26T20:23:52.741810+0000","last_peered":"2024-04-26T20:23:52.741810+0000","last_clean":"2024-04-26T20:23:52.741810+0000","last_became_active":"2024-04-26T20:14:13.461308+0000","last_became_peered":"2024-04-26T20:14:13.461308+0000","last_unstale":"2024-04-26T20:23:52.741810+0000","last_undegraded":"2024-04-26T20:23:52.741810+0000","last_fullsized":"2024-04-26T20:23:52.741810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'636","last_scrub_stamp":"2024-04-26T20:23:52.741747+0000","last_deep_scrub":"31'636","last_deep_scrub_stamp":"2024-04-26T20:23:52.741747+0000","last_clean_scrub_stamp":"2024-04-26T20:23:52.741747+0000","objects_scrubbed":6,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:50.571495+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":8218,"num_write":576,"num_write_kb":8481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'725","reported_seq":783,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.260438+0000","last_change":"2024-04-26T20:24:09.260569+0000","last_active":"2024-04-26T20:24:09.260438+0000","last_peered":"2024-04-26T20:24:09.260438+0000","last_clean":"2024-04-26T20:24:09.260438+0000","last_became_active":"2024-04-26T20:14:18.651025+0000","last_became_peered":"2024-04-26T20:14:18.651025+0000","last_unstale":"2024-04-26T20:24:09.260438+0000","last_undegraded":"2024-04-26T20:24:09.260438+0000","last_fullsized":"2024-04-26T20:24:09.260438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'725","last_scrub_stamp":"2024-04-26T20:24:09.260212+0000","last_deep_scrub":"31'725","last_deep_scrub_stamp":"2024-04-26T20:24:09.260212+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.260212+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:06.941797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":67432,"num_write":694,"num_write_kb":88740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.385982+0000","last_change":"2024-04-26T20:23:55.385982+0000","last_active":"2024-04-26T20:23:55.385982+0000","last_peered":"2024-04-26T20:23:55.385982+0000","last_clean":"2024-04-26T20:23:55.385982+0000","last_became_active":"2024-04-26T20:14:14.484824+0000","last_became_peered":"2024-04-26T20:14:14.484824+0000","last_unstale":"2024-04-26T20:23:55.385982+0000","last_undegraded":"2024-04-26T20:23:55.385982+0000","last_fullsized":"2024-04-26T20:23:55.385982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:23:55.385583+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:23:55.385583+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.385583+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:02.268168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'423","reported_seq":477,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.349116+0000","last_change":"2024-04-26T20:23:56.349216+0000","last_active":"2024-04-26T20:23:56.349116+0000","last_peered":"2024-04-26T20:23:56.349116+0000","last_clean":"2024-04-26T20:23:56.349116+0000","last_became_active":"2024-04-26T20:14:13.473679+0000","last_became_peered":"2024-04-26T20:14:13.473679+0000","last_unstale":"2024-04-26T20:23:56.349116+0000","last_undegraded":"2024-04-26T20:23:56.349116+0000","last_fullsized":"2024-04-26T20:23:56.349116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'423","last_scrub_stamp":"2024-04-26T20:23:56.348896+0000","last_deep_scrub":"31'423","last_deep_scrub_stamp":"2024-04-26T20:23:56.348896+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.348896+0000","objects_scrubbed":7,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:30.097499+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":8203,"num_write":363,"num_write_kb":12500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'827","reported_seq":900,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.260475+0000","last_change":"2024-04-26T20:24:04.260503+0000","last_active":"2024-04-26T20:24:04.260475+0000","last_peered":"2024-04-26T20:24:04.260475+0000","last_clean":"2024-04-26T20:24:04.260475+0000","last_became_active":"2024-04-26T20:14:18.518375+0000","last_became_peered":"2024-04-26T20:14:18.518375+0000","last_unstale":"2024-04-26T20:24:04.260475+0000","last_undegraded":"2024-04-26T20:24:04.260475+0000","last_fullsized":"2024-04-26T20:24:04.260475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'827","last_scrub_stamp":"2024-04-26T20:24:04.260386+0000","last_deep_scrub":"31'827","last_deep_scrub_stamp":"2024-04-26T20:24:04.260386+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.260386+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:58.847218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":109998,"num_write":786,"num_write_kb":139293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'186","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.836677+0000","last_change":"2024-04-26T20:23:58.836735+0000","last_active":"2024-04-26T20:23:58.836677+0000","last_peered":"2024-04-26T20:23:58.836677+0000","last_clean":"2024-04-26T20:23:58.836677+0000","last_became_active":"2024-04-26T20:14:14.487210+0000","last_became_peered":"2024-04-26T20:14:14.487210+0000","last_unstale":"2024-04-26T20:23:58.836677+0000","last_undegraded":"2024-04-26T20:23:58.836677+0000","last_fullsized":"2024-04-26T20:23:58.836677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:23:58.836510+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:23:58.836510+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.836510+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:48.329530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'405","reported_seq":455,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.393084+0000","last_change":"2024-04-26T20:23:57.393084+0000","last_active":"2024-04-26T20:23:57.393084+0000","last_peered":"2024-04-26T20:23:57.393084+0000","last_clean":"2024-04-26T20:23:57.393084+0000","last_became_active":"2024-04-26T20:14:13.478741+0000","last_became_peered":"2024-04-26T20:14:13.478741+0000","last_unstale":"2024-04-26T20:23:57.393084+0000","last_undegraded":"2024-04-26T20:23:57.393084+0000","last_fullsized":"2024-04-26T20:23:57.393084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'405","last_scrub_stamp":"2024-04-26T20:23:57.392981+0000","last_deep_scrub":"31'405","last_deep_scrub_stamp":"2024-04-26T20:23:57.392981+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.392981+0000","objects_scrubbed":4,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:52.448216+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":354,"num_write_kb":4644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'787","reported_seq":863,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.898089+0000","last_change":"2024-04-26T20:24:02.898215+0000","last_active":"2024-04-26T20:24:02.898089+0000","last_peered":"2024-04-26T20:24:02.898089+0000","last_clean":"2024-04-26T20:24:02.898089+0000","last_became_active":"2024-04-26T20:14:18.531573+0000","last_became_peered":"2024-04-26T20:14:18.531573+0000","last_unstale":"2024-04-26T20:24:02.898089+0000","last_undegraded":"2024-04-26T20:24:02.898089+0000","last_fullsized":"2024-04-26T20:24:02.898089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'787","last_scrub_stamp":"2024-04-26T20:24:02.897862+0000","last_deep_scrub":"31'787","last_deep_scrub_stamp":"2024-04-26T20:24:02.897862+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.897862+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:42.365446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":119092,"num_write":739,"num_write_kb":148060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'189","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.726123+0000","last_change":"2024-04-26T20:24:01.726148+0000","last_active":"2024-04-26T20:24:01.726123+0000","last_peered":"2024-04-26T20:24:01.726123+0000","last_clean":"2024-04-26T20:24:01.726123+0000","last_became_active":"2024-04-26T20:14:14.494906+0000","last_became_peered":"2024-04-26T20:14:14.494906+0000","last_unstale":"2024-04-26T20:24:01.726123+0000","last_undegraded":"2024-04-26T20:24:01.726123+0000","last_fullsized":"2024-04-26T20:24:01.726123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'189","last_scrub_stamp":"2024-04-26T20:24:01.726024+0000","last_deep_scrub":"31'189","last_deep_scrub_stamp":"2024-04-26T20:24:01.726024+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.726024+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:36:00.615651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'114","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.124647+0000","last_change":"2024-04-26T20:23:58.124775+0000","last_active":"2024-04-26T20:23:58.124647+0000","last_peered":"2024-04-26T20:23:58.124647+0000","last_clean":"2024-04-26T20:23:58.124647+0000","last_became_active":"2024-04-26T20:14:13.479591+0000","last_became_peered":"2024-04-26T20:14:13.479591+0000","last_unstale":"2024-04-26T20:23:58.124647+0000","last_undegraded":"2024-04-26T20:23:58.124647+0000","last_fullsized":"2024-04-26T20:23:58.124647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'114","last_scrub_stamp":"2024-04-26T20:23:58.124418+0000","last_deep_scrub":"31'114","last_deep_scrub_stamp":"2024-04-26T20:23:58.124418+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.124418+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:42.428626+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":58,"num_write_kb":4132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'870","reported_seq":952,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.508378+0000","last_change":"2024-04-26T20:24:07.508410+0000","last_active":"2024-04-26T20:24:07.508378+0000","last_peered":"2024-04-26T20:24:07.508378+0000","last_clean":"2024-04-26T20:24:07.508378+0000","last_became_active":"2024-04-26T20:14:18.525113+0000","last_became_peered":"2024-04-26T20:14:18.525113+0000","last_unstale":"2024-04-26T20:24:07.508378+0000","last_undegraded":"2024-04-26T20:24:07.508378+0000","last_fullsized":"2024-04-26T20:24:07.508378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'870","last_scrub_stamp":"2024-04-26T20:24:07.508290+0000","last_deep_scrub":"31'870","last_deep_scrub_stamp":"2024-04-26T20:24:07.508290+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.508290+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:34.064016+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":142355,"num_write":826,"num_write_kb":159668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'213","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.214238+0000","last_change":"2024-04-26T20:24:06.214321+0000","last_active":"2024-04-26T20:24:06.214238+0000","last_peered":"2024-04-26T20:24:06.214238+0000","last_clean":"2024-04-26T20:24:06.214238+0000","last_became_active":"2024-04-26T20:14:14.499832+0000","last_became_peered":"2024-04-26T20:14:14.499832+0000","last_unstale":"2024-04-26T20:24:06.214238+0000","last_undegraded":"2024-04-26T20:24:06.214238+0000","last_fullsized":"2024-04-26T20:24:06.214238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'213","last_scrub_stamp":"2024-04-26T20:24:06.214066+0000","last_deep_scrub":"31'213","last_deep_scrub_stamp":"2024-04-26T20:24:06.214066+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.214066+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:59:32.676916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'69","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.163864+0000","last_change":"2024-04-26T20:23:59.163930+0000","last_active":"2024-04-26T20:23:59.163864+0000","last_peered":"2024-04-26T20:23:59.163864+0000","last_clean":"2024-04-26T20:23:59.163864+0000","last_became_active":"2024-04-26T20:14:13.492335+0000","last_became_peered":"2024-04-26T20:14:13.492335+0000","last_unstale":"2024-04-26T20:23:59.163864+0000","last_undegraded":"2024-04-26T20:23:59.163864+0000","last_fullsized":"2024-04-26T20:23:59.163864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'69","last_scrub_stamp":"2024-04-26T20:23:59.163700+0000","last_deep_scrub":"31'69","last_deep_scrub_stamp":"2024-04-26T20:23:59.163700+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.163700+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:52.539172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'925","reported_seq":1043,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.501640+0000","last_change":"2024-04-26T20:24:09.501668+0000","last_active":"2024-04-26T20:24:09.501640+0000","last_peered":"2024-04-26T20:24:09.501640+0000","last_clean":"2024-04-26T20:24:09.501640+0000","last_became_active":"2024-04-26T20:14:18.637933+0000","last_became_peered":"2024-04-26T20:14:18.637933+0000","last_unstale":"2024-04-26T20:24:09.501640+0000","last_undegraded":"2024-04-26T20:24:09.501640+0000","last_fullsized":"2024-04-26T20:24:09.501640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'925","last_scrub_stamp":"2024-04-26T20:24:09.501555+0000","last_deep_scrub":"31'925","last_deep_scrub_stamp":"2024-04-26T20:24:09.501555+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.501555+0000","objects_scrubbed":0,"log_size":925,"log_dups_size":0,"ondisk_log_size":925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:48.111255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":239056,"num_write":898,"num_write_kb":283554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'788","reported_seq":858,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.641705+0000","last_change":"2024-04-26T20:24:07.641705+0000","last_active":"2024-04-26T20:24:07.641705+0000","last_peered":"2024-04-26T20:24:07.641705+0000","last_clean":"2024-04-26T20:24:07.641705+0000","last_became_active":"2024-04-26T20:14:18.647001+0000","last_became_peered":"2024-04-26T20:14:18.647001+0000","last_unstale":"2024-04-26T20:24:07.641705+0000","last_undegraded":"2024-04-26T20:24:07.641705+0000","last_fullsized":"2024-04-26T20:24:07.641705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'788","last_scrub_stamp":"2024-04-26T20:24:07.641593+0000","last_deep_scrub":"31'788","last_deep_scrub_stamp":"2024-04-26T20:24:07.641593+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.641593+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:54.684308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":94596,"num_write":748,"num_write_kb":94412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.388055+0000","last_change":"2024-04-26T20:23:59.388102+0000","last_active":"2024-04-26T20:23:59.388055+0000","last_peered":"2024-04-26T20:23:59.388055+0000","last_clean":"2024-04-26T20:23:59.388055+0000","last_became_active":"2024-04-26T20:14:14.458276+0000","last_became_peered":"2024-04-26T20:14:14.458276+0000","last_unstale":"2024-04-26T20:23:59.388055+0000","last_undegraded":"2024-04-26T20:23:59.388055+0000","last_fullsized":"2024-04-26T20:23:59.388055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:23:59.387942+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:23:59.387942+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.387942+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:40.273342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'803","reported_seq":851,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.201429+0000","last_change":"2024-04-26T20:23:56.201429+0000","last_active":"2024-04-26T20:23:56.201429+0000","last_peered":"2024-04-26T20:23:56.201429+0000","last_clean":"2024-04-26T20:23:56.201429+0000","last_became_active":"2024-04-26T20:14:13.471061+0000","last_became_peered":"2024-04-26T20:14:13.471061+0000","last_unstale":"2024-04-26T20:23:56.201429+0000","last_undegraded":"2024-04-26T20:23:56.201429+0000","last_fullsized":"2024-04-26T20:23:56.201429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'803","last_scrub_stamp":"2024-04-26T20:23:56.201181+0000","last_deep_scrub":"31'803","last_deep_scrub_stamp":"2024-04-26T20:23:56.201181+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.201181+0000","objects_scrubbed":2,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:07.402617+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":733,"num_write_kb":8579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'775","reported_seq":856,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.349421+0000","last_change":"2024-04-26T20:24:07.349505+0000","last_active":"2024-04-26T20:24:07.349421+0000","last_peered":"2024-04-26T20:24:07.349421+0000","last_clean":"2024-04-26T20:24:07.349421+0000","last_became_active":"2024-04-26T20:14:18.530518+0000","last_became_peered":"2024-04-26T20:14:18.530518+0000","last_unstale":"2024-04-26T20:24:07.349421+0000","last_undegraded":"2024-04-26T20:24:07.349421+0000","last_fullsized":"2024-04-26T20:24:07.349421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'775","last_scrub_stamp":"2024-04-26T20:24:07.349224+0000","last_deep_scrub":"31'775","last_deep_scrub_stamp":"2024-04-26T20:24:07.349224+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.349224+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:09.118989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":124481,"num_write":743,"num_write_kb":150909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'212","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.598401+0000","last_change":"2024-04-26T20:24:03.598423+0000","last_active":"2024-04-26T20:24:03.598401+0000","last_peered":"2024-04-26T20:24:03.598401+0000","last_clean":"2024-04-26T20:24:03.598401+0000","last_became_active":"2024-04-26T20:14:14.460023+0000","last_became_peered":"2024-04-26T20:14:14.460023+0000","last_unstale":"2024-04-26T20:24:03.598401+0000","last_undegraded":"2024-04-26T20:24:03.598401+0000","last_fullsized":"2024-04-26T20:24:03.598401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:03.598321+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:03.598321+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.598321+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:28.261419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'111","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:59.651876+0000","last_change":"2024-04-26T20:23:59.651905+0000","last_active":"2024-04-26T20:23:59.651876+0000","last_peered":"2024-04-26T20:23:59.651876+0000","last_clean":"2024-04-26T20:23:59.651876+0000","last_became_active":"2024-04-26T20:14:13.473440+0000","last_became_peered":"2024-04-26T20:14:13.473440+0000","last_unstale":"2024-04-26T20:23:59.651876+0000","last_undegraded":"2024-04-26T20:23:59.651876+0000","last_fullsized":"2024-04-26T20:23:59.651876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'111","last_scrub_stamp":"2024-04-26T20:23:59.651800+0000","last_deep_scrub":"31'111","last_deep_scrub_stamp":"2024-04-26T20:23:59.651800+0000","last_clean_scrub_stamp":"2024-04-26T20:23:59.651800+0000","objects_scrubbed":2,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:08:18.731660+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":58,"num_write_kb":4137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'499","reported_seq":554,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.308478+0000","last_change":"2024-04-26T20:23:57.308478+0000","last_active":"2024-04-26T20:23:57.308478+0000","last_peered":"2024-04-26T20:23:57.308478+0000","last_clean":"2024-04-26T20:23:57.308478+0000","last_became_active":"2024-04-26T20:14:13.481313+0000","last_became_peered":"2024-04-26T20:14:13.481313+0000","last_unstale":"2024-04-26T20:23:57.308478+0000","last_undegraded":"2024-04-26T20:23:57.308478+0000","last_fullsized":"2024-04-26T20:23:57.308478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'499","last_scrub_stamp":"2024-04-26T20:23:57.308234+0000","last_deep_scrub":"31'499","last_deep_scrub_stamp":"2024-04-26T20:23:57.308234+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.308234+0000","objects_scrubbed":4,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:20.009383+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10061,"num_write":440,"num_write_kb":12524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'167","reported_seq":212,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.756758+0000","last_change":"2024-04-26T20:24:00.756758+0000","last_active":"2024-04-26T20:24:00.756758+0000","last_peered":"2024-04-26T20:24:00.756758+0000","last_clean":"2024-04-26T20:24:00.756758+0000","last_became_active":"2024-04-26T20:14:14.484227+0000","last_became_peered":"2024-04-26T20:14:14.484227+0000","last_unstale":"2024-04-26T20:24:00.756758+0000","last_undegraded":"2024-04-26T20:24:00.756758+0000","last_fullsized":"2024-04-26T20:24:00.756758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2024-04-26T20:24:00.756664+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2024-04-26T20:24:00.756664+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.756664+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:10.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'742","reported_seq":807,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:58.709012+0000","last_change":"2024-04-26T20:23:58.709012+0000","last_active":"2024-04-26T20:23:58.709012+0000","last_peered":"2024-04-26T20:23:58.709012+0000","last_clean":"2024-04-26T20:23:58.709012+0000","last_became_active":"2024-04-26T20:14:18.522385+0000","last_became_peered":"2024-04-26T20:14:18.522385+0000","last_unstale":"2024-04-26T20:23:58.709012+0000","last_undegraded":"2024-04-26T20:23:58.709012+0000","last_fullsized":"2024-04-26T20:23:58.709012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'742","last_scrub_stamp":"2024-04-26T20:23:58.708861+0000","last_deep_scrub":"31'742","last_deep_scrub_stamp":"2024-04-26T20:23:58.708861+0000","last_clean_scrub_stamp":"2024-04-26T20:23:58.708861+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:51.103432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":82664,"num_write":709,"num_write_kb":110622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'170","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.668975+0000","last_change":"2024-04-26T20:24:00.668975+0000","last_active":"2024-04-26T20:24:00.668975+0000","last_peered":"2024-04-26T20:24:00.668975+0000","last_clean":"2024-04-26T20:24:00.668975+0000","last_became_active":"2024-04-26T20:14:13.487579+0000","last_became_peered":"2024-04-26T20:14:13.487579+0000","last_unstale":"2024-04-26T20:24:00.668975+0000","last_undegraded":"2024-04-26T20:24:00.668975+0000","last_fullsized":"2024-04-26T20:24:00.668975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'170","last_scrub_stamp":"2024-04-26T20:24:00.668873+0000","last_deep_scrub":"31'170","last_deep_scrub_stamp":"2024-04-26T20:24:00.668873+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.668873+0000","objects_scrubbed":3,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:07:35.462248+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":105,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'200","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.897272+0000","last_change":"2024-04-26T20:23:55.897272+0000","last_active":"2024-04-26T20:23:55.897272+0000","last_peered":"2024-04-26T20:23:55.897272+0000","last_clean":"2024-04-26T20:23:55.897272+0000","last_became_active":"2024-04-26T20:14:14.480337+0000","last_became_peered":"2024-04-26T20:14:14.480337+0000","last_unstale":"2024-04-26T20:23:55.897272+0000","last_undegraded":"2024-04-26T20:23:55.897272+0000","last_fullsized":"2024-04-26T20:23:55.897272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'200","last_scrub_stamp":"2024-04-26T20:23:55.897034+0000","last_deep_scrub":"31'200","last_deep_scrub_stamp":"2024-04-26T20:23:55.897034+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.897034+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:27.439805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'741","reported_seq":816,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.472520+0000","last_change":"2024-04-26T20:24:08.472520+0000","last_active":"2024-04-26T20:24:08.472520+0000","last_peered":"2024-04-26T20:24:08.472520+0000","last_clean":"2024-04-26T20:24:08.472520+0000","last_became_active":"2024-04-26T20:14:18.524950+0000","last_became_peered":"2024-04-26T20:14:18.524950+0000","last_unstale":"2024-04-26T20:24:08.472520+0000","last_undegraded":"2024-04-26T20:24:08.472520+0000","last_fullsized":"2024-04-26T20:24:08.472520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'741","last_scrub_stamp":"2024-04-26T20:24:08.472396+0000","last_deep_scrub":"31'741","last_deep_scrub_stamp":"2024-04-26T20:24:08.472396+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.472396+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:53.747282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":120190,"num_write":702,"num_write_kb":135097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'204","reported_seq":249,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.201796+0000","last_change":"2024-04-26T20:24:00.201911+0000","last_active":"2024-04-26T20:24:00.201796+0000","last_peered":"2024-04-26T20:24:00.201796+0000","last_clean":"2024-04-26T20:24:00.201796+0000","last_became_active":"2024-04-26T20:14:14.462914+0000","last_became_peered":"2024-04-26T20:14:14.462914+0000","last_unstale":"2024-04-26T20:24:00.201796+0000","last_undegraded":"2024-04-26T20:24:00.201796+0000","last_fullsized":"2024-04-26T20:24:00.201796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'204","last_scrub_stamp":"2024-04-26T20:24:00.201558+0000","last_deep_scrub":"31'204","last_deep_scrub_stamp":"2024-04-26T20:24:00.201558+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.201558+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:15.948706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'208","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:56.695751+0000","last_change":"2024-04-26T20:23:56.695776+0000","last_active":"2024-04-26T20:23:56.695751+0000","last_peered":"2024-04-26T20:23:56.695751+0000","last_clean":"2024-04-26T20:23:56.695751+0000","last_became_active":"2024-04-26T20:14:14.467194+0000","last_became_peered":"2024-04-26T20:14:14.467194+0000","last_unstale":"2024-04-26T20:23:56.695751+0000","last_undegraded":"2024-04-26T20:23:56.695751+0000","last_fullsized":"2024-04-26T20:23:56.695751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2024-04-26T20:23:56.695670+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2024-04-26T20:23:56.695670+0000","last_clean_scrub_stamp":"2024-04-26T20:23:56.695670+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:08.996038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'229","reported_seq":278,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:10.239310+0000","last_change":"2024-04-26T20:24:10.239367+0000","last_active":"2024-04-26T20:24:10.239310+0000","last_peered":"2024-04-26T20:24:10.239310+0000","last_clean":"2024-04-26T20:24:10.239310+0000","last_became_active":"2024-04-26T20:15:02.205525+0000","last_became_peered":"2024-04-26T20:15:02.205525+0000","last_unstale":"2024-04-26T20:24:10.239310+0000","last_undegraded":"2024-04-26T20:24:10.239310+0000","last_fullsized":"2024-04-26T20:24:10.239310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'229","last_scrub_stamp":"2024-04-26T20:24:10.239066+0000","last_deep_scrub":"31'229","last_deep_scrub_stamp":"2024-04-26T20:24:10.239066+0000","last_clean_scrub_stamp":"2024-04-26T20:24:10.239066+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:20.924059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'195","reported_seq":240,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.752308+0000","last_change":"2024-04-26T20:23:54.752330+0000","last_active":"2024-04-26T20:23:54.752308+0000","last_peered":"2024-04-26T20:23:54.752308+0000","last_clean":"2024-04-26T20:23:54.752308+0000","last_became_active":"2024-04-26T20:14:14.451218+0000","last_became_peered":"2024-04-26T20:14:14.451218+0000","last_unstale":"2024-04-26T20:23:54.752308+0000","last_undegraded":"2024-04-26T20:23:54.752308+0000","last_fullsized":"2024-04-26T20:23:54.752308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'195","last_scrub_stamp":"2024-04-26T20:23:54.752244+0000","last_deep_scrub":"31'195","last_deep_scrub_stamp":"2024-04-26T20:23:54.752244+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.752244+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:58.124458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'187","reported_seq":232,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:53.700964+0000","last_change":"2024-04-26T20:23:53.700985+0000","last_active":"2024-04-26T20:23:53.700964+0000","last_peered":"2024-04-26T20:23:53.700964+0000","last_clean":"2024-04-26T20:23:53.700964+0000","last_became_active":"2024-04-26T20:14:14.481958+0000","last_became_peered":"2024-04-26T20:14:14.481958+0000","last_unstale":"2024-04-26T20:23:53.700964+0000","last_undegraded":"2024-04-26T20:23:53.700964+0000","last_fullsized":"2024-04-26T20:23:53.700964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'187","last_scrub_stamp":"2024-04-26T20:23:53.700900+0000","last_deep_scrub":"31'187","last_deep_scrub_stamp":"2024-04-26T20:23:53.700900+0000","last_clean_scrub_stamp":"2024-04-26T20:23:53.700900+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:38.207196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'191","reported_seq":236,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:52.285248+0000","last_change":"2024-04-26T20:23:52.285269+0000","last_active":"2024-04-26T20:23:52.285248+0000","last_peered":"2024-04-26T20:23:52.285248+0000","last_clean":"2024-04-26T20:23:52.285248+0000","last_became_active":"2024-04-26T20:14:14.458485+0000","last_became_peered":"2024-04-26T20:14:14.458485+0000","last_unstale":"2024-04-26T20:23:52.285248+0000","last_undegraded":"2024-04-26T20:23:52.285248+0000","last_fullsized":"2024-04-26T20:23:52.285248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'191","last_scrub_stamp":"2024-04-26T20:23:52.285185+0000","last_deep_scrub":"31'191","last_deep_scrub_stamp":"2024-04-26T20:23:52.285185+0000","last_clean_scrub_stamp":"2024-04-26T20:23:52.285185+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:58.361179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'225","reported_seq":270,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:02.270507+0000","last_change":"2024-04-26T20:24:02.270569+0000","last_active":"2024-04-26T20:24:02.270507+0000","last_peered":"2024-04-26T20:24:02.270507+0000","last_clean":"2024-04-26T20:24:02.270507+0000","last_became_active":"2024-04-26T20:14:14.472158+0000","last_became_peered":"2024-04-26T20:14:14.472158+0000","last_unstale":"2024-04-26T20:24:02.270507+0000","last_undegraded":"2024-04-26T20:24:02.270507+0000","last_fullsized":"2024-04-26T20:24:02.270507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'225","last_scrub_stamp":"2024-04-26T20:24:02.270332+0000","last_deep_scrub":"31'225","last_deep_scrub_stamp":"2024-04-26T20:24:02.270332+0000","last_clean_scrub_stamp":"2024-04-26T20:24:02.270332+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:48.694255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.687517+0000","last_change":"2024-04-26T20:23:55.687537+0000","last_active":"2024-04-26T20:23:55.687517+0000","last_peered":"2024-04-26T20:23:55.687517+0000","last_clean":"2024-04-26T20:23:55.687517+0000","last_became_active":"2024-04-26T20:14:14.479022+0000","last_became_peered":"2024-04-26T20:14:14.479022+0000","last_unstale":"2024-04-26T20:23:55.687517+0000","last_undegraded":"2024-04-26T20:23:55.687517+0000","last_fullsized":"2024-04-26T20:23:55.687517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:23:55.687459+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:23:55.687459+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.687459+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:24:03.660542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'214","reported_seq":258,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.151367+0000","last_change":"2024-04-26T20:24:01.151424+0000","last_active":"2024-04-26T20:24:01.151367+0000","last_peered":"2024-04-26T20:24:01.151367+0000","last_clean":"2024-04-26T20:24:01.151367+0000","last_became_active":"2024-04-26T20:14:14.483191+0000","last_became_peered":"2024-04-26T20:14:14.483191+0000","last_unstale":"2024-04-26T20:24:01.151367+0000","last_undegraded":"2024-04-26T20:24:01.151367+0000","last_fullsized":"2024-04-26T20:24:01.151367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'214","last_scrub_stamp":"2024-04-26T20:24:01.151196+0000","last_deep_scrub":"31'214","last_deep_scrub_stamp":"2024-04-26T20:24:01.151196+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.151196+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:36.534195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.720737+0000","last_change":"2024-04-26T20:23:54.720757+0000","last_active":"2024-04-26T20:23:54.720737+0000","last_peered":"2024-04-26T20:23:54.720737+0000","last_clean":"2024-04-26T20:23:54.720737+0000","last_became_active":"2024-04-26T20:14:14.481924+0000","last_became_peered":"2024-04-26T20:14:14.481924+0000","last_unstale":"2024-04-26T20:23:54.720737+0000","last_undegraded":"2024-04-26T20:23:54.720737+0000","last_fullsized":"2024-04-26T20:23:54.720737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:23:54.720670+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:23:54.720670+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.720670+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:21:18.551233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'202","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.173774+0000","last_change":"2024-04-26T20:24:04.173832+0000","last_active":"2024-04-26T20:24:04.173774+0000","last_peered":"2024-04-26T20:24:04.173774+0000","last_clean":"2024-04-26T20:24:04.173774+0000","last_became_active":"2024-04-26T20:14:14.492939+0000","last_became_peered":"2024-04-26T20:14:14.492939+0000","last_unstale":"2024-04-26T20:24:04.173774+0000","last_undegraded":"2024-04-26T20:24:04.173774+0000","last_fullsized":"2024-04-26T20:24:04.173774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'202","last_scrub_stamp":"2024-04-26T20:24:04.173547+0000","last_deep_scrub":"31'202","last_deep_scrub_stamp":"2024-04-26T20:24:04.173547+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.173547+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:13.727113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'200","reported_seq":245,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:51.676401+0000","last_change":"2024-04-26T20:23:51.676445+0000","last_active":"2024-04-26T20:23:51.676401+0000","last_peered":"2024-04-26T20:23:51.676401+0000","last_clean":"2024-04-26T20:23:51.676401+0000","last_became_active":"2024-04-26T20:14:14.483634+0000","last_became_peered":"2024-04-26T20:14:14.483634+0000","last_unstale":"2024-04-26T20:23:51.676401+0000","last_undegraded":"2024-04-26T20:23:51.676401+0000","last_fullsized":"2024-04-26T20:23:51.676401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'200","last_scrub_stamp":"2024-04-26T20:23:51.676316+0000","last_deep_scrub":"31'200","last_deep_scrub_stamp":"2024-04-26T20:23:51.676316+0000","last_clean_scrub_stamp":"2024-04-26T20:23:51.676316+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:36.711505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'212","reported_seq":257,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:05.305035+0000","last_change":"2024-04-26T20:24:05.305095+0000","last_active":"2024-04-26T20:24:05.305035+0000","last_peered":"2024-04-26T20:24:05.305035+0000","last_clean":"2024-04-26T20:24:05.305035+0000","last_became_active":"2024-04-26T20:14:14.484592+0000","last_became_peered":"2024-04-26T20:14:14.484592+0000","last_unstale":"2024-04-26T20:24:05.305035+0000","last_undegraded":"2024-04-26T20:24:05.305035+0000","last_fullsized":"2024-04-26T20:24:05.305035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'212","last_scrub_stamp":"2024-04-26T20:24:05.304853+0000","last_deep_scrub":"31'212","last_deep_scrub_stamp":"2024-04-26T20:24:05.304853+0000","last_clean_scrub_stamp":"2024-04-26T20:24:05.304853+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:13.534081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'198","reported_seq":243,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.345042+0000","last_change":"2024-04-26T20:24:07.345209+0000","last_active":"2024-04-26T20:24:07.345042+0000","last_peered":"2024-04-26T20:24:07.345042+0000","last_clean":"2024-04-26T20:24:07.345042+0000","last_became_active":"2024-04-26T20:14:14.496756+0000","last_became_peered":"2024-04-26T20:14:14.496756+0000","last_unstale":"2024-04-26T20:24:07.345042+0000","last_undegraded":"2024-04-26T20:24:07.345042+0000","last_fullsized":"2024-04-26T20:24:07.345042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'198","last_scrub_stamp":"2024-04-26T20:24:07.344797+0000","last_deep_scrub":"31'198","last_deep_scrub_stamp":"2024-04-26T20:24:07.344797+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.344797+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:59.897346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'192","reported_seq":237,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.674565+0000","last_change":"2024-04-26T20:23:57.674591+0000","last_active":"2024-04-26T20:23:57.674565+0000","last_peered":"2024-04-26T20:23:57.674565+0000","last_clean":"2024-04-26T20:23:57.674565+0000","last_became_active":"2024-04-26T20:14:14.468157+0000","last_became_peered":"2024-04-26T20:14:14.468157+0000","last_unstale":"2024-04-26T20:23:57.674565+0000","last_undegraded":"2024-04-26T20:23:57.674565+0000","last_fullsized":"2024-04-26T20:23:57.674565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'192","last_scrub_stamp":"2024-04-26T20:23:57.674484+0000","last_deep_scrub":"31'192","last_deep_scrub_stamp":"2024-04-26T20:23:57.674484+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.674484+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:38.839087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'200","reported_seq":244,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:07.247528+0000","last_change":"2024-04-26T20:24:07.247656+0000","last_active":"2024-04-26T20:24:07.247528+0000","last_peered":"2024-04-26T20:24:07.247528+0000","last_clean":"2024-04-26T20:24:07.247528+0000","last_became_active":"2024-04-26T20:14:14.505727+0000","last_became_peered":"2024-04-26T20:14:14.505727+0000","last_unstale":"2024-04-26T20:24:07.247528+0000","last_undegraded":"2024-04-26T20:24:07.247528+0000","last_fullsized":"2024-04-26T20:24:07.247528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'200","last_scrub_stamp":"2024-04-26T20:24:07.247311+0000","last_deep_scrub":"31'200","last_deep_scrub_stamp":"2024-04-26T20:24:07.247311+0000","last_clean_scrub_stamp":"2024-04-26T20:24:07.247311+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:55.642586+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"31'215","reported_seq":259,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.119670+0000","last_change":"2024-04-26T20:24:00.119735+0000","last_active":"2024-04-26T20:24:00.119670+0000","last_peered":"2024-04-26T20:24:00.119670+0000","last_clean":"2024-04-26T20:24:00.119670+0000","last_became_active":"2024-04-26T20:14:14.472902+0000","last_became_peered":"2024-04-26T20:14:14.472902+0000","last_unstale":"2024-04-26T20:24:00.119670+0000","last_undegraded":"2024-04-26T20:24:00.119670+0000","last_fullsized":"2024-04-26T20:24:00.119670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'215","last_scrub_stamp":"2024-04-26T20:24:00.119469+0000","last_deep_scrub":"31'215","last_deep_scrub_stamp":"2024-04-26T20:24:00.119469+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.119469+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:24.090537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'203","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.252304+0000","last_change":"2024-04-26T20:24:03.252329+0000","last_active":"2024-04-26T20:24:03.252304+0000","last_peered":"2024-04-26T20:24:03.252304+0000","last_clean":"2024-04-26T20:24:03.252304+0000","last_became_active":"2024-04-26T20:14:14.485725+0000","last_became_peered":"2024-04-26T20:14:14.485725+0000","last_unstale":"2024-04-26T20:24:03.252304+0000","last_undegraded":"2024-04-26T20:24:03.252304+0000","last_fullsized":"2024-04-26T20:24:03.252304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'203","last_scrub_stamp":"2024-04-26T20:24:03.252218+0000","last_deep_scrub":"31'203","last_deep_scrub_stamp":"2024-04-26T20:24:03.252218+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.252218+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:01.135727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'203","reported_seq":248,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.737878+0000","last_change":"2024-04-26T20:23:57.737929+0000","last_active":"2024-04-26T20:23:57.737878+0000","last_peered":"2024-04-26T20:23:57.737878+0000","last_clean":"2024-04-26T20:23:57.737878+0000","last_became_active":"2024-04-26T20:14:14.464063+0000","last_became_peered":"2024-04-26T20:14:14.464063+0000","last_unstale":"2024-04-26T20:23:57.737878+0000","last_undegraded":"2024-04-26T20:23:57.737878+0000","last_fullsized":"2024-04-26T20:23:57.737878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'203","last_scrub_stamp":"2024-04-26T20:23:57.737782+0000","last_deep_scrub":"31'203","last_deep_scrub_stamp":"2024-04-26T20:23:57.737782+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.737782+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:18:09.316355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'186","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:04.573961+0000","last_change":"2024-04-26T20:24:04.574008+0000","last_active":"2024-04-26T20:24:04.573961+0000","last_peered":"2024-04-26T20:24:04.573961+0000","last_clean":"2024-04-26T20:24:04.573961+0000","last_became_active":"2024-04-26T20:14:14.468008+0000","last_became_peered":"2024-04-26T20:14:14.468008+0000","last_unstale":"2024-04-26T20:24:04.573961+0000","last_undegraded":"2024-04-26T20:24:04.573961+0000","last_fullsized":"2024-04-26T20:24:04.573961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:24:04.573848+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:24:04.573848+0000","last_clean_scrub_stamp":"2024-04-26T20:24:04.573848+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:51.072936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'169","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.820822+0000","last_change":"2024-04-26T20:23:57.820940+0000","last_active":"2024-04-26T20:23:57.820822+0000","last_peered":"2024-04-26T20:23:57.820822+0000","last_clean":"2024-04-26T20:23:57.820822+0000","last_became_active":"2024-04-26T20:14:14.482080+0000","last_became_peered":"2024-04-26T20:14:14.482080+0000","last_unstale":"2024-04-26T20:23:57.820822+0000","last_undegraded":"2024-04-26T20:23:57.820822+0000","last_fullsized":"2024-04-26T20:23:57.820822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'169","last_scrub_stamp":"2024-04-26T20:23:57.820548+0000","last_deep_scrub":"31'169","last_deep_scrub_stamp":"2024-04-26T20:23:57.820548+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.820548+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:03.966589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'178","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.305753+0000","last_change":"2024-04-26T20:24:03.305891+0000","last_active":"2024-04-26T20:24:03.305753+0000","last_peered":"2024-04-26T20:24:03.305753+0000","last_clean":"2024-04-26T20:24:03.305753+0000","last_became_active":"2024-04-26T20:14:14.483894+0000","last_became_peered":"2024-04-26T20:14:14.483894+0000","last_unstale":"2024-04-26T20:24:03.305753+0000","last_undegraded":"2024-04-26T20:24:03.305753+0000","last_fullsized":"2024-04-26T20:24:03.305753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'178","last_scrub_stamp":"2024-04-26T20:24:03.305550+0000","last_deep_scrub":"31'178","last_deep_scrub_stamp":"2024-04-26T20:24:03.305550+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.305550+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:20.042477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'186","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:06.351202+0000","last_change":"2024-04-26T20:24:06.351259+0000","last_active":"2024-04-26T20:24:06.351202+0000","last_peered":"2024-04-26T20:24:06.351202+0000","last_clean":"2024-04-26T20:24:06.351202+0000","last_became_active":"2024-04-26T20:14:14.497833+0000","last_became_peered":"2024-04-26T20:14:14.497833+0000","last_unstale":"2024-04-26T20:24:06.351202+0000","last_undegraded":"2024-04-26T20:24:06.351202+0000","last_fullsized":"2024-04-26T20:24:06.351202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:24:06.351018+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:24:06.351018+0000","last_clean_scrub_stamp":"2024-04-26T20:24:06.351018+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:31.197649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'201","reported_seq":246,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.350532+0000","last_change":"2024-04-26T20:24:08.350592+0000","last_active":"2024-04-26T20:24:08.350532+0000","last_peered":"2024-04-26T20:24:08.350532+0000","last_clean":"2024-04-26T20:24:08.350532+0000","last_became_active":"2024-04-26T20:14:14.502670+0000","last_became_peered":"2024-04-26T20:14:14.502670+0000","last_unstale":"2024-04-26T20:24:08.350532+0000","last_undegraded":"2024-04-26T20:24:08.350532+0000","last_fullsized":"2024-04-26T20:24:08.350532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'201","last_scrub_stamp":"2024-04-26T20:24:08.350342+0000","last_deep_scrub":"31'201","last_deep_scrub_stamp":"2024-04-26T20:24:08.350342+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.350342+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:56.308447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'178","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:57.686237+0000","last_change":"2024-04-26T20:23:57.686237+0000","last_active":"2024-04-26T20:23:57.686237+0000","last_peered":"2024-04-26T20:23:57.686237+0000","last_clean":"2024-04-26T20:23:57.686237+0000","last_became_active":"2024-04-26T20:14:14.472599+0000","last_became_peered":"2024-04-26T20:14:14.472599+0000","last_unstale":"2024-04-26T20:23:57.686237+0000","last_undegraded":"2024-04-26T20:23:57.686237+0000","last_fullsized":"2024-04-26T20:23:57.686237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'178","last_scrub_stamp":"2024-04-26T20:23:57.686080+0000","last_deep_scrub":"31'178","last_deep_scrub_stamp":"2024-04-26T20:23:57.686080+0000","last_clean_scrub_stamp":"2024-04-26T20:23:57.686080+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:46.241881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'199","reported_seq":229,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:08.297665+0000","last_change":"2024-04-26T20:24:08.297690+0000","last_active":"2024-04-26T20:24:08.297665+0000","last_peered":"2024-04-26T20:24:08.297665+0000","last_clean":"2024-04-26T20:24:08.297665+0000","last_became_active":"2024-04-26T20:15:02.200094+0000","last_became_peered":"2024-04-26T20:15:02.200094+0000","last_unstale":"2024-04-26T20:24:08.297665+0000","last_undegraded":"2024-04-26T20:24:08.297665+0000","last_fullsized":"2024-04-26T20:24:08.297665+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'199","last_scrub_stamp":"2024-04-26T20:24:08.297571+0000","last_deep_scrub":"31'199","last_deep_scrub_stamp":"2024-04-26T20:24:08.297571+0000","last_clean_scrub_stamp":"2024-04-26T20:24:08.297571+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:20:50.146245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'186","reported_seq":216,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:00.699064+0000","last_change":"2024-04-26T20:24:00.699089+0000","last_active":"2024-04-26T20:24:00.699064+0000","last_peered":"2024-04-26T20:24:00.699064+0000","last_clean":"2024-04-26T20:24:00.699064+0000","last_became_active":"2024-04-26T20:15:02.201216+0000","last_became_peered":"2024-04-26T20:15:02.201216+0000","last_unstale":"2024-04-26T20:24:00.699064+0000","last_undegraded":"2024-04-26T20:24:00.699064+0000","last_fullsized":"2024-04-26T20:24:00.699064+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'186","last_scrub_stamp":"2024-04-26T20:24:00.698992+0000","last_deep_scrub":"31'186","last_deep_scrub_stamp":"2024-04-26T20:24:00.698992+0000","last_clean_scrub_stamp":"2024-04-26T20:24:00.698992+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:15.432170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'208","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:03.340251+0000","last_change":"2024-04-26T20:24:03.340251+0000","last_active":"2024-04-26T20:24:03.340251+0000","last_peered":"2024-04-26T20:24:03.340251+0000","last_clean":"2024-04-26T20:24:03.340251+0000","last_became_active":"2024-04-26T20:14:14.484450+0000","last_became_peered":"2024-04-26T20:14:14.484450+0000","last_unstale":"2024-04-26T20:24:03.340251+0000","last_undegraded":"2024-04-26T20:24:03.340251+0000","last_fullsized":"2024-04-26T20:24:03.340251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2024-04-26T20:24:03.340011+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2024-04-26T20:24:03.340011+0000","last_clean_scrub_stamp":"2024-04-26T20:24:03.340011+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.849736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'190","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:54.107175+0000","last_change":"2024-04-26T20:23:54.107175+0000","last_active":"2024-04-26T20:23:54.107175+0000","last_peered":"2024-04-26T20:23:54.107175+0000","last_clean":"2024-04-26T20:23:54.107175+0000","last_became_active":"2024-04-26T20:14:14.496008+0000","last_became_peered":"2024-04-26T20:14:14.496008+0000","last_unstale":"2024-04-26T20:23:54.107175+0000","last_undegraded":"2024-04-26T20:23:54.107175+0000","last_fullsized":"2024-04-26T20:23:54.107175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'190","last_scrub_stamp":"2024-04-26T20:23:54.106935+0000","last_deep_scrub":"31'190","last_deep_scrub_stamp":"2024-04-26T20:23:54.106935+0000","last_clean_scrub_stamp":"2024-04-26T20:23:54.106935+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:22.280574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'185","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:23:55.793140+0000","last_change":"2024-04-26T20:23:55.793161+0000","last_active":"2024-04-26T20:23:55.793140+0000","last_peered":"2024-04-26T20:23:55.793140+0000","last_clean":"2024-04-26T20:23:55.793140+0000","last_became_active":"2024-04-26T20:14:14.458020+0000","last_became_peered":"2024-04-26T20:14:14.458020+0000","last_unstale":"2024-04-26T20:23:55.793140+0000","last_undegraded":"2024-04-26T20:23:55.793140+0000","last_fullsized":"2024-04-26T20:23:55.793140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2024-04-26T20:23:55.793074+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2024-04-26T20:23:55.793074+0000","last_clean_scrub_stamp":"2024-04-26T20:23:55.793074+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:28.916677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'208","reported_seq":253,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:01.295292+0000","last_change":"2024-04-26T20:24:01.295321+0000","last_active":"2024-04-26T20:24:01.295292+0000","last_peered":"2024-04-26T20:24:01.295292+0000","last_clean":"2024-04-26T20:24:01.295292+0000","last_became_active":"2024-04-26T20:14:14.460691+0000","last_became_peered":"2024-04-26T20:14:14.460691+0000","last_unstale":"2024-04-26T20:24:01.295292+0000","last_undegraded":"2024-04-26T20:24:01.295292+0000","last_fullsized":"2024-04-26T20:24:01.295292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'208","last_scrub_stamp":"2024-04-26T20:24:01.295204+0000","last_deep_scrub":"31'208","last_deep_scrub_stamp":"2024-04-26T20:24:01.295204+0000","last_clean_scrub_stamp":"2024-04-26T20:24:01.295204+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:35.255168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'206","reported_seq":251,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T20:24:09.397166+0000","last_change":"2024-04-26T20:24:09.397291+0000","last_active":"2024-04-26T20:24:09.397166+0000","last_peered":"2024-04-26T20:24:09.397166+0000","last_clean":"2024-04-26T20:24:09.397166+0000","last_became_active":"2024-04-26T20:14:14.496982+0000","last_became_peered":"2024-04-26T20:14:14.496982+0000","last_unstale":"2024-04-26T20:24:09.397166+0000","last_undegraded":"2024-04-26T20:24:09.397166+0000","last_fullsized":"2024-04-26T20:24:09.397166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'206","last_scrub_stamp":"2024-04-26T20:24:09.396909+0000","last_deep_scrub":"31'206","last_deep_scrub_stamp":"2024-04-26T20:24:09.396909+0000","last_clean_scrub_stamp":"2024-04-26T20:24:09.396909+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:08.286636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1174,"num_read_kb":3559915,"num_write":24393,"num_write_kb":4217550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25532,"ondisk_log_size":25532,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12641,"ondisk_log_size":12641,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":142687955,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":593,"num_read_kb":126729,"num_write":7020,"num_write_kb":145600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97075200,"data_stored":285375910,"data_compressed":42853718,"data_compressed_allocated":56066048,"data_compressed_original":244523008,"omap_allocated":0,"internal_metadata":0},"log_size":8366,"ondisk_log_size":8366,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66904,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542272,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85736,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286104,"statfs":{"total":96636764160,"available":96548970496,"internally_reserved":0,"allocated":14647296,"data_stored":51070463,"data_compressed":7663032,"data_compressed_allocated":9916416,"data_compressed_original":46551040,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542273,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87944,"kb_used_data":12352,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94283896,"statfs":{"total":96636764160,"available":96546709504,"internally_reserved":0,"allocated":12648448,"data_stored":46285310,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542273,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83272,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94288568,"statfs":{"total":96636764160,"available":96551493632,"internally_reserved":0,"allocated":12124160,"data_stored":29508122,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542272,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111120,"kb_used_data":17544,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94260720,"statfs":{"total":96636764160,"available":96522977280,"internally_reserved":0,"allocated":17965056,"data_stored":46284674,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542272,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86468,"kb_used_data":10876,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94285372,"statfs":{"total":96636764160,"available":96548220928,"internally_reserved":0,"allocated":11137024,"data_stored":35254034,"data_compressed":5452892,"data_compressed_allocated":6918144,"data_compressed_original":31244288,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542271,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55020,"kb_used_data":5796,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316820,"statfs":{"total":96636764160,"available":96580423680,"internally_reserved":0,"allocated":5935104,"data_stored":12807168,"data_compressed":1792737,"data_compressed_allocated":2543616,"data_compressed_original":9629696,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542272,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107644,"kb_used_data":14068,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94264196,"statfs":{"total":96636764160,"available":96526536704,"internally_reserved":0,"allocated":14405632,"data_stored":36422031,"data_compressed":5393569,"data_compressed_allocated":7294976,"data_compressed_original":29528064,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542271,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73884,"kb_used_data":10772,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94297956,"statfs":{"total":96636764160,"available":96561106944,"internally_reserved":0,"allocated":11030528,"data_stored":30097772,"data_compressed":4439375,"data_compressed_allocated":5836800,"data_compressed_original":25112576,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33452,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":29360788,"data_compressed":4405923,"data_compressed_allocated":5791744,"data_compressed_original":24539136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14069760,"data_stored":36275415,"data_compressed":5393569,"data_compressed_allocated":7294976,"data_compressed_original":29528064,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":12660552,"data_compressed":1792737,"data_compressed_allocated":2543616,"data_compressed_original":9629696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10801152,"data_stored":35107418,"data_compressed":5452892,"data_compressed_allocated":6918144,"data_compressed_original":31244288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17629184,"data_stored":46138058,"data_compressed":6795981,"data_compressed_allocated":8978432,"data_compressed_original":37502976,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11788288,"data_stored":29361506,"data_compressed":4169904,"data_compressed_allocated":5636096,"data_compressed_original":23228416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12312576,"data_stored":46138694,"data_compressed":7213132,"data_compressed_allocated":9031680,"data_compressed_original":42872832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":50333479,"data_compressed":7629580,"data_compressed_allocated":9871360,"data_compressed_original":45977600,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T20:24:36.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T20:24:36.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.507+0000 7f319da00640 1 Processor -- start 2024-04-26T20:24:36.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.507+0000 7f319da00640 1 -- start start 2024-04-26T20:24:36.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f319da00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31980cf660 0x7f319815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f319da00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f31980cfa40 0x7f31981538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f319da00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319815de50 con 0x7f3198072700 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f319da00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f31980c9fa0 con 0x7f31980cf660 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f319da00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f31980ccd00 con 0x7f31980cfa40 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31980cf660 0x7f319815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31980cf660 0x7f319815d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51160/0 (socket says 172.21.15.16:51160) 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 -- 172.21.15.16:0/1449924240 learned_addr learned my addr 172.21.15.16:0/1449924240 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f318fe00640 1 --2- 172.21.15.16:0/1449924240 >> v2:172.21.15.192:3300/0 conn(0x7f31980cfa40 0x7f31981538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 -- 172.21.15.16:0/1449924240 >> v2:172.21.15.192:3300/0 conn(0x7f31980cfa40 msgr2=0x7f31981538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 --2- 172.21.15.16:0/1449924240 >> v2:172.21.15.192:3300/0 conn(0x7f31980cfa40 0x7f31981538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 -- 172.21.15.16:0/1449924240 >> v1:172.21.15.16:6789/0 conn(0x7f3198072700 legacy=0x7f31980ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 -- 172.21.15.16:0/1449924240 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3198159d90 con 0x7f31980cf660 2024-04-26T20:24:36.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.511+0000 7f3197e00640 1 --2- 172.21.15.16:0/1449924240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cf660 0x7f319815d910 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f31980d02d0 tx=0x7f318801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a4a9684e4ad12e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f3197400640 1 -- 172.21.15.16:0/1449924240 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31880b5070 con 0x7f31980cf660 2024-04-26T20:24:36.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f3197400640 1 -- 172.21.15.16:0/1449924240 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31880a8a10 con 0x7f31980cf660 2024-04-26T20:24:36.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f3197400640 1 -- 172.21.15.16:0/1449924240 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31880a8de0 con 0x7f31980cf660 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- 172.21.15.16:0/1449924240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cf660 msgr2=0x7f319815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 --2- 172.21.15.16:0/1449924240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cf660 0x7f319815d910 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f31980d02d0 tx=0x7f318801ed10 comp rx=0 tx=0).stop 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- 172.21.15.16:0/1449924240 shutdown_connections 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 --2- 172.21.15.16:0/1449924240 >> v2:172.21.15.192:3300/0 conn(0x7f31980cfa40 0x7f31981538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 --2- 172.21.15.16:0/1449924240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cf660 0x7f319815d910 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- 172.21.15.16:0/1449924240 >> 172.21.15.16:0/1449924240 conn(0x7f3198070340 msgr2=0x7f3198070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- 172.21.15.16:0/1449924240 shutdown_connections 2024-04-26T20:24:36.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- 172.21.15.16:0/1449924240 wait complete. 2024-04-26T20:24:36.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 Processor -- start 2024-04-26T20:24:36.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- start start 2024-04-26T20:24:36.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3198072700 0x7f319815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31980cf660 0x7f31980b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cfa40 0x7f31980b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f319815a330 con 0x7f31980cfa40 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f319815a050 con 0x7f3198072700 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319da00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f319815a610 con 0x7f31980cf660 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cfa40 0x7f31980b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cfa40 0x7f31980b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51166/0 (socket says 172.21.15.16:51166) 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f319d000640 1 -- 172.21.15.16:0/1649231715 learned_addr learned my addr 172.21.15.16:0/1649231715 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f3197e00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3198072700 0x7f319815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.515+0000 7f318fe00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31980cf660 0x7f31980b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319d000640 1 -- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31980cf660 msgr2=0x7f31980b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319d000640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31980cf660 0x7f31980b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319d000640 1 -- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3198072700 msgr2=0x7f319815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319d000640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3198072700 0x7f319815ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319d000640 1 -- 172.21.15.16:0/1649231715 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31981f17e0 con 0x7f31980cfa40 2024-04-26T20:24:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3197e00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3198072700 0x7f319815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319d000640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cfa40 0x7f31980b3ac0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f319000c760 tx=0x7f319000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3190003b80 con 0x7f31980cfa40 2024-04-26T20:24:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3190003d20 con 0x7f31980cfa40 2024-04-26T20:24:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319000aa90 con 0x7f31980cfa40 2024-04-26T20:24:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31981f1aa0 con 0x7f31980cfa40 2024-04-26T20:24:36.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31981f2060 con 0x7f31980cfa40 2024-04-26T20:24:36.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31980506d0 con 0x7f31980cfa40 2024-04-26T20:24:36.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f319000ac30 con 0x7f31980cfa40 2024-04-26T20:24:36.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3194c00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3174068380 0x7f317406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f3190086e10 con 0x7f31980cfa40 2024-04-26T20:24:36.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.519+0000 7f3197e00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3174068380 0x7f317406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.523+0000 7f3197e00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3174068380 0x7f317406a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31880b2000 tx=0x7f3188008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.523+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f319008a030 con 0x7f31980cfa40 2024-04-26T20:24:36.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.687+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f31980cc7c0 con 0x7f31980cfa40 2024-04-26T20:24:36.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.691+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f3190056d40 con 0x7f31980cfa40 2024-04-26T20:24:36.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.691+0000 7f3194c00640 1 -- 172.21.15.16:0/1649231715 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3190056640 con 0x7f31980cfa40 2024-04-26T20:24:36.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3174068380 msgr2=0x7f317406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3174068380 0x7f317406a840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31880b2000 tx=0x7f3188008040 comp rx=0 tx=0).stop 2024-04-26T20:24:36.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cfa40 msgr2=0x7f31980b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cfa40 0x7f31980b3ac0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f319000c760 tx=0x7f319000cc20 comp rx=0 tx=0).stop 2024-04-26T20:24:36.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 shutdown_connections 2024-04-26T20:24:36.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f3174068380 0x7f317406a840 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31980cfa40 0x7f31980b3ac0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31980cf660 0x7f31980b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 --2- 172.21.15.16:0/1649231715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3198072700 0x7f319815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 >> 172.21.15.16:0/1649231715 conn(0x7f3198070340 msgr2=0x7f31980ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 shutdown_connections 2024-04-26T20:24:36.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.695+0000 7f319da00640 1 -- 172.21.15.16:0/1649231715 wait complete. 2024-04-26T20:24:36.718 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T20:24:36.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:36.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.855+0000 7fb715e00640 1 Processor -- start 2024-04-26T20:24:36.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.855+0000 7fb715e00640 1 -- start start 2024-04-26T20:24:36.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb715e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb710150580 0x7fb7100c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb715e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7100ca650 0x7fb7100cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb715e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb71015a8d0 con 0x7fb710071180 2024-04-26T20:24:36.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb715e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb7100ca1c0 con 0x7fb710150580 2024-04-26T20:24:36.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb715e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7fb7100cb040 con 0x7fb7100ca650 2024-04-26T20:24:36.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb70ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb710150580 0x7fb7100c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb707e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb710071180 0x7fb7100c70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49232/0 (socket says 172.21.15.16:49232) 2024-04-26T20:24:36.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb707e00640 1 -- 172.21.15.16:0/4013087517 learned_addr learned my addr 172.21.15.16:0/4013087517 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:36.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb70f400640 1 --2- 172.21.15.16:0/4013087517 >> v2:172.21.15.192:3300/0 conn(0x7fb7100ca650 0x7fb7100cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb70ea00640 1 -- 172.21.15.16:0/4013087517 >> v2:172.21.15.192:3300/0 conn(0x7fb7100ca650 msgr2=0x7fb7100cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:36.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb70ea00640 1 --2- 172.21.15.16:0/4013087517 >> v2:172.21.15.192:3300/0 conn(0x7fb7100ca650 0x7fb7100cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb70ea00640 1 -- 172.21.15.16:0/4013087517 >> v1:172.21.15.16:6789/0 conn(0x7fb710071180 legacy=0x7fb7100c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb70ea00640 1 -- 172.21.15.16:0/4013087517 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb710159d50 con 0x7fb710150580 2024-04-26T20:24:36.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.859+0000 7fb70e000640 1 -- 172.21.15.16:0/4013087517 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861876722 0 0) 0x7fb71015a8d0 con 0x7fb710071180 2024-04-26T20:24:36.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb70ea00640 1 --2- 172.21.15.16:0/4013087517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710150580 0x7fb7100c83d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb7101541f0 tx=0x7fb70001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b3523a5eecac4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb70e000640 1 -- 172.21.15.16:0/4013087517 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7000b5070 con 0x7fb710150580 2024-04-26T20:24:36.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb70e000640 1 -- 172.21.15.16:0/4013087517 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb7000a8970 con 0x7fb710150580 2024-04-26T20:24:36.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb70e000640 1 -- 172.21.15.16:0/4013087517 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7000a8d60 con 0x7fb710150580 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- 172.21.15.16:0/4013087517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710150580 msgr2=0x7fb7100c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 --2- 172.21.15.16:0/4013087517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710150580 0x7fb7100c83d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb7101541f0 tx=0x7fb70001ec70 comp rx=0 tx=0).stop 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- 172.21.15.16:0/4013087517 shutdown_connections 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 --2- 172.21.15.16:0/4013087517 >> v2:172.21.15.192:3300/0 conn(0x7fb7100ca650 0x7fb7100cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 --2- 172.21.15.16:0/4013087517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710150580 0x7fb7100c83d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- 172.21.15.16:0/4013087517 >> 172.21.15.16:0/4013087517 conn(0x7fb71006c380 msgr2=0x7fb71006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- 172.21.15.16:0/4013087517 shutdown_connections 2024-04-26T20:24:36.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- 172.21.15.16:0/4013087517 wait complete. 2024-04-26T20:24:36.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 Processor -- start 2024-04-26T20:24:36.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- start start 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710071180 0x7fb710158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100ca650 0x7fb7101f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb710150580 0x7fb7101f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb71015a5f0 con 0x7fb710071180 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb71015a310 con 0x7fb7100ca650 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.863+0000 7fb715e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb7100c8910 con 0x7fb710150580 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710071180 0x7fb710158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710071180 0x7fb710158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51194/0 (socket says 172.21.15.16:51194) 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 -- 172.21.15.16:0/2651730647 learned_addr learned my addr 172.21.15.16:0/2651730647 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:36.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb707e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100ca650 0x7fb7101f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70f400640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb710150580 0x7fb7101f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 -- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb710150580 msgr2=0x7fb7101f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb710150580 0x7fb7101f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 -- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100ca650 msgr2=0x7fb7101f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100ca650 0x7fb7101f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 -- 172.21.15.16:0/2651730647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7100c5420 con 0x7fb710071180 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb70ea00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710071180 0x7fb710158aa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb7000b3040 tx=0x7fb70001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb707400640 1 -- 172.21.15.16:0/2651730647 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7000bf070 con 0x7fb710071180 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb707400640 1 -- 172.21.15.16:0/2651730647 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb7000b07e0 con 0x7fb710071180 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb707400640 1 -- 172.21.15.16:0/2651730647 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7000b5040 con 0x7fb710071180 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7100c56e0 con 0x7fb710071180 2024-04-26T20:24:36.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7100c5ca0 con 0x7fb710071180 2024-04-26T20:24:36.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb710076570 con 0x7fb710071180 2024-04-26T20:24:36.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb707400640 1 -- 172.21.15.16:0/2651730647 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb7000b0bf0 con 0x7fb710071180 2024-04-26T20:24:36.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.867+0000 7fb707400640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb6ec068380 0x7fb6ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:36.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.871+0000 7fb707400640 1 -- 172.21.15.16:0/2651730647 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7fb700123af0 con 0x7fb710071180 2024-04-26T20:24:36.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.871+0000 7fb707e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb6ec068380 0x7fb6ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:36.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.871+0000 7fb707e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb6ec068380 0x7fb6ec06a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb71014d9b0 tx=0x7fb6f8007b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:36.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:36.875+0000 7fb707400640 1 -- 172.21.15.16:0/2651730647 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb7000187d0 con 0x7fb710071180 2024-04-26T20:24:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.075+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb710077c20 con 0x7fb710071180 2024-04-26T20:24:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.075+0000 7fb707400640 1 -- 172.21.15.16:0/2651730647 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6883 (secure 0 0 0) 0x7fb7000f3a20 con 0x7fb710071180 2024-04-26T20:24:37.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:24:37.079 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5538,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3312742738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":3312742738},{"type":"v1","addr":"172.21.15.16:6837","nonce":3312742738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:19.199857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":18,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5391,"qdb_cluster":[5391,5127,4970]},"id":1}]} 2024-04-26T20:24:37.079 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-04-26T20:24:37.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb6ec068380 msgr2=0x7fb6ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb6ec068380 0x7fb6ec06a840 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb71014d9b0 tx=0x7fb6f8007b80 comp rx=0 tx=0).stop 2024-04-26T20:24:37.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710071180 msgr2=0x7fb710158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710071180 0x7fb710158aa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb7000b3040 tx=0x7fb70001ba10 comp rx=0 tx=0).stop 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 shutdown_connections 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fb6ec068380 0x7fb6ec06a840 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb710150580 0x7fb7101f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100ca650 0x7fb7101f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 --2- 172.21.15.16:0/2651730647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb710071180 0x7fb710158aa0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 >> 172.21.15.16:0/2651730647 conn(0x7fb71006c380 msgr2=0x7fb71014ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 shutdown_connections 2024-04-26T20:24:37.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.079+0000 7fb715e00640 1 -- 172.21.15.16:0/2651730647 wait complete. 2024-04-26T20:24:37.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.243+0000 7f8d1a400640 1 Processor -- start 2024-04-26T20:24:37.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.243+0000 7f8d1a400640 1 -- start start 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.243+0000 7f8d1a400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d140c97f0 0x7f8d140ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.243+0000 7f8d1a400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d1415c580 0x7f8d14166640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.243+0000 7f8d1a400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d140cb7d0 con 0x7f8d140ca410 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.243+0000 7f8d1a400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8d140c83d0 con 0x7f8d140c97f0 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.243+0000 7f8d1a400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f8d140cad30 con 0x7f8d1415c580 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d0aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d140c97f0 0x7f8d140ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d13400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8d140ca410 0x7f8d1415be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49242/0 (socket says 172.21.15.16:49242) 2024-04-26T20:24:37.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d13400640 1 -- 172.21.15.16:0/746471465 learned_addr learned my addr 172.21.15.16:0/746471465 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:37.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d0aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d140c97f0 0x7f8d140ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51208/0 (socket says 172.21.15.16:51208) 2024-04-26T20:24:37.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d13e00640 1 --2- 172.21.15.16:0/746471465 >> v2:172.21.15.192:3300/0 conn(0x7f8d1415c580 0x7f8d14166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d0aa00640 1 -- 172.21.15.16:0/746471465 >> v2:172.21.15.192:3300/0 conn(0x7f8d1415c580 msgr2=0x7f8d14166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d0aa00640 1 --2- 172.21.15.16:0/746471465 >> v2:172.21.15.192:3300/0 conn(0x7f8d1415c580 0x7f8d14166640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d0aa00640 1 -- 172.21.15.16:0/746471465 >> v1:172.21.15.16:6789/0 conn(0x7f8d140ca410 legacy=0x7f8d1415be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d0aa00640 1 -- 172.21.15.16:0/746471465 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d140cba70 con 0x7f8d140c97f0 2024-04-26T20:24:37.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d12a00640 1 -- 172.21.15.16:0/746471465 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048890080 0 0) 0x7f8d140cb7d0 con 0x7f8d140ca410 2024-04-26T20:24:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d0aa00640 1 --2- 172.21.15.16:0/746471465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140c97f0 0x7f8d140ca7f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8d14070060 tx=0x7f8cfc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d26e7af15e30d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d12a00640 1 -- 172.21.15.16:0/746471465 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0b2070 con 0x7f8d140c97f0 2024-04-26T20:24:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d12a00640 1 -- 172.21.15.16:0/746471465 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8cfc0a58e0 con 0x7f8d140c97f0 2024-04-26T20:24:37.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.247+0000 7f8d12a00640 1 -- 172.21.15.16:0/746471465 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0a5cd0 con 0x7f8d140c97f0 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- 172.21.15.16:0/746471465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140c97f0 msgr2=0x7f8d140ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 --2- 172.21.15.16:0/746471465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140c97f0 0x7f8d140ca7f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8d14070060 tx=0x7f8cfc01c930 comp rx=0 tx=0).stop 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- 172.21.15.16:0/746471465 shutdown_connections 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 --2- 172.21.15.16:0/746471465 >> v2:172.21.15.192:3300/0 conn(0x7f8d1415c580 0x7f8d14166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 --2- 172.21.15.16:0/746471465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140c97f0 0x7f8d140ca7f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- 172.21.15.16:0/746471465 >> 172.21.15.16:0/746471465 conn(0x7f8d1406c380 msgr2=0x7f8d1406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- 172.21.15.16:0/746471465 shutdown_connections 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- 172.21.15.16:0/746471465 wait complete. 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 Processor -- start 2024-04-26T20:24:37.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- start start 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d140c97f0 0x7f8d141f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140ca410 0x7f8d140c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d1415c580 0x7f8d141f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8d140cd4c0 con 0x7f8d140ca410 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8d140cd1e0 con 0x7f8d1415c580 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d1a400640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8d140ccbe0 con 0x7f8d140c97f0 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140ca410 0x7f8d140c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140ca410 0x7f8d140c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51222/0 (socket says 172.21.15.16:51222) 2024-04-26T20:24:37.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 -- 172.21.15.16:0/616524388 learned_addr learned my addr 172.21.15.16:0/616524388 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d13400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d140c97f0 0x7f8d141f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d13e00640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d1415c580 0x7f8d141f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 -- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d140c97f0 msgr2=0x7f8d141f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d140c97f0 0x7f8d141f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 -- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d1415c580 msgr2=0x7f8d141f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d1415c580 0x7f8d141f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 -- 172.21.15.16:0/616524388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d140ce2c0 con 0x7f8d140ca410 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.251+0000 7f8d0aa00640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140ca410 0x7f8d140c7b70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0b0040 tx=0x7f8cfc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d0be00640 1 -- 172.21.15.16:0/616524388 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0b2050 con 0x7f8d140ca410 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d0be00640 1 -- 172.21.15.16:0/616524388 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8cfc0be070 con 0x7f8d140ca410 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d0be00640 1 -- 172.21.15.16:0/616524388 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0adb30 con 0x7f8d140ca410 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1414c670 con 0x7f8d140ca410 2024-04-26T20:24:37.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1414afb0 con 0x7f8d140ca410 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d14077c20 con 0x7f8d140ca410 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d0be00640 1 -- 172.21.15.16:0/616524388 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8cfc0adcd0 con 0x7f8d140ca410 2024-04-26T20:24:37.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d0be00640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8cf00683b0 0x7f8cf006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d0be00640 1 -- 172.21.15.16:0/616524388 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f8cfc121d40 con 0x7f8d140ca410 2024-04-26T20:24:37.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.255+0000 7f8d13400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8cf00683b0 0x7f8cf006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.259+0000 7f8d13400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8cf00683b0 0x7f8cf006a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d04007fd0 tx=0x7f8d04007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.259+0000 7f8d0be00640 1 -- 172.21.15.16:0/616524388 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8cfc0c7020 con 0x7f8d140ca410 2024-04-26T20:24:37.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d140cc1a0 con 0x7f8d140ca410 2024-04-26T20:24:37.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d0be00640 1 -- 172.21.15.16:0/616524388 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6883 (secure 0 0 0) 0x7f8cfc016520 con 0x7f8d140ca410 2024-04-26T20:24:37.465 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:24:37.466 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3427733929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6837","nonce":3427733929},{"type":"v1","addr":"172.21.15.192:6839","nonce":3427733929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3360160288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3360160288},{"type":"v1","addr":"172.21.15.192:6835","nonce":3360160288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":5538,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/3312742738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":3312742738},{"type":"v1","addr":"172.21.15.16:6837","nonce":3312742738}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T20:14:13.851430+0000","modified":"2024-04-26T20:22:19.199857+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5391,"mds_1":4970,"mds_2":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4970":{"gid":4970,"name":"b","rank":1,"incarnation":27,"state":"up:active","state_seq":31,"addr":"172.21.15.192:6838/3304030586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3304030586},{"type":"v1","addr":"172.21.15.192:6838","nonce":3304030586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5127":{"gid":5127,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":31,"addr":"172.21.15.16:6833/1748916109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1748916109},{"type":"v1","addr":"172.21.15.16:6833","nonce":1748916109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5391":{"gid":5391,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":18,"addr":"172.21.15.16:6836/1623880328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":1623880328},{"type":"v1","addr":"172.21.15.16:6836","nonce":1623880328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5391,"qdb_cluster":[5391,5127,4970]},"id":1}]} 2024-04-26T20:24:37.466 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 38 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8cf00683b0 msgr2=0x7f8cf006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8cf00683b0 0x7f8cf006a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d04007fd0 tx=0x7f8d04007d60 comp rx=0 tx=0).stop 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140ca410 msgr2=0x7f8d140c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140ca410 0x7f8d140c7b70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0b0040 tx=0x7f8cfc0196d0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 shutdown_connections 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f8cf00683b0 0x7f8cf006a870 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d1415c580 0x7f8d141f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d140ca410 0x7f8d140c7b70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 --2- 172.21.15.16:0/616524388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d140c97f0 0x7f8d141f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 >> 172.21.15.16:0/616524388 conn(0x7f8d1406c380 msgr2=0x7f8d1414f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 shutdown_connections 2024-04-26T20:24:37.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.463+0000 7f8d1a400640 1 -- 172.21.15.16:0/616524388 wait complete. 2024-04-26T20:24:37.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T20:24:37.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.627+0000 7f3535c00640 1 Processor -- start 2024-04-26T20:24:37.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.627+0000 7f3535c00640 1 -- start start 2024-04-26T20:24:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3535c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 0x7f35300c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3535c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35300c9d90 con 0x7f35300c9010 2024-04-26T20:24:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3535c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35300ca070 con 0x7f3530153af0 2024-04-26T20:24:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3535c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f353015dec0 con 0x7f35300c7b80 2024-04-26T20:24:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f35300c9010 0x7f35300c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49248/0 (socket says 172.21.15.16:49248) 2024-04-26T20:24:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352f400640 1 -- 172.21.15.16:0/618266717 learned_addr learned my addr 172.21.15.16:0/618266717 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:37.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3526000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 0x7f35300c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026542733 0 0) 0x7f35300c9d90 con 0x7f35300c9010 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3514003530 con 0x7f35300c9010 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3010353958 0 0) 0x7f3514003530 con 0x7f35300c9010 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 msgr2=0x7f35300c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 0x7f35300c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 >> v1:172.21.15.192:6789/0 conn(0x7f3530153af0 legacy=0x7f353015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35300ca350 con 0x7f35300c9010 2024-04-26T20:24:37.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f3528001680 con 0x7f35300c9010 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 >> v1:172.21.15.16:6789/0 conn(0x7f35300c9010 legacy=0x7f35300c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35140039f0 0x7f3514003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3514004810 0x7f3514004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 0x7f35140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f353015dec0 con 0x7f3514004810 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f351400bb10 con 0x7f35140039f0 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f351400bd10 con 0x7f35300c7b80 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3526000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3514004810 0x7f3514004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352ea00640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35140039f0 0x7f3514003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f352f400640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 0x7f35140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3526000640 1 -- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 msgr2=0x7f35140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3526000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300c7b80 0x7f35140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3526000640 1 -- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35140039f0 msgr2=0x7f3514003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3526000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35140039f0 0x7f3514003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.631+0000 7f3526000640 1 -- 172.21.15.16:0/618266717 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3514003530 con 0x7f3514004810 2024-04-26T20:24:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3526000640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3514004810 0x7f3514004c90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3518009ab0 tx=0x7f351801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d023e23407236505 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35180b2070 con 0x7f3514004810 2024-04-26T20:24:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f35180a5620 con 0x7f3514004810 2024-04-26T20:24:37.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f352e000640 1 -- 172.21.15.16:0/618266717 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35180096b0 con 0x7f3514004810 2024-04-26T20:24:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 -- 172.21.15.16:0/618266717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3514004810 msgr2=0x7f3514004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 --2- 172.21.15.16:0/618266717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3514004810 0x7f3514004c90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3518009ab0 tx=0x7f351801ca30 comp rx=0 tx=0).stop 2024-04-26T20:24:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f352f400640 1 -- 172.21.15.16:0/618266717 reap_dead start 2024-04-26T20:24:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 -- 172.21.15.16:0/618266717 shutdown_connections 2024-04-26T20:24:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 -- 172.21.15.16:0/618266717 >> 172.21.15.16:0/618266717 conn(0x7f353006c380 msgr2=0x7f353006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 -- 172.21.15.16:0/618266717 shutdown_connections 2024-04-26T20:24:37.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 -- 172.21.15.16:0/618266717 wait complete. 2024-04-26T20:24:37.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 Processor -- start 2024-04-26T20:24:37.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 -- start start 2024-04-26T20:24:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3514004810 0x7f353014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3530159570 0x7f353014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.635+0000 7f3535c00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300cdc10 0x7f353014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3535c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f353015d290 con 0x7f3530159570 2024-04-26T20:24:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3535c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f35300ca630 con 0x7f3514004810 2024-04-26T20:24:37.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3535c00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3530153ed0 con 0x7f35300cdc10 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3530159570 0x7f353014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3530159570 0x7f353014e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51226/0 (socket says 172.21.15.16:51226) 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 -- 172.21.15.16:0/3461771931 learned_addr learned my addr 172.21.15.16:0/3461771931 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f352ea00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3514004810 0x7f353014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f352f400640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300cdc10 0x7f353014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 -- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300cdc10 msgr2=0x7f353014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300cdc10 0x7f353014f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 -- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3514004810 msgr2=0x7f353014dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3514004810 0x7f353014dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 -- 172.21.15.16:0/3461771931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353014f080 con 0x7f3530159570 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f352f400640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300cdc10 0x7f353014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:37.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3526000640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3530159570 0x7f353014e2d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3518009ab0 tx=0x7f3514005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3527400640 1 -- 172.21.15.16:0/3461771931 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35180bf070 con 0x7f3530159570 2024-04-26T20:24:37.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3527400640 1 -- 172.21.15.16:0/3461771931 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3518004030 con 0x7f3530159570 2024-04-26T20:24:37.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35300cb670 con 0x7f3530159570 2024-04-26T20:24:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3527400640 1 -- 172.21.15.16:0/3461771931 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35180b2040 con 0x7f3530159570 2024-04-26T20:24:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3530075b60 con 0x7f3530159570 2024-04-26T20:24:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3530077c20 con 0x7f3530159570 2024-04-26T20:24:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.639+0000 7f3527400640 1 -- 172.21.15.16:0/3461771931 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35180c2070 con 0x7f3530159570 2024-04-26T20:24:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.643+0000 7f3527400640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f350c068380 0x7f350c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.643+0000 7f3527400640 1 -- 172.21.15.16:0/3461771931 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f3518120cf0 con 0x7f3530159570 2024-04-26T20:24:37.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.643+0000 7f352ea00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f350c068380 0x7f350c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.643+0000 7f352ea00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f350c068380 0x7f350c06a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3520001ce0 tx=0x7f3520009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.647+0000 7f3527400640 1 -- 172.21.15.16:0/3461771931 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3518016740 con 0x7f3530159570 2024-04-26T20:24:37.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.811+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35300c8670 con 0x7f3530159570 2024-04-26T20:24:37.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.811+0000 7f3527400640 1 -- 172.21.15.16:0/3461771931 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+19436 (secure 0 0 0) 0x7f35180f05d0 con 0x7f3530159570 2024-04-26T20:24:37.814 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T20:24:37.814 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"fae48009-e478-45bc-aae9-8a365e3cb2e9","created":"2024-04-26T20:13:56.108280+0000","modified":"2024-04-26T20:21:50.873943+0000","last_up_change":"2024-04-26T20:14:06.320523+0000","last_in_change":"2024-04-26T20:13:58.443900+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T20:14:06.995236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T20:14:11.465088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T20:14:12.802391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T20:14:16.488022+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"507c4fba-bdfd-41df-a4bd-72c9ce75da33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6809","nonce":3068465968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6811","nonce":3068465968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6815","nonce":3068465968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":3068465968},{"type":"v1","addr":"172.21.15.16:6813","nonce":3068465968}]},"public_addr":"172.21.15.16:6809/3068465968","cluster_addr":"172.21.15.16:6811/3068465968","heartbeat_back_addr":"172.21.15.16:6815/3068465968","heartbeat_front_addr":"172.21.15.16:6813/3068465968","state":["exists","up"]},{"osd":1,"uuid":"acc5407d-e3ad-4ffa-8988-7e6353ba226a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6801","nonce":1572811015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6803","nonce":1572811015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6807","nonce":1572811015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1572811015},{"type":"v1","addr":"172.21.15.16:6805","nonce":1572811015}]},"public_addr":"172.21.15.16:6801/1572811015","cluster_addr":"172.21.15.16:6803/1572811015","heartbeat_back_addr":"172.21.15.16:6807/1572811015","heartbeat_front_addr":"172.21.15.16:6805/1572811015","state":["exists","up"]},{"osd":2,"uuid":"94630365-5d5d-4b5c-9946-e403c8604b96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6817","nonce":2566691617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6819","nonce":2566691617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6823","nonce":2566691617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2566691617},{"type":"v1","addr":"172.21.15.16:6821","nonce":2566691617}]},"public_addr":"172.21.15.16:6817/2566691617","cluster_addr":"172.21.15.16:6819/2566691617","heartbeat_back_addr":"172.21.15.16:6823/2566691617","heartbeat_front_addr":"172.21.15.16:6821/2566691617","state":["exists","up"]},{"osd":3,"uuid":"7efc6fa8-e3c8-4acb-bd22-74c334fea496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6825","nonce":3915935540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6827","nonce":3915935540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6831","nonce":3915935540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":3915935540},{"type":"v1","addr":"172.21.15.16:6829","nonce":3915935540}]},"public_addr":"172.21.15.16:6825/3915935540","cluster_addr":"172.21.15.16:6827/3915935540","heartbeat_back_addr":"172.21.15.16:6831/3915935540","heartbeat_front_addr":"172.21.15.16:6829/3915935540","state":["exists","up"]},{"osd":4,"uuid":"7a2f16d0-808e-4ae2-ae74-a3c86fb169c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6801","nonce":1921936919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6803","nonce":1921936919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6807","nonce":1921936919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":1921936919},{"type":"v1","addr":"172.21.15.192:6805","nonce":1921936919}]},"public_addr":"172.21.15.192:6801/1921936919","cluster_addr":"172.21.15.192:6803/1921936919","heartbeat_back_addr":"172.21.15.192:6807/1921936919","heartbeat_front_addr":"172.21.15.192:6805/1921936919","state":["exists","up"]},{"osd":5,"uuid":"82e4c18e-eab8-4620-a1e8-fd7013ef8581","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6813","nonce":3980303039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6818","nonce":3980303039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6823","nonce":3980303039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3980303039},{"type":"v1","addr":"172.21.15.192:6821","nonce":3980303039}]},"public_addr":"172.21.15.192:6813/3980303039","cluster_addr":"172.21.15.192:6818/3980303039","heartbeat_back_addr":"172.21.15.192:6823/3980303039","heartbeat_front_addr":"172.21.15.192:6821/3980303039","state":["exists","up"]},{"osd":6,"uuid":"435a458a-9da0-44a7-b25b-e9cd45cbf4ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6809","nonce":3572924654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6812","nonce":3572924654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6817","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6819","nonce":3572924654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3572924654},{"type":"v1","addr":"172.21.15.192:6815","nonce":3572924654}]},"public_addr":"172.21.15.192:6809/3572924654","cluster_addr":"172.21.15.192:6812/3572924654","heartbeat_back_addr":"172.21.15.192:6819/3572924654","heartbeat_front_addr":"172.21.15.192:6815/3572924654","state":["exists","up"]},{"osd":7,"uuid":"e9a5b919-911c-46c5-a5e5-e5e8bad1de9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6825","nonce":3143162750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6827","nonce":3143162750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6831","nonce":3143162750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":3143162750},{"type":"v1","addr":"172.21.15.192:6829","nonce":3143162750}]},"public_addr":"172.21.15.192:6825/3143162750","cluster_addr":"172.21.15.192:6827/3143162750","heartbeat_back_addr":"172.21.15.192:6831/3143162750","heartbeat_front_addr":"172.21.15.192:6829/3143162750","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.048377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.112226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.159962+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.147196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.908578+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.962654+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:03.931775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T20:14:04.002942+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6835/1962586875":"2024-04-27T20:21:50.873892+0000","172.21.15.16:6836/1882507975":"2024-04-27T20:20:50.864042+0000","172.21.15.192:6838/2295577139":"2024-04-27T20:19:00.847936+0000","172.21.15.192:6836/2295577139":"2024-04-27T20:19:00.847936+0000","172.21.15.16:6837/1962586875":"2024-04-27T20:21:50.873892+0000","172.21.15.16:6833/3670477050":"2024-04-27T20:17:00.827028+0000","172.21.15.16:6834/1882507975":"2024-04-27T20:20:50.864042+0000","172.21.15.16:6832/3670477050":"2024-04-27T20:17:00.827028+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f350c068380 msgr2=0x7f350c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f350c068380 0x7f350c06a840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3520001ce0 tx=0x7f3520009040 comp rx=0 tx=0).stop 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3530159570 msgr2=0x7f353014e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3530159570 0x7f353014e2d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3518009ab0 tx=0x7f3514005840 comp rx=0 tx=0).stop 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 shutdown_connections 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f350c068380 0x7f350c06a840 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35300cdc10 0x7f353014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3530159570 0x7f353014e2d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 --2- 172.21.15.16:0/3461771931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3514004810 0x7f353014dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 >> 172.21.15.16:0/3461771931 conn(0x7f353006c380 msgr2=0x7f35300c36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 shutdown_connections 2024-04-26T20:24:37.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.815+0000 7f3535c00640 1 -- 172.21.15.16:0/3461771931 wait complete. 2024-04-26T20:24:37.836 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T20:24:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613fc00640 1 Processor -- start 2024-04-26T20:24:37.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613fc00640 1 -- start start 2024-04-26T20:24:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613fc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f613815c770 0x7f6138071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613fc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61380c8e50 con 0x7f6138070da0 2024-04-26T20:24:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613fc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6138160290 con 0x7f61380c9520 2024-04-26T20:24:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613fc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f61380c9110 con 0x7f613815c770 2024-04-26T20:24:37.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f6137e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f613815c770 0x7f6138071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613d200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6138070da0 0x7f613815c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49254/0 (socket says 172.21.15.16:49254) 2024-04-26T20:24:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.975+0000 7f613d200640 1 -- 172.21.15.16:0/1235519833 learned_addr learned my addr 172.21.15.16:0/1235519833 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.979+0000 7f6137e00640 1 -- 172.21.15.16:0/1235519833 >> v1:172.21.15.192:6789/0 conn(0x7f61380c9520 legacy=0x7f6138166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.979+0000 7f6137e00640 1 -- 172.21.15.16:0/1235519833 >> v1:172.21.15.16:6789/0 conn(0x7f6138070da0 legacy=0x7f613815c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.979+0000 7f6137e00640 1 -- 172.21.15.16:0/1235519833 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61380c9d70 con 0x7f613815c770 2024-04-26T20:24:37.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.979+0000 7f6137e00640 1 --2- 172.21.15.16:0/1235519833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f613815c770 0x7f6138071180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f61240097c0 tx=0x7f612401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe93e62b459246a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.979+0000 7f6137400640 1 -- 172.21.15.16:0/1235519833 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61240b0070 con 0x7f613815c770 2024-04-26T20:24:37.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.979+0000 7f6137400640 1 -- 172.21.15.16:0/1235519833 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61240ab600 con 0x7f613815c770 2024-04-26T20:24:37.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.979+0000 7f6137400640 1 -- 172.21.15.16:0/1235519833 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61240ab9f0 con 0x7f613815c770 2024-04-26T20:24:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- 172.21.15.16:0/1235519833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f613815c770 msgr2=0x7f6138071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 --2- 172.21.15.16:0/1235519833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f613815c770 0x7f6138071180 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f61240097c0 tx=0x7f612401c4a0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- 172.21.15.16:0/1235519833 shutdown_connections 2024-04-26T20:24:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 --2- 172.21.15.16:0/1235519833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f613815c770 0x7f6138071180 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- 172.21.15.16:0/1235519833 >> 172.21.15.16:0/1235519833 conn(0x7f61380ce2c0 msgr2=0x7f61380ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- 172.21.15.16:0/1235519833 shutdown_connections 2024-04-26T20:24:37.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- 172.21.15.16:0/1235519833 wait complete. 2024-04-26T20:24:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 Processor -- start 2024-04-26T20:24:37.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- start start 2024-04-26T20:24:37.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6138070da0 0x7f613815d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61380c9520 0x7f6138150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f613815c770 0x7f6138151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f613816ab30 con 0x7f61380c9520 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f613816a9b0 con 0x7f613815c770 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f613816acb0 con 0x7f6138070da0 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61380c9520 0x7f6138150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61380c9520 0x7f6138150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51248/0 (socket says 172.21.15.16:51248) 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 -- 172.21.15.16:0/1485781115 learned_addr learned my addr 172.21.15.16:0/1485781115 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613d200640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6138070da0 0x7f613815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613dc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f613815c770 0x7f6138151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 -- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6138070da0 msgr2=0x7f613815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6138070da0 0x7f613815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 -- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f613815c770 msgr2=0x7f6138151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f613815c770 0x7f6138151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 -- 172.21.15.16:0/1485781115 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61380c6500 con 0x7f61380c9520 2024-04-26T20:24:37.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613dc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f613815c770 0x7f6138151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T20:24:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6137e00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61380c9520 0x7f6138150d20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f61240190b0 tx=0x7f6124019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6134c00640 1 -- 172.21.15.16:0/1485781115 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61240b0040 con 0x7f61380c9520 2024-04-26T20:24:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6134c00640 1 -- 172.21.15.16:0/1485781115 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f61240ba070 con 0x7f61380c9520 2024-04-26T20:24:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f6134c00640 1 -- 172.21.15.16:0/1485781115 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61240b4890 con 0x7f61380c9520 2024-04-26T20:24:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.983+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61380c7490 con 0x7f61380c9520 2024-04-26T20:24:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.987+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61380c7a50 con 0x7f61380c9520 2024-04-26T20:24:37.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.987+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6138150ab0 con 0x7f61380c9520 2024-04-26T20:24:37.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.987+0000 7f6134c00640 1 -- 172.21.15.16:0/1485781115 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f61240b4a30 con 0x7f61380c9520 2024-04-26T20:24:37.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.987+0000 7f6134c00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6118068380 0x7f611806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:37.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.987+0000 7f6134c00640 1 -- 172.21.15.16:0/1485781115 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 7079+0+0 (secure 0 0 0) 0x7f6124120ef0 con 0x7f61380c9520 2024-04-26T20:24:37.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.987+0000 7f613d200640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6118068380 0x7f611806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:37.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.991+0000 7f613d200640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6118068380 0x7f611806a840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f612c005890 tx=0x7f612c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:37.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:37.991+0000 7f6134c00640 1 -- 172.21.15.16:0/1485781115 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6138150ab0 con 0x7f61380c9520 2024-04-26T20:24:38.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.191+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6138077c20 con 0x7f61380c9520 2024-04-26T20:24:38.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.195+0000 7f6134c00640 1 -- 172.21.15.16:0/1485781115 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f6124016090 con 0x7f61380c9520 2024-04-26T20:24:38.196 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T20:24:38.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.195+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6118068380 msgr2=0x7f611806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.195+0000 7f613fc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6118068380 0x7f611806a840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f612c005890 tx=0x7f612c009040 comp rx=0 tx=0).stop 2024-04-26T20:24:38.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.195+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61380c9520 msgr2=0x7f6138150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.195+0000 7f613fc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61380c9520 0x7f6138150d20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f61240190b0 tx=0x7f6124019240 comp rx=0 tx=0).stop 2024-04-26T20:24:38.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 shutdown_connections 2024-04-26T20:24:38.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6118068380 0x7f611806a840 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f613815c770 0x7f6138151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61380c9520 0x7f6138150d20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 --2- 172.21.15.16:0/1485781115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6138070da0 0x7f613815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 >> 172.21.15.16:0/1485781115 conn(0x7f61380ce2c0 msgr2=0x7f61380c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 shutdown_connections 2024-04-26T20:24:38.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.199+0000 7f613fc00640 1 -- 172.21.15.16:0/1485781115 wait complete. 2024-04-26T20:24:38.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T20:24:38.270 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T20:24:38.278 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-04-26T20:24:38.294 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-04-26T20:24:38.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee9a00640 1 Processor -- start 2024-04-26T20:24:38.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee9a00640 1 -- start start 2024-04-26T20:24:38.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee9a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feee40c7b10 0x7feee4070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee9a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feee4073760 0x7feee406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee9a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee40706c0 con 0x7feee4156040 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee9a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7feee4070c80 con 0x7feee4073760 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee9a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7feee40709a0 con 0x7feee40c7b10 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feee4073760 0x7feee406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feee4073760 0x7feee406f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51286/0 (socket says 172.21.15.16:51286) 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee3400640 1 -- 172.21.15.16:0/1582061284 learned_addr learned my addr 172.21.15.16:0/1582061284 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feedbe00640 1 --2- 172.21.15.16:0/1582061284 >> v2:172.21.15.192:3300/0 conn(0x7feee40c7b10 0x7feee4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee3400640 1 -- 172.21.15.16:0/1582061284 >> v2:172.21.15.192:3300/0 conn(0x7feee40c7b10 msgr2=0x7feee4070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee3400640 1 --2- 172.21.15.16:0/1582061284 >> v2:172.21.15.192:3300/0 conn(0x7feee40c7b10 0x7feee4070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee3400640 1 -- 172.21.15.16:0/1582061284 >> v1:172.21.15.192:6789/0 conn(0x7feee4156040 legacy=0x7feee415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.379+0000 7feee3400640 1 -- 172.21.15.16:0/1582061284 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee4072c80 con 0x7feee4073760 2024-04-26T20:24:38.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee3400640 1 --2- 172.21.15.16:0/1582061284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4073760 0x7feee406f460 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7feee4071840 tx=0x7feedc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2495be0133af2d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee2000640 1 -- 172.21.15.16:0/1582061284 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a5790 con 0x7feee4073760 2024-04-26T20:24:38.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee2000640 1 -- 172.21.15.16:0/1582061284 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feedc0a5930 con 0x7feee4073760 2024-04-26T20:24:38.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee2000640 1 -- 172.21.15.16:0/1582061284 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a5d20 con 0x7feee4073760 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 -- 172.21.15.16:0/1582061284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4073760 msgr2=0x7feee406f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 --2- 172.21.15.16:0/1582061284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4073760 0x7feee406f460 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7feee4071840 tx=0x7feedc01c9c0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 -- 172.21.15.16:0/1582061284 shutdown_connections 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 --2- 172.21.15.16:0/1582061284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4073760 0x7feee406f460 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 --2- 172.21.15.16:0/1582061284 >> v2:172.21.15.192:3300/0 conn(0x7feee40c7b10 0x7feee4070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 -- 172.21.15.16:0/1582061284 >> 172.21.15.16:0/1582061284 conn(0x7feee40c9d10 msgr2=0x7feee40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 -- 172.21.15.16:0/1582061284 shutdown_connections 2024-04-26T20:24:38.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 -- 172.21.15.16:0/1582061284 wait complete. 2024-04-26T20:24:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 Processor -- start 2024-04-26T20:24:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.383+0000 7feee9a00640 1 -- start start 2024-04-26T20:24:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feee4073760 0x7feee4158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee40c7b10 0x7feee4158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4156040 0x7feee415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feee40c94b0 con 0x7feee4156040 2024-04-26T20:24:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feee40c9330 con 0x7feee40c7b10 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feee4073bb0 con 0x7feee4073760 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4156040 0x7feee415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4156040 0x7feee415f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51290/0 (socket says 172.21.15.16:51290) 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 -- 172.21.15.16:0/1922058289 learned_addr learned my addr 172.21.15.16:0/1922058289 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee2a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feee4073760 0x7feee4158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feedbe00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee40c7b10 0x7feee4158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 -- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feee4073760 msgr2=0x7feee4158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feee4073760 0x7feee4158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 -- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee40c7b10 msgr2=0x7feee4158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee40c7b10 0x7feee4158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 -- 172.21.15.16:0/1922058289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee415c660 con 0x7feee4156040 2024-04-26T20:24:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feedbe00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee40c7b10 0x7feee4158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee2a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feee4073760 0x7feee4158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee3400640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4156040 0x7feee415f560 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7feedc0af040 tx=0x7feedc019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feedaa00640 1 -- 172.21.15.16:0/1922058289 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0b8670 con 0x7feee4156040 2024-04-26T20:24:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feedaa00640 1 -- 172.21.15.16:0/1922058289 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feedc0be070 con 0x7feee4156040 2024-04-26T20:24:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feedaa00640 1 -- 172.21.15.16:0/1922058289 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0b8ab0 con 0x7feee4156040 2024-04-26T20:24:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee414bfa0 con 0x7feee4156040 2024-04-26T20:24:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee415e680 con 0x7feee4156040 2024-04-26T20:24:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee4077c20 con 0x7feee4156040 2024-04-26T20:24:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.387+0000 7feedaa00640 1 -- 172.21.15.16:0/1922058289 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feedc0b8c50 con 0x7feee4156040 2024-04-26T20:24:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.391+0000 7feedaa00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feec0068380 0x7feec006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.391+0000 7feedaa00640 1 -- 172.21.15.16:0/1922058289 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7337+0+0 (secure 0 0 0) 0x7feedc122490 con 0x7feee4156040 2024-04-26T20:24:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.391+0000 7feee2a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feec0068380 0x7feec006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.391+0000 7feee2a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feec0068380 0x7feec006a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feed4001670 tx=0x7feed4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.395+0000 7feedaa00640 1 -- 172.21.15.16:0/1922058289 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feedc0165e0 con 0x7feee4156040 2024-04-26T20:24:38.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:38.595+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feee415b130 con 0x7feee4156040 2024-04-26T20:24:39.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.195+0000 7feedaa00640 1 -- 172.21.15.16:0/1922058289 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7feedc0f2380 con 0x7feee4156040 2024-04-26T20:24:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feec0068380 msgr2=0x7feec006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feec0068380 0x7feec006a840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feed4001670 tx=0x7feed4009040 comp rx=0 tx=0).stop 2024-04-26T20:24:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4156040 msgr2=0x7feee415f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4156040 0x7feee415f560 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7feedc0af040 tx=0x7feedc019760 comp rx=0 tx=0).stop 2024-04-26T20:24:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 shutdown_connections 2024-04-26T20:24:39.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7feec0068380 0x7feec006a840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee4156040 0x7feee415f560 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feee40c7b10 0x7feee4158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 --2- 172.21.15.16:0/1922058289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feee4073760 0x7feee4158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 >> 172.21.15.16:0/1922058289 conn(0x7feee40c9d10 msgr2=0x7feee40c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 shutdown_connections 2024-04-26T20:24:39.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.199+0000 7feee9a00640 1 -- 172.21.15.16:0/1922058289 wait complete. 2024-04-26T20:24:39.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T20:24:39.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.419+0000 7fc84be00640 1 Processor -- start 2024-04-26T20:24:39.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.419+0000 7fc84be00640 1 -- start start 2024-04-26T20:24:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.419+0000 7fc84be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc844152f90 0x7fc844073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.419+0000 7fc84be00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84415ce80 con 0x7fc8440c9760 2024-04-26T20:24:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.419+0000 7fc84be00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84415cbd0 con 0x7fc84415c0e0 2024-04-26T20:24:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.419+0000 7fc84be00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc8440c6f80 con 0x7fc844152f90 2024-04-26T20:24:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc848a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc8440c9760 0x7fc844152880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49258/0 (socket says 172.21.15.16:49258) 2024-04-26T20:24:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc848a00640 1 -- 172.21.15.16:0/2294005202 learned_addr learned my addr 172.21.15.16:0/2294005202 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:39.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc849e00640 1 --2- 172.21.15.16:0/2294005202 >> v2:172.21.15.16:3300/0 conn(0x7fc844152f90 0x7fc844073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc849e00640 1 -- 172.21.15.16:0/2294005202 >> v1:172.21.15.192:6789/0 conn(0x7fc84415c0e0 legacy=0x7fc84415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc849e00640 1 -- 172.21.15.16:0/2294005202 >> v1:172.21.15.16:6789/0 conn(0x7fc8440c9760 legacy=0x7fc844152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc849e00640 1 -- 172.21.15.16:0/2294005202 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8440c7520 con 0x7fc844152f90 2024-04-26T20:24:39.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc843e00640 1 -- 172.21.15.16:0/2294005202 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333430903 0 0) 0x7fc84415ce80 con 0x7fc8440c9760 2024-04-26T20:24:39.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc849e00640 1 --2- 172.21.15.16:0/2294005202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844152f90 0x7fc844073000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009d90 tx=0x7fc83c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5b501b0a664da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc843e00640 1 -- 172.21.15.16:0/2294005202 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0b4070 con 0x7fc844152f90 2024-04-26T20:24:39.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc843e00640 1 -- 172.21.15.16:0/2294005202 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc83c0af600 con 0x7fc844152f90 2024-04-26T20:24:39.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.423+0000 7fc843e00640 1 -- 172.21.15.16:0/2294005202 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0af9f0 con 0x7fc844152f90 2024-04-26T20:24:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- 172.21.15.16:0/2294005202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844152f90 msgr2=0x7fc844073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 --2- 172.21.15.16:0/2294005202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844152f90 0x7fc844073000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009d90 tx=0x7fc83c01f150 comp rx=0 tx=0).stop 2024-04-26T20:24:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- 172.21.15.16:0/2294005202 shutdown_connections 2024-04-26T20:24:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 --2- 172.21.15.16:0/2294005202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc844152f90 0x7fc844073000 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- 172.21.15.16:0/2294005202 >> 172.21.15.16:0/2294005202 conn(0x7fc8440c9d10 msgr2=0x7fc8440ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- 172.21.15.16:0/2294005202 shutdown_connections 2024-04-26T20:24:39.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- 172.21.15.16:0/2294005202 wait complete. 2024-04-26T20:24:39.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 Processor -- start 2024-04-26T20:24:39.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- start start 2024-04-26T20:24:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8440c9760 0x7fc8441f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc844152f90 0x7fc8441f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84415c0e0 0x7fc844073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8440c4a90 con 0x7fc84415c0e0 2024-04-26T20:24:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8440c47b0 con 0x7fc844152f90 2024-04-26T20:24:39.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc84be00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440c4d70 con 0x7fc8440c9760 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84415c0e0 0x7fc844073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84415c0e0 0x7fc844073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51298/0 (socket says 172.21.15.16:51298) 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 -- 172.21.15.16:0/2664297813 learned_addr learned my addr 172.21.15.16:0/2664297813 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849400640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8440c9760 0x7fc8441f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc848a00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc844152f90 0x7fc8441f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 -- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8440c9760 msgr2=0x7fc8441f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8440c9760 0x7fc8441f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 -- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc844152f90 msgr2=0x7fc8441f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc844152f90 0x7fc8441f0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 -- 172.21.15.16:0/2664297813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8441e4c70 con 0x7fc84415c0e0 2024-04-26T20:24:39.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.427+0000 7fc849e00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84415c0e0 0x7fc844073160 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc83c01cd80 tx=0x7fc83c01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc841600640 1 -- 172.21.15.16:0/2664297813 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0b4040 con 0x7fc84415c0e0 2024-04-26T20:24:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc841600640 1 -- 172.21.15.16:0/2664297813 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc83c0c1070 con 0x7fc84415c0e0 2024-04-26T20:24:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc841600640 1 -- 172.21.15.16:0/2664297813 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0ba6b0 con 0x7fc84415c0e0 2024-04-26T20:24:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8441e4f50 con 0x7fc84415c0e0 2024-04-26T20:24:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8441f2d70 con 0x7fc84415c0e0 2024-04-26T20:24:39.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc844077c20 con 0x7fc84415c0e0 2024-04-26T20:24:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc841600640 1 -- 172.21.15.16:0/2664297813 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc83c0ba850 con 0x7fc84415c0e0 2024-04-26T20:24:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc841600640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc824068380 0x7fc82406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:39.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc841600640 1 -- 172.21.15.16:0/2664297813 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7337+0+0 (secure 0 0 0) 0x7fc83c125cd0 con 0x7fc84415c0e0 2024-04-26T20:24:39.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.431+0000 7fc849400640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc824068380 0x7fc82406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:39.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.435+0000 7fc849400640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc824068380 0x7fc82406a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc838007fd0 tx=0x7fc838009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:39.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.435+0000 7fc841600640 1 -- 172.21.15.16:0/2664297813 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc83c018cb0 con 0x7fc84415c0e0 2024-04-26T20:24:39.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:39.603+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc8440cc410 con 0x7fc84415c0e0 2024-04-26T20:24:40.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.295+0000 7fc841600640 1 -- 172.21.15.16:0/2664297813 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) ==== 181+0+0 (secure 0 0 0) 0x7fc83c0f5c20 con 0x7fc84415c0e0 2024-04-26T20:24:40.297 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc824068380 msgr2=0x7fc82406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc824068380 0x7fc82406a840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc838007fd0 tx=0x7fc838009040 comp rx=0 tx=0).stop 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84415c0e0 msgr2=0x7fc844073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84415c0e0 0x7fc844073160 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc83c01cd80 tx=0x7fc83c01bef0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 shutdown_connections 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7fc824068380 0x7fc82406a840 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc84415c0e0 0x7fc844073160 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc844152f90 0x7fc8441f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 --2- 172.21.15.16:0/2664297813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8440c9760 0x7fc8441f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 >> 172.21.15.16:0/2664297813 conn(0x7fc8440c9d10 msgr2=0x7fc8440ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 shutdown_connections 2024-04-26T20:24:40.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.299+0000 7fc84be00640 1 -- 172.21.15.16:0/2664297813 wait complete. 2024-04-26T20:24:40.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T20:24:40.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.475+0000 7ff53c600640 1 Processor -- start 2024-04-26T20:24:40.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.475+0000 7ff53c600640 1 -- start start 2024-04-26T20:24:40.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.475+0000 7ff53c600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff53414eff0 0x7ff534074110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.475+0000 7ff53c600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff534072d00 0x7ff534162bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.475+0000 7ff53c600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff53414f3d0 con 0x7ff534072260 2024-04-26T20:24:40.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.475+0000 7ff53c600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff534074650 con 0x7ff53414eff0 2024-04-26T20:24:40.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.475+0000 7ff53c600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7ff5340733e0 con 0x7ff534072d00 2024-04-26T20:24:40.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff534072260 0x7ff53406fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49266/0 (socket says 172.21.15.16:49266) 2024-04-26T20:24:40.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539200640 1 -- 172.21.15.16:0/3290754236 learned_addr learned my addr 172.21.15.16:0/3290754236 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:40.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff53414eff0 0x7ff534074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff53a600640 1 --2- 172.21.15.16:0/3290754236 >> v2:172.21.15.192:3300/0 conn(0x7ff534072d00 0x7ff534162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539c00640 1 -- 172.21.15.16:0/3290754236 >> v2:172.21.15.192:3300/0 conn(0x7ff534072d00 msgr2=0x7ff534162bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539c00640 1 --2- 172.21.15.16:0/3290754236 >> v2:172.21.15.192:3300/0 conn(0x7ff534072d00 0x7ff534162bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539c00640 1 -- 172.21.15.16:0/3290754236 >> v1:172.21.15.16:6789/0 conn(0x7ff534072260 legacy=0x7ff53406fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539c00640 1 -- 172.21.15.16:0/3290754236 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5340c96c0 con 0x7ff53414eff0 2024-04-26T20:24:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff53a600640 1 --2- 172.21.15.16:0/3290754236 >> v2:172.21.15.192:3300/0 conn(0x7ff534072d00 0x7ff534162bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff533e00640 1 -- 172.21.15.16:0/3290754236 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213067184 0 0) 0x7ff53414f3d0 con 0x7ff534072260 2024-04-26T20:24:40.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff539c00640 1 --2- 172.21.15.16:0/3290754236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff53414eff0 0x7ff534074110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c45e0 tx=0x7ff52801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5273e3b723336b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff533e00640 1 -- 172.21.15.16:0/3290754236 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280b0070 con 0x7ff53414eff0 2024-04-26T20:24:40.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff533e00640 1 -- 172.21.15.16:0/3290754236 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5280ab600 con 0x7ff53414eff0 2024-04-26T20:24:40.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.479+0000 7ff533e00640 1 -- 172.21.15.16:0/3290754236 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280ab9f0 con 0x7ff53414eff0 2024-04-26T20:24:40.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- 172.21.15.16:0/3290754236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff53414eff0 msgr2=0x7ff534074110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 --2- 172.21.15.16:0/3290754236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff53414eff0 0x7ff534074110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c45e0 tx=0x7ff52801c480 comp rx=0 tx=0).stop 2024-04-26T20:24:40.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- 172.21.15.16:0/3290754236 shutdown_connections 2024-04-26T20:24:40.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 --2- 172.21.15.16:0/3290754236 >> v2:172.21.15.192:3300/0 conn(0x7ff534072d00 0x7ff534162bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 --2- 172.21.15.16:0/3290754236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff53414eff0 0x7ff534074110 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- 172.21.15.16:0/3290754236 >> 172.21.15.16:0/3290754236 conn(0x7ff5340c9d10 msgr2=0x7ff5340ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:40.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- 172.21.15.16:0/3290754236 shutdown_connections 2024-04-26T20:24:40.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- 172.21.15.16:0/3290754236 wait complete. 2024-04-26T20:24:40.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 Processor -- start 2024-04-26T20:24:40.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- start start 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff534072260 0x7ff534154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff534072d00 0x7ff5341492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53414eff0 0x7ff534147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff534073bf0 con 0x7ff534072d00 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff534073910 con 0x7ff53414eff0 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53c600640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff534070400 con 0x7ff534072260 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff534072d00 0x7ff5341492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff534072d00 0x7ff5341492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51302/0 (socket says 172.21.15.16:51302) 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 -- 172.21.15.16:0/3152963747 learned_addr learned my addr 172.21.15.16:0/3152963747 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53a600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53414eff0 0x7ff534147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539c00640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff534072260 0x7ff534154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 -- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff534072260 msgr2=0x7ff534154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff534072260 0x7ff534154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 -- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53414eff0 msgr2=0x7ff534147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53414eff0 0x7ff534147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 -- 172.21.15.16:0/3152963747 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff534153ce0 con 0x7ff534072d00 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff53a600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53414eff0 0x7ff534147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.483+0000 7ff539200640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff534072d00 0x7ff5341492e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c450 tx=0x7ff52000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff531600640 1 -- 172.21.15.16:0/3152963747 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5200074e0 con 0x7ff534072d00 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff531600640 1 -- 172.21.15.16:0/3152963747 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5200047f0 con 0x7ff534072d00 2024-04-26T20:24:40.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff531600640 1 -- 172.21.15.16:0/3152963747 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520007680 con 0x7ff534072d00 2024-04-26T20:24:40.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341f5320 con 0x7ff534072d00 2024-04-26T20:24:40.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341f58e0 con 0x7ff534072d00 2024-04-26T20:24:40.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5340c4940 con 0x7ff534072d00 2024-04-26T20:24:40.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff531600640 1 -- 172.21.15.16:0/3152963747 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff520011070 con 0x7ff534072d00 2024-04-26T20:24:40.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff531600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff514068380 0x7ff51406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:40.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff531600640 1 -- 172.21.15.16:0/3152963747 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6899+0+0 (secure 0 0 0) 0x7ff520086b20 con 0x7ff534072d00 2024-04-26T20:24:40.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.487+0000 7ff539c00640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff514068380 0x7ff51406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:40.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.491+0000 7ff539c00640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff514068380 0x7ff51406a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff5280ad000 tx=0x7ff5280a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:40.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.491+0000 7ff531600640 1 -- 172.21.15.16:0/3152963747 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff520056b90 con 0x7ff534072d00 2024-04-26T20:24:40.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:40.659+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff5340c8530 con 0x7ff534072d00 2024-04-26T20:24:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.315+0000 7ff531600640 1 -- 172.21.15.16:0/3152963747 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) ==== 169+0+0 (secure 0 0 0) 0x7ff520056490 con 0x7ff534072d00 2024-04-26T20:24:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-04-26T20:24:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff514068380 msgr2=0x7ff51406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff514068380 0x7ff51406a840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff5280ad000 tx=0x7ff5280a6000 comp rx=0 tx=0).stop 2024-04-26T20:24:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff534072d00 msgr2=0x7ff5341492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff534072d00 0x7ff5341492e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c450 tx=0x7ff52000c910 comp rx=0 tx=0).stop 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 shutdown_connections 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7ff514068380 0x7ff51406a840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff53414eff0 0x7ff534147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff534072d00 0x7ff5341492e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 --2- 172.21.15.16:0/3152963747 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff534072260 0x7ff534154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 >> 172.21.15.16:0/3152963747 conn(0x7ff5340c9d10 msgr2=0x7ff53415b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 shutdown_connections 2024-04-26T20:24:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.319+0000 7ff53c600640 1 -- 172.21.15.16:0/3152963747 wait complete. 2024-04-26T20:24:41.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T20:24:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b9e00640 1 Processor -- start 2024-04-26T20:24:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b9e00640 1 -- start start 2024-04-26T20:24:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f69b41541d0 0x7f69b40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b9e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b415a820 con 0x7f69b4153df0 2024-04-26T20:24:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b9e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b40c7c90 con 0x7f69b40c5120 2024-04-26T20:24:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b9e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 -- 0x7f69b415aac0 con 0x7f69b41541d0 2024-04-26T20:24:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f69b4153df0 0x7f69b40c8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49280/0 (socket says 172.21.15.16:49280) 2024-04-26T20:24:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2a00640 1 -- 172.21.15.16:0/3356983088 learned_addr learned my addr 172.21.15.16:0/3356983088 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T20:24:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69aa000640 1 --2- 172.21.15.16:0/3356983088 >> v2:172.21.15.192:3300/0 conn(0x7f69b41541d0 0x7f69b40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262633606 0 0) 0x7f69b415a820 con 0x7f69b4153df0 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6998003530 con 0x7f69b4153df0 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1657386064 0 0) 0x7f6998003530 con 0x7f69b4153df0 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 >> v2:172.21.15.192:3300/0 conn(0x7f69b41541d0 msgr2=0x7f69b40c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 --2- 172.21.15.16:0/3356983088 >> v2:172.21.15.192:3300/0 conn(0x7f69b41541d0 0x7f69b40c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 >> v1:172.21.15.192:6789/0 conn(0x7f69b40c5120 legacy=0x7f69b40c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b40c7f50 con 0x7f69b4153df0 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 437292358 0 0) 0x7f69a4001680 con 0x7f69b4153df0 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 >> v1:172.21.15.16:6789/0 conn(0x7f69b4153df0 legacy=0x7f69b40c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980039c0 0x7f6998003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998004810 0x7f6998004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69980051d0 0x7f699800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69b415aac0 con 0x7f69980051d0 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f699800c170 con 0x7f69980039c0 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.491+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f699800c370 con 0x7f6998004810 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69980051d0 0x7f699800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b2a00640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980039c0 0x7f6998003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69aa000640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998004810 0x7f6998004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 -- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998004810 msgr2=0x7f6998004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6998004810 0x7f6998004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 -- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980039c0 msgr2=0x7f6998003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980039c0 0x7f6998003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 -- 172.21.15.16:0/3356983088 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6998003530 con 0x7f69980051d0 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 -- 172.21.15.16:0/3356983088 reap_dead start 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b3400640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69980051d0 0x7f699800b9d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f69ac001e70 tx=0x7f69ac01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34273eefa88d7886 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac001a90 con 0x7f69980051d0 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f69ac003bc0 con 0x7f69980051d0 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b2000640 1 -- 172.21.15.16:0/3356983088 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac005020 con 0x7f69980051d0 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b9e00640 1 -- 172.21.15.16:0/3356983088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69980051d0 msgr2=0x7f699800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.495+0000 7f69b9e00640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69980051d0 0x7f699800b9d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f69ac001e70 tx=0x7f69ac01c780 comp rx=0 tx=0).stop 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- 172.21.15.16:0/3356983088 shutdown_connections 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 --2- 172.21.15.16:0/3356983088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69980051d0 0x7f699800b9d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- 172.21.15.16:0/3356983088 >> 172.21.15.16:0/3356983088 conn(0x7f69b40c9d10 msgr2=0x7f69b40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- 172.21.15.16:0/3356983088 shutdown_connections 2024-04-26T20:24:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- 172.21.15.16:0/3356983088 wait complete. 2024-04-26T20:24:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 Processor -- start 2024-04-26T20:24:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- start start 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980051d0 0x7f69b41f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b4073e60 0x7f69b4072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4147cd0 0x7f69b4148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40c75b0 con 0x7f69b4147cd0 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40c6e40 con 0x7f69980051d0 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b9e00640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f69b40c7730 con 0x7f69b4073e60 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4147cd0 0x7f69b4148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4147cd0 0x7f69b4148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51318/0 (socket says 172.21.15.16:51318) 2024-04-26T20:24:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 -- 172.21.15.16:0/1694571387 learned_addr learned my addr 172.21.15.16:0/1694571387 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69aa000640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b4073e60 0x7f69b4072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b2a00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980051d0 0x7f69b41f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 -- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b4073e60 msgr2=0x7f69b4072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b4073e60 0x7f69b4072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 -- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980051d0 msgr2=0x7f69b41f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980051d0 0x7f69b41f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 -- 172.21.15.16:0/1694571387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b41f16a0 con 0x7f69b4147cd0 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69aa000640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b4073e60 0x7f69b4072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T20:24:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.499+0000 7f69b3400640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4147cd0 0x7f69b4148150 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69ac098190 tx=0x7f6998005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69abe00640 1 -- 172.21.15.16:0/1694571387 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac007dc0 con 0x7f69b4147cd0 2024-04-26T20:24:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69abe00640 1 -- 172.21.15.16:0/1694571387 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f69ac0012e0 con 0x7f69b4147cd0 2024-04-26T20:24:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b41f56b0 con 0x7f69b4147cd0 2024-04-26T20:24:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69abe00640 1 -- 172.21.15.16:0/1694571387 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac005780 con 0x7f69b4147cd0 2024-04-26T20:24:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b41f5990 con 0x7f69b4147cd0 2024-04-26T20:24:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b4077c20 con 0x7f69b4147cd0 2024-04-26T20:24:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69abe00640 1 -- 172.21.15.16:0/1694571387 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69ac006b60 con 0x7f69b4147cd0 2024-04-26T20:24:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69abe00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:24:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.503+0000 7f69abe00640 1 -- 172.21.15.16:0/1694571387 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6369+0+0 (secure 0 0 0) 0x7f69ac120370 con 0x7f69b4147cd0 2024-04-26T20:24:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.507+0000 7f69b2a00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:24:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.507+0000 7f69b2a00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69a40011f0 tx=0x7f69a4001160 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:24:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.507+0000 7f69abe00640 1 -- 172.21.15.16:0/1694571387 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f69ac0b8060 con 0x7f69b4147cd0 2024-04-26T20:24:41.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:41.679+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f69b4157720 con 0x7f69b4147cd0 2024-04-26T20:24:42.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.323+0000 7f69abe00640 1 -- 172.21.15.16:0/1694571387 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) ==== 178+0+0 (secure 0 0 0) 0x7f69ac016490 con 0x7f69b4147cd0 2024-04-26T20:24:42.325 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data_ec' removed 2024-04-26T20:24:42.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 msgr2=0x7f699006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:42.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f69a40011f0 tx=0x7f69a4001160 comp rx=0 tx=0).stop 2024-04-26T20:24:42.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4147cd0 msgr2=0x7f69b4148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T20:24:42.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4147cd0 0x7f69b4148150 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69ac098190 tx=0x7f6998005840 comp rx=0 tx=0).stop 2024-04-26T20:24:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 shutdown_connections 2024-04-26T20:24:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:6832/773157316,v1:172.21.15.192:6833/773157316] conn(0x7f6990068380 0x7f699006a840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69b4147cd0 0x7f69b4148150 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69b4073e60 0x7f69b4072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 --2- 172.21.15.16:0/1694571387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69980051d0 0x7f69b41f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:24:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 >> 172.21.15.16:0/1694571387 conn(0x7f69b40c9d10 msgr2=0x7f69b4157940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T20:24:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 shutdown_connections 2024-04-26T20:24:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T20:24:42.327+0000 7f69b9e00640 1 -- 172.21.15.16:0/1694571387 wait complete. 2024-04-26T20:24:42.362 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T20:24:42.362 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T20:24:42.362 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:42.378 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T20:24:42.378 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T20:24:42.378 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:42.435 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T20:24:42.435 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-26T20:24:42.435 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:42.488 INFO:tasks.ceph.mds.e:Stopped 2024-04-26T20:24:42.488 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T20:24:42.488 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:42.501 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T20:24:42.501 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T20:24:42.501 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:42.559 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T20:24:42.559 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-26T20:24:42.559 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:42.617 INFO:tasks.ceph.mds.f:Stopped 2024-04-26T20:24:42.618 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T20:24:42.618 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T20:24:42.618 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:42.715 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T20:24:42.716 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T20:24:42.716 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:45.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T20:24:48.818 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T20:24:48.819 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T20:24:48.819 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:48.902 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T20:24:48.902 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T20:24:48.902 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:49.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:24:49.193 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:24:51.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T20:24:51.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T20:24:55.004 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T20:24:55.004 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T20:24:55.004 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:55.094 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T20:24:55.094 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T20:24:55.094 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:24:57.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-26T20:24:57.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T20:25:01.196 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T20:25:01.197 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T20:25:01.197 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:25:01.263 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T20:25:01.263 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T20:25:01.263 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:25:01.350 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T20:25:01.350 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T20:25:01.350 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T20:25:01.350 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:25:01.408 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T20:25:01.408 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T20:25:01.408 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:25:01.437 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T20:25:01.438 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T20:25:01.438 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T20:25:01.438 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:25:01.458 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T20:25:01.458 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T20:25:01.458 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:25:01.498 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T20:25:01.498 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T20:25:01.498 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T20:25:01.558 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T20:25:01.558 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T20:25:01.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'Replacing daemon mds' | head -n 1 2024-04-26T20:25:01.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:25:01.608 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T20:25:01.872 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:25:01.873 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T20:25:02.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:25:02.208 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T20:25:02.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-26T20:25:02.410 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:25:02.410 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T20:25:02.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:25:02.588 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T20:25:02.941 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:25:02.941 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T20:25:03.244 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:25:03.244 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T20:25:03.428 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:25:03.429 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T20:25:03.602 INFO:tasks.ceph:Archiving mon data... 2024-04-26T20:25:03.604 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/data/mon.a.tgz 2024-04-26T20:25:03.604 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-26T20:25:03.613 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.ISflxmuSFs 2024-04-26T20:25:03.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ISflxmuSFs 2024-04-26T20:25:03.742 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.ISflxmuSFs 2024-04-26T20:25:03.820 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.ISflxmuSFs is 320KB 2024-04-26T20:25:03.885 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.ISflxmuSFs 2024-04-26T20:25:03.894 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/data/mon.b.tgz 2024-04-26T20:25:03.894 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-04-26T20:25:03.900 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.8kDjmdFK2V 2024-04-26T20:25:03.900 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8kDjmdFK2V 2024-04-26T20:25:04.026 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.8kDjmdFK2V 2024-04-26T20:25:04.090 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.8kDjmdFK2V is 333KB 2024-04-26T20:25:04.147 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.8kDjmdFK2V 2024-04-26T20:25:04.152 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/data/mon.c.tgz 2024-04-26T20:25:04.153 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-04-26T20:25:04.198 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.UonDNcTWlX 2024-04-26T20:25:04.198 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.UonDNcTWlX 2024-04-26T20:25:04.328 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.UonDNcTWlX 2024-04-26T20:25:04.390 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.UonDNcTWlX is 333KB 2024-04-26T20:25:04.448 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.UonDNcTWlX 2024-04-26T20:25:04.452 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T20:25:04.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T20:25:04.456 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T20:25:04.528 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T20:25:04.554 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T20:25:04.554 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T20:25:04.556 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/remote/smithi016/crash 2024-04-26T20:25:04.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T20:25:04.592 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/remote/smithi192/crash 2024-04-26T20:25:04.593 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T20:25:04.610 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T20:25:04.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:25:04.642 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T20:25:04.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T20:25:04.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T20:25:04.738 INFO:tasks.ceph:Compressing logs... 2024-04-26T20:25:04.738 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:25:04.770 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T20:25:04.802 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22664.log 2024-04-26T20:25:04.803 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36228.log 2024-04-26T20:25:04.804 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.22664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35018.log 2024-04-26T20:25:04.804 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22664.log.gz 2024-04-26T20:25:04.805 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-04-26T20:25:04.805 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36228.log.gz 2024-04-26T20:25:04.806 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-04-26T20:25:04.806 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35018.log.gz 2024-04-26T20:25:04.806 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-04-26T20:25:04.807 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-04-26T20:25:04.807 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32462.log 2024-04-26T20:25:04.808 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-04-26T20:25:04.808 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34099.log 2024-04-26T20:25:04.809 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-04-26T20:25:04.809 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37195.log 2024-04-26T20:25:04.809 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32462.log.gz 2024-04-26T20:25:04.810 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33595.log 2024-04-26T20:25:04.810 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34099.log.gz 2024-04-26T20:25:04.811 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31437.log 2024-04-26T20:25:04.811 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37195.log.gz 2024-04-26T20:25:04.818 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33595.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T20:25:04.818 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33595.log.gz 2024-04-26T20:25:04.818 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31583.log 2024-04-26T20:25:04.818 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31437.log.gz 2024-04-26T20:25:04.818 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35992.log 2024-04-26T20:25:04.818 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37941.log 2024-04-26T20:25:04.818 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31583.log.gz 2024-04-26T20:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-04-26T20:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35992.log.gz 2024-04-26T20:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32697.log 2024-04-26T20:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37941.log.gz 2024-04-26T20:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36124.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-04-26T20:25:04.819 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36516.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28130.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28202.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.28130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28178.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28130.log.gz 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.28202.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28202.log.gz 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.28178.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28178.log.gz 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28274.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.28274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28226.log 2024-04-26T20:25:04.822 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.5.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28274.log.gz 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28154.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.28226.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.28154.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28226.log.gz 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28154.log.gz 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28106.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.28106.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28106.log.gz 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T20:25:04.823 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-26T20:25:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T20:25:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.d.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T20:25:04.826 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T20:25:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T20:25:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T20:25:04.827 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T20:25:04.827 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28250.log 2024-04-26T20:25:04.831 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33511.log 2024-04-26T20:25:04.831 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32697.log.gz 2024-04-26T20:25:04.831 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32892.log 2024-04-26T20:25:04.831 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36516.log.gz 2024-04-26T20:25:04.831 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32688.log 2024-04-26T20:25:04.831 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33511.log.gz 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36568.log 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32892.log.gz 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33569.log 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32688.log.gz 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36568.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36568.log.gz 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31662.log 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33569.log.gz 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32907.log 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36841.log 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31662.log.gz 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-04-26T20:25:04.832 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32907.log.gz 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33725.log 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36841.log.gz 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37706.log 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37117.log 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33725.log.gz 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37576.log 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37706.log.gz 2024-04-26T20:25:04.833 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33115.log 2024-04-26T20:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37117.log.gz 2024-04-26T20:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31465.log 2024-04-26T20:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37576.log.gz 2024-04-26T20:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36815.log 2024-04-26T20:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33115.log.gz 2024-04-26T20:25:04.835 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36307.log 2024-04-26T20:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31465.log.gz 2024-04-26T20:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33098.log 2024-04-26T20:25:04.836 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36815.log.gz 2024-04-26T20:25:04.837 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36894.log 2024-04-26T20:25:04.837 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36307.log.gz 2024-04-26T20:25:04.837 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34463.log 2024-04-26T20:25:04.838 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33098.log.gz 2024-04-26T20:25:04.838 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35523.log 2024-04-26T20:25:04.838 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36894.log.gz 2024-04-26T20:25:04.839 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.28250.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28250.log.gz 2024-04-26T20:25:04.839 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32136.log 2024-04-26T20:25:04.840 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34463.log.gz 2024-04-26T20:25:04.840 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34939.log 2024-04-26T20:25:04.840 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35523.log.gz 2024-04-26T20:25:04.840 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37446.log 2024-04-26T20:25:04.841 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32136.log.gz 2024-04-26T20:25:04.841 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-04-26T20:25:04.842 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34939.log.gz 2024-04-26T20:25:04.842 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32888.log 2024-04-26T20:25:04.842 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37446.log.gz 2024-04-26T20:25:04.843 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37472.log 2024-04-26T20:25:04.844 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-04-26T20:25:04.844 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32566.log 2024-04-26T20:25:04.844 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32888.log.gz 2024-04-26T20:25:04.845 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31327.log 2024-04-26T20:25:04.845 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37472.log.gz 2024-04-26T20:25:04.846 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31820.log 2024-04-26T20:25:04.846 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32566.log.gz 2024-04-26T20:25:04.847 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37524.log 2024-04-26T20:25:04.847 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31327.log.gz 2024-04-26T20:25:04.848 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-04-26T20:25:04.848 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31820.log.gz 2024-04-26T20:25:04.849 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37524.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T20:25:04.849 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37524.log.gz 2024-04-26T20:25:04.849 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37498.log 2024-04-26T20:25:04.850 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-04-26T20:25:04.850 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2024-04-26T20:25:04.852 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32215.log 2024-04-26T20:25:04.852 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37498.log.gz 2024-04-26T20:25:04.852 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32032.log 2024-04-26T20:25:04.853 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-04-26T20:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32215.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32215.log.gz 2024-04-26T20:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35384.log 2024-04-26T20:25:04.854 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32163.log 2024-04-26T20:25:04.855 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32032.log.gz 2024-04-26T20:25:04.856 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35384.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T20:25:04.856 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35384.log.gz 2024-04-26T20:25:04.857 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35044.log 2024-04-26T20:25:04.857 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32163.log.gz 2024-04-26T20:25:04.858 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33407.log 2024-04-26T20:25:04.859 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35044.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35044.log.gz 2024-04-26T20:25:04.859 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35150.log 2024-04-26T20:25:04.860 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5/var/log/ceph/ceph-client.admin.33407.log: --verbose -- /var/log/ceph/ceph-client.admin.33123.log 2024-04-26T20:25:04.861 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33407.log.gz 2024-04-26T20:25:04.861 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32267.log 2024-04-26T20:25:04.861 INFO:teuthology.orchestra.run.smithi016.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35150.log.gz 2024-04-26T20:25:04.862 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-04-26T20:25:04.863 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33123.log.gz 2024-04-26T20:25:04.863 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37288.log 2024-04-26T20:25:04.863 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32267.log.gz 2024-04-26T20:25:04.864 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31274.log 2024-04-26T20:25:04.865 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-04-26T20:25:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37288.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37288.log.gz 2024-04-26T20:25:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34307.log 2024-04-26T20:25:04.866 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35800.log 2024-04-26T20:25:04.867 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31274.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31274.log.gz 2024-04-26T20:25:04.868 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32241.log 2024-04-26T20:25:04.868 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34307.log.gz 2024-04-26T20:25:04.869 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35414.log 2024-04-26T20:25:04.869 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32241.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35800.log.gz 2024-04-26T20:25:04.870 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32241.log.gz 2024-04-26T20:25:04.870 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37420.log 2024-04-26T20:25:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37863.log 2024-04-26T20:25:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35414.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35414.log.gz 2024-04-26T20:25:04.872 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36390.log 2024-04-26T20:25:04.872 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37420.log.gz 2024-04-26T20:25:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32402.log 2024-04-26T20:25:04.873 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37863.log.gz 2024-04-26T20:25:04.875 INFO:teuthology.orchestra.run.smithi192.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T20:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37394.log 2024-04-26T20:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32402.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36390.log.gz 2024-04-26T20:25:04.875 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32402.log.gz 2024-04-26T20:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34437.log 2024-04-26T20:25:04.876 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37394.log: /var/log/ceph/ceph-client.admin.34255.log 2024-04-26T20:25:04.877 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37394.log.gz 2024-04-26T20:25:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34031.log 2024-04-26T20:25:04.877 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34437.log.gz 2024-04-26T20:25:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-04-26T20:25:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34255.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34255.log.gz 2024-04-26T20:25:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.34031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34031.log.gz 2024-04-26T20:25:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33459.log 2024-04-26T20:25:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33433.log 2024-04-26T20:25:04.881 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36464.log: /var/log/ceph/ceph-client.admin.33459.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-04-26T20:25:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32488.log 2024-04-26T20:25:04.882 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33459.log.gz 2024-04-26T20:25:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2024-04-26T20:25:04.883 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33433.log.gz 2024-04-26T20:25:04.884 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34518.log 2024-04-26T20:25:04.884 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32488.log.gz 2024-04-26T20:25:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35609.log 2024-04-26T20:25:04.885 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2024-04-26T20:25:04.886 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37262.log 2024-04-26T20:25:04.886 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34518.log.gz 2024-04-26T20:25:04.887 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-04-26T20:25:04.888 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35609.log.gz 2024-04-26T20:25:04.888 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37602.log 2024-04-26T20:25:04.888 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37262.log.gz 2024-04-26T20:25:04.889 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32895.log 2024-04-26T20:25:04.890 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-04-26T20:25:04.890 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34965.log 2024-04-26T20:25:04.890 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37602.log.gz 2024-04-26T20:25:04.891 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35557.log 2024-04-26T20:25:04.892 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32895.log.gz 2024-04-26T20:25:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34965.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34965.log.gz 2024-04-26T20:25:04.893 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37342.log 2024-04-26T20:25:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32376.log 2024-04-26T20:25:04.894 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35557.log: /var/log/ceph/ceph-client.admin.37342.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35557.log.gz 2024-04-26T20:25:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35774.log 2024-04-26T20:25:04.895 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37342.log.gz 2024-04-26T20:25:04.896 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32376.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T20:25:04.896 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32376.log.gz 2024-04-26T20:25:04.897 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35774.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35774.log.gz 2024-04-26T20:25:04.897 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32058.log 2024-04-26T20:25:04.898 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32890.log 2024-04-26T20:25:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33114.log 2024-04-26T20:25:04.899 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32058.log.gz 2024-04-26T20:25:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37758.log 2024-04-26T20:25:04.900 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32890.log.gz 2024-04-26T20:25:04.901 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36622.log 2024-04-26T20:25:04.901 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33114.log.gz 2024-04-26T20:25:04.902 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35471.log 2024-04-26T20:25:04.903 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37758.log.gz 2024-04-26T20:25:04.904 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36708.log 2024-04-26T20:25:04.904 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36622.log.gz 2024-04-26T20:25:04.905 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35665.log 2024-04-26T20:25:04.905 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35471.log.gz 2024-04-26T20:25:04.906 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34333.log 2024-04-26T20:25:04.906 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36708.log.gz 2024-04-26T20:25:04.907 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31740.log 2024-04-26T20:25:04.907 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35665.log.gz 2024-04-26T20:25:04.908 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33621.log 2024-04-26T20:25:04.908 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34333.log.gz 2024-04-26T20:25:04.909 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34281.log 2024-04-26T20:25:04.909 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31740.log.gz 2024-04-26T20:25:04.910 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-04-26T20:25:04.910 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33621.log.gz 2024-04-26T20:25:04.911 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36436.log 2024-04-26T20:25:04.912 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34281.log.gz 2024-04-26T20:25:04.912 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35966.log 2024-04-26T20:25:04.913 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2024-04-26T20:25:04.913 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36682.log 2024-04-26T20:25:04.914 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36436.log.gz 2024-04-26T20:25:04.915 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33099.log 2024-04-26T20:25:04.915 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35966.log.gz 2024-04-26T20:25:04.916 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32540.log 2024-04-26T20:25:04.916 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36682.log.gz 2024-04-26T20:25:04.917 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32905.log 2024-04-26T20:25:04.917 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33099.log.gz 2024-04-26T20:25:04.918 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32592.log 2024-04-26T20:25:04.919 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32540.log.gz 2024-04-26T20:25:04.920 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33110.log 2024-04-26T20:25:04.920 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32905.log.gz 2024-04-26T20:25:04.920 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33804.log 2024-04-26T20:25:04.921 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32592.log.gz 2024-04-26T20:25:04.921 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-04-26T20:25:04.922 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33110.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33110.log.gz 2024-04-26T20:25:04.922 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33804.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T20:25:04.923 INFO:teuthology.orchestra.run.smithi016.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33804.log.gz 2024-04-26T20:25:04.923 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35691.log 2024-04-26T20:25:04.924 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-04-26T20:25:04.925 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36072.log 2024-04-26T20:25:04.926 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.35691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35888.log 2024-04-26T20:25:04.926 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35691.log.gz 2024-04-26T20:25:04.927 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34177.log 2024-04-26T20:25:04.927 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36072.log.gz 2024-04-26T20:25:04.928 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35888.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35888.log.gz 2024-04-26T20:25:04.929 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35639.log 2024-04-26T20:25:04.929 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34177.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34177.log.gz 2024-04-26T20:25:04.929 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27580.log 2024-04-26T20:25:04.931 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37049.log 2024-04-26T20:25:04.931 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35639.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35639.log.gz 2024-04-26T20:25:04.932 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35257.log 2024-04-26T20:25:04.932 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27580.log.gz 2024-04-26T20:25:04.933 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31527.log 2024-04-26T20:25:04.933 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37049.log.gz 2024-04-26T20:25:04.934 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33539.log 2024-04-26T20:25:04.935 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35257.log.gz 2024-04-26T20:25:04.936 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-04-26T20:25:04.936 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31527.log.gz 2024-04-26T20:25:04.937 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37003.log 2024-04-26T20:25:04.937 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33539.log.gz 2024-04-26T20:25:04.938 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32683.log 2024-04-26T20:25:04.938 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-04-26T20:25:04.939 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37003.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37003.log.gz 2024-04-26T20:25:04.939 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31636.log 2024-04-26T20:25:04.941 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32683.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32683.log.gz 2024-04-26T20:25:04.941 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34725.log 2024-04-26T20:25:04.942 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35096.log 2024-04-26T20:25:04.943 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31636.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31636.log.gz 2024-04-26T20:25:04.943 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34725.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34725.log.gz 2024-04-26T20:25:04.944 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T20:25:04.944 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34151.log 2024-04-26T20:25:04.945 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35096.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35096.log.gz 2024-04-26T20:25:04.945 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35176.log 2024-04-26T20:25:04.946 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-04-26T20:25:04.946 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34151.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34151.log.gz 2024-04-26T20:25:04.947 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35176.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35176.log.gz 2024-04-26T20:25:04.948 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36018.log 2024-04-26T20:25:04.948 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36098.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-04-26T20:25:04.949 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34883.log 2024-04-26T20:25:04.949 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34544.log 2024-04-26T20:25:04.950 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36018.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36018.log.gz 2024-04-26T20:25:04.951 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34883.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34883.log.gz 2024-04-26T20:25:04.952 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33113.log 2024-04-26T20:25:04.952 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34544.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34544.log.gz 2024-04-26T20:25:04.953 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33303.log 2024-04-26T20:25:04.954 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-04-26T20:25:04.954 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33113.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33113.log.gz 2024-04-26T20:25:04.955 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33303.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33303.log.gz 2024-04-26T20:25:04.956 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-04-26T20:25:04.956 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-04-26T20:25:04.957 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-04-26T20:25:04.958 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T20:25:04.959 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35332.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz 2024-04-26T20:25:04.959 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35826.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-04-26T20:25:04.960 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-04-26T20:25:04.961 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34991.log 2024-04-26T20:25:04.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32644.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-04-26T20:25:04.963 INFO:teuthology.orchestra.run.smithi016.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T20:25:04.963 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37915.log 2024-04-26T20:25:04.963 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34991.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34991.log.gz 2024-04-26T20:25:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37316.log 2024-04-26T20:25:04.965 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37811.log 2024-04-26T20:25:04.965 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37915.log.gz 2024-04-26T20:25:04.967 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34073.log 2024-04-26T20:25:04.967 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37316.log.gz 2024-04-26T20:25:04.967 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36176.log 2024-04-26T20:25:04.968 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37811.log.gz 2024-04-26T20:25:04.969 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37143.log 2024-04-26T20:25:04.969 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34073.log.gz 2024-04-26T20:25:04.970 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33381.log 2024-04-26T20:25:04.970 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36176.log.gz 2024-04-26T20:25:04.971 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35914.log 2024-04-26T20:25:04.972 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37143.log.gz 2024-04-26T20:25:04.972 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35358.log 2024-04-26T20:25:04.972 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33381.log.gz 2024-04-26T20:25:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33122.log 2024-04-26T20:25:04.973 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35914.log.gz 2024-04-26T20:25:04.975 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36920.log 2024-04-26T20:25:04.975 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35358.log.gz 2024-04-26T20:25:04.976 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33751.log 2024-04-26T20:25:04.976 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33122.log.gz 2024-04-26T20:25:04.977 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-04-26T20:25:04.977 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36920.log.gz 2024-04-26T20:25:04.978 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33915.log 2024-04-26T20:25:04.979 INFO:teuthology.orchestra.run.smithi016.stderr: 91.1%/var/log/ceph/ceph-client.admin.37993.log: -- replaced with /var/log/ceph/ceph-client.admin.33751.log.gz 2024-04-26T20:25:04.979 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-04-26T20:25:04.981 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33915.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33915.log.gz 2024-04-26T20:25:04.981 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-04-26T20:25:04.982 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37654.log 2024-04-26T20:25:04.984 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33854.log 2024-04-26T20:25:04.984 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-04-26T20:25:04.984 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37654.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37654.log.gz 2024-04-26T20:25:04.986 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33854.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33854.log.gz 2024-04-26T20:25:04.986 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35583.log 2024-04-26T20:25:04.987 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-04-26T20:25:04.989 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38083.log 2024-04-26T20:25:04.989 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35583.log.gz 2024-04-26T20:25:04.990 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-04-26T20:25:04.990 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2024-04-26T20:25:04.991 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32110.log 2024-04-26T20:25:04.991 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38083.log.gz 2024-04-26T20:25:04.993 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31152.log 2024-04-26T20:25:04.993 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-04-26T20:25:04.994 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-04-26T20:25:04.994 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32110.log.gz 2024-04-26T20:25:04.995 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32084.log 2024-04-26T20:25:04.995 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31152.log.gz 2024-04-26T20:25:04.996 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32899.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-04-26T20:25:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34125.log 2024-04-26T20:25:04.998 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32084.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32084.log.gz 2024-04-26T20:25:04.998 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T20:25:04.999 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T20:25:04.999 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34125.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34125.log.gz 2024-04-26T20:25:05.000 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38109.log 2024-04-26T20:25:05.002 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T20:25:05.002 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38109.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38109.log.gz 2024-04-26T20:25:05.003 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38057.log 2024-04-26T20:25:05.004 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-04-26T20:25:05.006 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38057.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38057.log.gz 2024-04-26T20:25:05.006 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34570.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-04-26T20:25:05.007 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37221.log 2024-04-26T20:25:05.008 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34411.log 2024-04-26T20:25:05.010 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37221.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37221.log.gz 2024-04-26T20:25:05.011 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34411.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34411.log.gz 2024-04-26T20:25:05.011 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T20:25:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34229.log 2024-04-26T20:25:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.34229.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34229.log.gz 2024-04-26T20:25:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37967.log 2024-04-26T20:25:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37967.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37967.log.gz 2024-04-26T20:25:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37839.log 2024-04-26T20:25:05.020 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37839.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37839.log.gz 2024-04-26T20:25:05.021 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-04-26T20:25:05.024 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-04-26T20:25:05.025 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-04-26T20:25:05.028 INFO:teuthology.orchestra.run.smithi192.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T20:25:05.029 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32006.log 2024-04-26T20:25:05.030 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36737.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-04-26T20:25:05.033 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5/var/log/ceph/ceph-client.admin.32006.log: --verbose -- /var/log/ceph/ceph-client.0.34049.log 2024-04-26T20:25:05.036 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.34049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34049.log.gz 2024-04-26T20:25:05.036 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34909.log 2024-04-26T20:25:05.037 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32006.log.gz 2024-04-26T20:25:05.038 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35720.log 2024-04-26T20:25:05.040 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34909.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34909.log.gz 2024-04-26T20:25:05.040 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35497.log 2024-04-26T20:25:05.047 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35720.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35720.log.gz 2024-04-26T20:25:05.047 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35497.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35497.log.gz 2024-04-26T20:25:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35940.log 2024-04-26T20:25:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35940.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35940.log.gz 2024-04-26T20:25:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36202.log 2024-04-26T20:25:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36202.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36202.log.gz 2024-04-26T20:25:05.049 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32324.log 2024-04-26T20:25:05.052 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35124.log 2024-04-26T20:25:05.053 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32324.log.gz 2024-04-26T20:25:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-04-26T20:25:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35124.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35124.log.gz 2024-04-26T20:25:05.061 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.32695.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37732.log 2024-04-26T20:25:05.061 INFO:teuthology.orchestra.run.smithi016.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T20:25:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27690.log 2024-04-26T20:25:05.063 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-04-26T20:25:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35070.log 2024-04-26T20:25:05.065 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37732.log: /var/log/ceph/ceph-client.admin.27690.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37732.log.gz 2024-04-26T20:25:05.065 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27690.log.gz 2024-04-26T20:25:05.067 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35070.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35070.log.gz 2024-04-26T20:25:05.068 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36946.log 2024-04-26T20:25:05.069 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32898.log 2024-04-26T20:25:05.071 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36946.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36946.log.gz 2024-04-26T20:25:05.072 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32898.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32898.log.gz 2024-04-26T20:25:05.072 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31609.log 2024-04-26T20:25:05.073 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-04-26T20:25:05.075 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31609.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31609.log.gz 2024-04-26T20:25:05.076 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31188.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-04-26T20:25:05.076 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-04-26T20:25:05.078 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36974.log 2024-04-26T20:25:05.079 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33673.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-04-26T20:25:05.079 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-04-26T20:25:05.081 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36974.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36974.log.gz 2024-04-26T20:25:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33329.log 2024-04-26T20:25:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35228.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-04-26T20:25:05.084 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33329.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33329.log.gz 2024-04-26T20:25:05.084 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32693.log 2024-04-26T20:25:05.085 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log 2024-04-26T20:25:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32693.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32693.log.gz 2024-04-26T20:25:05.088 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37091.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-04-26T20:25:05.088 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-04-26T20:25:05.090 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31948.log 2024-04-26T20:25:05.091 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34831.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-04-26T20:25:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31948.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.31948.log.gz 2024-04-26T20:25:05.094 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36789.log 2024-04-26T20:25:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36254.log 2024-04-26T20:25:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36789.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36789.log.gz 2024-04-26T20:25:05.098 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36254.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36254.log.gz 2024-04-26T20:25:05.098 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33699.log 2024-04-26T20:25:05.100 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31353.log 2024-04-26T20:25:05.101 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33699.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33699.log.gz 2024-04-26T20:25:05.102 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31353.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31353.log.gz 2024-04-26T20:25:05.103 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32514.log 2024-04-26T20:25:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36868.log 2024-04-26T20:25:05.106 INFO:teuthology.orchestra.run.smithi192.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T20:25:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32514.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32514.log.gz 2024-04-26T20:25:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36868.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36868.log.gz 2024-04-26T20:25:05.107 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32690.log 2024-04-26T20:25:05.108 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33647.log 2024-04-26T20:25:05.110 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32690.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32690.log.gz 2024-04-26T20:25:05.111 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33647.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33647.log.gz 2024-04-26T20:25:05.111 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-04-26T20:25:05.113 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32698.log 2024-04-26T20:25:05.114 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36333.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-04-26T20:25:05.115 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32698.log.gz 2024-04-26T20:25:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-04-26T20:25:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37368.log 2024-04-26T20:25:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34779.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-04-26T20:25:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31411.log 2024-04-26T20:25:05.120 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37368.log.gz 2024-04-26T20:25:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34203.log 2024-04-26T20:25:05.122 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31411.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31411.log.gz 2024-04-26T20:25:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34203.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34203.log.gz 2024-04-26T20:25:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35440.log 2024-04-26T20:25:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31379.log 2024-04-26T20:25:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35440.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35440.log.gz 2024-04-26T20:25:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31379.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31379.log.gz 2024-04-26T20:25:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37628.log 2024-04-26T20:25:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34857.log 2024-04-26T20:25:05.131 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37628.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37628.log.gz 2024-04-26T20:25:05.131 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34857.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34857.log.gz 2024-04-26T20:25:05.132 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36044.log 2024-04-26T20:25:05.133 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31493.log 2024-04-26T20:25:05.135 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36044.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36044.log.gz 2024-04-26T20:25:05.135 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31493.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31493.log.gz 2024-04-26T20:25:05.136 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36542.log 2024-04-26T20:25:05.137 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-26T20:25:05.139 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36542.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36542.log.gz 2024-04-26T20:25:05.139 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32350.log 2024-04-26T20:25:05.142 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37680.log 2024-04-26T20:25:05.142 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32350.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32350.log.gz 2024-04-26T20:25:05.144 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37680.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37680.log.gz 2024-04-26T20:25:05.144 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2024-04-26T20:25:05.145 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27471.log 2024-04-26T20:25:05.150 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37784.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2024-04-26T20:25:05.150 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27471.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.27471.log.gz 2024-04-26T20:25:05.150 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2024-04-26T20:25:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34751.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2024-04-26T20:25:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31766.log 2024-04-26T20:25:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31766.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31766.log.gz 2024-04-26T20:25:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34359.log 2024-04-26T20:25:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34359.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34359.log.gz 2024-04-26T20:25:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32189.log 2024-04-26T20:25:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37889.log 2024-04-26T20:25:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32189.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32189.log.gz 2024-04-26T20:25:05.166 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37889.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37889.log.gz 2024-04-26T20:25:05.166 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37550.log 2024-04-26T20:25:05.169 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37550.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37550.log.gz 2024-04-26T20:25:05.169 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32436.log 2024-04-26T20:25:05.171 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33485.log 2024-04-26T20:25:05.172 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32436.log.gz 2024-04-26T20:25:05.173 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31688.log 2024-04-26T20:25:05.175 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33485.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33485.log.gz 2024-04-26T20:25:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31688.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31688.log.gz 2024-04-26T20:25:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32618.log 2024-04-26T20:25:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32618.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32618.log.gz 2024-04-26T20:25:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31553.log 2024-04-26T20:25:05.184 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31553.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31553.log.gz 2024-04-26T20:25:05.184 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33355.log 2024-04-26T20:25:05.187 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33355.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33355.log.gz 2024-04-26T20:25:05.517 INFO:teuthology.orchestra.run.smithi016.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T20:25:10.526 INFO:teuthology.orchestra.run.smithi016.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T20:25:10.766 INFO:teuthology.orchestra.run.smithi192.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T20:25:11.375 INFO:teuthology.orchestra.run.smithi192.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T20:25:12.346 INFO:teuthology.orchestra.run.smithi192.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T20:25:14.163 INFO:teuthology.orchestra.run.smithi192.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T20:25:14.164 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-04-26T20:25:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m9.380s 2024-04-26T20:25:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m29.187s 2024-04-26T20:25:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.916s 2024-04-26T20:25:15.602 INFO:teuthology.orchestra.run.smithi016.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T20:25:16.347 INFO:teuthology.orchestra.run.smithi016.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T20:25:17.936 INFO:teuthology.orchestra.run.smithi016.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T20:25:18.038 INFO:teuthology.orchestra.run.smithi016.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T20:25:48.701 INFO:teuthology.orchestra.run.smithi016.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-26T20:25:48.702 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T20:25:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m43.924s 2024-04-26T20:25:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:user 1m32.120s 2024-04-26T20:25:48.702 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m6.656s 2024-04-26T20:25:48.702 INFO:tasks.ceph:Archiving logs... 2024-04-26T20:25:48.704 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/remote/smithi016/log 2024-04-26T20:25:48.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:25:59.166 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/remote/smithi192/log 2024-04-26T20:25:59.167 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T20:26:03.327 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T20:26:03.338 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T20:26:03.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:26:03.342 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T20:26:03.409 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T20:26:03.419 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T20:26:03.419 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:26:03.422 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T20:26:03.433 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:26:03.433 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2024-04-26T20:26:03.434 INFO:teuthology.orchestra.run.smithi192.stdout:+hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.075 -3.265 1.583 2024-04-26T20:26:03.434 INFO:teuthology.orchestra.run.smithi192.stdout:*hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.081 -2.102 1.078 2024-04-26T20:26:03.434 INFO:teuthology.orchestra.run.smithi192.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 377 0.089 -3.364 1.797 2024-04-26T20:26:03.434 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-26T20:26:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T20:26:03.435 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-26T20:26:03.435 INFO:teuthology.orchestra.run.smithi016.stdout:+hv01.front.sepi 67.205.162.81 3 u 42 64 377 0.088 -2.674 0.429 2024-04-26T20:26:03.435 INFO:teuthology.orchestra.run.smithi016.stdout:*hv02.front.sepi 63.231.80.2 3 u 36 64 377 0.100 -1.088 0.699 2024-04-26T20:26:03.435 INFO:teuthology.orchestra.run.smithi016.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.094 -0.263 0.467 2024-04-26T20:26:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-26T20:26:03.436 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T20:26:03.460 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T20:26:03.461 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T20:26:03.471 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T20:26:03.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T20:26:03.490 INFO:teuthology.task.internal:Duration was 1455.134634 seconds 2024-04-26T20:26:03.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T20:26:03.499 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T20:26:03.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:26:03.503 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T20:26:03.598 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T20:26:03.598 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T20:26:03.598 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:26:03.619 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-04-26T20:26:03.619 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T20:26:03.630 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T20:26:03.631 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:26:03.670 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T20:26:03.708 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T20:26:03.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:26:03.754 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T20:26:03.830 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T20:26:03.841 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T20:26:03.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:26:03.863 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T20:26:03.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T20:26:03.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:26:03.910 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:26:03.924 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-04-26T20:26:03.925 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-04-26T20:26:03.952 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:26:03.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:26:03.994 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T20:26:03.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T20:26:03.999 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T20:26:04.008 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T20:26:04.010 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/remote/smithi016 2024-04-26T20:26:04.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:26:04.063 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675145/remote/smithi192 2024-04-26T20:26:04.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T20:26:04.086 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T20:26:04.087 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:26:04.102 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T20:26:04.130 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T20:26:04.141 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T20:26:04.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T20:26:04.169 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T20:26:04.169 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:26:04.173 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T20:26:04.178 INFO:teuthology.orchestra.run.smithi192.stdout: 524292 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:26 /home/ubuntu/cephtest 2024-04-26T20:26:04.178 INFO:teuthology.orchestra.run.smithi016.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 20:26 /home/ubuntu/cephtest 2024-04-26T20:26:04.180 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T20:26:04.191 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T20:26:04.216 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} duration: 1455.134634256363 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-04-26T20:26:04.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T20:26:04.299 INFO:teuthology.run:pass